
Recent research by the Beijing Academy of Artificial Intelligence, including C Li, M Qin, S Xiao, and J Chen, has introduced a text embedding model that leverages large language models' (LLMs) in-context learning capabilities to generate high-quality, adaptable embeddings. This model demonstrates remarkable effectiveness in handling both familiar and novel tasks. Additionally, a comprehensive survey of small language models (SLMs), ranging from 100 million to 5 billion parameters, has been conducted. This survey analyzes 59 state-of-the-art open-source SLMs, evaluating their capabilities in reasoning, in-context learning, mathematics, and coding. The research provides insights into the performance and innovations of these models across various architectures, training datasets, and algorithms.











