In News
Microsoft unveiled the latest version of its ‘lightweight’ AI model – the Phi-3-Mini.
About Phi-3-mini
- It is the smallest AI model developed by Microsoft. It is believed to be the first in a series of three smaller models planned by Microsoft.
- It reportedly outperformed models of the same size and the next size up across a variety of benchmarks, in areas like language, reasoning, coding, and maths.
- Essentially, language models are the backbone of AI applications like ChatGPT, Claude, Gemini, etc.
- These models are trained on existing data to solve common language problems such as text classification, answering questions, text generation, document summarisation, etc.
Comparison with LLMs
- Phi-3-mini is an SLM. Simply, SLMs are more streamlined versions of large language models.
- When compared to LLMs, smaller AI models are also cost-effective to develop and operate, and they perform better on smaller devices like laptops and smartphones.
- SLMs are great for “resource-constrained environments including on-device and offline inference scenarios.”
| Do you know?
– Phi-2 was introduced in December 2023 and reportedly equaled models like Meta’s Llama 2. – Phi-3 models significantly outperformed several models of the same size or even larger ones, including Gemma 7B and Mistral 7B, in key areas. |