In News

Microsoft unveiled the latest version of its ‘lightweight’ AI model – the Phi-3-Mini.

About Phi-3-mini

  • It is the smallest AI model developed by Microsoft. It is believed to be the first in a series of three smaller models planned by Microsoft.
  • It reportedly outperformed models of the same size and the next size up across a variety of benchmarks, in areas like language, reasoning, coding, and maths.
  • Essentially, language models are the backbone of AI applications like ChatGPT, Claude, Gemini, etc.
  • These models are trained on existing data to solve common language problems such as text classification, answering questions, text generation, document summarisation, etc.

Comparison with LLMs

  • Phi-3-mini is an SLM. Simply, SLMs are more streamlined versions of large language models.
  • When compared to LLMs, smaller AI models are also cost-effective to develop and operate, and they perform better on smaller devices like laptops and smartphones.
  • SLMs are great for “resource-constrained environments including on-device and offline inference scenarios.”
Do you know?

– Phi-2 was introduced in December 2023 and reportedly equaled models like Meta’s Llama 2.

– Phi-3 models significantly outperformed several models of the same size or even larger ones, including Gemma 7B and Mistral 7B, in key areas.