• TWEAK
• Software

Microsoft's Phi-3: Smallest Open-Source AI!

Translate from : Microsofts Phi-3: Mindste Open-Source AI!

Microsoft has taken a significant step forward in artificial intelligence (AI) by unveiling Phi-3, their latest and smallest language AI model. This new development marks a decisive improvement over its predecessor, Phi-2, which was introduced in December 2023.

With improvements in both the training database and its parameters, Phi-3 is designed to efficiently handle more complex queries. Its capabilities are so advanced that it is comparable to models trained with over ten times its parameter count. The potential of running smaller AI models like Phi-3 on smartphones could revolutionize how we interact with technology.

This AI model, with its 3.3 trillion tokens and 3.8 billion parameters, displays a complex neural network capable of understanding a wide range of topics in depth. Microsoft's internal benchmarks even place the Phi-3 alongside giants like the Mixtral 8x7B and the GPT-3.5, despite its considerably smaller size. For those interested in exploring this innovation, Phi-3 is available through the Azure and Ollama platforms.

In addition, there are plans to expand the Hugging Face catalog for the more compact version, the Phi-3-mini, with the release of its scales. Sebastien Bubeck shared a demo on Twitter that gives an insight into the model's effectiveness. While the excitement surrounding Phi-3 is palpable, it is important to note that the model's claims are based on a pre-print article on arXiv, a platform that does not conduct peer reviews. This means that the scientific community has yet to fully validate Phi-3's proclaimed capabilities.

Nevertheless, Microsoft's dedication to improving AI's conversational capabilities, as shown in their development of even more capable variants like Phi-3-small and Phi-3-medium, underscores the company's commitment to pushing the boundaries of AI technology. Because beyond its technical prowess, Microsoft's approach to making Phi-3's technology available is worth noting. The AI model is hosted on both Microsoft Azure and Ollama, but details about its open-source license are not yet available.

The mention of the Apache 2.0 license from Grok AI, which allows both academic and commercial use, hints at the possible directions Microsoft might consider for Phi-3-mini's distribution. In the rapidly evolving AI landscape, developments like Phi-3 not only highlight the progress in creating more efficient and capable models, but also reflect the broader implications for the role of technology in our daily lives.