The era of lean AI models

Revolution on the smartphone market

The latest wave of technological innovation in the field of artificial intelligence (AI) is characterised by a significant trend towards leaner but more powerful AI models that can run even on standard smartphones. This progress could have the potential to fundamentally change the way we use mobile devices, with data protection and energy efficiency taking centre stage.

A paradigm shift in AI development

Traditionally, powerful AI models, known as Large Language Models (LLMs), have been hosted in large data centres and required specialised hardware to run. These models, although extremely powerful in their processing capacity and ability to handle complex tasks, are known for their high energy consumption and computing infrastructure requirements. One example of this is the H100 semiconductor from Nvidia, which was specially developed for such high-end applications.

In contrast, the newly developed Small Language Models (SLMs), such as the Phi-3 model presented by Microsoft, utilise advanced algorithms that allow them to learn and operate with far less data, similar to a child learning new words and concepts from a few interactions. This technology requires significantly less computing power, making it ideal for use on devices with limited resources such as smartphones or even smart home appliances.

Impact on the market and consumers

The implementation of lean AI models in smartphones and other everyday devices could bring a number of benefits:

Improved data privacy: as SLMs can be run locally on the device, personal data no longer necessarily needs to be transmitted to external servers. This minimises the risk of data breaches and gives users greater control over their personal information.

Energy efficiency: The lower power consumption of these models could significantly extend the battery life of smartphones, which is particularly useful for applications that require continuous AI support.

Ubiquitous AI: The integration of AI into everyday devices could expand the potential of smart home technologies by making them smarter and more autonomous.
Challenges and concerns
Despite the many benefits, there are also challenges and concerns regarding the widespread implementation of SLMs:

Performance limitations: While SLMs are sufficient for many standard applications, they may reach their limits for particularly demanding tasks.
Market dynamics: Large tech companies such as Apple and Google could decide to develop their own AI models or buy existing solutions, which would have a significant impact on market dynamics.
Consumer acceptance: Despite technological advances, there may be concerns about the reliability and accuracy of SLM results.

Conclusion

The development and adoption of lean AI models is on the cusp of triggering a revolution in the way we use interactive technology. From smartphones that can perform intelligent functions without an internet connection to smart home appliances that understand our speech, trends suggest that the future of AI will be mobile, integrated and energy efficient. While the challenges are not insignificant, the potential benefits could have a lasting impact on the landscape of digital technology.