A tech team just released Needle, a tiny AI that can control apps and answer questions while running entirely on your smartphone. The 26-million parameter model performs tasks like setting timers, sending messages, and controlling smart home devices without needing internet connection.
What makes this impressive is that Needle runs as fast as much larger AI models while using a fraction of the computing power. Most AI assistants need powerful servers in data centers, but this one works on budget phones, smartwatches, and even smart glasses.
Shrinking AI Down to Size
The creators discovered something interesting: you don’t need massive AI models for basic assistant tasks. They found that controlling apps and extracting information is more about matching and assembly than complex reasoning. So they built Needle using only “attention” components, removing the bulky parts that usually store facts and knowledge.
The team trained Needle on 200 billion examples over 27 hours, then fine-tuned it with 2 billion function-calling examples in just 45 minutes. They tested it across 15 categories including timers, messaging, navigation, and smart home controls.
While Needle beats several competing small models at single tasks, larger models still perform better in conversations. But for quick commands and app control, this tiny AI proves you don’t always need the biggest brain in the room.
What’s Next
The team released everything for free, including the model weights and code. Developers can download and customize Needle for their own apps. This could lead to more AI assistants running locally on phones instead of relying on cloud servers.
