Run Powerful AI on Your Phone with Bonsai 27B
PrismML just launched Bonsai 27B. This project shrinks the popular Qwen 27B model so it can run on laptops and phones instead of needing a giant server. It uses the same architecture as the original but optimizes the weight values to save space.
You can choose between two versions. The ternary version uses three weight values and takes up about 6 gigabytes of space. The binary version uses even less memory for faster performance on mobile hardware.
Both models are available under an Apache 2.0 license. This makes it easy for developers to build private AI tools that work locally on their own machines without a cloud connection.
Comments (0)
No comments yet. Be the first!
More AI news
NewsGoogle Launches LiteRT.js for Faster Browser AI
Google just released a new tool that lets developers run AI models directly in web browsers with much better performance.
NewsNew AI cameras catch drivers who skip stop signs
California startup Obvio is putting AI cameras on stop signs to protect pedestrians from reckless drivers.
NewsPerplexity accused of ignoring website blocks
A major web security company says Perplexity is scraping sites that explicitly told it to stay away.