magic! Open source players successfully used an $8 ESP32-S3 chip to run a 28.9 million parameter large language model offline
Do you believe that the IoT chip ESP32-S3 microcontroller, which is only cheaper than two cups of coffee at US$8 ...
Tag: LLM
An overseas YouTuber tested running a local LLM on a 20-year-old Pentium 4 PC; answering a single question took 33 minutes.
When it comes to running AI locally on a computer, most people think you need a large amount of memory, ...
The AI Agent Breakout Moment: Andrej Karpathy Says, “I Hardly Write Code Myself Anymore”
OpenAI early engineer and former Tesla AI director Andrej Karpathy recently sat down with a well-known AI podcast
Just 0.1B Parameters! The Ultra-Compact Open-Source All-Modal Model MiniMind-O Garnered 3K Stars Upon Launch
Does an AI model that matches traditional expectations really need to reach a certain scale to be useful? The open-source ...
Lao Ka counterattacks! The $100 NVIDIA V100 runs LLM performance faster than consumer-grade graphics cards
Recently, a foreign YouTuber tested an 8-year-old server graphics card "NVIDIA Tesla V100". The speed and efficiency of running models ...
Xiaomi releases the MiMo-V2.5 series of large models, and the open-source version has claimed the top spot on the global open-source leaderboard.
Xiaomi only unveiled the Mimo-V2 large model last month, and not long after, it recently announced the updated and more ...
DeepSeek V4 Released: The Most Powerful Open-Source Model! Agent Performance Fully Surpasses Mainstream Closed-Source Models at Just 2% of the Price
After more than half a year of rumors, DeepSeek, dubbed the "most powerful open-source warrior," officially announced today (April 24, ...
MiniMind: An open source project that allows ordinary people to “train large models from scratch” in just two hours and less than NT$13
In the past, people’s understanding of large model training was that it required flagship GPUs from several computer rooms + ...
The volume is reduced by 14 times! PrismML launches the world’s first 1-bit LLM “Bonsai 8B”, which can run locally on iPhone
In the traditional impression, if you want an AI model to be smarter, you must make it larger, which means ...
Cleaner Cat Lifetime Free! An LLM-powered Mac system cleaner with system monitoring features
More and more tools are starting to incorporate AI features. I recently discovered this "Cleaner Cat" Mac system cleanup tool, ...