There are many AI chatbot services on the Internet. Even ChatGPT and Copilot also have mobile versions. Although they are free to use, you must have an Internet environment. You may want to try to see if there are any LLMs large language models that can be used directly on your mobile phone? This article will recommend a MiniCPM that can do this. It can be installed on iOS and Android. In addition to text models, it also has models that can analyze images.
However, I would like to remind you that there has not yet been in-depth optimization and system testing of the mobile phone inference model, so if the mobile phone memory is too low, the processing speed will be a bit slow, and it is not recommended for mid-to-low-end mobile phones.
MiniCPM is a free large-language AI model that can be deployed locally on mobile phones. It supports text and image analysis.
MiniCPM is a series of end-side large models jointly open sourced by China Wall-Facing Intelligence and the Natural Language Processing Laboratory of Tsinghua University. The Chinese part only supports Simplified Chinese, and there is no way to answer in Traditional Chinese. The installation method for Android is very simple, just download the APK file. For iOS, it is more troublesome. iPhone users can go toReading teaching here。
There is also a lot of test data shared in the GitHub project. They claim that even though this model is smaller than others, its performance is more advantageous in all aspects. For example, compared with Llama2-7B, Qwen-7B, Mistral-7B, MPT-30B, etc., the average score of MiniCPM is higher, and the average score in English and Chinese is far higher than other leapfrog opponents. Whether it is really so powerful, readers can test it themselves:
There is also mobile phone test data. If yours happens to be on the list, you can take a look. Mine is a Pixel 6 Pro phone, and it’s a bit slow to use. Every time I ask a question, I have to wait 3 to 5 seconds for a reply:
I’ll take an Android phone as an example. After clicking above to enter the GitHub project, slide to the “Mobile Dependencies” list. For Android, click on the red box in the picture below. It will jump to another page, and then click the APK link to download:
Follow the instructions on the screen to install and open it after installation:
You will see that there are two models. The upper MiniCPM 2.0 is pure text, and the lower MiniCPM-V 2.0 supports image analysis and processing. The file will not be very large. After downloading, it will turn into a memo-like icon:
Click to start chatting using:
The length of the response is quite long. According to its description, in addition to providing information, answering questions, programming help, voice recognition and other functions, it also supports smart home control. I have tested calling it Traditional Chinese, and it said it works, but it still continues to answer in Simplified Chinese:
I have tested it and it can indeed run offline. I tested it in flight mode above. However, because it has not been optimized yet, the speed I measured is really a bit slow. In terms of practicality, I think it is completely useless.
The MiniCPM model is also placed on Hugging Face. People who need it can also use computers for testing. You can also find the download point in the GitHun project description, or use the one they made.Online version。
Source: KOCPC Chinese