It really makes people look forward to the future AI world! Nowadays, as long as multiple tools are used together, AI, which was originally just a machine, can be turned into a more humane one. Earlier, Geekerwan, a well-known Chinese hardware review channel, released a very interesting “AI Paemon”. It uses four services to turn ChatGPT into a virtual character and give it emotional dialogue. That is, it does not use a robotic voice to talk to you, turning it into your virtual assistant. It is also free for everyone to download. You can use it as long as you have a Windows computer + Android phone.
Developers who are interested in this tool also plan to share the source code on the GitHub website in the future. Let’s teach you how to install it.
“AI Paimeng” is a ChatGPT virtual character + emotional dialogue, turning it into your cute virtual assistant
This AI Paemon is generated by ChatGPT as the main dialogue, and then uses VITS for speech generation, and imports it into BERT for emotion recognition, and then uses the characters produced by UE5 for animation display. The detailed development process is briefly mentioned in Geekerwan’s video. The video will be attached at the end of the article, so I won’t mention it here:
Quick video test using GPT-3.5 for responsiveness and speed (web version):
Reply using GPT-4 (web version):
Geekerwan has packaged “AI Paimeng” and put it on the cloud hard drive for everyone to download for free. There are two download points, it depends on which one you want to download from (from Geekerwan channel description):
Things you need to know before installation:
- “AI Paimeng” is not an App that can operate independently on mobile phones. It needs to be paired with a computer. The computer is a server-side concept, but the user can choose an Android phone or a computer.
- The computer needs to have an NVIDIA GTX 9 series or above graphics card (and it must be an N card).
- The server computer and the client must be under the same local network. However, if you want to try the external network, you can change the port of the router to see if there is a solution.
- Windows computers are in the Traditional Chinese language system and need to change Unicode support before they can be used. Opening it directly will cause an error.
- This one was developed by Chinese media. The Android App also needs to download the APK file to install. People who are worried about security are advised to skip it.
- After use, it is recommended to change Unicode back to the original setting, otherwise some software may display garbled characters.
How to install and use “AI Paimon”
The file of AI Paimon is quite large, 6.x GB, and it will take a while to decompress:
After decompression, there will be two files, the SocketServer folder and run.bat. Click run.bat to open the server:
This message may pop up when you open it for the first time. In this case, please click “Other Information”:
A “Run Anyway” button will appear:
This is the server-side interface of AI Paimeng. It has two windows and a command prompt character behind it. Remember that these two cannot be turned off during use. The ChatGPT part provides two types of “web version” and “API version”. The API version does not require you to fill in your OpenAI API. Geekerwan has embedded their OpenAI API. If the API Key is blank, their API will be automatically accessed, which is free for everyone to use, but there is an hourly limit. If you have your own OpenAI API, paste it in the API Key field:
Before you start using it, you also need to turn on Unicode support, otherwise it will not run properly, as is the case with most software developed in China.
Open the Windows console, go to “Clock and Region”, and click “Change date, time, or number format” under Region:
Open “Change System Region Settings” in the system management menu:
Check “Beta: Use Unicode UTF-8 for global language support” and click OK:
You will need to reboot. Remember to save what you are currently working on:
After the reboot is complete, open Run.bat in the AI Paimeng folder again.
There are two roles provided. Paimon is the virtual female assistant, and yunfei is the virtual male assistant of Geekerwan. It depends on which one you want to use:
Let’s first look at using Geekerwan’s API directly. Press the red “start button” in the lower left corner:
This warning will pop up when you use it for the first time. Remember to click “Allow Access”:
After successful activation, the startup icon in the lower left corner will turn green, and the connected IP location will also be displayed. At this time, please install the dedicated App on your Android phone and click “Use Mobile”:
The QRCode of the APK file download point will pop up, scan it with your Android phone:
Install directly after downloading the APK file:
The name of this App is Digital Life. When you open it for the first time, you will be asked for permission. Please click Allow, and then enter the IP location you just obtained in the server settings. Remember: put the last 5 digits in the field below, and then click Apply:
Displaying the character means the connection is successful. This is paimon. Click the recording icon below to start speaking:
Remember to allow recording, select “While using the application”:
If the connection is successful, the lower left corner will change to “Connected”, and the processing log will be displayed on the right, including AI Paimon’s reply:
In addition, I have also tested using my own OpenAI API, and there is no problem. The advantage of using my own API is that I don’t have to worry about being restricted. You can ask as many questions as you want. Although Geekerwan is free, if you ask too many questions at once, you may be restricted and asked to come back after an hour.
The API version currently provides two models. There is no GPT-4 yet. Those who want to use GPT-4 can use the web version instead (only for ChatGPT Plus members):
- gpt-3.5-turbo
- gpt-3.5-turbo-0301
The web version has two login methods: “Cookies” and “Account and Password”. Accounts and passwords are not currently available, but Cookies are. As long as your browser is logged in to ChatGPT, you can use Cookies. Clicking “How to Get Cookies” will tell you where to get it from and which paragraph to copy. Those who have a Plus account remember to check:
This page will open. Click the “Click the following link” link to open the location of the Cookies you should obtain. Copy the large string after the accessToken, excluding the double quotes:
Plus members can choose the GPT-4 model, but compared to GPT-3.5, the response speed will be a little slower, but I personally think it is acceptable:
Likewise, all conversation content will be displayed on the right:
You can also see the conversation records when you enter the web version:
If you don’t want to chat with Paimon, you can actually modify the AI’s personality by editing the prompt words, and it can also become a teacher, wife, etc.:
During use, remember that the AI Paemon server on the computer cannot be turned off so that it can operate normally. When you don’t use it, just close the program.
Geekerwan full video:
Source: KOCPC Chinese