OpenAI just announcedUnlocking ChatGPT Advanced Voice Mode for select ChatGPT Plus users(Advanced Voice Mode) If you’re lucky enough, you can experience Advanced Voice Mode right now. Some ChatGPT Plus users have already gotten to try it out and shared the different ways it can be used. Before it’s your turn for Advanced Voice Mode, let’s take a look at how you should use it!
OpenAI ChatGPT Advanced Voice Mode: Low Latency, Multilingual Conversion, Alpha Version Experience Sharing
ChatGPT’s Advanced Voice Mode has more natural, real-time conversation capabilities, able to detect and respond to emotions and non-verbal cues (for interested friends, you canGo read the Advanced Voice Mode introductionIn May, when OpenAI announced ChatGPT’s advanced voice mode, many users were very excited. With visual recognition and more natural, real-time conversations, it should be even smoother to use. On August 1, OpenAI announced that some ChatGPT Plus users would get early access to the advanced voice mode; if you’re lucky, it might be your turn. Even if you’re not lucky and can’t use it yet, that’s fine—today we’ve compiled several examples from abroad where people have already experienced ChatGPT’s advanced voice mode, so you can get familiar with the changes it brings.
A netizen shared that using ChatGPT Advanced Voice Mode feels like video chatting with a knowledgeable friend. If you have questions about a new kitten, you can also ask ChatGPT Advanced Voice Mode, which uses visual recognition and real-time conversation to answer questions instantly. For example, if you ask why the kitten hasn’t eaten even though you set out food, water, and a bed for the newly arrived cat, ChatGPT Advanced Voice Mode uses visual recognition to comfort you: “You’ve done great already; the kitten probably just needs time to adjust, so don’t be too nervous.”
Trying #ChatGPT’s new Advanced Voice Mode that just got released in Alpha. It feels like face-timing a super knowledgeable friend, which in this case was super helpful — reassuring us with our new kitten. It can answer questions in real-time and use the camera as input too! pic.twitter.com/Xx0HCAc4To
— Manuel Sainsily (@ManuVision) July 30, 2024
In addition to comforting you, ChatGPT’s advanced voice mode can also use visual recognition for real-time translation.
Real-Time Japanese translation using #ChatGPT’s new advanced voice mode + vision alpha! Yet another useful example! pic.twitter.com/wDXrgYQkZE
— Manuel Sainsily (@ManuVision) July 31, 2024
ChatGPT’s Advanced Voice Mode has incredibly impressive low latency and the ability to interrupt mid-speech. You can ask it to act as a tour guide and introduce a travel itinerary for a specific area. While it’s speaking, you can immediately cut in and ask it to answer in a different way. Whether you want it to talk like a pirate, in a musical style, in a whisper, or switch to a different language, Advanced Voice Mode can quickly make the switch.
#Chatgpt low latency + interruption Voice is awesome. I’ll be relearning Cantonese soon to make mom happy!
OpenAI is helping all relearn so much, at any speed, anyway, super fun, and in my pocket!
This will be my engine for google home, phone, glasses, couch, fridge, car, etc! pic.twitter.com/n39gcw6Zks
— Aaron (Tango) Tang (@hahatango) July 31, 2024
Some netizens also stress-tested ChatGPT’s advanced voice mode by constantly interrupting it and switching through different language variants. From Spanish → Mexican Spanish → Portuguese → Brazilian Portuguese → Korean with a heavy Italian accent, ChatGPT’s advanced voice mode handled it all perfectly.
“Stress testing” ChatGPT Advanced Voice Mode. Here you can see how it handles interruptions, different versions of languages and even languages with foreign accents.
Tells a story in Spanish → Mexican Spanish → Portuguese→ Brazilian Portuguese → Korean w/ an Italian accent 😉 pic.twitter.com/4vC3AQZeDn— Cristiano Giardina (@CrisGiardina) July 31, 2024
Besides changing languages, ChatGPT’s advanced voice mode can also adjust the tone of speech very well—whether normal, excited, or angry, it handles all of them.
ChatGPT Advanced Voice Mode speaking Armenian (regular, excited, angry) pic.twitter.com/SKm73lExdX
— Cristiano Giardina (@CrisGiardina) July 31, 2024
OpenAI’s ChatGPT Advanced Voice Mode features for real-time translation and visual recognition look similar to what was demonstrated at the ChatGPT GPT-4o launch event in May. What do you all think—are the examples shown above practical? OpenAI says that ChatGPT’s Advanced Voice Mode is still in a limited Alpha testing phase, so it may still make mistakes. If you’ve received an email inviting you to participate in Alpha testing these past few days, you can try using ChatGPT’s Advanced Voice Mode. For those who want to know what to do after receiving the email, click the link below.
Source: KOCPC Chinese