China’s Kuaishou team has developed a video-driven portrait framework, “LivePortrait,” that allows people in photos to make expressions as you wish. With LivePortrait, you can make expressions on any photo you want, bringing the people in the photo to life. Like in the video below, you can map your own expressions onto the person in an image. Now everyone can try it—let’s take a look!
Make photos “come alive”! Use LivePortrait to transfer your facial expressions onto photos.
The Kuaishou team in China developed a video-driven portrait animation framework called “LivePortrait.” Simply provide an expression, and LivePortrait can make the person in the image mimic the same expression. Now we can use LivePortrait to create videos—let’s take a look!
Go to LivePortrait to create a video.
After clicking the link above, you’ll see this screen. The left box is for the image you want to use, and the right box is for the face video you want the person in the image to imitate (the video aspect ratio should be 1:1).
After adding both images and videos, scroll down the webpage to find “Animate,” and click it to create a video.
Here’s a video made by our editor. After watching it, I can only say that beautiful people still look beautiful when making funny faces…
Everyone can also check out the comparison videos. LivePortrait basically transfers the expressions from the video onto the image:
On Twitter, many users also share videos they’ve made with LivePortrait. If you’re interested, you can check them out.
話題のLivePortraitようやくローカルに入れて試した。とりあえずCG風の生成画像を自分の顔で動かすのを試した。CG使わずに色々できるようになってきてるね。youtubeくらいならいけそうな品質？ pic.twitter.com/wLHGHoPwjn
— Hirokazu Yokohara (@Yokohara_h) July 17, 2024
AIで画像の顔の動きを完全にコントロールできるようになりました！
右は１枚の画像で、左の動画の動きに合わせて動いています。
使ったのは「LivePortrait」で、ComfyUIで動かすことができます！
アニメも対応しているので、動画生成AIと組み合わせたらすごい作品が作れそう！ pic.twitter.com/XjocZEWZWk
— ハルオミ (@HaruAiman) July 7, 2024
画像をアップロードした動画の顔の表情にリンクさせる「LivePortrait」がすごい。
瞬きから目の動きまでとても正確に画像に反映できている。
デモページで無料で使えますよ。
使い方はリプ欄から。 pic.twitter.com/DuJVSLhCui— DAISUKE | 画像生成AI ・ メタバース (@daisu_creator) July 12, 2024
Go to LivePortrait to create your video.
With LivePortrait, everyone can make their AI-generated images of beautiful women come to life. You can even record a segment of singing mouth movements and facial expressions like the netizen below, then use LivePortrait to create a video, thereby producing an AI beauty who can lip-sync.
AIが生身の人間みたいに動くLivePortraitよりもすごいツールを知りたい人はHeyGen Expressive Photos v1.0を使うと良い。動きだけでなく音声に合わせてAI美女がしゃべる。これはもう人です！人！やり方を知りたい人はリプ欄 pic.twitter.com/2d0abEFkI3 https://t.co/qgkKeVvAEl
— おじぎねこ ｜AI画像生成マネタイズクラブ副管理人 (@ojigineko_tips) July 12, 2024
Source: KOCPC Chinese