Ever since OpenAI launched its own text-to-video large model Sora Afterward, companies were all racing to be the first to launch their own text-to-video generation large models. Just a few days ago, we finished introducing one.KLING, created by the Kuaishou teamRecently, Luma AI also launched “Dream Machine,” which can generate videos from text or images. Now everyone can test Dream Machine—let’s take a look!
Luma AI launches Dream Machine for generating videos from text/images — just need a Google account to use it!
Luma AI has launched Dream Machine, a large AI model that can generate videos from text/images. Dream Machine is said to be capable of producing physically accurate, consistent, and dynamic shots. Now anyone can use Dream Machine to generate videos.
Click here to use Dream Machine to generate videos
After clicking the link above, a Google login screen will appear. Once you log in, you can start experiencing Dream Machine’s service. Free accounts can generate 30 videos per month, and they all come with watermarks. Here are a few test videos made with Dream Machine.
The first one used the prompt “An old lady laughing underwater, wearing a scuba diving suit, her expression denotes calm and happiness” provided by Dream Machine to generate a video. Although the old lady, wearing a scuba suit, laughing underwater, and looking happy were all achieved, if you look closely, the old lady’s hands weren’t generated properly, which looks quite scary.
Earlier I also mentioned that Dream Machine can generate videos from images, but in my own testing, just feeding it a single photo without any prompt sometimes yields better results. That’s how those recent videos of old photos coming to life are made.
Original photo:
Just throw it directly into LUMA to generate. After turning off the Enhance prompt, generate directly.
The finished product actually looks much better. Recently, some Japanese…Videos that bring deceased loved ones to lifeThat’s how it’s done:
Photo test generated using Midjourney:
Other netizens’ attempts turned out pretty well, so here are a few for your reference:
～ 新世紀への渇望 ～
新しい時代が幕を開けた。私たちは生まれ変わり、技術の波に乗って進化を遂げる。過去を振り返ることなく未来へ向かい、絶え間なく適応し続けていく。#LumaDreamMachine @LumaLabsAI #生成AI pic.twitter.com/iCY5OWrKeS— Kaku Drop 架空飴 (@KakuDrop) June 12, 2024
Announcement trailer for “Gala”, my new feature-length film project.
Created with the just-announced @LumaLabsAI video AI model, #LumaDreamMachine.
This is nothing less than a sea change moment for AI video. Thank you to Luma Labs for allowing me to share in the release! pic.twitter.com/ynUNpFytHM
— Christopher Fryant (@cfryant) June 12, 2024
Ha! And you thought @LumaLabsAI was just about cool 3D objects. WRONG! It turns out that thousands of Gaussian splats can EASILY be turned into a POWERFUL video generation model.
I got early access!
(Envision a teaser trailer for a new streaming channel!) #LumaDreamMachine pic.twitter.com/4HFgwaHuAk
— Justin Hart (@justin_hart) June 12, 2024
Here is a quick teaser of the image2video you can make with #LumaDreamMachine, midjourney images, no face swaps, no speed ups, 1st rolls. Twitter doesn’t do it justice, needs to be seen in 4k. I will drop a full video later tonight! Make your movies! sound on @LumaLabsAI pic.twitter.com/XXCh6shcA5
— Uncanny Harry AI (@Uncanny_Harry) June 12, 2024
We had the opportunity to test out Dream Machine by @LumaLabsAI and we have been BLOWN AWAY. Here are some videos generated with their image to video model.
The model takes text and (more importantly) image to video!
The best part? You can try it out today!… pic.twitter.com/vFdFZfkK8d
— Curious Refuge (@CuriousRefuge) June 12, 2024
I wonder if after watching this, you’re interested in Luma AI’s Dream Machine, the AI model that generates videos from text or images? Kuaishou’s KLING only allows beta testers with Chinese phone numbers to generate videos, but Dream Machine is now open to everyone. All you need is to log in with a Google account to experience generating videos with Dream Machine. If you’re interested, you can visit the Dream Machine official website to learn more.
If you’d like to try Dream Machine’s video generation feature, please click here.
Source: KOCPC Chinese