OpenAI introduces Sora
- Thread starter Ill-Mind
- Start date
1/7
A sneak peek of AI short film - The Pursuit.
This scene is where I build the world and introduce characters so there will be a lot of dialogues. It's been a bit of a challenge to get the dialogue and lip-syncing just right, especially with all the keyframes involved.
While I’m still learning and improving, I hope you enjoy this taste of what's to come.
Image: @freepik @midjourney
Video: @LumaLabsAI
Voice: @elevenlabsio Lip-syncing: @hedra_labs /search?q=#liveportrait
2/7
If you're interested in seeing more, check out another scene from the film here. Thanks for your support!
3/7
🫡🫡
4/7
Thanks mate!
5/7
Definitely not the bottom
6/7
Thanks mate!
7/7
Thanks mate, still working on it
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
A sneak peek of AI short film - The Pursuit.
This scene is where I build the world and introduce characters so there will be a lot of dialogues. It's been a bit of a challenge to get the dialogue and lip-syncing just right, especially with all the keyframes involved.
While I’m still learning and improving, I hope you enjoy this taste of what's to come.
Image: @freepik @midjourney
Video: @LumaLabsAI
Voice: @elevenlabsio Lip-syncing: @hedra_labs /search?q=#liveportrait
2/7
If you're interested in seeing more, check out another scene from the film here. Thanks for your support!
3/7
🫡🫡
4/7
Thanks mate!
5/7
Definitely not the bottom
6/7
Thanks mate!
7/7
Thanks mate, still working on it
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
1/6
Introducing AI short film: The Pursuit - Part One
Log-line:
A man's obsession with avenging his brother's death leads him on a relentless pursuit, culminating in a climactic confrontation in a gothic cathedral that reveals a shocking truth.
This is the first part of my short film, which is created using /search?q=#LumaDreamMachine V1.5. I'm planning to make a total of five parts to complete. It's been a challenging process, but I'm loving every minute of it.
Tools:
Image: @freepik @midjourney
Video: @LumaLabsAI
Voice: @elevenlabsio
Lipsyncing: @hedra_labs /search?q=#liveportrait
2/6
Thanks for sharing your thoughts mate. I tried to use my own voice and use speech to speech to make it better. But I have a strong accent which I feel does not match with the scene.
But thanks for your suggestion brother
3/6
🫡
4/6
Thanks Dave, luma keyframe magic
5/6
Thanks mate🫡
6/6
Thank you, Kevin!
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
Introducing AI short film: The Pursuit - Part One
Log-line:
A man's obsession with avenging his brother's death leads him on a relentless pursuit, culminating in a climactic confrontation in a gothic cathedral that reveals a shocking truth.
This is the first part of my short film, which is created using /search?q=#LumaDreamMachine V1.5. I'm planning to make a total of five parts to complete. It's been a challenging process, but I'm loving every minute of it.
Tools:
Image: @freepik @midjourney
Video: @LumaLabsAI
Voice: @elevenlabsio
Lipsyncing: @hedra_labs /search?q=#liveportrait
2/6
Thanks for sharing your thoughts mate. I tried to use my own voice and use speech to speech to make it better. But I have a strong accent which I feel does not match with the scene.
But thanks for your suggestion brother
3/6
🫡
4/6
Thanks Dave, luma keyframe magic
5/6
Thanks mate🫡
6/6
Thank you, Kevin!
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
Stone Cold
Superstar
1/2
Another AI-Video-generator called HotShot. Quality looks amazing, 2024 is definetly the year of GenAI Video generators.
2/2
Pretty good!
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
Another AI-Video-generator called HotShot. Quality looks amazing, 2024 is definetly the year of GenAI Video generators.
2/2
Pretty good!
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
1/4
محاولة لإنشاء فيديو بواسطة @HotshotSupport
Trying out for creating a video by : @HotshotSupport
-
@mohamedjabarat @8bit_e @martin_casado @AITalesNBH @HBCoop_ @toolstelegraph @andyorsow
2/4
Thank you so much
3/4
تسلمين الله يسعدك
4/4
شكرا على التعليق والدعم أ.محمد
واياك يارب
المقطع طال شوي لكن نتعلم
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
محاولة لإنشاء فيديو بواسطة @HotshotSupport
Trying out for creating a video by : @HotshotSupport
-
@mohamedjabarat @8bit_e @martin_casado @AITalesNBH @HBCoop_ @toolstelegraph @andyorsow
2/4
Thank you so much
3/4
تسلمين الله يسعدك
4/4
شكرا على التعليق والدعم أ.محمد
واياك يارب
المقطع طال شوي لكن نتعلم
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
1/1
This is an amazing, phenomenal short AI film! Just watch it and see what one person can create in just a few weeks using a couple of AI tools. Now, imagine how much more advanced this will be in a few years!
The dawn of a new era in human creativity, fueled by AI, has begun!
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
This is an amazing, phenomenal short AI film! Just watch it and see what one person can create in just a few weeks using a couple of AI tools. Now, imagine how much more advanced this will be in a few years!
The dawn of a new era in human creativity, fueled by AI, has begun!
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
1/32
Watch Battalion—My First Ever 5-Minute Gen AI Short Film. I had to upload it in two parts. This is part 1; part 2 is in the comments.
I created this over a few weeks using 100% image-to-video and text-to-video Generative AI. While not perfect, the tools advance daily, even during production, helping to produce incredible results.
This is my most in-depth and longest Gen AI narrative film project. It was created by one person.
Watch the full-length 4K pro res here: https://invidious.poast.org/5NZubOOeeV0?si=vv6588mKJnt4HNU2
Various tools helped me bring it to life, and it wouldn't have been possible without the power of AI.
The story chronicles the 320th Barrage Balloon Batallion, the only unit to storm the beach during D-Day composed entirely of African American soldiers. They provided critical protection to the ships and soldiers below them from attacks by enemy aircraft.
AI tools used: @Kling_ai @runwayml @LumaLabsAI @Hailuo_AI @midjourney @Magnific_AI @elevenlabsio @OpenAI @StabilityAI @udiomusic @FilmConvert @Adobe Premiere Pro @Photoshop @grok Comfyui, Live Portrait
2/32
Here is part 2 of Battalion:
3/32
You can watch Battalion in it's entirety and in 4k here: https://invidious.poast.org/5NZubOOeeV0?si=OHogN3eO7Q_Zsk1t
4/32
Ty!
5/32
Ty!
6/32
Thank you. Yes I spent weeks on this one!
7/32
Thank you!
8/32
Amazing!
9/32
I think you were spot on @elonmusk
[Quoted tweet]
First compelling AI 30 minute show will be no later than next year.
Movie length in 2026.
10/32
Ty I agree!
11/32
Thank you for your words!
12/32
Ty!
13/32
Thanks PJ! Just further shows that stories are still king. ai is just our toolset n
14/32
Thank you!
15/32
Appreciate it Erika!
16/32
Thanks Tom!
17/32
Appreciate it!!
18/32
Thank you. Yes so powerful. My friend Chris Branch augmented it with some AI to give it the epic climax feel
19/32
Much appreciated!!!
20/32
Thank you! Appreciated.
21/32
Thanks dude!
22/32
Ty!!
23/32
Ty!!
24/32
Definitely over a hundred or 2
25/32
Cheers!
26/32
Thanks Reza. Means a lot from you brother!
27/32
28/32
Halation is awesome!
29/32
Thanks Alex! Appreciate it.
30/32
Yeah it took a few weeks for sure!
31/32
Thanks Chrissie!
32/32
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
Watch Battalion—My First Ever 5-Minute Gen AI Short Film. I had to upload it in two parts. This is part 1; part 2 is in the comments.
I created this over a few weeks using 100% image-to-video and text-to-video Generative AI. While not perfect, the tools advance daily, even during production, helping to produce incredible results.
This is my most in-depth and longest Gen AI narrative film project. It was created by one person.
Watch the full-length 4K pro res here: https://invidious.poast.org/5NZubOOeeV0?si=vv6588mKJnt4HNU2
Various tools helped me bring it to life, and it wouldn't have been possible without the power of AI.
The story chronicles the 320th Barrage Balloon Batallion, the only unit to storm the beach during D-Day composed entirely of African American soldiers. They provided critical protection to the ships and soldiers below them from attacks by enemy aircraft.
AI tools used: @Kling_ai @runwayml @LumaLabsAI @Hailuo_AI @midjourney @Magnific_AI @elevenlabsio @OpenAI @StabilityAI @udiomusic @FilmConvert @Adobe Premiere Pro @Photoshop @grok Comfyui, Live Portrait
2/32
Here is part 2 of Battalion:
3/32
You can watch Battalion in it's entirety and in 4k here: https://invidious.poast.org/5NZubOOeeV0?si=OHogN3eO7Q_Zsk1t
4/32
Ty!
5/32
Ty!
6/32
Thank you. Yes I spent weeks on this one!
7/32
Thank you!
8/32
Amazing!
9/32
I think you were spot on @elonmusk
[Quoted tweet]
First compelling AI 30 minute show will be no later than next year.
Movie length in 2026.
10/32
Ty I agree!
11/32
Thank you for your words!
12/32
Ty!
13/32
Thanks PJ! Just further shows that stories are still king. ai is just our toolset n
14/32
Thank you!
15/32
Appreciate it Erika!
16/32
Thanks Tom!
17/32
Appreciate it!!
18/32
Thank you. Yes so powerful. My friend Chris Branch augmented it with some AI to give it the epic climax feel
19/32
Much appreciated!!!
20/32
Thank you! Appreciated.
21/32
Thanks dude!
22/32
Ty!!
23/32
Ty!!
24/32
Definitely over a hundred or 2
25/32
Cheers!
26/32
Thanks Reza. Means a lot from you brother!
27/32
28/32
Halation is awesome!
29/32
Thanks Alex! Appreciate it.
30/32
Yeah it took a few weeks for sure!
31/32
Thanks Chrissie!
32/32
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
Pika 1.5 AI video generator
1/6
Sry, we forgot our password.
PIKA 1.5 IS HERE.
With more realistic movement, big screen shots, and mind-blowing Pikaffects that break the laws of physics, there’s more to love about Pika than ever before.
Try it.
2/6
🫡
3/6
@MatanCohenGrumi never not delivers
4/6
we'll always be here for you
5/6
Thank you, Alex! Means a lot coming from you.
6/6
Thank you, Tom!
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
Sry, we forgot our password.
PIKA 1.5 IS HERE.
With more realistic movement, big screen shots, and mind-blowing Pikaffects that break the laws of physics, there’s more to love about Pika than ever before.
Try it.
2/6
🫡
3/6
@MatanCohenGrumi never not delivers
4/6
we'll always be here for you
5/6
Thank you, Alex! Means a lot coming from you.
6/6
Thank you, Tom!
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
1/2
2/2
Try to generate your AI video on Pika
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
2/2
Try to generate your AI video on Pika
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
1/2
Crush it. Melt it. Cake-ify it. Explode it. Squish it. Inflate it. Pikaffect it. PIKA 1.5 IS HERE. Try it on Pika
2/2
Sound Credit: @EclecticMethod Video Credit: @starryhe214
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
Crush it. Melt it. Cake-ify it. Explode it. Squish it. Inflate it. Pikaffect it. PIKA 1.5 IS HERE. Try it on Pika
2/2
Sound Credit: @EclecticMethod Video Credit: @starryhe214
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
1/2
Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date.
Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike.
More details and examples of what Movie Gen can do
Meta Movie Gen - the most advanced media foundation AI models
Movie Gen models and capabilities
Movie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt.
Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment.
Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes.
Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video.
We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.
2/2
As part of our continued belief in open science and progressing the state-of-the-art in media generation, we’ve published more details on Movie Gen in a new research paper for the academic community https://go.fb.me/toz71j
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date.Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike.
More details and examples of what Movie Gen can do
Meta Movie Gen - the most advanced media foundation AI models Movie Gen models and capabilitiesMovie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt.
Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment.
Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes.
Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video.
We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.
2/2
As part of our continued belief in open science and progressing the state-of-the-art in media generation, we’ve published more details on Movie Gen in a new research paper for the academic community
https://go.fb.me/toz71jTo post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
1/2
More examples of what Meta Movie Gen can do across video generation, precise video editing, personalized video generation and audio generation.
2/2
We’ve shared more details on the models and Movie Gen capabilities in a new blog post How Meta Movie Gen could usher in a new AI-enabled era for content creators
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
More examples of what Meta Movie Gen can do across video generation, precise video editing, personalized video generation and audio generation.
2/2
We’ve shared more details on the models and Movie Gen capabilities in a new blog post
How Meta Movie Gen could usher in a new AI-enabled era for content creatorsTo post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
Meta Movie Gen - the most advanced media foundation AI modelshttps://reddit.com/link/1fvyvr9/video/v6ozewbtoqsd1/player
Generate videos from text Edit video with text
Produce personalized videos
Create sound effects and soundtracks
Paper: MovieGen: A Cast of Media Foundation Models
https://ai.meta.com/static-resource/movie-gen-research-paper
Source: AI at Meta on X:
1/40
@aisolopreneur
Yesterday, a Chinese company released an alarmingly advanced text-to-video AI:
Minimax.
It's like a Hollywood studio in your pocket.
10 mind-bending examples (plus how to access it for free):
2/40
@aisolopreneur
2.
[Quoted tweet]
Minimax is a new Chinese text-to-video model. It is available to try hailuoai.com/video
I've been experimenting with a couple of descriptive prompts showing human motion with AI and so far I'm impressed. It isn't perfect but the hand movement is the most natural I've seen.
3/40
@aisolopreneur
3.
4/40
@aisolopreneur
4.
[Quoted tweet]
Another Chinese 'Sora': A new AI video tool launched today by Minimax, backed by major investors Alibaba Group and Tencent.
Check out their official AI film Magic Coin
, created entirely with text-to-video .
Try it for free now: hailuoai.com/video
5/40
@aisolopreneur
5.
[Quoted tweet]
MiniMAX New Chinese Free AI Generator - WOW
Free to use for now and only text to video! (Most phone number accepted)
Music: @udiomusic
6/40
@aisolopreneur
6.
[Quoted tweet]
6. Video in pixel style
7/40
@aisolopreneur
7.
[Quoted tweet]
4.
two giant mech robots fighting in the middle of the ocean
8/40
@aisolopreneur
8.
[Quoted tweet]
I got to try the new Chinese text to image model by MiniMax. It generates 5 second videos in HD, and the fidelity looks really good. I included the link below if you want to try. It's free, for now!
Thanks for sharing @JunieLauX !
9/40
@aisolopreneur
9.
[Quoted tweet]
前几天 Minimax 发布了他们的视频模型 abab-video-1，我还做了个小测试。
今天补了一下针对性的详细测试，发现确实非常牛批，模型综合实力是全世界最好的之一。
先说结论：
- 画质表现是现在所有视频模型最强的；
- 人物面部细节和情绪的表现是现在所有模型最好的；
- 提示词理解、运动幅度、稳定性都在第一档；
- 美学表现略差于 Luma，好于 Ruwnay；
- 物理正确性跟 Runway 差不多，好于 Luma；
真的，你们可以看一下最后一段测试视频，太牛了。
原来的提示词让一个女性的表情从喜悦到恐惧在到无奈，Minimax 完美实现了提示词描述的内容。Luma 人物直接崩了，Runway调教过于生硬开始硬切画面。
画质分部分他的视频清晰度和纹理都非常清晰和稳定，没有出现常见的模糊和网格问题。
提示词理解也很强，比如豹子武僧的部分，Luma 画出来了但是画面完全不动，runway 直接画了个人出来，只有 minimax 完全理解了提示词并且运动幅度正常。
所有的提示词都是 AI 生成，没有使用常见视频模型的演示提示词。所有测试都只跑一次。
10/40
@aisolopreneur
10.
11/40
@aisolopreneur
Repost if you found this thread valuable.
Follow me @aisolopreneur for more on how to leverage & profit from AI.
[Quoted tweet]
Yesterday, a Chinese company released an alarmingly advanced text-to-video AI:
Minimax.
It's like a Hollywood studio in your pocket.
10 mind-bending examples (plus how to access it for free):
12/40
@SocDoneLeft
this lightsaber battle is incredibly gay
please make more Frot Wars content, thank you
13/40
@MaxRovensky
Nearly every visual effects artist working today started their career because they wanted to do a lightsaber effect
All of them will tell you in detail how bad these are
14/40
@blackdolphin0
@TweetHelperBot download this
15/40
@Yaz2022742
@TweetHelperBot download this
16/40
@Anni_malik33
This is next-level! Can't believe we're already at text-to-video AI. Excited to see what creative possibilities this unlocks!
"
17/40
@imsandraroses
I use those things in my bed but for other things
18/40
@sara69baddie
The Light Sabers need some more work
19/40
@haribhajnmeena
What is this
20/40
@MethadosA
YOU WANNA SWORD FIGHT MAN!?
YOUWANNASWORDFIGHTMANG!?!
21/40
@haribhajnmeena
That's too bad what's in his hands it looks like he's fighting with a sword of light
22/40
@Apikameena
Is this docking
23/40
@saoulidisg
Is this docking?
24/40
@BenjaminDEKR
Uhhhh i'm sorry but this isn't good.
25/40
@shawnchauhan1
Thanks for the recommendation
26/40
@BlakeC
Schwartz
27/40
@iamtexture
They’re “sword fighting”
28/40
@DannysWeb3
Looks like they’re trying to tickle each other w their light sabers
29/40
@CMRidinDerby
Sword fight
30/40
@PDXFato
Not better than Runway
31/40
@AndImOkayWithIt
Mini max lol
@realmadmaxx
32/40
@EisenhartJoshua
I think if any american company used the data this chinese company used to train these, they would be sued within a week, if not the same day.
33/40
@jakebrowne95
Interesting, going to have to try it out.
Are there any other chinese text-to-video models you recommend?
34/40
@shiridesu
are they dikkfighting?
35/40
@paliaskepsi
Better than the last couple Disney efforts.
36/40
@Brongis9163
What’s those sword made of? laser or gum?? 
LOOOOL
37/40
@michael_kove
Are they fighting or crossing their "swords" in a weird fetish fantasy a niche audience of nerds might have?
38/40
@kakigaijin
if you play with it too long...
39/40
@bitsinabyte
40/40
@IanFenwickTX
Bruh what they doin’ with their lightsabers???
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
@aisolopreneur
Yesterday, a Chinese company released an alarmingly advanced text-to-video AI:
Minimax.
It's like a Hollywood studio in your pocket.
10 mind-bending examples (plus how to access it for free):
2/40
@aisolopreneur
2.
[Quoted tweet]
Minimax is a new Chinese text-to-video model. It is available to try hailuoai.com/video
I've been experimenting with a couple of descriptive prompts showing human motion with AI and so far I'm impressed. It isn't perfect but the hand movement is the most natural I've seen.
3/40
@aisolopreneur
3.
4/40
@aisolopreneur
4.
[Quoted tweet]
Another Chinese 'Sora': A new AI video tool launched today by Minimax, backed by major investors Alibaba Group and Tencent.
Check out their official AI film Magic Coin
, created entirely with text-to-video . Try it for free now: hailuoai.com/video5/40
@aisolopreneur
5.
[Quoted tweet]
MiniMAX New Chinese Free AI Generator - WOW
Free to use for now and only text to video! (Most phone number accepted)
Music: @udiomusic
6/40
@aisolopreneur
6.
[Quoted tweet]
6. Video in pixel style
7/40
@aisolopreneur
7.
[Quoted tweet]
4.
two giant mech robots fighting in the middle of the ocean
8/40
@aisolopreneur
8.
[Quoted tweet]
I got to try the new Chinese text to image model by MiniMax. It generates 5 second videos in HD, and the fidelity looks really good. I included the link below if you want to try. It's free, for now!
Thanks for sharing @JunieLauX !
9/40
@aisolopreneur
9.
[Quoted tweet]
前几天 Minimax 发布了他们的视频模型 abab-video-1，我还做了个小测试。
今天补了一下针对性的详细测试，发现确实非常牛批，模型综合实力是全世界最好的之一。
先说结论：
- 画质表现是现在所有视频模型最强的；
- 人物面部细节和情绪的表现是现在所有模型最好的；
- 提示词理解、运动幅度、稳定性都在第一档；
- 美学表现略差于 Luma，好于 Ruwnay；
- 物理正确性跟 Runway 差不多，好于 Luma；
真的，你们可以看一下最后一段测试视频，太牛了。
原来的提示词让一个女性的表情从喜悦到恐惧在到无奈，Minimax 完美实现了提示词描述的内容。Luma 人物直接崩了，Runway调教过于生硬开始硬切画面。
画质分部分他的视频清晰度和纹理都非常清晰和稳定，没有出现常见的模糊和网格问题。
提示词理解也很强，比如豹子武僧的部分，Luma 画出来了但是画面完全不动，runway 直接画了个人出来，只有 minimax 完全理解了提示词并且运动幅度正常。
所有的提示词都是 AI 生成，没有使用常见视频模型的演示提示词。所有测试都只跑一次。
10/40
@aisolopreneur
10.
11/40
@aisolopreneur
Repost if you found this thread valuable.
Follow me @aisolopreneur for more on how to leverage & profit from AI.
[Quoted tweet]
Yesterday, a Chinese company released an alarmingly advanced text-to-video AI:
Minimax.
It's like a Hollywood studio in your pocket.
10 mind-bending examples (plus how to access it for free):
12/40
@SocDoneLeft
this lightsaber battle is incredibly gay
please make more Frot Wars content, thank you
13/40
@MaxRovensky
Nearly every visual effects artist working today started their career because they wanted to do a lightsaber effect
All of them will tell you in detail how bad these are
14/40
@blackdolphin0
@TweetHelperBot download this
15/40
@Yaz2022742
@TweetHelperBot download this
16/40
@Anni_malik33
This is next-level! Can't believe we're already at text-to-video AI. Excited to see what creative possibilities this unlocks!
"17/40
@imsandraroses
I use those things in my bed but for other things
18/40
@sara69baddie
The Light Sabers need some more work
19/40
@haribhajnmeena
What is this
20/40
@MethadosA
YOU WANNA SWORD FIGHT MAN!?
YOUWANNASWORDFIGHTMANG!?!
21/40
@haribhajnmeena
That's too bad what's in his hands it looks like he's fighting with a sword of light
22/40
@Apikameena
Is this docking
23/40
@saoulidisg
Is this docking?
24/40
@BenjaminDEKR
Uhhhh i'm sorry but this isn't good.
25/40
@shawnchauhan1
Thanks for the recommendation
26/40
@BlakeC
Schwartz
27/40
@iamtexture
They’re “sword fighting”
28/40
@DannysWeb3
Looks like they’re trying to tickle each other w their light sabers
29/40
@CMRidinDerby
Sword fight
30/40
@PDXFato
Not better than Runway
31/40
@AndImOkayWithIt
Mini max lol
@realmadmaxx
32/40
@EisenhartJoshua
I think if any american company used the data this chinese company used to train these, they would be sued within a week, if not the same day.
33/40
@jakebrowne95
Interesting, going to have to try it out.
Are there any other chinese text-to-video models you recommend?
34/40
@shiridesu
are they dikkfighting?
35/40
@paliaskepsi
Better than the last couple Disney efforts.
36/40
@Brongis9163
What’s those sword made of?
laser or gum?? LOOOOL37/40
@michael_kove
Are they fighting or crossing their "swords" in a weird fetish fantasy a niche audience of nerds might have?
38/40
@kakigaijin
if you play with it too long...
39/40
@bitsinabyte
40/40
@IanFenwickTX
Bruh what they doin’ with their lightsabers???
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
1/11
@genmoai
Introducing Mochi 1 preview. A new SOTA in open-source video generation. Apache 2.0.
magnet:?xt=urn:btih:441da1af7a16bcaa4f556964f8028d7113d21cbb&dn=weights&tr=udp://tracker.opentrackr.org:1337/announce
https://video.twimg.com/ext_tw_video/1848745801926795264/pu/vid/avc1/1920x1080/zCXCFAyOnvznHUAf.mp4
2/11
@genmoai
Mochi 1 has superior motion quality, prompt adherence and exceptional rendering of humans that begins to cross the uncanny valley.
Today, we are open-sourcing our base 480p model with an HD version coming soon.
3/11
@genmoai
We're excited to see what you create with Mochi 1. We're also excited to announce our $28.4M Series A from @NEA, @TheHouseVC, @GoldHouseCo, @WndrCoLLC, @parasnis, @amasad, @pirroh and more.
Use Mochi 1 via our playground at our homepage or download the weights freely.
4/11
@jahvascript
can I get a will smith eating spaghetti video?
5/11
@genmoai
6/11
@GozukaraFurkan
Does it have image to video and video to video?
7/11
@genmoai
Good question! Our new model, Mochi, is entirely text to video. On Genmo. The best open video generation models. , if you use the older model (Replay v.0.2), you're able to do image to video as well as text to video.
8/11
@iamhitarth
Keep getting this error message even though I've created an account and signed in
9/11
@genmoai
Hey there, thanks for escalating this! We're taking a closer look right now to see why this is happening
I appreciate your patience and understanding!
10/11
@sairahul1
Where can I try it
11/11
@genmoai
You can find everything you'll need to try Mochi at Genmo. The best open video generation models. 🫶 Happy generating!
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
@genmoai
Introducing Mochi 1 preview. A new SOTA in open-source video generation. Apache 2.0.
magnet:?xt=urn:btih:441da1af7a16bcaa4f556964f8028d7113d21cbb&dn=weights&tr=udp://tracker.opentrackr.org:1337/announce
https://video.twimg.com/ext_tw_video/1848745801926795264/pu/vid/avc1/1920x1080/zCXCFAyOnvznHUAf.mp4
2/11
@genmoai
Mochi 1 has superior motion quality, prompt adherence and exceptional rendering of humans that begins to cross the uncanny valley.
Today, we are open-sourcing our base 480p model with an HD version coming soon.
3/11
@genmoai
We're excited to see what you create with Mochi 1. We're also excited to announce our $28.4M Series A from @NEA, @TheHouseVC, @GoldHouseCo, @WndrCoLLC, @parasnis, @amasad, @pirroh and more.
Use Mochi 1 via our playground at our homepage or download the weights freely.
4/11
@jahvascript
can I get a will smith eating spaghetti video?
5/11
@genmoai
6/11
@GozukaraFurkan
Does it have image to video and video to video?
7/11
@genmoai
Good question! Our new model, Mochi, is entirely text to video. On Genmo. The best open video generation models. , if you use the older model (Replay v.0.2), you're able to do image to video as well as text to video.
8/11
@iamhitarth
Keep getting this error message even though I've created an account and signed in
9/11
@genmoai
Hey there, thanks for escalating this! We're taking a closer look right now to see why this is happening
I appreciate your patience and understanding!10/11
@sairahul1
Where can I try it
11/11
@genmoai
You can find everything you'll need to try Mochi at Genmo. The best open video generation models. 🫶 Happy generating!
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
1/3
@AIWarper
My Mochi 1 test thread. Will post some video examples below if you are interested.
Inference done with FAL
https://video.twimg.com/ext_tw_video/1848834063462993920/pu/vid/avc1/848x480/5De8HKQoKL4cYf6I.mp4
https://video-t-1.twimg.com/ext_tw_...016/pu/vid/avc1/848x480/JJWbnMjCeriVR86A.mp4?
2/3
@AIWarper
A floating being composed of pure, radiant energy, its form shifting between physical and immaterial states. The Lumiscribe’s eyes glow with ancient knowledge, and its translucent wings pulse with golden light. It hovers above the Skyvault, a vast floating city on its homeworld, Zephyra, a world of constant storms and lightning-filled skies. Giant skyborne creatures soar above the city, their bodies crackling with electricity. Below, the landscape is a mix of jagged mountains and stormy seas, illuminated by constant flashes of lightning. The Lumiscribe uses its energy to inscribe symbols of power into the air, controlling the flow of the storms that define their world.
https://video.twimg.com/ext_tw_video/1848835515191332868/pu/vid/avc1/848x480/HjfJWN7l2MzSNEcz.mp4
3/3
@DataPlusEngine
Holy shyt it's so good
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
@AIWarper
My Mochi 1 test thread. Will post some video examples below if you are interested.
Inference done with FAL
https://video.twimg.com/ext_tw_video/1848834063462993920/pu/vid/avc1/848x480/5De8HKQoKL4cYf6I.mp4
https://video-t-1.twimg.com/ext_tw_...016/pu/vid/avc1/848x480/JJWbnMjCeriVR86A.mp4?
2/3
@AIWarper
A floating being composed of pure, radiant energy, its form shifting between physical and immaterial states. The Lumiscribe’s eyes glow with ancient knowledge, and its translucent wings pulse with golden light. It hovers above the Skyvault, a vast floating city on its homeworld, Zephyra, a world of constant storms and lightning-filled skies. Giant skyborne creatures soar above the city, their bodies crackling with electricity. Below, the landscape is a mix of jagged mountains and stormy seas, illuminated by constant flashes of lightning. The Lumiscribe uses its energy to inscribe symbols of power into the air, controlling the flow of the storms that define their world.
https://video.twimg.com/ext_tw_video/1848835515191332868/pu/vid/avc1/848x480/HjfJWN7l2MzSNEcz.mp4
3/3
@DataPlusEngine
Holy shyt it's so good
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
1/1
引用
Mochi 1 represents a significant advancement in open-source video generation, featuring a 10 billion parameter diffusion model built on our novel Asymmetric Diffusion Transformer architecture.
The model requires at least 4 H100 GPUs to run.
genmo/mochi-1-preview · Hugging Face
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
引用
Mochi 1 represents a significant advancement in open-source video generation, featuring a 10 billion parameter diffusion model built on our novel Asymmetric Diffusion Transformer architecture.
The model requires at least 4 H100 GPUs to run.
genmo/mochi-1-preview · Hugging Face
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
1/10
@_akhaliq
Mochi 1 preview
A new SOTA in open-source video generation. Apache 2.0
https://video.twimg.com/ext_tw_video/1848763058291642370/pu/vid/avc1/1280x720/QFGsHnbVyszo5Xgz.mp4
2/10
@_akhaliq
model: genmo/mochi-1-preview · Hugging Face
3/10
@Prashant_1722
Sora has become extremely non moat by now
4/10
@LearnedVector
Ima need more h100s
5/10
@thebuttredettes
Getting only errors on the preview page.
6/10
@noonescente
What is a SOTA?
7/10
@m3ftah
It requires 4 H100 to run!
8/10
@ED84VG
It’s crazy how fast ai video has come.
Does anyone know if it got better because Sora showed it was possible, or would they have gotten this good even if they never showed us?
9/10
@JonathanKorstad
10/10
@_EyesofTruth_
OpenAi getting mogged
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
@_akhaliq
Mochi 1 preview
A new SOTA in open-source video generation. Apache 2.0
https://video.twimg.com/ext_tw_video/1848763058291642370/pu/vid/avc1/1280x720/QFGsHnbVyszo5Xgz.mp4
2/10
@_akhaliq
model: genmo/mochi-1-preview · Hugging Face
3/10
@Prashant_1722
Sora has become extremely non moat by now
4/10
@LearnedVector
Ima need more h100s
5/10
@thebuttredettes
Getting only errors on the preview page.
6/10
@noonescente
What is a SOTA?
7/10
@m3ftah
It requires 4 H100 to run!
8/10
@ED84VG
It’s crazy how fast ai video has come.
Does anyone know if it got better because Sora showed it was possible, or would they have gotten this good even if they never showed us?
9/10
@JonathanKorstad
10/10
@_EyesofTruth_
OpenAi getting mogged
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
Last edited:
