Yall dont understand: Sora is going to be a GAME CHANGER for fan fiction.

bnew

Veteran
Joined
Nov 1, 2015
Messages
54,203
Reputation
8,082
Daps
153,848


1/3
@alexgnewmedia
i2v @pika_labs 1.5. Some of the prompting was completely ignored (like the camera movement), but the main interest (the man charging) was well kept..i like it. Here is the original prompt: "The camera opens with a wide aerial shot using a 24mm lens, sweeping over a massive battlefield. Thousands of armored warriors clash in the valley below, swords clanging and battle cries echoing across the scene. The ground is littered with fallen weapons and shattered shields, and smoke rises from distant fires. In the foreground, a warrior charges running, cinematic, photo real"



https://video.twimg.com/ext_tw_video/1842149636431093760/pu/vid/avc1/1296x720/wO-D40Q7KgQnl1MA.mp4

2/3
@M_Slootmaekers
That looks great! 🤩How would you compare the quality to @Kling_ai ? Do you think it’s better or more along the same lines? 🤔👍🏻



3/3
@alexgnewmedia
I believe it’s still early to say that. I need to do more tests, but it's really nice for what I've been trying so far. In a few days, I think I can give you a better opinion. ;)




To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196



1/1
image2video @pika_labs 1.5




To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196



1/1
Ok, so @pika_labs 1.5 videos are starting to finally generate, so i will start posting some over the next few hours. Need much more testing with prompting, but im getting really nice results. ;) This one is i2v.




To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196





1/2
A few more @pika_labs 1.5 generations. All text2video.



2/2
I will. ;) need a few more data to test it better. ;) great tool, as always.




To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
 

bnew

Veteran
Joined
Nov 1, 2015
Messages
54,203
Reputation
8,082
Daps
153,848

1/1
Ok, at the moment, I have to say that @Kling_ai is the best AI tool I've used in the image-to-video category, especially for action scenes.




To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196



1/1
Time for some action! Check out a few of my latest and greatest generations with @Hailuo_AI Minimax. 🔥 Sound on!




To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
 

bnew

Veteran
Joined
Nov 1, 2015
Messages
54,203
Reputation
8,082
Daps
153,848








1/11
@HBCoop_
🎬Comparing AI video models with text effects:

• Gen-3
• Kling AI 1.5
• Hailuo MiniMax
• Luma Dream Machine

I used a Midjourney image, edited in Photoshop to clean up the visible text as the input.

Each model ran the same prompt at least 3 times, and I chose my favorite results.

I enabled the prompt enhancer on Hailuo and Luma, but I chose Luma's result without the enhanced prompt.

Full workflow below👇



https://video.twimg.com/ext_tw_video/1845926334335238144/pu/vid/avc1/1280x720/Mrvhim2puSd9pSgp.mp4

2/11
@HBCoop_
⭕Prompt:

Fixed camera position, smooth motion push in slowly, amazing fashion advertising video, low angle shot of a young woman with long curly hair pulled up into a long ponytail, blowing to the side in the gentle breeze, wearing an open black zipper jacket with a hood, a black shirt under the jacket, small hoop earrings and aviator glasses with gold rims, in a relaxed pose in front of an airport concourse, text beside her reads "Your style, your way" She turns her head slightly to fix her gaze just offscreen and smiles with a light laugh, 3D VFX, ultra-smooth movement, close details with subtle shadow changes and movement, realistic textures.

This is a result from Kling AI - I liked the movement in the background, but I can't decide which one is my overall favorite:



https://video.twimg.com/ext_tw_video/1845926390954143744/pu/vid/avc1/1280x720/Kf5Qe9NAvRO3_efG.mp4

3/11
@HBCoop_
The original image was great, but I removed the extra text and changed the font to match other images I'm using in a spec ad.

The Midjourney image is first, and Photoshopped version is the second one:



GZ4MUN2WUAAYyVR.jpg

GZ4MU09WoAA8N4G.jpg


4/11
@HBCoop_
I don't know how useful this will be in real-world advertising content, but it is worth experimenting with since these models are capable of animating text and adding text.

This is another Hailuo result that switched from the original text to its own:



https://video.twimg.com/ext_tw_video/1845926491135119360/pu/vid/avc1/1280x720/cC4aC4ZhrFFRYOy4.mp4

5/11
@HBCoop_
Thanks for reading.

If you found this helpful, follow @HBCoop_ for more generative AI visual content tips you can use.

Repost the 1st post below to share this thread:

[Quoted tweet]
🎬Comparing AI video models with text effects:

• Gen-3
• Kling AI 1.5
• Hailuo MiniMax
• Luma Dream Machine

I used a Midjourney image, edited in Photoshop to clean up the visible text as the input.

Each model ran the same prompt at least 3 times, and I chose my favorite results.

I enabled the prompt enhancer on Hailuo and Luma, but I chose Luma's result without the enhanced prompt.

Full workflow below👇


https://video.twimg.com/ext_tw_video/1845926334335238144/pu/vid/avc1/1280x720/Mrvhim2puSd9pSgp.mp4

6/11
@BrentLynch
These are great, I need to be more sparing as I do not have unlimited, but if you want to do strictly animated logo titles, @Hailuo_AI Minimax does @runwayml competitive work with less mercurial content filtering blocks (AI Text still gonna be AI Text so in most cases you will have to try a few times)

/search?q=#promptshare
EPIC CINEMATIC MOVIE TITLE LOGO WITH BOLD DISTINCT BLACK CAT FURRY TEXT ON WHITE BACKGROUND THT SAYS "TOOTSIE TRANSFORMS" that TRANSFORMS INTO A CUTE PHOTO-REALISTIC BLACK CAT WITH PALE GREEN EYES



https://video.twimg.com/ext_tw_video/1845936028705861632/pu/vid/avc1/1280x720/gId-Ukrzj-fGHCjX.mp4

7/11
@HBCoop_
This is very interesting. I am not looking to do title animations, but I wanted to see if it was possible to maintain copy text for an ad that I could animate - next I'll try with a brand logo and font, but that gets tricky.

Why did you use all caps?



8/11
@ashok_hey
Which model did you like the best for these specific results?



9/11
@HBCoop_
I can't decide! They all had interesting results and I could use any of them.



10/11
@laf131
ha i did the same thing after you posted the first one!!



11/11
@HBCoop_
What did you think of your results?




To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
 

bnew

Veteran
Joined
Nov 1, 2015
Messages
54,203
Reputation
8,082
Daps
153,848

1/9
@Xianbao_QIAN
Open Sora Plan has released the 1.3 version of their video generation model.

Open-Sora-Plan/docs/Report-v1.3.0.md at main · PKU-YuanGroup/Open-Sora-Plan

Love this /search?q=#BlackMythWukong story illustrated by AI!



2/9
@DataPlusEngine
it's honestly shocking the level of quality and professionalism they display considering this is an open source project. amazing work!



3/9
@ai_for_success
Damn this is 🔥



4/9
@MrForExample
Awesome🔥🔥🔥
The spirit of resisting authority is somewhat outstanding
Which is why, I'm not sure if this video will be allowed inside China's internet🙈🙉🙊



5/9
@1littlecoder
This is insane!



6/9
@Prashant_1722
This is more than real, Hollywood level.



7/9
@jg_community
Incredible what can be done with AI-generated art. Jul i've played this game 'Black Myth Wukong' myself and I'm loving how these illustrations bring the story to life.



8/9
@BeLikeS4M
This is so cool🔥



9/9
@DavideSpagocci
any website ready already for use it easy?




To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
 

bnew

Veteran
Joined
Nov 1, 2015
Messages
54,203
Reputation
8,082
Daps
153,848











1/12
@minchoi
HeyGen just dropped Avatar 3.0 with Unlimited Looks.

Now anyone can clone themselves with AI and unlock multiple poses, outfits, and camera angles.

Here's how:



https://video.twimg.com/ext_tw_video/1843391162154909696/pu/vid/avc1/1280x720/vjOC27CxtaYlcsNT.mp4

2/12
@minchoi
1/ Create your Avatar

- Go to HeyGen
- Click on Avatars then Create Avatar
- Follow the given step by step instructions

It's very important to follow the instructions on making a good video of yourself



https://video.twimg.com/ext_tw_video/1843391974348369920/pu/vid/avc1/1402x720/u1ApPmZvnF9nKIKv.mp4

3/12
@minchoi
2/ Create your Video

- Click Create Video
- Click Avatar Video
- Choose video orientation
- Select your Avatar (you can add more Scenes for different Looks)
- Add/Generate your script
- Then Click Submit



https://video.twimg.com/ext_tw_video/1843392144632889344/pu/vid/avc1/1402x720/xFXBfdxUpFtB66hu.mp4

4/12
@minchoi
3/ Wait for your Video to be generated

- Depending on the length of your video, it will take several minutes to process
- And you are done ✅



https://video.twimg.com/ext_tw_video/1843392877172281344/pu/vid/avc1/1402x720/knyVqqheSTn9iaVk.mp4

5/12
@minchoi
Official video from @HeyGen_Official & @joshua_xu_

Unlock Unlimited looks, unlimited creativity at HeyGen - AI Video Generator



https://video.twimg.com/ext_tw_video/1841433281515892737/pu/vid/avc1/1920x1080/mzMZa8aPOgAp1Pm9.mp4

6/12
@minchoi
If you enjoyed this thread,

Follow me @minchoi and please Bookmark, Like, Comment & Repost the first Post below to share with your friends:

[Quoted tweet]
HeyGen just dropped Avatar 3.0 with Unlimited Looks.

Now anyone can clone themselves with AI and unlock multiple poses, outfits, and camera angles.

Here's how:


https://video.twimg.com/ext_tw_video/1843391162154909696/pu/vid/avc1/1280x720/vjOC27CxtaYlcsNT.mp4

7/12
@KanikaBK
Woah, awesome



8/12
@minchoi
Awesome indeed



9/12
@adolfoasorlin
This is amazing dude 😚😳



10/12
@minchoi
Lip syncing on HeyGen is another level



11/12
@mhdfaran
With all these unlimited looks and poses, I bet social media influencers are already gearing up to flood our feeds with even more content.



12/12
@minchoi
Genuine human content will become more important than ever




To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
 

bnew

Veteran
Joined
Nov 1, 2015
Messages
54,203
Reputation
8,082
Daps
153,848






1/11
@genmoai
Introducing Mochi 1 preview. A new SOTA in open-source video generation. Apache 2.0.

magnet:?xt=urn:btih:441da1af7a16bcaa4f556964f8028d7113d21cbb&dn=weights&tr=udp://tracker.opentrackr.org:1337/announce



https://video.twimg.com/ext_tw_video/1848745801926795264/pu/vid/avc1/1920x1080/zCXCFAyOnvznHUAf.mp4

2/11
@genmoai
Mochi 1 has superior motion quality, prompt adherence and exceptional rendering of humans that begins to cross the uncanny valley.

Today, we are open-sourcing our base 480p model with an HD version coming soon.



GagSEjMW0AAQ-ff.jpg

GagSFdDWIAAHKSa.jpg


3/11
@genmoai
We're excited to see what you create with Mochi 1. We're also excited to announce our $28.4M Series A from @NEA, @TheHouseVC, @GoldHouseCo, @WndrCoLLC, @parasnis, @amasad, @pirroh and more.

Use Mochi 1 via our playground at our homepage or download the weights freely.



4/11
@jahvascript
can I get a will smith eating spaghetti video?



5/11
@genmoai




6/11
@GozukaraFurkan
Does it have image to video and video to video?



7/11
@genmoai
Good question! Our new model, Mochi, is entirely text to video. On Genmo. The best open video generation models. , if you use the older model (Replay v.0.2), you're able to do image to video as well as text to video.



8/11
@iamhitarth
Keep getting this error message even though I've created an account and signed in 🤔



GaguaHHa0AA-5yl.png


9/11
@genmoai
Hey there, thanks for escalating this! We're taking a closer look right now to see why this is happening 👀 I appreciate your patience and understanding!



10/11
@sairahul1
Where can I try it



11/11
@genmoai
You can find everything you'll need to try Mochi at Genmo. The best open video generation models. 🫶 Happy generating!




To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196



1/3
@AIWarper
My Mochi 1 test thread. Will post some video examples below if you are interested.

Inference done with FAL



https://video.twimg.com/ext_tw_video/1848834063462993920/pu/vid/avc1/848x480/5De8HKQoKL4cYf6I.mp4

2/3
@AIWarper
A floating being composed of pure, radiant energy, its form shifting between physical and immaterial states. The Lumiscribe’s eyes glow with ancient knowledge, and its translucent wings pulse with golden light. It hovers above the Skyvault, a vast floating city on its homeworld, Zephyra, a world of constant storms and lightning-filled skies. Giant skyborne creatures soar above the city, their bodies crackling with electricity. Below, the landscape is a mix of jagged mountains and stormy seas, illuminated by constant flashes of lightning. The Lumiscribe uses its energy to inscribe symbols of power into the air, controlling the flow of the storms that define their world.



https://video.twimg.com/ext_tw_video/1848835515191332868/pu/vid/avc1/848x480/HjfJWN7l2MzSNEcz.mp4

3/3
@DataPlusEngine
Holy shyt it's so good




To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196



1/1
引用
Mochi 1 represents a significant advancement in open-source video generation, featuring a 10 billion parameter diffusion model built on our novel Asymmetric Diffusion Transformer architecture.

The model requires at least 4 H100 GPUs to run.
genmo/mochi-1-preview · Hugging Face




To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196



1/10
@_akhaliq
Mochi 1 preview

A new SOTA in open-source video generation. Apache 2.0



https://video.twimg.com/ext_tw_video/1848763058291642370/pu/vid/avc1/1280x720/QFGsHnbVyszo5Xgz.mp4

2/10
@_akhaliq
model: genmo/mochi-1-preview · Hugging Face



3/10
@Prashant_1722
Sora has become extremely non moat by now



4/10
@LearnedVector
Ima need more h100s



5/10
@thebuttredettes
Getting only errors on the preview page.



6/10
@noonescente
What is a SOTA?



7/10
@m3ftah
It requires 4 H100 to run!



8/10
@ED84VG
It’s crazy how fast ai video has come.

Does anyone know if it got better because Sora showed it was possible, or would they have gotten this good even if they never showed us?



9/10
@JonathanKorstad
🔥



10/10
@_EyesofTruth_
OpenAi getting mogged




To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196

 

bnew

Veteran
Joined
Nov 1, 2015
Messages
54,203
Reputation
8,082
Daps
153,848






1/11
@runwayml
Introducing, Act-One. A new way to generate expressive character performances inside Gen-3 Alpha using a single driving video and character image. No motion capture or rigging required.

Learn more about Act-One below.

(1/7)



https://video-t-2.twimg.com/ext_tw_...248/pu/vid/avc1/1280x720/2EyYj6GjSpT_loQf.mp4

2/11
@runwayml
Act-One allows you to faithfully capture the essence of an actor's performance and transpose it to your generation. Where traditional pipelines for facial animation involve complex, multi-step workflows, Act-One works with a single driving video that can be shot on something as simple as a cell phone.

(2/7)



https://video-t-2.twimg.com/ext_tw_...282/pu/vid/avc1/1280x720/Qie29gOWU42zMaGo.mp4

3/11
@runwayml
Without the need for motion-capture or character rigging, Act-One is able to translate the performance from a single input video across countless different character designs and in many different styles.

(3/7)



https://video-t-2.twimg.com/ext_tw_...696/pu/vid/avc1/1280x720/TcWzpRl3kMfHM4ro.mp4

4/11
@runwayml
One of the models strengths is producing cinematic and realistic outputs across a robust number of camera angles and focal lengths. Allowing you generate emotional performances with previously impossible character depth opening new avenues for creative expression.

(4/7)



https://video-t-2.twimg.com/ext_tw_...424/pu/vid/avc1/1280x720/3fupOI32Ck6ITIiE.mp4

5/11
@runwayml
A single video of an actor is used to animate a generated character.

(5/7)



https://video-t-2.twimg.com/ext_tw_...016/pu/vid/avc1/1280x720/Fh7WanCgSTR_ffHF.mp4

6/11
@runwayml
With Act-One, eye-lines, micro expressions, pacing and delivery are all faithfully represented in the final generated output.

(6/7)



https://video-t-2.twimg.com/ext_tw_...528/pu/vid/avc1/1280x720/ywweYvzLHe-3GO2B.mp4

7/11
@runwayml
Access to Act-One will begin gradually rolling out to users today and will soon be available to everyone.

To learn more, visit Runway Research | Introducing Act-One

(7/7)



8/11
@xushanpao310
@threadreaderapp Unroll



9/11
@threadreaderapp
@xushanpao310 Salam, please find the unroll here: Thread by @runwayml on Thread Reader App See you soon. 🤖



10/11
@threadreaderapp
Your thread is gaining traction! /search?q=#TopUnroll Thread by @runwayml on Thread Reader App 🙏🏼@TheReal_Ingrid_ for 🥇unroll



11/11
@flowersslop
motion capture industry is cooked




To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
 

bnew

Veteran
Joined
Nov 1, 2015
Messages
54,203
Reputation
8,082
Daps
153,848




1/11
@AIWarper
This is so cool.

This edit was done all inside of ComfyUI! The cuts were done based on a BPM analyzer and the videos were generated with Runway API nodes

So so so clever



https://video.twimg.com/ext_tw_video/1846198127650394112/pu/vid/avc1/1800x1080/PpRNofDRMsYsWgWU.mp4

2/11
@SweetBeanDazz
Yo Warper, check out this one

[Quoted tweet]
Almost 3 months of prompting with MidJourney and Kling, I can finally present the opening theme for Red Bean Adventure! ⛩️

Who do you see in the video? Help me tag them in the comments to let them know the video is here 🫰

I'll start with @BobuBeanFarmer

@Azuki @BEANZOfficial

1 / 3


https://video.twimg.com/ext_tw_video/1846569341946585088/pu/vid/avc1/1920x1080/-Qxm5ZSfa7Y0U5y6.mp4

3/11
@AIWarper
Also very well done. So much cool stuff coming out of the community.



4/11
@bdmarotta
In college, I had an idea for something that edited to BPM. Every film prof told me it would be too expensive to make. Now, it seems like it exists. Where can I get it?



5/11
@AIWarper
You’d have to ask @OdinLovis



6/11
@OdinLovis
Thanks you so much bro !!



7/11
@AIWarper
Fire work! Love it



8/11
@scorecesse
Love daft punk!



9/11
@Tom_Laroc
@abcdjabcdjabcdj



10/11
@guicastellanos1
This is incredible, I want to start to learn ComfyUI



11/11
@defithenorm
@NeetChick




To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
 

bnew

Veteran
Joined
Nov 1, 2015
Messages
54,203
Reputation
8,082
Daps
153,848

1/2
@carlfranzen
New /search?q=#AIvideo model just dropped: Mochi 1 from @genmoai — and it claims higher performance on motion and prompt adherence than leading proprietary rivals!

It's also ✨OPEN SOURCE✨ under Apache 2.0. Only 480p but still really impressive imo...

AI video startup Genmo launches Mochi 1, an open source rival to Runway, Kling, and others



https://video-ft.twimg.com/ext_tw_v...160/pu/vid/avc1/1280x720/a5TaV-PxQRNBI-Nd.mp4

https://video-ft.twimg.com/ext_tw_v...680/pu/vid/avc1/1280x720/26TdwdF2YX18tD21.mp4

https://video-ft.twimg.com/ext_tw_v...432/pu/vid/avc1/1280x720/Vl5X1IyamBbWxVbU.mp4

https://video-ft.twimg.com/ext_tw_v...048/pu/vid/avc1/1280x720/Bqdqq8nW3XwEuwnH.mp4

2/2
@_parasj
Thank you for the coverage! The playground and weights are now live finally

[Quoted tweet]
Introducing Mochi 1 preview. A new SOTA in open-source video generation. Apache 2.0.

magnet:?xt=urn:btih:441da1af7a16bcaa4f556964f8028d7113d21cbb&dn=weights&tr=udp://tracker.opentrackr.org:1337/announce


https://video.twimg.com/ext_tw_video/1848745801926795264/pu/vid/avc1/1920x1080/zCXCFAyOnvznHUAf.mp4


To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
 
Top