Earlier in the year, I said you'd be able to make short animated movies via A.I. by the end of 2023. Well??
- Thread starter Micky Mikey
- Start date
‘Slow Horses’ & ‘One Life’ Director Predicts A Show Made Entirely By Generative AI Is Only Three-To-Five Years Away
'Slow Horses' director James Hawes has talked Apple TV+ hit and generative AI.
deadline.com
‘Slow Horses’ & ‘One Life’ Director Predicts A Show Made Entirely By Generative AI Is Only Three-To-Five Years Away
By Max Goldbart
Max Goldbart
International TV Co-Editor@Goldbart1
More Stories By Max
- ITV Seeks Post Office Drama Successor With Series On Devastating Contaminated Blood Scandal Penned By Peter Moffat
- Police Drop Investigation Into Suspended GB News Anchor Dan Wootton
- The London TV Screenings Hot List: What Buyers Need To Know About The Distributors Selling ‘Wolf Hall’, Jenna Coleman & Elizabeth Taylor Shows
February 21, 2024 3:05am
Slow Horses Apple+
A TV series made entirely by generative AI is only three-to-five years away, according to the director of hits including Slow Horses and Anthony Hopkins movie One Life.
James Hawes spoke with legal teams at SAG-AFTRA and the WGA and undertook a poll with fellow directors and VFX workers after the BBC canceled long-running drama Doctors, in which he probed the likelihood of a fully AI series, he revealed today.
“The best guess was three to five years,” he told the British Film & High-End TV Inquiry. “Someone will say, ‘Create a scene in an ER room where a doctor comes in and he’s having an affair with a woman and they’re flirting, and someone is dying on the table,’ and [AI] will start to create it. Maybe it won’t be as polished as we are used to but that is how close we are getting.”
Hawes, who is also vice chair of Directors UK, raised concerns that shows with AI so central to their creation will have an impact on “vital training grounds” for below-the-line staffers making their way through the industry, citing Doctors.
He simultaneously acknowledged the “genie is out the bottle” on AI and the UK should work to catch up with the likes of the U.S., as he pointed to the launch of Open AI’s Sora program last week, which can generate scenes digitally.
“My worry is that if we don’t get up to speed with this then the AI-generated stories will come from elsewhere,” he added. “We need to take note and act on it now. Silicon Valley is way ahead.”
The U.S. writers and actors guilds were able to secure guardrails surrounding use of AI in their contracts with the AMPTP following lengthy and messy negotiations last year, and Hawes said the U.S. DGA is sitting down with members and studios to discuss this every few months. In the UK, artificial intelligence is set to play a major role in the actor’s unions upcoming negotiations with broadcasters and producers.
Hawes urged British stakeholders across the board to be cognisant of the debate. Prior to the inquiry hearing, he joked that he had asked ChatGPT to come up with the questions he would be asked, and it had been “very accurate.”
Hawes stressed that there is no replacement for the spontaneity of non-AI production and cited an example of Anthony Hopkins playing a piano on the set of One Life, which was introduced into the scene after wowing those working on the show.
‘Slow Horses’ deemed “too quirky”
James Hawes. Image: Maria Moratti/Getty Images
During a wide-ranging session, Hawes also revealed that Slow Horses was rejected by some British broadcasters and was initially deemed “too quirky and British” for Apple TV+.
“They wondered whether it would travel even though we have the spy genre reputation [in the UK],” he added. “The attachment of Gary Oldman and subsequent success shows ‘quirky British’ can travel and it is now the longest running series on Apple.”
Speaking to the decline in the indie movie and TV sector, he echoed comments made earlier this week by Bectu boss Philippa Childs that the UK has become too reliant on inward investment.
“There are downsides [to inward investment] because it has inflated costs and therefore domestic production is finding it hard to compete for the best practitioners,” he added. “It’s been very busy out there, although not right now. That has given North America confidence in what we are doing.”
Having made the transition from high-end TV to movies, Hawes also said there is no longer a “sniffiness” from film execs towards TV directors.
The inquiry is spotlighting the state of British film and high-end TV, which is being overseen by the UK’s Culture, Media & Sport Committee, examining issues such as financing, tax credits and diversity.
Last month, Bend it Like Beckham director Gurinder Chadha revealed to the inquiry she is making a Christmas movie about an Indian Ebenezer Scrooge set in London, financed by Zygi Kamasa’s new UK distributor True Brit.
Later today, Ken Loach indie boss Rebecca O’Brien and the heads of Film4 and BBC Film will appear.
Whenever they're ready
Lemme stop playing and see what's goin on in that Sora thread
Json
Superstar
This reminds me of when I was interested in being a comic artist and doing a portfolios.
The main thing was professionals don’t care about splash pages and action scenes. 90 percent of art is just people sitting in rooms talking.
All these videos just look like tech guys trying to impress each other. The actual images mostly are kinda hollow
The main thing was professionals don’t care about splash pages and action scenes. 90 percent of art is just people sitting in rooms talking.
All these videos just look like tech guys trying to impress each other. The actual images mostly are kinda hollow
EMO
EMO: Emote Portrait Alive - Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditions
humanaigc.github.io
EMO: Emote Portrait Alive - Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditions
Linrui Tian, Qi Wang, Bang Zhang, Liefeng Bo
Institute for Intelligent Computing, Alibaba Group
GitHub arXiv
Institute for Intelligent Computing, Alibaba Group
GitHub arXiv
Character: Audrey Kathleen Hepburn-Ruston
Vocal Source: Ed Sheeran - Perfect. Covered by Samantha Harvey
Character: AI Lady from SORA
Vocal Source: Where We Go From Here with OpenAI's Mira Murati
Vocal Source: Ed Sheeran - Perfect. Covered by Samantha Harvey
Character: AI Lady from SORA
Vocal Source: Where We Go From Here with OpenAI's Mira Murati
Abstract
We proposed EMO, an expressive audio-driven portrait-video generation framework. Input a single reference image and the vocal audio, e.g. talking and singing, our method can generate vocal avatar videos with expressive facial expressions, and various head poses, meanwhile, we can generate videos with any duration depending on the length of input video.
Method
Overview of the proposed method. Our framework is mainly constituted with two stages. In the initial stage, termed Frames Encoding, the ReferenceNet is deployed to extract features from the reference image and motion frames. Subsequently, during the Diffusion Process stage, a pretrained audio encoder processes the audio embedding. The facial region mask is integrated with multi-frame noise to govern the generation of facial imagery. This is followed by the employment of the Backbone Network to facilitate the denoising operation. Within the Backbone Network, two forms of attention mechanisms are applied: Reference-Attention and Audio-Attention. These mechanisms are essential for preserving the character's identity and modulating the character's movements, respectively. Additionally, Temporal Modules are utilized to manipulate the temporal dimension, and adjust the velocity of motion.
Various Generated Videos
Singing
Make Portrait Sing
Input a single character image and a vocal audio, such as singing, our method can generate vocal avatar videos with expressive facial expressions, and various head poses, meanwhile, we can generate videos with any duration depending on the length of input audio. Our method can also persist the characters' identifies in a long duration.
Character: AI Mona Lisa generated by dreamshaper XL
Vocal Source: Miley Cyrus - Flowers. Covered by YUQI
Character: AI Lady from SORA
Vocal Source: Dua Lipa - Don't Start Now
Different Language & Portrait Style
Our method supports songs in various languages and brings diverse portrait styles to life. It intuitively recognizes tonal variations in the audio, enabling the generation of dynamic, expression-rich avatars.
Character: AI Girl generated by ChilloutMix
Vocal Source: David Tao - Melody. Covered by NINGNING (mandarin)
Character: AI Ymir from AnyLora & Ymir Fritz Adult
Vocal Source: 『衝撃』Music Video【TVアニメ「進撃の巨人」The Final Season エンディングテーマ曲】 (Japanese)
Character: Leslie Cheung Kwok Wing
Vocal Source: Eason Chan - Unconditional. Covered by AI (Cantonese)
Character: AI girl generated by WildCardX-XL-Fusion
Vocal Source: JENNIE - SOLO. Cover by Aiana (Korean)
Rapid Rhythm
The driven avatar can keep up with fast-paced rhythms, guaranteeing that even the swiftest lyrics are synchronized with expressive and dynamic character animations.
Character: Leonardo Wilhelm DiCaprio
Vocal Source: EMINEM - GODZILLA (FT. JUICE WRLD) COVER
Character: KUN KUN
Vocal Source: Eminem - Rap God
Talking
Talking With Different Characters
Our approach is not limited to processing audio inputs from singing, it can also accommodate spoken audio in various languages. Additionally, our method has the capability to animate portraits from bygone eras, paintings, and both 3D models and AI generated content, infusing them with lifelike motion and realism.
Character: Audrey Kathleen Hepburn-Ruston
Vocal Source: Interview Clip
Character: AI Chloe: Detroit Become Human
Vocal Source: Interview Clip
Character: Mona Lisa
Vocal Source: Shakespeare's Monologue II As You Like It: Rosalind "Yes, one; and in this manner."
Character: AI Ymir from AnyLora & Ymir Fritz Adult
Vocal Source: NieR: Automata
Cross-Actor Performance
Explore the potential applications of our method, which enables the portraits of movie characters delivering monologues or performances in different languages and styles. we can expanding the possibilities of character portrayal in multilingual and multicultural contexts.
Character: Joaquin Rafael Phoenix - The Jocker - 《Jocker 2019》
Vocal Source: 《The Dark Knight》 2008
Character: SongWen Zhang - QiQiang Gao - 《The Knockout》
Vocal Source: Online courses for legal exams
Character: AI girl generated by xxmix_9realisticSDXL
Vocal Source: Videos published by itsjuli4.
Last edited:
1/7
The next generation of visual storytelling is here.
Join the waitlist at AI Powered Filmmaking | LTX Studio
2/7
The next generation of visual storytelling is here.
Join the waitlist at AI Powered Filmmaking | LTX Studio
3/7
Of course.
4/7
We license closed models, use open ones, and train our own in order to build the best products we can. Given no single provider currently offers all needed models for story creation—stories, visuals, sounds, dialogue, music—we enhance our in-house training. We also release models…
5/7
That’s right
6/7
Join the waitlist!
7/7
For early access, be sure to join our waitlist
The next generation of visual storytelling is here.
Join the waitlist at AI Powered Filmmaking | LTX Studio
2/7
The next generation of visual storytelling is here.
Join the waitlist at AI Powered Filmmaking | LTX Studio
3/7
Of course.
4/7
We license closed models, use open ones, and train our own in order to build the best products we can. Given no single provider currently offers all needed models for story creation—stories, visuals, sounds, dialogue, music—we enhance our in-house training. We also release models…
5/7
That’s right
6/7
Join the waitlist!
7/7
For early access, be sure to join our waitlist
when videos with the quality of these A.I generated images start to move. it's gonna get crazy. 
1/1
Space family...
#Elements #Cybertech
@LeonardoAi_
Space family...
#Elements #Cybertech
@LeonardoAi_
1/1
Bald man with electrodes in his brain...
#Elements #Cybertech
@LeonardoAi_
Bald man with electrodes in his brain...
#Elements #Cybertech
@LeonardoAi_
1/2
Superman in Paris
#elements #glasscore
@leonardoai_
2/2
Ideogram is the only ai image generator that was able to create an image of three monkeys representing the proverb "see no evil, hear no evil, speak no evil". The consistency is worse, but the ability to accurately represent the prompt is excellent @ideogram_ai
Superman in Paris
#elements #glasscore
@leonardoai_
2/2
Ideogram is the only ai image generator that was able to create an image of three monkeys representing the proverb "see no evil, hear no evil, speak no evil". The consistency is worse, but the ability to accurately represent the prompt is excellent @ideogram_ai
