Meta’s new AI image generator was trained on 1.1 billion Instagram and Facebook photos

[bnew]

Meta’s new AI image generator was trained on 1.1 billion Instagram and Facebook photos

“Imagine with Meta AI” turns prompts into images, trained using public Facebook data.

arstechnica.com

Meta’s new AI image generator was trained on 1.1 billion Instagram and Facebook photos​

"Imagine with Meta AI" turns prompts into images, trained using public Facebook data.​

BENJ EDWARDS - 12/6/2023, 4:52 PM

Enlarge / Three images generated by "Imagine with Meta AI" using the Emu AI model.

Meta | Benj Edwards

101​

On Wednesday, Meta released a free standalone AI image-generator website, "Imagine with Meta AI," based on its Emu image-synthesis model. Meta used 1.1 billion publicly visible Facebook and Instagram images to train the AI model, which can render a novel image from a written prompt. Previously, Meta's version of this technology—using the same data—was only available in messaging and social networking apps such as Instagram.

FURTHER READING​

Users find that Facebook’s new AI stickers can generate Elmo with a knife

If you're on Facebook or Instagram, it's quite possible a picture of you (or that you took) helped train Emu. In a way, the old saying, "If you're not paying for it, you are the product" has taken on a whole new meaning. Although, as of 2016, Instagram users uploaded over 95 million photos a day, so the dataset Meta used to train its AI model was a small subset of its overall photo library.

Since Meta says it only uses publicly available photos for training, setting your photos private on Instagram or Facebook should prevent their inclusion in the company's future AI model training (unless it changes that policy, of course).

Imagine with Meta AI​

Previous SlideNext Slide

Spoiler: IMAGES

• ​
  AI-generated images of "a muscular barbarian with weapons beside a CRT television set, cinematic, 8K, studio lighting" created by Meta Emu on the "Imagine with Meta AI" website.
  Meta | Benj Edwards
  
• ​
  AI-generated images of "a cat in a car holding a can of beer" created by Meta Emu on the "Imagine with Meta AI" website.
  Meta | Benj Edwards
• ​
  AI-generated images of "a flaming cheeseburger" created by Meta Emu on the "Imagine with Meta AI" website.
  Meta | Benj Edwards
• ​
  AI-generated images of "a photorealistic Mickey Mouse on the moon in a spacesuit" created by Meta Emu on the "Imagine with Meta AI" website.
  Meta | Benj Edwards
• ​
  AI-generated images of "a handsome man" created by Meta Emu on the "Imagine with Meta AI" website.
  Meta | Benj Edwards
• ​
  AI-generated images of "the ultimate gaming PC with 1,000 RGB lights" created by Meta Emu on the "Imagine with Meta AI" website.
  Meta | Benj Edwards
• ​
  AI-generated images of "a man holding a sign that says 'Ars Technica'" created by Meta Emu on the "Imagine with Meta AI" website.
  Meta | Benj Edwards
• ​
  AI-generated images of a complex prompt involving Christmas stockings and a cave created by Meta Emu on the "Imagine with Meta AI" website.
  Meta | Benj Edwards
• ​
  AI-generated images of "photorealistic vintage computer collector nerd in a computer lab, bright psychedelic technicolor swirls" created by Meta Emu on the "Imagine with Meta AI" website.
  Meta | Benj Edwards
• ​
  AI-generated images of "an embroidered Santa Claus" created by Meta Emu on the "Imagine with Meta AI" website.
  Meta | Benj Edwards
• ​
  AI-generated images of "A teddy bear on a skateboard" created by Meta Emu on the "Imagine with Meta AI" website.
  Meta | Benj Edwards
• ​
  AI-generated images of "a beautiful queen of the universe" created by Meta Emu on the "Imagine with Meta AI" website.
  Meta | Benj Edwards[/LEFT]
  

 

[bnew]

Similar to Stable Diffusion, DALL-E 3, and Midjourney, Imagine with Meta AI generates new images based on what the AI model "knows" about visual concepts learned from the training data. Creating images using the new website requires a Meta account, which can be imported from an existing Facebook or Instagram account. Each generation creates four 1280×1280 pixel images that can be saved in JPEG format. Images include a small "Imagined with AI" watermark logo in the lower left-hand corner.

"We’ve enjoyed hearing from people about how they’re using imagine, Meta AI’s text-to-image generation feature, to make fun and creative content in chats," Meta says in its news release. "Today, we’re expanding access to imagine outside of chats, making it available in the US to start at imagine.meta.com. This standalone experience for creative hobbyists lets you create images with technology from Emu, our image foundation model."

FURTHER READING​

Stable Diffusion XL Turbo can generate AI images as fast as you can type

We put Meta's new AI image generator through a battery of low-stakes informal tests using our "Barbarian with a CRT" and "Cat with a beer" image-synthesis protocol and found aesthetically novel results, as you can see above. (As an aside, when generating images of people with Emu, we noticed many looked like typical Instagram fashion posts.)

We also tried our hand at adversarial testing. The generator appears to filter out most violence, curse words, sexual topics, and the names of celebrities and historical figures (no Abraham Lincoln, sadly), but it allows commercial characters like Elmo (yes, even "with a knife") and Mickey Mouse (though not with a machine gun).

Meta's model generally creates photorealistic images well, but not as well as Midjourney. It can handle complex prompts better than Stable Diffusion XL, but perhaps not as well as DALL-E 3. It doesn't seem to do text rendering well at all, and it handles different media outputs like watercolors, embroidery, and pen-and-ink with mixed results. Its images of people seem to include diversity in ethnic backgrounds. Overall, it seems about average these days in terms of AI image synthesis.

Facebook and Instagram made this possible​

Enlarge / An AI-generated image of a "psychedelic emu" created on the "Imagine with Meta AI" website.
Meta | Benj Edwards

So, what do we know about Emu, the AI model behind Meta's new AI image-generation features? Based on a research paper released by Meta in September, Emu gets its ability to generate high-quality images through a process called "quality-tuning." Unlike traditional text-to-image models trained with large numbers of image-text pairs, Emu focuses on "aesthetic alignment" after pre-training, using a set of relatively small but visually appealing images.

At Emu's heart, however, is the aforementioned massive pre-training dataset of 1.1 billion text-image pairs pulled from Facebook and Instagram. In the Emu research paper, Meta does not specify where that training data came from, but reports from Meta Connect 2023 conference cite Meta President of Global Affairs Nick Clegg confirming that they were using social media posts as training data for AI models, including images fed into Emu.

It's a change in approach over other AI companies since Meta has access to so much image and caption data from its services. Other image-synthesis models use images that have been illicitly scraped from the Internet, licensed from commercial stock image libraries, or a combination of both.

Interestingly, Meta's research paper on Emu is the first paper on a major image-synthesis model we've seen that doesn't disclaim the potential for the model to create reality-warping disinformation or potentially harmful content. That feels like a reflection of the general acceptance (or resignation) of the reality of AI image synthesis models, which are now becoming far more commonplace. Whether that's a good thing or not is an open question.

Still, Meta seems to be handling issues of potential harmful outputs with filters, a proposed watermarking system that isn't operational yet ("In the coming weeks, we’ll add invisible watermarking to the imagine with Meta AI experience for increased transparency and traceability," the company says), and a small disclaimer at the bottom of the website: "Images are and may be inaccurate or inappropriate."

The images might not be accurate (do cats drink beer?), and they might not even be ethical in the eyes of the unnamed authors of the 1.1 billion images used to train the model. But dare we say it: Generating them can be fun. Of course, depending on your disposition and how you view the pace of AI image synthesis, that fun may be balanced out by an equal level of concern.

 

[skylove4]

In before posters come here with pitch forks about their photos being used. Even after they agreed to the terms and conditions of these free social media sites

 

[Majestyx]

You were your own demise

 

[At30wecashout]

In before posters come here with pitch forks about their photos being used. Even after they agreed to the terms and conditions of these free social media sites

This. Much like people screaming about their privacy and....sharing everything they do and think on Instagram and Facebook while downloading hella data mining apps.

 

[Neo. The Only. The One.]

I mean duh. The value of FB and every other social media site has always been the vast amounts of data about us that they have. We are literally the commodity.

 

[the bossman]

When the product is free to use then you are the product

 

[froggle]

When the product is free to use then you are the product

what does that mean for the coli?

 

[null]

what does that mean for the coli?

too late ...

 

[Morethan1]

In before posters come here with pitch forks about their photos being used. Even after they agreed to the terms and conditions of these free social media sites

They post on The Coli as 8f this place is secured

 

[010101]

..........*

 

[Hersh]

where the link to use?

 

[DEAD7]

When the product is free to use then you are the product

 

[bnew]

https://archive.is/W3YZU

Spoiler: larger images

Spoiler: mirror

https://archive.is/VrDjB

 

[badboys11]

This article barely scratches the surface of what's about to happen. There are articles online that go in depth.

That nude simulator where u show AI a picture and it produces a nude photo?

Soon u will be able to scan someone's face book photo, upload a clip of their voice, and a 3d model of said person is now uploaded into the meta verse, and you'll be to interact with them on any way unlike. Including sex.

The senses of touch and smell will be integrated into the meta quests of the 2030s, and basically you be able to take any person in the world and treat them anyway u like in your own personal world. There's a debate going on right now about the impacts this will have on both schools and the workplace, can u really respect your boss after she was your sex slave last night?

Also, who copyrights the images or is anybody across the world who ever existed now up for grabs?

We in the Nintendo/Sega master system era of virtual reality, just wait til u see what they got lined up for the Xbox 360 era