LAION
LAION
Main page
2505511

LAION

logo
Community Hub0 subscribers
What are your thoughts?
Be the first to start a discussion here.
Be the first to start a discussion here.
LAION

LAION (acronym for Large-scale Artificial Intelligence Open Network) is a German non-profit organization which makes open-sourced artificial intelligence models and datasets. It is best known for releasing a number of large datasets of images and captions scraped from the web which have been used to train a number of high-profile text-to-image models, including Stable Diffusion and Imagen.

In February 2023, LAION was named in the Getty Images lawsuit against Stable Diffusion as a non-party. In April 2023, LAION was directly sued by a German photographer who wanted to have his images removed from the training set. In September 2024, the Regional Court of Hamburg dismissed the lawsuit, in what was described as a "landmark ruling on TDM [Text and data mining] exceptions for AI training data" in Germany and the EU more generally.

On April 15, 2023, LAION and contributors publicly released an open source AI assistant chatbot called OpenAssistant.

LAION has publicly released a number of large datasets of image-caption pairs which have been widely used by AI researchers.[citation needed] The data is derived from the Common Crawl, a dataset of scraped web pages. The developers searched the crawled html for <img> tags and treated their alt attributes as captions. They used CLIP to identify and discard images whose content did not appear to match their captions. LAION does not host the content of scraped images themselves; rather, the dataset contains URLs pointing to images, which researchers must download themselves.

The first such dataset, LAION-400M, was released in August 2021 and consisted of 400 million image-caption pairs. The pairs were extracted from a random subset of webpages scraped by Common Crawl between 2014 and 2021. It was an attempt to recreate the process used by OpenAI to collect the 400 million image-caption pairs they used to train the CLIP model - the company had chosen to open-source the model's code and weights, but not its training dataset. Imagen, a text-to-image model announced by Google Brain in 2022, was trained on LAION-400M in combination with private internal datasets.

A successor of more than 5 billion pairs, LAION-5B, was released in March 2022. As of its release, it was the largest freely available dataset of image-caption pairs in existence. Its creation was funded by Doodlebot, Hugging Face and Stability AI, the AI company behind the funding of the Stable Diffusion text-to-image model, which was trained on it.

Several studies show that the images in LAION-5B contain problematic images and text pairs of rape, pornography, malign stereotypes, racist and ethnic slurs, and other extremely problematic content.

An investigation by Bayerischer Rundfunk showed that LAION's datasets, hosted on Hugging Face, contain large amounts of private and sensitive data harvested from public websites.

See all
User Avatar
No comments yet.