You’re signed up for e-mail updates.
Together AI admits the RedPajama dataset it helped create included part of Books3 and was downloaded more than 190,000 times
In its answer to the authors' amended complaint, Together AI admits it is one of the collaborators that created RedPajama, a public dataset made for training large language models, and that when RedPajama was released in April 2023 its books section contained a subset of Books3. It admits its April 17, 2023 blog post linked to the dataset download on its Hugging Face page, that it reported more than 190,000 downloads as of October 30, 2023, and that other companies used RedPajama to train models. It admits Books3 was removed from RedPajama on April 12, 2024, and that the download page now says the books section is no longer accessible because of reported copyright infringement. Together AI denies infringement and pleads fair use among two dozen defenses. The answer does not admit that Together trained its own models on the books section. These are Together AI's own statements in its pleading.
Loading the rest of the news…
What the labels mean
Every item says what kind of source it rests on. A court ruling or order is the court's own statement. A company filing is what a defendant says about itself. A government filing is a statement by a government agency that is not a party to the case, such as a statement of interest; it is the government's position, not a ruling. An allegation is what a complaint or motion claims and has not been decided. Reported means press reporting we have not confirmed from the primary document. Summaries are our own; follow the links for the source.
This page is general information, not legal advice. An allegation is not a finding. Whether any of this matters for a particular work or claim is a question for a lawyer.