

Yeah, model collapse is worrying, but I don’t see how they can do anything about it due to how LLMs work. There have been some articles written about this drawing an analogy to the grey goo problem in nanotechnology. The end result is that the free web becomes essentially useless and knowledge becomes balkanized and paywalled.

























Money is no object to AI companies. That’s one of the things that alerted the booksellers, in fact—masses of books were being purchased without regard to price or subject matter.