minus-squareKubeRoot@discuss.tchncs.detoBuy European@feddit.uk•Portugal debuts first open-source AI model as Europe pushes for tech sovereignty, accelerates efforts to reduce reliance on US and ChinalinkfedilinkEnglisharrow-up1·4 months agoIf I understand correctly, the training data isn’t actually opensource Data from Arquivo.pt, obtained after processing collections of public web pages and free books; Pre-training data from the EuroLLM model; Long-context data samples from Stack-v2; Synthetic data to improve long-context retention, filtered from public datasets (needle-llama3-16x8k, needle_32k_finetuning_dataset). Sounds like they scraped “public” websites for data? linkfedilink
If I understand correctly, the training data isn’t actually opensource
Sounds like they scraped “public” websites for data?