[carsoon]

Using old models is a good way to received less biased information about an active event. Once a major event occurs information wars happen that try and change narratives and erase old information. But because models were trained before this the bias that the event causes is not yet present.

[lukev]

I’m sorry I don’t quite follow… how can a model provide information at all about events it was trained before?

[carsoon]

For instance I want information about 2 countries currently at war. By asking about these countries from an older model then we get more factual information about the countries. If we ask about them and the information is seeded from news articles etc AFTER the war started then they will be biasedly influenced and often have disclaimers like "But it should be noted that x y z" showing that there is some MAJOR bias that occurred from the training on the news.

If I want an unbiased reason for what happened before a war started i would want all the information about 2 countries at different points before the war. Because after a military war starts an INFORMATION war also starts. Propaganda will be spread from both sides as wars are just as much about global support as they are about military dominance.

[pixl97]

Overspecialization of models is a thing.

>Overspecialization of models, often referred to as overfitting in machine learning, is a condition where a model learns the details and noise in the training data so well that it negatively impacts its performance on new, unseen data. This prevents the model from being able to generalize its knowledge effectively.

[phs318u]

You provide the info... and the bias.

[carsoon]

Everyone introduces bias. But for instance getting a model trained pre war vs after a war starts is super different. If I want to get raw information about 2 nations then models are in some ways a good source. Because most other parts of the internet can get changed or wiped. A model is "stuck" with the information it had exactly at that point so cannot be directly affected by new information attacks.

It is crucial to have a good framework in how you ask your questions though to avoid bias when using these systems and to try and focus on raw facts. To test ideas I like to make it fight for both opposite extreme sides of an argument then I can make up my own mind.