|
|
|
|
|
by Bender
25 days ago
|
|
dang wont see this message unless it gets a lot of activity. best to email him, contact at the bottom of the page if you have suggestions how to better detect and auto-[dead] the junk. We are flagging the AI slop but there are times of the day that not enough of us do it. The botters know people have to {sleep, do IRL things}. Best to just flag it and move on for now but dont go out of your way to do it. The sites that cant manage it will eventually just fade away and become ghost towns. Ghost towns always have a handful of people that stick around. FWIW I know how to spot the bots on my hobby sites before they post their first byte but it can block legit search engines if people care about such things (I don't). (Blocking HTTP/1.1 connections, the long list of user-agents because most botters are too lazy to change it ... oh yes they are and most will not spoof, blocking TCP SYN missing things in the header, blocking connections missing some variables such as $http_sec_fetch_mode and others, any connection coming from a data-center and this is what nukes some search engines)... Just dropping HTTP/1.1 connections will drop about three fourths of them but that also nukes the GoogleBot. Would be nifty if Google could fix that. BingBot is HTTP/2.0. |
|