To comprehensively manage bots when you see a lot of guests online click the "Who is Online" header and then click "Display Guests" link. Check the user agents and make sure there isn't any with identifiable user agent for bot. If they are listed as guest add them to the Bots list.
Bots that are identifying themselves usually obey robots.txt, add them there. This may take a day or two to take effect. You want to go the the bots web page to see what to use for user agent match. Don't rely on one in phpBB's bot list.
https://developers.google.com/search/do ... bots/intro
For Cloudlfare in the security section open "bots" sub section. Enable "Bot Fight Mode", this will block the most aggressive IP's determined by Cloudflare to be bad bot traffic. It does not affect legitimate bots like Google. You can also enable "Block AI Bots" but this largely affects legitimate bots like ChatGPT. "
Next click the sub section WAF and the Custom Rules link. Create new rule "Challenge everyone" , add countries you expect traffic from using AND clause. "Country - does not equal - US AND ....etc." Under action to take use JS Challenge.
You can add up to five rules with free plan, put you most aggressive ones at top e.g. if you are going to outright block countries add new rule for that and add the country.
Bots that are identifying themselves usually obey robots.txt, add them there. This may take a day or two to take effect. You want to go the the bots web page to see what to use for user agent match. Don't rely on one in phpBB's bot list.
https://developers.google.com/search/do ... bots/intro
For Cloudlfare in the security section open "bots" sub section. Enable "Bot Fight Mode", this will block the most aggressive IP's determined by Cloudflare to be bad bot traffic. It does not affect legitimate bots like Google. You can also enable "Block AI Bots" but this largely affects legitimate bots like ChatGPT. "
Next click the sub section WAF and the Custom Rules link. Create new rule "Challenge everyone" , add countries you expect traffic from using AND clause. "Country - does not equal - US AND ....etc." Under action to take use JS Challenge.
You can add up to five rules with free plan, put you most aggressive ones at top e.g. if you are going to outright block countries add new rule for that and add the country.
Statistics: Posted by thecoalman — Thu Feb 20, 2025 1:05 pm