Menu
I’m noticing some odd looking user agent details in server logs that vary from the typical mozilla, chrome, and other expected browsers.
Is there any normal reason for a user agent to be python-requests or python-urllib?
Are these type of traffic hits usually bad scrapers, or can they be “good” crawlers that shouldn’t be blocked?