JobsEQBot is the web crawler for Chmura Economics & Analytics. It collects public job postings for JobsEQ and our job search tools, which workforce boards, economic development organizations and colleges use to connect job seekers with local openings and to understand their labor markets.
What it collects
JobsEQBot reads only public job postings: the job title, employer, location, posting date, description and a link to the original posting. It does not log in, submit forms, apply for jobs or collect personal information. Each job we list links back to the original posting, where candidates apply.
How to identify it
JobsEQBot requests carry this user agent:
Mozilla/5.0 (compatible; JobsEQBot/1.0; +https://www.chmura.com/crawler)
JobsEQBot signs its requests using Web Bot Auth.
How it behaves
- Follows robots.txt, including
Crawl-delay. - Visits each site about once a day and waits between requests.
- Slows down or stops when a site responds with HTTP 429 or 503.
- Only reads job listing and job posting pages.
Controlling access
To stop JobsEQBot from crawling your site, add this to your robots.txt:
User-agent: JobsEQBot Disallow: /
To slow it down, set a crawl delay in seconds:
User-agent: JobsEQBot Crawl-delay: 10
If you’d rather send us a job feed, or have any questions or concerns, contact us at crawler at chmura.com.