YaqbalBot
YaqbalBot is the program that finds cybersecurity jobs for Yaqbal (يَقبَل), a free job board for people in the Arab countries. It reads public job postings once or a few times a day and links every job back to where it was posted.
It names itself in every request: YaqbalBot/1.0 (+https://yaqbal.com/bot)
What it reads
- The public job APIs of hiring systems (Greenhouse, Lever, Ashby, Workable, Recruitee, BambooHR, SmartRecruiters, Workday, Oracle Recruiting Cloud).
- Careers sites through their sitemap and the JobPosting data on each job page.
- Job sites whose terms allow it, credited with a link on every job.
It keeps the title, the employer, the place and who may apply. It never republishes a posting's full text; job pages link to the original.
How it behaves
- It obeys robots.txt on every request and every redirect, for the YaqbalBot agent or, failing that, for all agents.
- One request at a time per site: at least 1 second apart for APIs and 2 seconds for careers pages, or longer when your Crawl-delay asks.
- It stops for the night on a 403, a 429 or a challenge page, and never disguises itself or uses proxies.
- It never opens Linkedin, Indeed, Bayt, Gulftalent, Naukrigulf, Glassdoor, Wuzzuf, Forasna, Akhtaboot.
Keep it out
Add this to your robots.txt. YaqbalBot reads robots.txt before every visit, so the change takes effect on its next run:
User-agent: YaqbalBot Disallow: /