RoastbookOpenCoffeeBot

If you saw this user agent in your logs, it was us: the Sourcing agent of Roastbook Open Coffee, an open dataset of coffee places.

RoastbookOpenCoffeeBot/1.0 (+https://data.roastbook.coffee/bot)

What it reads

A café's or roaster's own public pages: home, about, menu, shop and legal notice (Impressum). It extracts facts such as opening hours, whether filter coffee is served, which roasters are served and the operating company, and cites the page as the source.

It never copies texts or photos, never logs in, and does not read Instagram posts or captions. Descriptions in the dataset are written from the extracted facts only.

How it behaves

• Respects robots.txt, including rules for RoastbookOpenCoffeeBot and *.
• At most one request per second per host, and only a handful of pages per site.
• Caches pages for 30 days; a full re-check runs about twice a year, opening hours and status quarterly.
• Runs from GitHub Actions on a schedule; every change goes through a public, reviewed pull request in Roastbook/open-coffee-data.

Opt out

Add this to your robots.txt and the crawler will not fetch your site again:

User-agent: RoastbookOpenCoffeeBot
Disallow: /

To have your place removed or corrected, open an issue or email data@roastbook.coffee. Owners can also claim their place and submit facts and photos themselves; see CONTRIBUTING.md.

Contact

data@roastbook.coffee · Roastbook, maintainers of Roastbook Open Coffee.