What's Changed

• chore: add amazon-kendra-, Anomura, Cloudflare-AutoRAG and Bravebot by @cdransf in #183

Full Changelog: v1.41...v1.42

What's Changed

• Update Brightbot operator and details; add meta-webindexer entry by @karolyi in #174
• Add TerraCotta by @emersion in #176
• chore(robots.json): add DeepSeekBot by @cdransf in #179

New Contributors

• @karolyi made their first contribution in #174
• @emersion made their first contribution in #176

Full Changelog: v1.40...v1.41

What's Changed

• chore: add Google-Firebase and ShapBot by @cdransf in #168

Full Changelog: v1.39...1.40

What's Changed

• Adding YaK by @GlitzSmarter in #164
• fix: remove summaly by @cdransf in #166
• chore: adds OpenAI bot user agent by @cdransf in #167

New Contributors

• @GlitzSmarter made their first contribution in #164

Full Changelog: v1.38...v1.39

What's Changed

• re-add facebookexternalhit by @paulrudy in #154
• Update funtion and description for SemrushBot by @nisbet-hubbard in #156
• chore(robots.json): add SummalyBot + Thinkbot by @cdransf in #158
• Simplify htaccess rewrite rule by @sdavids in #160

New Contributors

• @paulrudy made their first contribution in #154
• @sdavids made their first contribution in #160

Full Changelog: v1.37...v1.38

What's Changed

• chore(robots.json): adds additional SemrushBot user agents by @cdransf in #150
• chore(robots.json): adds MyCentralAIScraperBot by @cdransf in #152
• Update robots.json with new crawler by @sergiospagnuolo in #153

New Contributors

• @sergiospagnuolo made their first contribution in #153

Full Changelog: v1.36...v1.37

What's Changed

• chore(robots.json): adds EchoboxBot by @cdransf in #148

Full Changelog: v1.35...v1.36

What's Changed

• chore(robots.json): adds bedrockbot by @cdransf in #145

Full Changelog: v1.34...v1.35

What's Changed

• chore(robots.json): adds Quillbot by @cdransf in #142
• chore(robots.json): adds Panscient by @cdransf in #143

Full Changelog: v1.33...v1.34

What's Changed

• Add SBIntuitionsBot by @Ivan-Chupin in #141

New Contributors

• @Ivan-Chupin made their first contribution in #141

Full Changelog: v1.32...v1.33