💄 style: add blockAds & stealth params for Browserless

[hezhijie0327]

💻 变更类型 | Change Type

• ✨ feat
• 🐛 fix
• ♻️ refactor
• 💄 style
• 👷 build
• ⚡️ perf
• 📝 docs
• 🔨 chore

🔀 变更说明 | Description of Change

1. 增加 blockAds & stealth 参数，降低被检测自动化的特征，可用环境变量控制
2. 增加 BROWSERLESS_BLOCK_ADS 及 BROWSERLESS_STEALTH_MODE 文档

---

环境变量	禁用（默认）	启用
BROWSERLESS_BLOCK_ADS
BROWSERLESS_STEALTH_MODE

📝 补充信息 | Additional Information

ref: 检测网站 https://bot.sannysoft.com https://adblock-tester.com

Summary by Sourcery

Introduce blockAds and stealth parameters to the Browserless crawler, configurable via environment variables to reduce bot detection and block ads.

New Features:

• Allow blocking ads in Browserless requests with BROWSERLESS_BLOCK_ADS
• Enable stealth mode in Browserless launches with BROWSERLESS_STEALTH_MODE

[vercel]

@hezhijie0327 is attempting to deploy a commit to the LobeHub Community Team on Vercel.

A member of the Team first needs to authorize it.

[sourcery-ai]

Reviewer's Guide

This PR enhances the Browserless crawler by introducing two new environment-driven flags—blockAds and stealth—and weaving them into the request payload so that ad requests can be blocked and automation fingerprints can be masked on demand.

File-Level Changes

Change	Details	Files
Introduce environment flags for ad-blocking and stealth mode	Add BROWSERLESS_BLOCK_ADS constant reading from process.env Add BROWSERLESS_STEALTH_MODE constant reading from process.env Convert both flags into booleans by checking for '1'	packages/web-crawler/src/crawImpl/browserless.ts
Extend the content request to include the new flags	Augment qs.stringifyUrl query with blockAds flag Inject launch param as a JSON string with stealth setting Keep token query intact and restructure query object	packages/web-crawler/src/crawImpl/browserless.ts

---

Tips and commands

Interacting with Sourcery

• Trigger a new review: Comment @sourcery-ai review on the pull request.
• Continue discussions: Reply directly to Sourcery's review comments.
• Generate a GitHub issue from a review comment: Ask Sourcery to create an
  issue from a review comment by replying to it. You can also reply to a
  review comment with @sourcery-ai issue to create an issue from it.
• Generate a pull request title: Write @sourcery-ai anywhere in the pull
  request title to generate a title at any time. You can also comment
  @sourcery-ai title on the pull request to (re-)generate the title at any time.
• Generate a pull request summary: Write @sourcery-ai summary anywhere in
  the pull request body to generate a PR summary at any time exactly where you
  want it. You can also comment @sourcery-ai summary on the pull request to
  (re-)generate the summary at any time.
• Generate reviewer's guide: Comment @sourcery-ai guide on the pull
  request to (re-)generate the reviewer's guide at any time.
• Resolve all Sourcery comments: Comment @sourcery-ai resolve on the
  pull request to resolve all Sourcery comments. Useful if you've already
  addressed all the comments and don't want to see them anymore.
• Dismiss all Sourcery reviews: Comment @sourcery-ai dismiss on the pull
  request to dismiss all existing Sourcery reviews. Especially useful if you
  want to start fresh with a new review - don't forget to comment
  @sourcery-ai review to trigger a new review!

Customizing Your Experience

Access your dashboard to:

• Enable or disable review features such as the Sourcery-generated pull request
  summary, the reviewer's guide, and others.
• Change the review language.
• Add, remove or edit custom review instructions.
• Adjust other review settings.

Getting Help

• Contact our support team for questions or feedback.
• Visit our documentation for detailed guides and information.
• Keep in touch with the Sourcery team by following us on X/Twitter, LinkedIn or GitHub.

[greptile-apps]

Your free trial has ended. If you'd like to continue receiving code reviews, you can add a payment method here.

[lobehubbot]

👍 @hezhijie0327

Thank you for raising your pull request and contributing to our Community
Please make sure you have followed our contributing guidelines. We will review it as soon as possible.
If you encounter any problems, please feel free to connect with us.
非常感谢您提出拉取请求并为我们的社区做出贡献，请确保您已经遵循了我们的贡献指南，我们会尽快审查它。
如果您遇到任何问题，请随时与我们联系。

[gru-agent]

TestGru Assignment

Summary

Link	CommitId	Status	Reason
Detail	b39edc5	🚫 Skipped	No files need to be tested {"packages/web-crawler/src/crawImpl/browserless.ts":"Can not find valuable test target.\nbrowserless: Out of scope - The exported browserless is a function that acts as a controller/service, handling HTTP requests, environment variables, and integrating multiple modules (fetch, htmlToMarkdown, etc). Its correctness depends on external services and side effects, making it more suitable…"}

History Assignment

Tip

You can @gru-agent and leave your feedback. TestGru will make adjustments based on your input

[sourcery-ai]

Hey @hezhijie0327 - I've reviewed your changes and they look great!

Prompt for AI Agents

Please address the comments from this code review:
## Individual Comments

### Comment 1
<location> `packages/web-crawler/src/crawImpl/browserless.ts:39` </location>
<code_context>
+      qs.stringifyUrl({
+        query: {
+          blockAds: BROWSERLESS_BLOCK_ADS,
+          launch: `{"stealth":${BROWSERLESS_STEALTH_MODE}}`,
+          token: BROWSERLESS_TOKEN,
+        },
</code_context>

<issue_to_address>
Consider using JSON.stringify for the launch parameter to avoid manual string interpolation.

Using JSON.stringify({ stealth: BROWSERLESS_STEALTH_MODE }) reduces errors and improves maintainability if more properties are added.
</issue_to_address>

<suggested_fix>
<<<<<<< SEARCH
          launch: `{"stealth":${BROWSERLESS_STEALTH_MODE}}`,
=======
          launch: JSON.stringify({ stealth: BROWSERLESS_STEALTH_MODE }),
>>>>>>> REPLACE

</suggested_fix>

---

Sourcery is free for open source - if you like our reviews please consider sharing them ✨

• X
• Mastodon
• LinkedIn
• Facebook

_{Help me be more useful! Please click 👍 or 👎 on each comment and I'll use the feedback to improve your reviews.}

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 87.38%. Comparing base (b86dc9b) to head (af7e03d).
Report is 5 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff            @@
##             main    #8255     +/-   ##
=========================================
  Coverage   87.37%   87.38%             
=========================================
  Files         843      843             
  Lines       62876    62885      +9     
  Branches     4140     5671   +1531     
=========================================
+ Hits        54941    54949      +8     
- Misses       7935     7936      +1     

Flag	Coverage Δ
app	87.38% <100.00%> (+<0.01%)	⬆️
server	95.67% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
lobe-chat-preview	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jun 23, 2025 6:04am

[lobehubbot]

❤️ Great PR @hezhijie0327 ❤️

The growth of project is inseparable from user feedback and contribution, thanks for your contribution! If you are interesting with the lobehub developer community, please join our discord and then dm @arvinxx or @canisminor1990. They will invite you to our private developer channel. We are talking about the lobe-chat development or sharing ai newsletter around the world.
项目的成长离不开用户反馈和贡献，感谢您的贡献! 如果您对 LobeHub 开发者社区感兴趣，请加入我们的 discord，然后私信 @arvinxx 或 @canisminor1990。他们会邀请您加入我们的私密开发者频道。我们将会讨论关于 Lobe Chat 的开发，分享和讨论全球范围内的 AI 消息。

[lobehubbot]

🎉 This PR is included in version 1.96.7 🎉

The release is available on:

• npm package (@latest dist-tag)
• GitHub release

Your semantic-release bot 📦🚀