-
Notifications
You must be signed in to change notification settings - Fork 1
Open
Labels
Description
Currently, the tool may scrape and reprocess the same articles if run multiple times. Introduce a caching mechanism (e.g., using a hash of article title or URL) to skip articles that have already been scraped in previous runs. This improves efficiency, avoids redundant LLM processing, and ensures only fresh articles are analyzed.