unknown knowledge base

[ndahiro]

why does it hallucinate showing that i have a knowledge base about Elon Musk and Dogecoin yet there are not in my knowledge base?

[dosubot[bot]]

The hallucination you're seeing—where RAGFlow shows knowledge bases or content about Elon Musk and Dogecoin that you haven't added—can be caused by a few factors:

1. External Knowledge Supplementation: RAGFlow has a wikipedia component that can supplement your knowledge base by searching Wikipedia for relevant topics, even if those topics are not in your uploaded documents. If this feature is enabled or used in your configuration, it could introduce information about public figures or popular topics like Elon Musk and Dogecoin into your results, even if they're not in your own knowledge base files (source).

2. Embedding Model or Chunking Configuration: If the embedding model or chunking method is not set up correctly for your knowledge base, it can cause semantic mismatches or unexpected retrieval results. This can lead to the model generating or retrieving content that isn't actually present in your data (source).

3. Prompt or Generation Settings: If the prompt for the language model is too open-ended or not properly constrained, the model may "hallucinate" plausible-sounding but incorrect information, especially about well-known entities (source).

4. Web Crawling or Document Imports: If you or someone with access to your knowledge base used the web crawling feature or imported documents from the web, it's possible that content about these topics was inadvertently added (source).

How to troubleshoot:

• Check if the wikipedia component is enabled or if your retrieval pipeline is set to supplement with external sources.
• Review your knowledge base configuration, especially the embedding model and chunking method, to ensure they match your data and use case.
• Inspect the prompt settings for your LLM to make sure they are not too broad.
• Review the list of documents in your knowledge base to confirm that no web-crawled or unexpected files have been added.

If you need to verify or adjust your knowledge base configuration, you can use the configuration tools and hooks provided in RAGFlow, such as useFetchKnowledgeBaseConfiguration and useUpdateKnowledge (source).

There are currently no known issues or discussions about this specific hallucination behavior in the RAGFlow repository. If after checking these areas the issue persists, it may be worth reviewing your setup in more detail.

To continue talking to Dosu, mention @dosu-bot.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other}

[ZhenhangTung]

@ndahiro screenshots or logs pls