Skip to content

Updated documentation to highlight existence of RAG_USE_FULL_CONTEXT variable #90

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from

Conversation

timmanik
Copy link

Currently, there isn't documentation that highlights the ability to use full context of the documents uploaded for RAG. This causes new users like myself to run into subpar RAG results in certain scenarios. Adding documentation for the RAG_USE_FULL_CONTEXT parameter/variable to raise awareness of this feature.

Related discussion: danny-avila/LibreChat#4066

@timmanik timmanik force-pushed the rag-documentation-update branch from 501b96b to fdf71fc Compare October 21, 2024 21:20
@FinnConnor
Copy link
Contributor

FinnConnor commented Oct 24, 2024

The env variable RAG_USE_FULL_CONTEXT is not apart of of RAG_API. Setting it true or false (within RAG_API) will have no effect. I double checked this by setting RAG_USE_FULL_CONTEXT=false and was able to retrieve 20+ documents (full context) on the GET /documents/{id}/context endpoint. The RAG_API will always return full context. RAG_USE_FULL_CONTEXT is a configuration of LibreChat.

Therefore, changing the documentation of LibreChat not RAG_API is needed. Thanks for bringing this up @timmanik

@FinnConnor FinnConnor closed this Oct 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants