Prompt Template

[Linz1248]

May I ask what prompt template is used in this framework, and can I use my own defined prompt template?

[SergiiShcherbak]

Extraction prompts: https://github.com/shcherbak-ai/contextgem/tree/main/contextgem/internal/prompts
System message: https://github.com/shcherbak-ai/contextgem/tree/main/contextgem/internal/system

You can override the default system message and prompt templates, but it's not recommended, as they are optimized for extraction. For example, any custom prompts must contain the same conditions and variables, as well as the same output structures, as the default prompts. And if they don't, the functionality will be affected.

To override the default prompts, you can use llm._update_default_prompt() method. And to override the default system message, you can pass your own when creating an LLM in system_message param.

If you need to use your own prompts, you can use frameworks like LangChain, where custom prompts are required. ContextGem handles prompts under the hood, for better efficiency and ease of use.

[Linz1248]

Thank you for your answer. I would also like to ask, will using SAT for sentence segmentation affect the performance of extraction if the official language of the document I am processing is not English?

[SergiiShcherbak]

SaT models have a strong performance across 85 languages, so using SaT should not affect extraction performance for non-English texts.
https://github.com/segment-any-text/wtpsplit