Does Prism currently support an ongoing chat with memory?

[vesper8]

I've previously been able to achieve this with other packages using the Assistant API and using Threads which have built-in memory. I think this is specific to OpenAI however and a solution that works with all LLMs would be preferred. I also just prefer Prism's syntax and approach. Is there currently a way to add memory to an ongoing chat or this has to all be done manually by the developer?

[CeriseGoutPelican]

I think you have to implement it yourself, but it is actually quite straightforward.

If you watch the following video (about 40-45min): https://www.youtube.com/watch?v=4WzS91_TVz8

[whobutsb]

I spent the last week playing around with NeuronAI before I found Prism. Prism feels a bit more mature but I do like how you can write your own memory storage interfaces within NeuronAI.

I think it would be great to "borrow' the idea of adding a Chat History & Memory storage to the Neuron API.

Example API:

$response = Prism::text()
    ->using(Provider::Anthropic, 'claude-3-sonnet')
    ->withSystemPrompt(view('prompts.system'))
    ->withPrompt('Explain quantum computing to a 5-year-old.')
    ->withChatHistory(History::Sqlite)
    ->asText();

Then have an interface to:

abstract class AbstractChatHistory implements ChatHistoryInterface
{
    abstract protected function storeMessage(Message $message): ChatHistoryInterface;
    
    abstract public function removeOldestMessage(): ChatHistoryInterface;

    abstract protected function clear(): ChatHistoryInterface;
}

Example SQLite Structure:

CREATE TABLE "history" ("id" integer primary key autoincrement not null, "input_tokens" integer not null default '0', "output_tokens" integer not null default '0', "meta" text, "role" varchar not null, "content" text not null, "created_at" datetime, "updated_at" datetime)

Prism seems more robust and would probably need some additional columns to store the message data.

Example memory types:

• In memory
• File
• Sqlite
• PgSQL
• MySQL

Just an idea. If I have some time I will try to tinker at adding a PR.

[pushpak1300]

I agree but i still think it can be extra package on top of the prism and shouldn't be built within prism itself. There can be numerous data storages and supporting all of them can be very problematic.

[vesper8]

This sounds super awesome though and I really need something like that to support chat threads with memory. As a separate package or not.. really hoping to see something come to life soon!

[sixlive]

👀 there are plans

[vesper8]

Just checking in.. did anything materialize yet?