A tool for benchmarking and tracking Large Language Model (LLM) investment decisions.

This project provides a framework to create, manage, and track investment portfolios generated by LLM models. It allows you to:

• Create new portfolios
• List current holdings and recent context
• Update portfolios based on model decisions

The model executions and their current context can be seen here.

To optimize their portfolio, the primary objective defined for the LLMs, it is imperative to evaluate the risk-reward ratio, formulate cogent assumptions about future market conditions, and leverage tools and their understanding of human psychology and financial market dynamics.

This benchmark may be a good proxy to measure how well LLMs are able to coordinate the aforementioned efforts.

• Removed Gemini for now because the available free chat UI can't search for updated prices nor does it support the upload of CSV or JSON 😬.
• Removed Claude for now because the available free chat UI can't search for updated prices and its context window is too small for uploaded files 😬.
• Removed ChatGPT for now becaue the available free chat UI can't no longer do complex data analysis 😬.

• cmd: Contains the main command implementations
  • create: Initialize new portfolios
  • list: Display current holdings and context
  • update: Process investment orders and update holdings
  • stocks: Fetch most recent stock prices

The most recent prompt with the clear guidelines can be see here and here.