This is a port of GPT-Neo that uses OpenVino - and hopefully the Intel Neural Compressor - to run on CPU.

1. venv
2. pip install -r requirements.txt
3. python ovify.py

pythong main.py

For Embeddings:

• https://huggingface.co/sentence-transformers/all-mpnet-base-v2?fbclid=IwAR3yYkBren6LGyPN9ZeCa2c7l7PWlVEon2J31O5MiA8BqaZfIjncpvsM6XU

Chatbot:

• https://github.com/bborn/howdoi.ai
• https://github.com/hwchase17/chat-langchain