gpt-cotts

Table of Contents

gpt-cotts

gpt-cotts is my personal assistant. It has access to all my notes. It’s essentially a wrapper around multiple LLMs (allows me to use the best one for the task), with nice keyboard shortcuts and access to an extension of my brain in a sense. I made it because a) having multiple tabs with different language models is annoying, b) keyboard shortcuts are useful, c) giving it access to my notes allows the LLM to understand me and d) it’s fun.

Currently, it’s being run on a Lambda instance, although this may be switched to a more permanent solution to avoid the annoying cold starts.

I currently have it synced up with multiple LLMs, including deepseek-coder, claude-3.5-sonnet and gpt-4. It’s also semi-synced up with my notes, in which my Pinecone instance is auto-updated via a Github action.

The keyboard shortcuts try to follow terminal / browser shortcuts:

  • <Alt> + l to clear the screen
  • <Alt> + k to focus on the input
  • <Alt> + r to turn on rag.

Completed:

  • Authentication
  • Retrieval
  • Reranking
  • Multiple LLMs
  • Usable interface with keyboard shortcuts
  • Listener to github repo of notes to update vector db when changes are made

Next steps:

  • Automated model evaluation
  • File uploads
  • Multiple Users - with in-browser editing of notes.
  • Multi-modal models for image based prompts.

The current version is here. You’ll need to ask me for access.

Key Technologies

  • python
  • fastapi
  • reactjs