Update (9/30): #215 (comment)

Overview

Currently, Ollama support is an unstable and experimental feature. This feature is implemented using the Ollama AI Provider. It is explicitly stated that it is unstable in Object generation and Tool usage. Additionally, Tool streaming is not supported. Morphic is very unstable because it requires these capabilities. Please use it with the understanding of these limitations.

Environment Variables

• OLLAMA_MODEL=[YOUR_OLLAMA_MODEL]
  • The main model to use. Recommended: mistral or openherms
  • Object generation, Tool usage
• OLLAMA_SUB_MODEL=[YOUR_OLLAMA_SUB_MODEL]
  • The sub model to use. Recommended: phi3 or llama3
  • Text generation
• OLLAMA_BASE_URL=[YOUR_OLLAMA_URL]
  • The base URL to use. e.g. http://localhost:11434

PR

• feat(utils): Add Ollama support and improve error handling for models #214
  • Draft
    • feat(utils): Add Ollama support and improve error handling for models #190
    • draft: Update Ollama support  #200