Skip to content
This repository was archived by the owner on Jul 29, 2025. It is now read-only.

Ollama integration #346

Open
wants to merge 7 commits into
base: main
Choose a base branch
from

Conversation

alexthotse
Copy link

No description provided.

@alexthotse
Copy link
Author

Ollama integration

This commit introduces a dedicated Ollama provider to the application. Previously, local models were handled by a generic `local` provider. This change adds a new `ollama` provider, making the integration more explicit and easier to maintain.

The following changes are included:

- A new `ollama.go` file in `internal/llm/provider` to define the `OllamaClient`.
- A new `ollama.go` file in `internal/llm/models` to define Ollama models.
- Updates to `provider.go` and `models.go` to register the new provider and its models.
- A new test file `internal/llm/provider/ollama_test.go` to verify the integration.
This commit introduces several new features and improvements to the codebase.

- Reordered the provider priority to prioritize Ollama, OpenRouter, and Gemini.
- Added a new `config` command to the CLI that allows you to set your API keys and other settings.
- Added support for Hugging Face, Replicate, and Cohere as new LLM providers.
- Added a testing framework for the providers, including a mock provider.
- Improved the error handling in the application by creating a new `errors.go` file with custom error types.
@kujtimiihoxha
Copy link
Collaborator

Hi! Thanks so much for taking the time to contribute.

I wanted to let you know that this project is no longer maintained here. I've continued working on it with the team at Charm, where it's now called Crush.

This repo will be archived soon to help people find the active version, so I’d love for you to check out Crush and continue development there.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants