Ollama

An open-source tool that downloads open-weight models and serves them on your own machine through a local API.

In more detail

Ollama exposes an OpenAI-compatible endpoint on localhost, so code written for a hosted API can call a local model by changing the base address. It suits offline work, private data and cheap experiments, at the cost of smaller models and your own hardware.

Related terms

Taught in

References

Certification courses