Introduction to Ollama

Contents

Introduction to Ollama#

Note

Hey guys, this is my personal reading note. I am not sure there might be some mistakes in my understanding. Please feel free to correct me (hsiangjenli@gmail.com) if you find any. Thanks!

ollama/ollama

Ollama is an open-source project designed to run large language models across various platforms, including macOS, Windows, and Linux. It also offers a simple deployment method through Docker and supports integration with both JavaScript and Python.

Available Models#

Ollama provides an easy-to-use API interface, allowing users to access models seamlessly. Their website also includes hardware requirements to help users select the maximum model size that can run on their machine:

  • 8GB RAM - Supports the 7B model

  • 16GB RAM - Supports the 13B model

  • 32GB RAM - Supports the 175B model

Contents