Blake Mizerany 3519dd1c6e

server/internal/client/ollama: hold DiskCache on Registry (#9463) ...

Previously, using a Registry required a DiskCache to be passed in for
use in various methods. This was a bit cumbersome, as the DiskCache is
required for most operations, and the DefaultCache is used in most of
those cases. This change makes the DiskCache an optional field on the
Registry struct.

This also changes DefaultCache to initialize on first use. This is to
not burden clients with the cost of creating a new cache per use, or
having to hold onto a cache for the lifetime of the Registry.

Also, slip in some minor docs updates for Trace.

2025-03-02 20:55:44 -08:00

..

opp

server/internal/client/ollama: hold DiskCache on Registry (#9463)

2025-03-02 20:55:44 -08:00

oppbench

server/internal: copy bmizerany/ollama-go to internal package (#9294)

2025-02-24 22:39:44 -08:00