Ollama

Configuration

'ollama' => [
    'url' => env('OLLAMA_URL', 'http://localhost:11434/v1'),
],

Ollama Options

Ollama allows you to customize how the model is run via options. These options can be passed via the ->withProviderOptions() method.

Prism::text() 
  ->using(Provider::Ollama, 'gemma3:1b')
  ->withPrompt('Who are you?')
  ->withClientOptions(['timeout' => 60])
  ->withProviderOptions([ 
      'top_p' => 0.9, 
      'num_ctx' => 4096, 
  ]) 

NOTE

Using withProviderOptions will override settings like topP and temperature

Streaming

Ollama supports streaming responses from your local models. All standard streaming methods are supported:

return Prism::text()
    ->using('ollama', 'llama3.2')
    ->withPrompt(request('message'))
    ->withClientOptions(['timeout' => 120])
    ->asEventStreamResponse();

TIP

Remember to increase the timeout for local models to prevent premature disconnection.

For complete streaming documentation, see Streaming Output.

Considerations

Timeouts

Depending on your configuration, responses tend to time out. You may need to extend the client's timeout using ->withClientOptions(['timeout' => $seconds]).

Prism::text() 
  ->using(Provider::Ollama, 'gemma3:1b')
  ->withPrompt('Who are you?')
  ->withClientOptions(['timeout' => 60]) 

Structured Output

Ollama doesn't have native JSON mode or structured output like some providers, Prism implements a robust workaround for structured output:

• We automatically append instructions to your prompt that guide the model to output valid JSON matching your schema
• If the response isn't valid JSON, Prism will raise a PrismException

Limitations

Image URL

Ollama does not support images using Image::fromUrl().

Tool Choice

Ollama does not currently support tool choice / required tools.