Supported Models

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)

Maximum context length the model can handle

Fraction of GPU memory to use (0.1 - 1.0)