Presenton supports GPU acceleration when using Ollama models, significantly improving performance — especially for larger models. To enable GPU support, you need to install and configure the NVIDIA Container Toolkit.Documentation Index
Fetch the complete documentation index at: https://docs.presenton.ai/llms.txt
Use this file to discover all available pages before exploring further.
🛠️ Step 1: Install NVIDIA Container Toolkit
Follow the official guide to install the toolkit:👉 https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html
🚀 Step 2: Run Presenton with GPU
Once installed, use the--gpus=all flag when running the container:
- Running without environment variables
- Running with environment variables