System Requirements
Supported platforms
OptimaGPT runs on Windows, Linux, and macOS. All three components — Gateway, Node, and the desktop chat application — are supported on all platforms.
| Platform | Architecture |
|---|---|
| Windows | x86-64, ARM64 |
| Linux | x86-64, ARM64 |
| macOS | Apple Silicon (ARM64) only |
macOS on Intel is not supported.
OptimaGateway
The Gateway is a lightweight server process with modest resource requirements.
| Minimum | |
|---|---|
| CPU | 2-core, 64-bit |
| RAM | 2 GB |
| Disk | 10 GB |
| Network | A fixed IP address or hostname reachable by users and Node machines |
OptimaNode
Node requirements vary significantly depending on the AI models you intend to run. Model files range in size from a few gigabytes to over 40 GB, and loading them requires either sufficient system RAM or a GPU with adequate VRAM.
| Minimum | Recommended | |
|---|---|---|
| CPU | 4-core, 64-bit | 8+ cores |
| RAM | 8 GB | 32 GB or more, depending on model size |
| GPU | Not required | Dedicated GPU with 8 GB+ VRAM, strongly recommended |
| Disk | 20 GB + model storage | SSD with 100 GB+ available |
GPU acceleration: Running models on a GPU is significantly faster than CPU inference. For production use or any model larger than 7 billion parameters, a GPU is strongly recommended. Both NVIDIA and AMD GPUs are supported.
RAM and model size: If running on CPU only, the system must have enough RAM to hold the model in memory. As a rough guide, a 7-billion parameter model in Q4 quantisation requires approximately 4–5 GB. A 70-billion parameter model in Q4 requires approximately 40 GB. Embedding models are generally much smaller.
OptimaGPT Desktop App
The desktop application runs on the same platforms and architectures as the Gateway and Node. Its own hardware requirements are minimal — any machine capable of running the operating system will run the desktop app.