Model setup recipes

Install Strata on Windows or Linux and send a first prompt

Choose a model, let the download finish, then verify it in your browser.

Strata 0.1.43 prepares a Qwen3.8-Flash-Next engine for your GPU1 on Windows or Linux, then returns answers to a local browser or compatible app. Before setup, check GPU support, at least 32 GB RAM2, and about 80 GB of disk space for the model and runtime3. Download the repository, run START-HERE.bat on Windows or ./setup.sh on Linux, and verify a short prompt4 at http://127.0.0.1:8080.

The Strata installer prepares the engine and model files needed to run Qwen3.8-Flash-Next on your PC. Once setup finishes, the local server receives prompts from a browser or compatible app and returns the model's answers. Run the repository launcher, choose a model, and check the first response at http://127.0.0.1:8080.

Windows and Linux use different launchers, but the initial setup follows the same sequence: check the graphics driver, make sure memory fits the chosen model, and leave enough disk space for downloads. Then run the launcher for your operating system. You can begin with the recommended setup choices and adjust them for your workload.

Requirements and key details
  • Run START-HERE.bat on Windows or ./setup.sh from the repository folder on Linux.
  • Choose a model and context length for your RAM, then decide whether to enable image input.
  • Send a short question in the browser's Chat page; a visible answer confirms the first run.

Before downloading, check the driver and free disk space

Strata 0.1.43 runs on Windows 10/11 or Linux. The GPU baseline is an NVIDIA RTX 20/30/40/50-series card or a Radeon family listed in the documentation. NVIDIA driver 580 or newer is recommended. AMD uses a current Adrenalin driver on Windows and the kernel's amdgpu driver on Linux. Check your GPU and driver in Windows Device Manager, AMD Software, or Linux device information.

RAM needs depend on the model size; 32 GB is a starting point to consider. With 64 GB, every model size in the guide can run, though large variants and long contexts still need room for other apps. Reserve about 80 GB for the roughly 70 GB model, the roughly 6 GB MTP5 layer, settings, and possible image files. On Linux AMD, setup may need about 10 GB more for ROCm6. An NVMe7 SSD8 helps reduce the first model load time.

This guide installs Strata 0.1.43. The Git command below checks out that fixed version. Without Git, download and extract the ZIP from the same v0.1.43 release. The update instructions below distinguish the installation methods. For a new installation, you can choose the 0.1.43.1 ZIP with the Linux NVIDIA regression fix and follow the same steps below.

Get the Strata 0.1.43 repository
git clone --depth 1 --branch v0.1.43 https://github.com/Niko1221/Strata.git
cd Strata
If you do not use Git, download and extract the v0.1.43 release ZIP.
A black tower PC, a blank monitor, and RAM modules on a warm wood desk indoors
Check the GPU, RAM, and free disk space before choosing a model.

Run the launcher for your operating system

From the repository folder, double-click START-HERE.bat on Windows. On Linux, open a terminal in that folder and run ./setup.sh. If Linux reports a permission error, start it with bash setup.sh. Setup prepares the required Python environment, GPU engine, model, and MTP draft layer.

If the NVIDIA driver is older than 580, update it before setup. If no ready-made NVIDIA engine matches the PC, setup explains the build-tool installation before compiling an engine. AMD Windows uses the Adrenalin driver and bundled HIP9 engine; AMD Linux also prepares ROCm and compiles an engine for the card.

The setup questions determine model size and context for your available RAM and GPU memory. Keeping the recommended choices continues setup. If you will not send images, disable the vision option to leave more GPU memory for the expert cache. Longer contexts also use more KV-cache10 memory, so start with the length you need.

Start installation on Windows
START-HERE.bat
Choose the model and context in the setup screen.
Install and start on Linux
./setup.sh
If execution permission is denied, run `bash setup.sh` from the repository folder.

Wait for the download and first model load

Setup downloads the roughly 70 GB model and runtime files. If a first-install download is interrupted, rerun START-HERE.bat on Windows or ./setup.sh from the repository folder on Linux. Setup resumes with files already downloaded. During the first load into RAM and GPU memory, the PC may slow down or appear unresponsive for 1–3 minutes. Keep the window open while progress messages continue.

When setup finishes, the browser opens or the local address appears in the window. Enter a short prompt in Chat at http://127.0.0.1:8080 and check that an answer appears. The server window shows that the model has started. Later runs do not download the same files again. Close the server window to stop it.

For the fixed 0.1.43 checkout above or a ZIP installation, move to a new release ZIP. Keep the old Strata folder and extract the new ZIP under the same parent folder, then run START-HERE.bat or ./setup.sh. Finding the adjacent existing Strata-data folder avoids downloading the large model again. Settings live inside the old Strata folder, so check the model, context and working folder in the new setup.

A branch checkout created with git clone without pinning a version can update through Windows UPDATE.bat or Linux ./update.sh in that folder. After the script refreshes code, engine, packages and settings, start the model with START-HERE.bat or ./setup.sh. In the fixed-tag checkout above, the updater's git pull fails; use the new-ZIP route instead.

A graphics card, RAM modules, and an NVMe SSD on a warm wood desk
Longer contexts also use more memory for the KV cache.

If there is no answer, check where the first error occurred

If the first download does not finish, check the network connection and free disk space, then rerun START-HERE.bat on Windows or ./setup.sh on Linux. Setup resumes with files already downloaded. Use UPDATE.bat or ./update.sh only when updating a branch-based Git installation; use a new release ZIP for fixed-tag or ZIP installs. If setup says the NVIDIA driver is old, update it, restart the PC, and run the launcher again.

If you see port 8080 is already in use, first check whether a Strata server window is already running. If another program owns the port, consult the installation guide for the port option and start Strata on another port. If the server is running but the browser did not open, enter the local address yourself.

If model loading stops or you see engine stopped unexpectedly, restart the PC, close memory-heavy apps such as browsers, games, or editors, and try again. If it still stops, check free RAM and VRAM11 and choose a smaller model such as Q2_0 or IQ2_XS, or a shorter context. If Linux AMD fails while installing ROCm or compiling, note the final terminal error and selected GPU architecture, then consult the official AMD HIP guide.

Once the first answer appears, the installation flow is complete. If the reply is slow or stops, check GPU, CPU12, and RAM use in Monitor. The stage of failure points to the next check: model size, driver and runtime match, or whether the download completed.

If Windows GGUF-mmap is slow, check version 0.1.43

This is for an existing low-memory Windows setup that is unusually slow, not part of the first installation. When GGUF13 shards remained mmaped during unbuffered NTFS reads, expert files could be read one at a time. Strata 0.1.43 closes each shard's mapped view when the file tier begins unbuffered reads, restoring parallel expert-file reads.

To compare after updating, use the same GGUF model and prompt. The release example used IQ3_XXS on an RTX 5070, Ryzen 5 7600, and 64 GB RAM. Short-prompt decode14 changed from 13.3 to 18.2 tok/s with 22 GiB of experts held in RAM, and from 4.6 to 8.5 tok/s with 12 GiB. These are results for that Windows setup.

Two graphics cards and other components installed in an open PC case
After setup, use Monitor to see how much GPU memory and RAM the model uses.

Terminology notes

  1. GPU — A processor designed to handle many calculations in parallel. It performs model computations during AI inference.

    Back to the text
  2. System RAM — System memory that temporarily holds data while programs run.

    Back to the text
  3. Runtime — The software environment that provides facilities needed while a program runs. In local AI, it can also refer to a model execution engine.

    Back to the text
  4. Prompt — The input text sent to a model. For generative models it describes the desired result and strongly shapes the output.

    Back to the text
  5. MTP — A training objective or model component for predicting multiple future tokens at once. In speculative decoding, those predictions can be proposed as candidate tokens.

    Back to the text
  6. ROCm — AMD’s software platform for AI and high-performance computing on GPUs. Support depends on the combination of GPU, operating system, driver, and framework versions.

    Back to the text
  7. NVMe — A storage protocol used by SSDs communicating over PCI Express.

    Back to the text
  8. SSD — A data storage device that uses flash memory and retains data without power.

    Back to the text
  9. HIP — An API and runtime for portable GPU C++ code. It helps with porting CUDA code.

    Back to the text
  10. KV cache — Memory that stores attention keys and values from earlier tokens for reuse during later token generation. Its size depends on context length and batch size.

    Back to the text
  11. VRAM — Memory used by a graphics card’s GPU to store model weights and intermediate values.

    Back to the text
  12. CPU — The central processor that runs the operating system and general-purpose instructions; in AI workloads it also handles tasks such as preprocessing and data movement.

    Back to the text
  13. GGUF — A file format for model data, widely used by llama.cpp-based tools.

    Back to the text
  14. Token decoding — The stage that generates successive output tokens using the input and the response produced so far.

    Back to the text

Frequently asked questions

What should you check first in this article?
Strata 0.1.43 prepares a Qwen3.8-Flash-Next engine for your GPU on Windows or Linux, then returns answers to a local browser or compatible app. Before setup, check GPU support, at least 32 GB RAM, and about 80 GB of disk space for the model and runtime. Download the repository, run START-HERE.bat on Windows or ./setup.sh on Linux, and verify a short prompt at http://127.0.0.1:8080.
How much memory does it need?
The setup questions determine model size and context for your available RAM and GPU memory. Keeping the recommended choices continues setup. If you will not send images, disable the vision option to leave more GPU memory for the expert cache. Longer contexts also use more KV-cache memory, so start with the length you need.