Skip to content
Niko1221Public

About

Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

Resources

Contributing

Security policy

Stars

33.7k stars

Watchers

177 watching

Forks

Latest commit

 

History

4,196 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Strata

Run powerful AI on your own computer.

Chat, code and work with images, locally.

Models · Install · Hardware · Tools · Help · Support

Download Strata MIT license Support Strata on Buy Me a Coffee

English · 简体中文 · 日本語 · Deutsch · Français · Español · Português

Free, open source, and yours to run. Use Strata on your desktop or with your favorite coding tools. No account needed.

Models

We recommend ISTA-DASLab first, then Unsloth and other providers, where a compatible model fits.

 Qwen3.8-Flash-Next
Provider Choices
ISTA-DASLab · recommended Q2_0, IQ2_XS, IQ3_XXS, IQ3_S. Coder: IQ1_M for coding.
Unsloth UD-IQ4_XS, UD-Q4_K_XL, UD-Q5_K_XL, UD-Q6_K_XL, Q8_0
Gyro · agentionai Gyro-S, Gyro-M. Lower memory use but slower.
Other options Swift 1.5, NVFP4, OrcaRouter

Compare sizes, memory needs and compatibility.

 Qwen3.6-35B-A3B

Unsloth: UD-Q4_K_XL, UD-Q6_K_XL, Q8_0. These are the currently documented packs for this model.

Model guide and compatibility.

 DeepSeekV4.1-Flash-1017

In the desktop app and the Terminal. What does not fit in memory is read from your SSD, so it needs a lot of free disk space.

Set (IST-DAS) Download Free disk needed
1.75 bpw 239 GB about 245 GB
2.00 bpw 257 GB about 265 GB
2.25 bpw 274 GB about 280 GB

Runs on NVIDIA RTX 30, 40 and 50 series (Windows and Linux) and AMD Radeon AI PRO R9700 (Linux). Setup downloads the files and the DeepSeek engine, then starts the model.

strata launch --family deepseek41 --model ist-das-2.00bpw --plan

Measured with the 2.00 bpw set on Strata 0.2.5. Output is the speed of the answer, prompt is how fast Strata reads your input.

Hardware Output Prompt
RTX 5070 12 GB, 64 GB RAM 4 to 6 tokens/s about 110 tokens/s (4K)
RTX 3060 12 GB, 46 GB RAM 9 to 11 tokens/s about 155 tokens/s (4K)
1x Radeon AI PRO R9700, 251 GB RAM 21 to 25 tokens/s 320 to 360 tokens/s (8K)
4x Radeon AI PRO R9700 74 to 77 tokens/s 400 to 450 tokens/s (8K)

Memory, disk and details · Release notes

Not sure what fits? Choose a model for your computer.

Install

Desktop app

Download Strata for Windows, Linux or Mac →

Install the app, choose a model, and start chatting. There is one installer for each system. On first start the app downloads the engine for your graphics card. Help with the installer.

Files: Strata-0.2.6-windows-x64-setup.exe · Strata-0.2.6-linux-x86_64.AppImage · Strata-0.2.6-macos-arm64.dmg

Strata desktop app with a chat and live code preview side by side
Chat, files and a live preview in one window.

Terminal app

Prefer the terminal? Install Strata, then run strata launch.

Install commands

Linux / Mac

curl -fsSL https://github.com/Niko1221/Strata/releases/latest/download/install.sh -o install.sh && sh install.sh

Windows PowerShell

irm https://github.com/Niko1221/Strata/releases/latest/download/install.ps1 | iex

On Windows, open a new terminal afterwards. Then:

strata launch

Follow the prompts to download and start a model. Terminal guide.

Strata terminal app showing model activity, speed, memory and recent requests
Watch your model and hardware while it runs.

Build from source · Docker · Full install guide

Hardware

Supported hardware Guide
NVIDIA GeForce RTX 20 / 30 / 40 / 50 series NVIDIA setup
AMD Radeon RX 7700 / 7800 / 7900, RX 9060 / 9070, AI PRO R9700 AMD setup
AMD Radeon RX 6800 / 6900 · experimental RX 6000 setup
Intel Arc · Linux Intel setup
Apple Silicon · M1 or newer Mac setup
AMD Ryzen AI Max · Strix Halo Strix Halo setup

Tools

Claude Code · Codex CLI · OpenCode · oh-my-pi · pi.dev · Hermes Agent · OpenClaw, and more through the OpenAI- and Anthropic-compatible APIs.

Run strata connect to see setup instructions for your tool. Connection guide.

Help

All guides · Troubleshooting · Report a bug · Benchmarks · How it works · Contribute

Support Strata

Help keep local AI open to everyone. A coffee helps fund development and testing on more hardware.

Buy Me a Coffee: support Strata

MIT license · Credits and model licenses · Privacy

For AI tools and automated readers: technical reference · setup instructions.

Sponsorships, hardware partnerships or collaborations: niko.veit@outlook.com.

About

Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

Resources

Contributing

Security policy

Stars

33.7k stars

Watchers

177 watching

Forks

Releases

Packages

Contributors

Languages