In simple English
Alibaba makes a series of powerful artificial intelligence models called Qwen. These models can write code, answer questions, and plan multi-step tasks. You can run them on your own computer or server without sending your data to a third party. The software is free to use under an open licence. You will need a powerful graphics card or a cloud server with plenty of memory to run the larger versions.
What it is
Qwen3.8 is an open-weight large language model series from Alibaba Group that brings top-tier AI capabilities to local machines and private servers. It includes models of various sizes, supporting text, code generation, and agentic workflows.
What it is good for
Solo builders who want a capable, private AI model for coding assistance, automation, and document processing without paying recurring fees to external API providers.
- Runs locally on your own hardware for complete privacy and data control.
- Supports advanced reasoning and multi-step agent tasks.
- Compatible with popular inference tools like vLLM, SGLang, and Hugging Face Transformers.
- Large model sizes require expensive graphics cards with high RAM.
- Setting up a local inference server requires technical knowledge of command-line tools.
- Model weights take up many gigabytes of disk space.
Proprietary cloud AI APIs
vLLM
- mudler/LocalAI50k stars
Serves text, vision, speech, image and video models from one self-hosted service that imitates the paid interfaces.
- janhq/jan45k stars
Downloads and runs language models entirely offline as a desktop application, and opens a local server other programs can use.
- Mintplex-Labs/anything-llm67k stars
One program that reads your documents and answers questions about them, with the model running locally if you want.
pip install transformers transformers serve Qwen/Qwen3.8-27B --port 8000 --continuous-batching