In simple English
This program stores large files across many computers so your data is always safe. You can build a private cloud storage service for backups or web media. It takes a lot of time to configure and maintain a large cluster. You need multiple servers to get the best results from it.
What it is
OpenStack Swift is an open-source storage system designed for high concurrency and multi-tenancy. It uses a REST-based API (a set of rules that lets different software programs talk to each other over the web) to manage unstructured data.
What it is good for
Solo builders and infrastructure teams who want to host their own S3-compatible object storage for backups or large media files without relying on a public cloud provider.
- Scales from one test machine to thousands of production servers.
- Provides a well-documented API for reading and writing files.
- Handles unstructured data like backups and user uploads without slowing down.
- Requires complex setup and deep knowledge of distributed systems.
- Needs an XFS filesystem with large xattrs (extended attributes used to store extra file metadata) for reliable testing.
- Demotes small-scale solo deployments in favor of massive enterprise clusters.
Amazon S3
OpenStack
- ceph/ceph17k stars
A distributed storage cluster that handles object, block, and file storage under one roof.
- caprover/caprover15k stars
A web page that installs apps and databases onto one rented computer, and sorts out the addresses and certificates.
- google/slo-generator564 stars
Turns a written reliability target into a measured number and a remaining budget.
- vectordotdev/vector23k stars
One collector that gathers logs and numbers from machines and sends them to one or more monitoring services.
pip install -r requirements.txt -r doc/requirements.txt sphinx-build -W -b html doc/source doc/build/html