⚡Stack Radar

AI & Automation · AI Development & Evaluation

Prompt Management

6 paid against 10 free you can run yourself.

Paid against free › AI & Automation › AI Development & Evaluation › Prompt Management · AI and models on Repo Radar

Prompt management tools keep the prompts behind an AI app out of the code: every version is saved, teammates can edit and test them in a playground, and the app fetches the approved version at runtime. Dedicated tools (PromptLayer, PromptHub) sit next to platforms where prompt management is one part of a wider stack: gateways (Portkey, Orq.ai) and LLM engineering platforms with tracing and evals (Langfuse, LangSmith, Braintrust). On the open-source side Langfuse covers the full workflow, MLflow and Opik add prompt registries to evaluation, DSPy optimises prompts automatically, BAML turns prompts into typed functions and promptfoo tests them in CI. Marks come from vendor pricing pages and project READMEs as of 19 October 2026; nothing was tested hands-on.

Paid 6 reviewed

Prices and free tiers as checked, dated on each review.

PPromptLayer

Prompt management, evals, and observability platform for AI teams.

$49free tierPPromptHub

PromptHub is a prompt management platform for teams to test, deploy, and manage prompts.

$12free tierAAgenta

Open-source workspace for building, evaluating, and monitoring AI agents.

$29free tierPPortkey AI Gateway

Unified AI gateway for LLM access, governance, and observability.

$49free tierLLatitude

Open-source AI agent monitoring platform for production teams.

$99free tierOOrq.ai

Enterprise AI gateway and control plane for building, deploying, and governing AI applications.

free tier

Free 10 direct · 7 related

Free to use. You run it on your own server.

Direct alternatives

They do this job.

DSstanfordnlp/dspy

It improves the instructions sent to an AI model by measuring the answers instead of guessing.

★ 38.7kFreePRlinshenkx/prompt-optimizer

An AI prompt optimizer for writing better prompts and getting better AI results.

★ 38.6kFreeREyamadashy/repomix

It packs a whole code folder into one file a language model can read.

★ 28.8kFreePRmicrosoft/promptflow

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

★ 11.3kFreeBABoundaryML/baml

A small language for describing what a model should return, and checking that it did.

★ 9.4kFreeCOmufeedvh/code2prompt

Turns a folder of code into one prompt, with a file tree and a token count.

★ 7.7kFreeGUguardrails-ai/guardrails

Wraps checks around what a language model is asked and what it answers.

★ 7.5kFreeNENVIDIA/NeMo-Guardrails

Puts rules you write around a language model's input and output, and enforces them before the answer reaches anybody.

★ 7.2kFreeAGAgenta-AI/agenta

Agenta is a workspace where you and your team build agents and automations.

★ 4.8kFreePEpezzolabs/pezzo

🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.

★ 3.3kFree

Related alternatives

A second choice: they cover part of this job or are a building block for it.

LAlangfuse/langfuse

A platform that traces language model calls, versions the prompts, and scores the output.

★ 35.7kFreeCOmksglu/context-mode

It cuts the output a coding assistant has to read, and keeps a searchable record of the session.

★ 29.4kFreePRpromptfoo/promptfoo

A test runner for prompts: you describe a good answer once, and it grades every model against it.

★ 26.1kFreeDEconfident-ai/deepeval

Tests for language-model output, written and run like ordinary unit tests.

★ 18.8kFreeOUdottxt-ai/outlines

Forces an AI model's answer into a shape you define, while the answer is being produced.

★ 15.9kFreeIN567-labs/instructor

Makes a language model return data in a declared shape, and retries automatically when it does not.

★ 14kFreeHEHelicone/helicone

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

★ 6.2kFree

Feature by feature

Every paid tool and free repository we compared, marked against the same features.

✓has itPartlysome plans or extra work—confirmed not available?not confirmed✓the vendor's claim onlypricingClick a mark for its note and source

Paid · 9Free · 10
Featurelangfuse/langfuseAgenta-AI/agentapezzolabs/pezzomicrosoft/promptflowstanfordnlp/dspyBoundaryML/bamlpromptfoo/promptfoomlflow/mlflowcomet-ml/opiklinshenkx/prompt-optimizer
Starts at$49 per month (Pro)$12 per month (single user)$29 per month (Starter)$49 per month$99 per month (Pro)Pay-as-you-go platform fee on token spend$29 per month (Core)$39 per seat per month (Plus)$249 per month (Pro)MITMITApache-2.0MITMITApache-2.0MITApache-2.0Apache-2.0AGPL-3.0
Manage
Prompt versioningKeep every version of a prompt and roll back.
PlaygroundTry prompts against models in a visual editor.
Deploy
Prompt registry served by APIApps fetch the current prompt at runtime instead of hard-coding it.
Evaluate
Evaluations and testsScore prompt outputs with tests or evaluators before shipping.
Experiments or A/B testsCompare prompt versions side by side or in production.
Improve
Automatic prompt optimisationRewrites or tunes prompts automatically against a goal.
Observe
Tracing and logsRecords the calls each prompt makes in production.
Deploy
Gateway or multi-provider routingRoutes prompts to many model providers through one endpoint.
Build
Typed prompts or structured outputsPrompts defined as typed functions or with output schemas.
Deployment
Self-hostingRun it on your own infrastructure.
Pricing
Free tierA free plan with real usage included.
No per-seat chargePaid plans include unlimited team members.
Teams
SSOSingle sign-on for organisations.
Licence
Open sourceSource published under an open licence.

Excluded candidates

Looked at, and left out of the comparison, with the reason.

Paid apps

  • VellumVellum's pricing page now sells a personal AI assistant with computer and credit plans ($30 to $200 a month), not a prompt management platform.Source
  • HumanloopHumanloop's site announces that it is joining Anthropic, so it is no longer an independent prompt management product to adopt.Source

Repositories

  • mufeedvh/code2promptcode2prompt converts a codebase into a single prompt for an AI model. It packs context for prompts rather than managing prompts, so it fits developer utilities better.Source
  • yamadashy/repomixRepomix packs a whole repository into one AI-friendly file. Like code2prompt it prepares context for prompts rather than managing prompts.Source
  • guardrails-ai/guardrailsGuardrails adds validation and safety checks to language model outputs. It is an output-safety tool, better compared with AI guardrail tools.Source
  • NVIDIA/NeMo-GuardrailsNeMo Guardrails is a toolkit for adding programmable guardrails to LLM apps. It controls conversations and safety rather than managing prompts.Source
  • microsoft/pomlPOML is Microsoft's prompt orchestration markup language. It is a prompt format rather than a management tool, and it has had no push since 14 January 2026.Source
  • latitude-dev/latitude-llmThe open-source Latitude repository now describes itself as observability for AI agents, so it is compared in AI Observability; the hosted Latitude is listed here as P5.Source
  • Arize-ai/phoenixPhoenix includes a prompt playground but is mainly AI observability and evaluation, compared in that subcategory; Opik and MLflow represent the overlap here.Source
  • rockbenben/ChatGPT-ShortcutChatGPT Shortcut is a searchable prompt library for ChatGPT users. It collects ready prompts rather than managing an application's prompts.Source
  • f/prompts.chatprompts.chat, formerly Awesome ChatGPT Prompts, is a community prompt collection. It is a library of example prompts rather than a management tool.Source
  • coze-dev/coze-loopCoze Loop is an agent optimisation platform with prompt development tied to the Coze ecosystem. It overlaps Langfuse and Opik, which are more widely used.Source

Gaps

What the research could not settle from the vendors' own pages.

What vendors don't publish

  • Several former prompt-management tools have changed course (Agenta and Latitude toward agents and observability), so their pricing pages no longer describe prompt management limits such as number of prompts or versions.Agenta, Latitude · checked 2026-10-19 · source 1 · source 2
  • Vendors meter usage in different units (requests, recorded logs, units, traces, credits, token spend), so the cost of managing prompts for the same app cannot be compared directly.PromptLayer, Portkey AI Gateway, Orq.ai, Langfuse, LangSmith · checked 2026-10-19 · source 1 · source 2 · source 3 · source 4

Where vendor pages disagree

  • Orq.ai's pricing page states two different platform fees: the plan comparison says 4% after 1M free requests, while the bill estimator applies 4.5% of token spend.Orq.ai · checked 2026-10-19 · source 1

Paid against free, in your inbox

One job at a time: the paid tools worth paying for, the free ones you can run yourself, and who should pick which.

No tracking pixels. One click to leave. We use your address to send Stack Radar and nothing else. Privacy.