Athina AI

Athina is a web-based collaborative IDE and platform for AI teams to build, test, and monitor LLM-powered applications using a spreadsheet-like workspace.

Key capabilities include:

• Spreadsheet-style development for prototyping pipelines and working with datasets (filter, sort, edit, annotate), plus dynamic columns that can run LLM prompts, code, API calls, and data transformations.
• Prompt management with versioning, plus side-by-side comparisons across prompts and models.
• Evaluations and QA with 50+ preset metrics and support for custom evaluators (including LLM-as-a-judge), designed to run in development, CI/CD, and production.
• Observability for production AI with monitoring and tracing, online evals on incoming logs, and analytics to track costs, latency, and quality and investigate issues such as hallucinations.

Pricing: Freemium with a Free Starter tier (includes 10k logs/month) plus Pro (contact sales) and Enterprise (custom pricing).

Notable for combining a collaborative, spreadsheet-like UI with end-to-end LLM observability and flexible integrations. It supports custom models and providers (including Azure OpenAI and AWS Bedrock), offers self-hosted deployments, fine-grained access controls, and is SOC 2 Type 2 compliant.