Developer tools AI Tools

Open-source LLMOps platform for prompt management, LLM evaluation, and observability. Build, evaluate, and monitor production-grade LLM applications. [#opensource](https://github.com/agenta-ai/agenta)

Unified infrastructure for AI agents and automation. One API key for all services instead of managing dozens. Build production-ready agents without operational complexity.

AI/ML API gives developers access to 100+ AI models with one API.

CLI that provides command completion, command translation using generative AI to translate intent to commands, and a full agentic chat interface with context management that helps you write code.

Automated Code Reviews: Find Bugs, Fix Security Issues, and Speed Up Performance.

Debug Production x10 Faster with AI.

CLI allowing you to interact with AWS Cloud using human language inside your Terminal.

Detect and remediate hallucinations in any LLM application.

Cohere provides access to advanced Large Language Models and NLP tools.

Ship Blazing-Fast Python Code — Every Time.

An AI-powered code review tool that helps developers improve code quality and productivity.

A framework for building NLP applications (e.g. agents, semantic search, question-answering) with language models.

A Open-source No-Code tool to build your AI Chatbot / Agent (multi-lingual, multi-channel, LLM, NLU, + ability to develop custom extensions)

Open source Tool for converting user traffic to Test Cases and Data Stubs.

Intuitive app to build your own AI models. Includes no-code synthetic data generation, fine-tuning, dataset collaboration, and more.

A framework for developing applications powered by language models.

Open-source LLM engineering platform that helps teams collaboratively debug, analyze, and iterate on their LLM applications. [#opensource](https://github.com/langfuse/langfuse)

A data framework for building LLM applications over external data.

LMQL is a query language for large language models.

A generative AI evaluation and observability platform, empowering modern AI teams to ship products with quality, reliability, and speed.

Load and run large LLMs locally to use in your terminal or build your apps.

Free tool that tracks API uptime and latencies for various OpenAI models and other LLM providers.

Evaluate, test, and ship LLM applications with a suite of observability tools to calibrate language model outputs across your dev and production lifecycle.

Your Operations Co-pilot on Slack/Teams. It assists and prompts oncall with relevant information to debug issues.

Open-source tool for ML observability that runs in your notebook environment, by Arize. Monitor and fine-tune LLM, CV, and tabular models.

Open source framework for building agents that pre-express their planned actions, share their progress and can be interrupted by a human. [#opensource](https://github.com/portiaAI/portia-sdk-python)

Full-stack LLMOps platform to monitor, manage, and improve LLM-based apps.

Seamlessly integrate private, controlled, and compliant Large Language Models (LLM) functionality.

AI GTM Automation Agent

AI-powered backend platform with Vector DB, DocumentDB, Auth, and more to speed up app development.

AI Platform Engineer

An open-source framework for building production-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluations, and experimentation.

A web-hosted IDE where non-technical domain experts work with AI Engineers to build task-specific AI agents. It approaches prompting as a new programming language rather than low/no-code blocks.