Protect AI
Protect AI provides artificial intelligence (AI) security solutions within the cybersecurity domain. The company offers products to secure AI applications throughout their lifecycle, from model selection and testing to runtime monitoring and protection. Protect AI serves sectors that require AI security measures, including tech companies and enterprises integrating AI into their operations. It was founded in 2022 and is based in Seattle, Washington. In April 2025, Protect AI was acquired by Palo Alto Networks.
Promptfoo
Promptfoo focuses on AI security, specifically addressing language model vulnerabilities in the tech industry. The company provides tools for adaptive red teaming, model security, and evaluations to identify and mitigate risks in AI systems. Promptfoo serves enterprises that require AI security measures, including large companies and the developer community. It was founded in 2024 and is based in San Francisco, California.
Mercor
Mercor offers artificial intelligence-based services for talent acquisition in the human resources sector. It provides a platform that matches candidates with job opportunities and facilitates the hiring process for companies. The company services are designed to streamline the recruitment process by offering tools for resume indexing, interview scheduling, and global payment compliance. It was founded in 2023 and is based in San Francisco, California.
Comet
Comet provides a self-hosted and cloud-based meta-machine learning platform allowing data scientists and teams to track, compare, explain, and optimize experiments and models. Comet was founded in 2017 and is based in New York, New York.
Confident AI
Confident AI provides services related to large language model (LLMs) evaluation and optimization in the artificial intelligence sector. The company's offerings include a platform for benchmarking, monitoring, and improving the performance of large language models using evaluation metrics and tools. Confident AI serves teams that develop and deploy LLM applications. It was founded in 2023 and is based in San Francisco, California.
Ragas
Supercharge Your LLM Application Evaluations 🚀
Gentrace
Gentrace develops and monitors artificial intelligence (AI) applications, particularly in the large language model (LLM) sector. The company provides services that include testing and monitoring these applications, automating grading processes, and simplifying trace data for evaluation. The solutions aim to transition AI applications from the minimum viable product (MVP) to production. It was founded in 2020 and is based in San Francisco, California.
HoneyHive
HoneyHive is a platform for AI observability and evaluation, serving the artificial intelligence domain. The company provides tools for testing, debugging, monitoring, and optimizing AI agents, particularly large language models (LLMs). HoneyHive's platform supports LLM applications in production through human feedback and quantitative analysis. It was founded in 2022 and is based in Albany, New York.
Klu
Klu provides a generative AI platform for SaaS applications. It aims to simplify the design, deployment, and optimization of AI-enabled applications. The company was founded in 2022 and is based in London, United Kingdom.
Kolena
Kolena is a company focused on AI quality assurance and data analysis within the artificial intelligence and machine learning sectors. The company has a platform for processing unstructured data and provides tools for validating and testing AI models, particularly in computer vision and natural language processing. Kolena's solutions are used in sectors like finance, legal, and corporate environments, aiming to assist in decision-making processes through data analysis and AI quality standards. It was founded in 2021 and is based in San Francisco, California.
Evidently AI
Evidently AI focuses on AI observability and machine learning monitoring within the technology sector. The company's offerings include evaluating, testing, and monitoring AI-powered products, with a focus on large language model (LLM) observability and machine learning (ML) observability, along with an open-source Python library for ML monitoring. Evidently AI serves sectors that require AI and ML systems, providing tools for data drift detection, data quality assurance, and model performance tracking. It was founded in 2020 and is based in San Francisco, California.
LangSmith
LangChain specializes in the development of large language model (LLM) applications and provides a suite of products that support developers throughout the application lifecycle. It offers a framework for building context-aware, reasoning applications, tools for debugging, testing, and monitoring application performance, and solutions for deploying application programming interfaces (APIs) with ease. It was founded in 2022 and is based in San Francisco, California.