TensorFlow Lite
LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization
Apple Neural Engine
Apple operates as a technology company that designs and manufactures consumer electronics, personal computing devices, and mobile communication devices. The company offers products including smartphones, tablets, laptops, smartwatches, and accessories, as well as services such as streaming media, digital content, and financial services. Apple's products are integrated within its ecosystem. It was founded in 1976 and is based in Cupertino, California.
Samsung Exynos
Samsung Semiconductor specializes in semiconductor solutions and operates in the technology sector. The company offers a portfolio including dynamic random access memory (DRAM), solid state drive (SSD)s, processors, image sensors, and display integrated circuit (IC)s. Samsung Semiconductor serves various sectors including consumer electronics, automotive, and networking. It was founded in 1974 and is based in San Jose, California.
ONNX Runtime
Open standard for machine learning interoperability
AWS Inferentia 2
Amazon Web Services provides cloud computing services in sectors including technology, finance, and healthcare. AWS offers services such as virtual servers and data storage, as well as AI and machine learning capabilities. The company serves startups, enterprises, and public sector organizations that use cloud technology. It was founded in 2006 and is based in Seattle, Washington. Amazon Web Services operates as a subsidiary of Amazon.
Groq LPU
Groq specializes operates as an AI inference technology within the semiconductor and cloud computing sectors. The company provides computation services for AI models, ensuring compatibility and efficiency for various applications. Groq's products are designed for both cloud and on-premises AI solutions. It was founded in 2016 and is based in Mountain View, California.
Graphcore
Graphcore specializes in processor technology for artificial intelligence, operating within the artificial intelligence (AI) and machine learning industry. The company offers Intelligence Processing Units (IPUs) designed to accelerate machine learning tasks and enable new types of AI research. Graphcore's products are utilized across various sectors, including finance, healthcare, scientific research, and AI-native startups. It was founded in 2016 and is based in Bristol, United Kingdom. In July 2024, Graphcore was acquired by SoftBank.
Cerebras WSE-3
Cerebras focuses on Artificial Intelligence (AI) acceleration through its development of wafer-scale processors and supercomputers for different sectors. The company provides computing solutions that support deep learning, natural language processing, and other AI workloads. Cerebras serves industries including healthcare, scientific computing, and financial services with its AI supercomputers and model training services. It was founded in 2015 and is based in Sunnyvale, California.
AWS Trainium 2
Amazon Web Services provides cloud computing services in sectors including technology, finance, and healthcare. AWS offers services such as virtual servers and data storage, as well as AI and machine learning capabilities. The company serves startups, enterprises, and public sector organizations that use cloud technology. It was founded in 2006 and is based in Seattle, Washington. Amazon Web Services operates as a subsidiary of Amazon.
Tenstorrent
Tenstorrent is a computing company specializing in hardware focused on artificial intelligence (AI) within the technology sector. The company offers computing systems for the development and testing of AI models, including desktop workstations and rack-mounted servers powered by its Wormhole processors. Tenstorrent also provides an open-source software platform, TT-Metalium, for customers to customize and run AI models. It was founded in 2016 and is based in Toronto, Canada.
d-Matrix
d-Matrix specializes in AI inference technology within the computing sector. The company offers a platform named Corsair, which is designed to provide low-latency processing for generative AI applications. Corsair is a solution for data centers, aiming to make AI inference viable by addressing the balance between speed and efficiency. It was founded in 2019 and is based in Santa Clara, California.
Etched
Etched focuses on developing the transformer supercomputer, specializing in the high-performance computing sector. The company's main offering includes powerful servers designed for transformer inference, which are capable of processing extensive data for applications such as real-time voice agents and content generation. The company's products are aimed at supporting complex computational tasks like running trillion parameter models and are complemented by a fully open-source software stack. It was founded in 2022 and is based in Cupertino, California.