
Neural Magic is a series-A company that specializes in enterprise inference solutions for open-source machine learning models, focusing on optimizing performance and hardware efficiency across both GPUs and CPUs. Founded in 2018 by MIT experts, the company has developed state-of-the-art techniques for model quantization and sparsification, enabling organizations to deploy AI models securely and cost-effectively. With a commitment to open-source innovation, Neural Magic provides subscription-based enterprise-grade inference server solutions that maximize computational efficiency and support a wide range of infrastructures, including cloud, data centers, and edge computing.

Neural Magic is a series-A company that specializes in enterprise inference solutions for open-source machine learning models, focusing on optimizing performance and hardware efficiency across both GPUs and CPUs. Founded in 2018 by MIT experts, the company has developed state-of-the-art techniques for model quantization and sparsification, enabling organizations to deploy AI models securely and cost-effectively. With a commitment to open-source innovation, Neural Magic provides subscription-based enterprise-grade inference server solutions that maximize computational efficiency and support a wide range of infrastructures, including cloud, data centers, and edge computing.
Founded: 2018 in Somerville, Massachusetts
Founders: Nir Shavit and Alex Matveev
Core product focus: Enterprise inference and model-optimization (quantization, sparsification) for CPUs and GPUs
Key products: nm-vllm, DeepSparse, SparseML
Funding: Total ~ $50M (seed + Series A); Series A $30M (Oct 5, 2021)
Exit / M&A: Acquisition announced by Red Hat (Nov 12, 2024)
Model inference performance and hardware efficiency for production AI deployments
2018
5000000.00
Raised prior to Nov 6, 2019 (reported $5M pre-seed)
15000000.00
Participants included NEA, Andreessen Horowitz, Pillar VC, and Amdocs
30000000.00
Participants included Andreessen Horowitz, Amdocs, Comcast Ventures, Pillar VC, and Ridgeline Ventures; company reported total raised became $50M after this round
“Backed by NEA, Comcast Ventures, Andreessen Horowitz, Pillar VC, Amdocs, and Ridgeline Ventures; acquisition announced by Red Hat on Nov 12, 2024”