Fractile
Fractile is building chips to run large language models two orders of magnitude faster. Existing hardware is good for training LLMs, but very poorly suited to subsequent inference of the trained model, which is increasingly the dominant workload. A network’s weights need to be moved onto a chip once per word generated, and this movement takes a few hundred times longer than the subsequent computations themselves. Fractile’s revolutionary approach to fusing computation with memory eliminates this bottleneck, and can scale to allow running the world’s largest models at a global scale.
Fractile
Fractile is building chips to run large language models two orders of magnitude faster. Existing hardware is good for training LLMs, but very poorly suited to subsequent inference of the trained model, which is increasingly the dominant workload. A network’s weights need to be moved onto a chip once per word generated, and this movement takes a few hundred times longer than the subsequent computations themselves. Fractile’s revolutionary approach to fusing computation with memory eliminates this bottleneck, and can scale to allow running the world’s largest models at a global scale.
TL;DR
Product: Processors that physically interleave memory and compute to accelerate LLM inference
Headquarters: London, United Kingdom (team presence in London and Bristol)
Founded: 2022
Founder & CEO: Walter Goodwin
Funding: $17.5M total; currently Seed-stage
Employees: 71
Related Companies
| Company |
|---|
 |
 |
 |
 |
 |
Company Overview
Problem Domain
Large language model (LLM) inference / AI hardware
Founded
2022
Industry
Computer Hardware Manufacturing
Funding Track Record
$15M
Company emerged from stealth with a $15M seed round; investor participation reported from Kindred Capital, NATO Innovation Fund, Cocoa, and Inovia Capital.
Investor Signal
“Backed by technology- and science-focused investors including Oxford Science Enterprises and Kindred Capital, with participation from the NATO Innovation Fund and later involvement from Patrick Gelsinger and ARIA.”