Win Wang

Everyone knows about LLM inference on GPUs, but what about type inference on GPUs? After all, we love strong types, but hate compile times. Unfortunately, the more we try to prove about our programs, the more time we spend waiting for our builds.

Can we throw a GPU at it? Is type inference even that parallelizable? What about for type systems of real languages like Scala, or Rust, etc.?

One commonality of these languages is typeclass resolution. Whether it’s called implicit resolution or trait resolution, it’s a powerful pattern, but can induce particularly long compile times.

We’ve convinced ourselves that type inference is highly serial, but it doesn’t have to be. We’ll explore how we might scale such type systems to many cores, unlock data-parallelism, and accelerate type inference and resolution on GPUs.