Loading…
Virtual Event
June 2
Learn More and Register to Attend
Back To Schedule
Wednesday, June 2 • 17:15 - 17:45
CFU Playground: Model-specific Acceleration on FPGAs - Timothy Callahan & Alan V. Green,Google

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
This talk describes the CFU Playground, an open-source framework that an engineer, intern, or student can use to design and evaluate enhancements to an FPGA-based soft RISC-V processor, specifically to increase the performance of machine learning (ML) tasks through the addition of custom function units (CFUs). The goal is to abstract away most infrastructure details so that the user can get up to speed quickly and focus solely on adding new processor functions, exploiting them in the computation, and measuring the results.  The presentation describes the process of identifying hot spots in the code during an inference using a specific model, constructing a CFU to support new custom instructions, modifying the TensorFlow Lite kernel library to use these new instructions, measuring the results, and iterating.  The goal is not to design a general ML accelerator; the goal is to jointly specialize the processor and ML kernels just for the model of interest.  All IP and software used is open sourced and licensed permissively -- the open RISC-V ISA that allows new custom instructions, the VexRiscv soft core implementation, the LiteX system-on-chip IP, the Symbiflow FPGA toolchain, Renode and Verilator simulators, and TensorFlow Lite kernel libraries.  Thus, the combined CPU, CFU, and kernel libraries that the user develops are not tied to any particular FPGA vendor; there are no licensing restrictions or fees; and there is no dependence on any black box proprietary tools.

Speakers
avatar for Timothy Callahan

Timothy Callahan

Software Engineer, Google
Tim Callahan studied electrical engineering at the University of Minnesota, computer science at the University of Cambridge, and attained graduate degrees at UC Berkeley, also in computer science. His graduate research and much of his career centered around compiling from various... Read More →
AV

Alan V. Green

Staff Software Engineer, Google
Alan is a Staff Software Engineer on the Google ChromeOS Platform team. He works on both making existing ML acceleration hardware accessible to the ChromeOS and on projects that require new hardware ML accelerators. Alan also contributes to the CFU-Playground project, exploring software... Read More →



Wednesday June 2, 2021 17:15 - 17:45 CEST
  Session
  • Slides Included Yes