Christopher Prohm

Whisper in ONNX with key value caching pt. 2

As promised in the last post, I will cover the ONNX conversion of the full Whisper model, including key-value caching, in this post. The full model resists a straightforward ONNX conversion due to its reliance on hooks and branching control flow. In this post I will discuss how to patch the model to make it exportable.

Read more

Table of contents

#c++ #htmx #java #js #ml #polars #python #rust #testing

2023

Whisper in ONNX with key value caching pt. 2

Whisper in ONNX with key value caching pt. 1

Whisper in ONNX

Vega-Lite plots with HTMX using custom elements

Nested declarative macros for enum dispatch in Rust

Self contained task runners in Python

Plotting Polars data frames with Seaborn

2022

Mixing React and htmx

Reusable htmx components with custom elements

2021

cargo without project

Rust: the emergent complexity of a simple language

The project that got me started with Rust

Linearizing graphs

2020

Hacking python's import system for single file packages

2019

asyncio testing inside notebooks

2018

Prototyping to tested code, or developing across notebooks and modules

Causality and function approximations

Better test output with AST rewriting and a patched standard library

2017

Efficient Labeling in IPython

Keyword detection from scratch

Minimalist personal cross device notes

2016

ipytest: running pytest in IPython notebooks

framequery - SQL on dataframes

Sharing data and control

ipytest - a IPython test runner

Debugging with q

Spring cleaning

2015

void for traits

End-to-end training of deep autoencoders in IPython

argmap available on PyPI

2014

Argmap: declarative argument parsing with Python

tomato timer & the pomodoro technique

jsonbind - guice configured with json

2013

Yet another short update

Short update

Restricted Boltzmann Machines - Theory II

Restricted Boltzmann Machines - Theory I

Machine Learning with Generative Models

Recipes for jmpress animations

Wrapping C++ code using boost python

Animations in jmpress

Exporting D3 graphs

Simple html5 talks

HTML5 Presentations

Multi-particle collision dynamics

Welcome