Garrett Goon

AI, PyTorch, and distributed computing.

Formerly a researcher in theoretical physics. Links: Google Scholar, GitHub, LinkedIn, and an old (~2022) CV.

Professional and personal blog posts, previous research interests, talks, and work-in-progress notes can be found below.

Photograph of Garrett Goon.

Hugo Blog

Short-form notes on various topics. See all posts →

Notes

Screenshot of technical notes

Notes on Transformers (WIP). Direct link to pdf here.

Professional Blog Posts

Grouped GEMM scheduling

Accelerating MoE’s with a Triton Persistent Cache-Aware Grouped GEMM Kernel

Plot of tensor-parallel throughput

Tensor Parallelism in Three Levels of Difficulty

Thumbnail of saved activations

Activation Memory: A Deep Dive using PyTorch

Activation memory diagram thumbnail.

Activation Memory: What is it?

Stable diffusion images.

Personalizing Stable Diffusion with Determined

arXiv/viXra: ML Project

Pie chart of quiz results

arXiv/viXra Quiz

Can you distinguish papers from arXiv and viXra?

confusion matrix for quiz results

arXiv/viXra - Introduction

Questions and goals.

Corner plot of arxiv/vixra data

arXiv/viXra - The Data

Exploring.

Learning rate finder plot.

arXiv/viXra - Workflow

Tools and process.

Plot of logistic regression cumulative weights.

arXiv/viXra - Baseline Models

Starting simple.

Plot of recurrent neuron excitations.

arXiv/viXra - Simple Recurrent Models

Working memory.

Heatmap of cosine-similarity between various words.

arXiv/viXra - Embeddings

Pointy words.

Physics Posts

Picture of Gaussian random field realization

Gaussian Fields

What they are and how to generate them simply.

Equation defining natural units

Natural Units Convertor

Computing in units where \(\hbar=c=k_B=1\) (and sometimes \(G_N=1\), too)

Previous Research Interests (Physics)

Click on the text for links to relevant papers.

The Early Universe

What signatures of primordial physics are cosmologically observable? How different was the particle content at early times?

The Dark Sector

What is the nature of dark energy? Can cosmic acceleration be explained by any consistent long-distance modification of gravity?

Black Holes

What can black holes tell us about high-energy physics? What are generic features of black holes beyond General Relativity?

Geometry in Physics

How can we leverage elegant geometrical concepts to simplify the description of physical theories?

Press

Picture displaying 'Undisciplined Podcast' text

Gravity Falls

Discussed 1909.05254 and related exciting research on black holes.

Picture displaying 'Quanta Magazine' text

Black Hole Paradoxes

Popular article about black holes beyond General Relativity featuring my 1909.05254

Selected Talks

Title slide for PyTorch 2025 conference talk.

PyTorch Conference 2025

October 2025

Title slide for PyTorch Day France 2025 talk.

PyTorch Day France 2025

May 2025

Title slide for Pitt-PACC 2020 seminar

Pitt-PACC Seminar

March 2020

Title slide for DAMTP 2019 seminar

DAMTP, U. Cambridge GR Seminar

April 2019

Title slide Utrecht colloquium 2017

Universiteit Utrecht, Nico van Kampen Colloquium

June 2017

Title slide EPFL 2016 seminar

École polytechnique fédérale de Lausanne (EPFL) Seminar

October 2016