Skip to content

Instantly share code, notes, and snippets.

View Philmod's full-sized avatar

Philippe Modard Philmod

View GitHub Profile
@karpathy
karpathy / microgpt.py
Last active February 14, 2026 16:28
microgpt
"""
The most atomic way to train and inference a GPT in pure, dependency-free Python.
This file is the complete algorithm.
Everything else is just efficiency.
@karpathy
"""
import os # os.path.exists
import math # math.log, math.exp
steps:
- name: gcr.io/cloud-builders/docker
args: ['version']
- name: gcr.io/cloud-builders/docker
args: ['pull', 'r2d4/mocker:latest']
- name: gcr.io/cloud-builders/docker
args: ['pull', 'ubuntu:16.04']
- name: gcr.io/cloud-builders/wget