henridf

I needed to quickly encode a protobuf from the command-line, and while I pretty much immediately came across protoc --encode as the obvious solution, I did not find much documentation on the input textual syntax.

Here is the relevant snippet from protoc --help:

--encode=MESSAGE_TYPE       Read a text-format message of the given type
                              from standard input and write it in binary
                              to standard output.  The message type must
                              be defined in PROTO_FILES or their imports.

	"""
	The most atomic way to train and inference a GPT LLM in pure, dependency-free Python.
	Differences from GPT-2 are minor: rmsnorm instead of layer norm, no biases, square ReLU instead of GeLU nonlinearity.
	The contents of this file is everything algorithmically needed to train a GPT. Everything else is just efficiency.
	Art project by @karpathy.
	"""

	import os # for os.path.exists
	import math # for math.log, math.exp
	import random # for random.seed, random.choices