In 2019, training GPT-2 cost ~$43,000. Today, you can beat it for ~$73 . Costs have been falling to ~40% of the prior year! Still feels slow given how fast everyone claims AI is accelerating.