The cost of inference is trending towards zeroToken throughput is trending towards infinityContext windows sizes are getting largerCompanies are spending more on training despite improvements in compute and cost efficiencyModels are quickly becoming commoditizedCompute is quickly becoming commoditizedWe’re sharing our notes on trends that we wrote about back in December of last year (and updated in February of 2024). This document has been sitting in our team Notion workspace for almost half ...