Is Hardware chasing Software or vice-versa for Generative AI workloads ?
Generative AI has changed the world profoundly since ChatGPT in November 2022. The significance of ChatGPT is that it did the hard 10% of what was missing from prior generations of generative auto-regressive models, which was to scale up significantly from previous generations.
In addition, the use of human feedback
