Not sure if this should go in CPU or GPU discussions because it appears to be a hybrid of both...
https://www.cerebras.net/technology/
Now this is interesting....
https://www.cerebras.net/technology/
- 46,225 mm2 chip (56x larger than the biggest GPU ever made)
- 400,000 cores (78x more cores)
- 18 GB on-chip SRAM (3000x more on-chip memory)
- 33,000x more bandwidth (100 Pb/s interconnect)
Now this is interesting....