AmpereOne and AMD are duking it out for the most cores in a single socket.
Links to the things I mentioned in this video:
- Supermicro MegaDC ARS-211ME-FNR: https://www.supermicro.com/en/products/system/megadc/2u/ars-211me-fnr
- My AmpereOne A192-32X Test Results: https://github.com/geerlingguy/sbc-reviews/issues/52
- N+1 Fan Redundancy: https://mainstream-corp.com/n-plus-1-vs-n-minus-1-redundancy/
- What is Edge Computing? https://stlpartners.com/articles/edge-computing/what-is-edge-computing/
- NEBS Level 3: https://en.wikipedia.org/wiki/Network_Equipment-Building_System
- Open RAN: https://www.keysight.com/us/en/assets/7121-1103/ebooks/The-Essential-Guide-for-Understanding-O-RAN.pdf
- AWS Graviton Arm CPU: https://aws.amazon.com/ec2/graviton/
- Google Axion Arm CPU: https://cloud.google.com/blog/products/compute/introducing-googles-new-arm-based-cpu
- Nvidia 4090 HPL FP64 Results: https://www.pugetsystems.com/labs/hpc/NVIDIA-RTX4090-ML-AI-and-Scientific-Computing-Performance-Preliminary-2382/#HPL_Linpack
- Ampere-optimized llama.cpp: https://github.com/AmpereComputingAI/llama.cpp
- AmpereOne Aurora 512-core CPU announcement: https://amperecomputing.com/blogs/introducing-ampereone-aurora
- Phoronix AmpereOne review: https://www.phoronix.com/review/ampereone-a192-32x
- Phoronix AmpereOne vs AMD Epyc Turin: https://www.phoronix.com/review/amd-epyc-9965-ampereone
- ServeTheHome review: https://www.servethehome.com/ampere-ampereone-a192-32x-review-a-192-arm-core-supermicro-nvidia-broadcom-kioxia-server-cpu/
- ChipsAndCheese architecture overview: https://chipsandcheese.com/p/ampereone-at-hot-chips-2024-maximizing-density
Ampere and Supermicro sent the AmpereOne server used in this video for testing. They did not pay for this video nor have any say in the content of the video. See my sponsorship policies: https://github.com/geerlingguy/youtube?tab=readme-ov-file#sponsorships
Support me on Patreon: https://www.patreon.com/geerlingguy
Sponsor me on GitHub: https://github.com/sponsors/geerlingguy
Merch: https://www.redshirtjeff.com
2nd Channel: https://www.youtube.com/@GeerlingEngineering
3rd Channel: https://www.youtube.com/@Level2Jeff
Contents:
00:00 - 192 Cores
01:07 - Massive core counts, and a strange era
02:46 - What's in front
04:20 - What's in back (only fans)
05:49 - What's inside
07:32 - What it's for (Edge ORAN)
09:31 - Racking and repairing RAM
10:30 - Benchmarking hits different (why not Geekbench?)
14:16 - An excuse for 25G on the Arm NAS
15:57 - Benchmarking 192 Arm cores
17:00 - Arm-native workloads
18:19 - Other benchmarks
19:04 - The only game in town
20:30 - Arm's all grown up
21:44 - Myths about x86 and Arm