Tenstorrent details Blackhole at Hot Chips: Tensix AI cores, 16 RISC-V CPUs and built-in Ethernet

Tenstorrent/Blackhole

At Hot Chips 2024 Tenstorrent detailed Blackhole: 140 Tensix AI cores delivering 745 teraFLOPS at FP8, 32 GB GDDR6 memory, 16 RISC-V CPU cores running Linux, and ten 400 Gb/s Ethernet links for chaining chips. Standard Ethernet interconnect enables 32 chips to form one Galaxy system without proprietary hardware.

• Blackhole: 140 Tensix cores, 752 Baby RISC-V cores, 16 Big RISC-V cores capable of running Linux; 745 teraFLOPS FP8 (372 teraFLOPS FP16).
• 32 GB GDDR6 memory; ten 400 Gb/s Ethernet links totaling 1TBps bandwidth enabling standard network interconnection between chips.
• Blackhole Galaxy clusters 32 chips in 4x8 mesh topology, achieving nearly 24 petaFLOPS FP8 with 1TB memory and 16 TBps aggregate bandwidth.