Two questions:

• What's the TFLOPs/Watt of an H100 today?

• What floating point precision is this about? Double-precision?

GPUs usually don't do higher than single precision (32 bit), It's considered unnecessary for graphics or neural networs. But good question, modern ai systems do often use even lower precision.

Well H100 supports double precision 🤷‍♂️

In practice modern AI is usually much less than 32 bit; 16 bit is the large end. Honestly I'd recommend counting any of 8, 16, or 32 bit flop/s/w performance for this question.

This market will use an adjusted flop/s/w by adjusting k-bit precision by a factor of 2^(1 - 32/k). That is, 16 bit precision counts 1/4 as much as 32 bit, which counts 1/4 as much as 64 bit precision.

Whichever precision gets the highest score is counted as the FLOP/s/W for the chip.