← back to the journal

Tag

#nemotron

1 entries

The Day I Lost to Tensor Parallelism: Nemotron-70B Across Two DGX Sparks

“The right response to 'the weights don't fit' was to shrink the weights, not to distribute them across a fabric with a documented collective bug.”