FLOPs (floating-point operations)
Also written: FLOPs, FLOP, floating-point operations
Individual arithmetic operations such as multiplications, used as a measure of compute. Training costs about 6 × parameters × tokens FLOPs.
Also written: FLOPs, FLOP, floating-point operations
Individual arithmetic operations such as multiplications, used as a measure of compute. Training costs about 6 × parameters × tokens FLOPs.