3 Commits

Author	SHA1	Message	Date
Yu Li	5ba2d28b7f	add block-wise scaled int8 quantization based on QuantizedLayout mechanism ... add more tests by comparing with manual torch implementation add perf benchmarks fix errors caused by merging default no output quant fix unittest	2025-12-10 12:23:05 -06:00
comfyanonymous	c58c13b2ba	Fix torch compile regression on fp8 ops. (#10580)	2025-11-01 00:25:17 -04:00
contentis	8817f8fc14	Mixed Precision Quantization System (#10498) ... * Implement mixed precision operations with a registry design and metadate for quant spec in checkpoint. * Updated design using Tensor Subclasses * Fix FP8 MM * An actually functional POC * Remove CK reference and ensure correct compute dtype * Update unit tests * ruff lint * Implement mixed precision operations with a registry design and metadate for quant spec in checkpoint. * Updated design using Tensor Subclasses * Fix FP8 MM * An actually functional POC * Remove CK reference and ensure correct compute dtype * Update unit tests * ruff lint * Fix missing keys * Rename quant dtype parameter * Rename quant dtype parameter * Fix unittests for CPU build	2025-10-28 16:20:53 -04:00