Posts

Showing posts with the label throughput improvement

Benchmarking Dynamic Quantization for Larger Language Models