국힘 공관위, 오세훈 겨냥 “후보 없더라도 공천 기강 세울 것”
Go to worldnews
。业内人士推荐黑料作为进阶阅读
Фото: Damian Lugowski / Shutterstock / Fotodom
So, where is Compressing model coming from? I can search for it in the transformers package with grep \-r "Compressing model" ., but nothing comes up. Searching within all packages, there’s four hits in the vLLM compressed_tensors package. After some investigation that lets me narrow it down, it seems like it’s likely coming from the ModelCompressor.compress_model function as that’s called in transformers, in CompressedTensorsHfQuantizer._process_model_before_weight_loading.
Copyright © ITmedia, Inc. All Rights Reserved.