Skip to content

Commit c7c9248

Browse files
kylesayrsdsikka
andauthored
Change deprecated name to has_offloaded_params (vllm-project#1556)
The `is_module_offloaded` util is now deprecated and has been implemented under the name `has_offloaded_params`. `has_offloaded_params` is the name adopted by accelerate. https://github.com/neuralmagic/compressed-tensors/blob/main/src/compressed_tensors/utils/offload.py#L118-L120 Signed-off-by: Kyle Sayers <[email protected]> Co-authored-by: Dipika Sikka <[email protected]>
1 parent 74c1063 commit c7c9248

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

src/llmcompressor/transformers/sparsification/compressed_tensors_utils.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@
1010
ModelCompressor,
1111
SparsityCompressionConfig,
1212
delete_offload_parameter,
13-
is_module_offloaded,
13+
has_offloaded_params,
1414
register_offload_parameter,
1515
)
1616
from loguru import logger
@@ -138,7 +138,7 @@ def untie_word_embeddings(model: PreTrainedModel):
138138
continue
139139

140140
# this could be replaced by a `get_offloaded_parameter` util
141-
if not is_module_offloaded(module):
141+
if not has_offloaded_params(module):
142142
untied_data = module.weight.data.clone()
143143
else:
144144
untied_data = module._hf_hook.weights_map["weight"].clone()

0 commit comments

Comments
 (0)