`neural_compressor.utils.load_huggingface`

Huggingface Loader: provides access to Huggingface pretrained models.

Module Contents

Classes

OptimizedModel

The class provides a method from_pretrained to access Huggingface models.

Functions

save_for_huggingface_upstream(model, tokenizer, output_dir)

Save the model and tokenizer in the output directory.

class neural_compressor.utils.load_huggingface.OptimizedModel(*args, **kwargs)[source]: The class provides a method from_pretrained to access Huggingface models.

neural_compressor.utils.load_huggingface.save_for_huggingface_upstream(model, tokenizer, output_dir)[source]: Save the model and tokenizer in the output directory.