neural_compressor.experimental.data

Built-in dataloaders, datasets, transforms, filters for multiple framework backends.

Subpackages

• neural_compressor.experimental.data.dataloaders
  • neural_compressor.experimental.data.dataloaders.base_dataloader
  • neural_compressor.experimental.data.dataloaders.dataloader
  • neural_compressor.experimental.data.dataloaders.default_dataloader
  • neural_compressor.experimental.data.dataloaders.fetcher
  • neural_compressor.experimental.data.dataloaders.mxnet_dataloader
  • neural_compressor.experimental.data.dataloaders.onnxrt_dataloader
  • neural_compressor.experimental.data.dataloaders.pytorch_dataloader
  • neural_compressor.experimental.data.dataloaders.sampler
  • neural_compressor.experimental.data.dataloaders.tensorflow_dataloader
• neural_compressor.experimental.data.datasets
  • neural_compressor.experimental.data.datasets.bert_dataset
  • neural_compressor.experimental.data.datasets.coco_dataset
  • neural_compressor.experimental.data.datasets.dataset
  • neural_compressor.experimental.data.datasets.dummy_dataset
  • neural_compressor.experimental.data.datasets.dummy_dataset_v2
  • neural_compressor.experimental.data.datasets.imagenet_dataset
  • neural_compressor.experimental.data.datasets.style_transfer_dataset
• neural_compressor.experimental.data.filters
  • neural_compressor.experimental.data.filters.coco_filter
  • neural_compressor.experimental.data.filters.filter
• neural_compressor.experimental.data.transforms
  • neural_compressor.experimental.data.transforms.imagenet_transform
  • neural_compressor.experimental.data.transforms.tokenization
  • neural_compressor.experimental.data.transforms.transform

Package Contents

Classes

Datasets	A base class for all framework datasets.
Dataset	The base class of dataset.
IterableDataset	An iterable Dataset.
TRANSFORMS	Transforms collection class.
BaseTransform	The base class for transform.
FILTERS	The filter register for all frameworks.
Filter	The base class for transform.

Functions

dataset_registry(dataset_type, framework[, dataset_format])	Register dataset subclasses.
transform_registry(transform_type, process, framework)	Class decorator used to register all transform subclasses.
filter_registry(filter_type, framework)	Register all transform subclasses.

Attributes

DATALOADERS