neural_compressor.experimental.data.dataloaders.fetcher

Definitions of the methods to fetch data from an iterable-style or list-style dataset.

Module Contents

Classes

Fetcher	Base class for different fetchers.
IterableFetcher	Iterate to get next batch-size samples as a batch.
IndexFetcher	Take single index or a batch of indices to fetch samples as a batch.

class neural_compressor.experimental.data.dataloaders.fetcher.Fetcher(dataset, collate_fn, drop_last)

Base class for different fetchers.

class neural_compressor.experimental.data.dataloaders.fetcher.IterableFetcher(dataset, collate_fn, drop_last, distributed)

Iterate to get next batch-size samples as a batch.

class neural_compressor.experimental.data.dataloaders.fetcher.IndexFetcher(dataset, collate_fn, drop_last, distributed)

Take single index or a batch of indices to fetch samples as a batch.