Installation Guide

System Requirements

Hardware Requirement

Verified Hardware Platforms:

Intel® Data Center GPU Flex Series 170

Software Requirements

Ubuntu 20.04 (64-bit)
Intel GPU Drivers
- Intel® Data Center GPU Flex Series 419.40
Intel® oneAPI Base Toolkit 2022.3
Python 3.6-3.9

PyTorch-Intel® Extension for PyTorch* Version Mapping

Intel® Extension for PyTorch* has to work with a corresponding version of PyTorch. Here are the PyTorch versions that we support and the mapping relationship:

PyTorch Version	Extension Version
v1.10.0 (patches needed)	v1.10.*

Preparations

Install Intel GPU Driver

Release	OS	Intel GPU	Install Intel GPU Driver
v1.0.0	Ubuntu 20.04	Intel® Data Center GPU Flex Series	Refer to the Installation Guides for the latest driver installation. If installing the verified Intel® Data Center GPU Flex Series 419.40, use a specific version for component package names, such as `sudo apt-get install intel-opencl-icd=22.28.23726.1+i419~u20.04`

Install oneAPI Base Toolkit

Please refer to Install oneAPI Base Toolkit Packages.

Need to install components of Intel® oneAPI Base Toolkit:

Intel® oneAPI DPC++ Compiler
Intel® oneAPI Math Kernel Library (oneMKL)

Default installation location {ONEAPI_ROOT} is /opt/intel/oneapi for root account, ${HOME}/intel/oneapi for other accounts.

NOTE: You need to activate oneAPI environment when using Intel® Extension for PyTorch* on Intel GPU.

source {ONEAPI_ROOT}/setvars.sh

Install via wheel files

Prebuilt wheel files availability matrix for Python versions:

Extension Version	Python 3.6	Python 3.7	Python 3.8	Python 3.9	Python 3.10
1.10.200+gpu	✔️	✔️	✔️	✔️

Install PyTorch

python -m pip install torch==1.10.0a0 --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/

Install Numpy

Numpy is required to work with PyTorch*. Verified numpy versions differ according to python versions.

python -m pip install numpy==1.19.5  # for Python 3.6
python -m pip install numpy==1.21.6  # for Python 3.7
python -m pip install numpy==1.23.4  # for Python 3.8 and 3.9

Install torchvision and torchaudio (Optional)

Intel® Extension for PyTorch* doesn’t depend on torchvision or torchaudio.

You can install torchvision via the following command.

python -m pip install torchvision==0.11.0+cpu --no-deps --extra-index-url https://download.pytorch.org/whl/torch_stable.html

For torchaudio installation, please follow the instructions to compile it from source. According to torchaudio-pytorch dependency table, torchaudio 0.10.0 is recommended.

Install Intel® Extension for PyTorch*

python -m pip install intel_extension_for_pytorch==1.10.200+gpu --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/

Install via compiling from source

Download source code of PyTorch and Intel® Extension for PyTorch*:

$ git clone https://github.com/pytorch/pytorch.git
$ cd pytorch
$ git checkout v1.10.0

$ git clone https://github.com/intel/intel-extension-for-pytorch.git 
$ cd intel-extension-for-pytorch
$ git checkout v1.10.200+gpu

Install PyTorch:

$ cd pytorch
$ git apply ${intel_extension_for_pytorch_directory}/torch_patches/*.patch 
$ git submodule sync
$ git submodule update --init --recursive
$ pip install -r requirements.txt
$ source {ONEAPI_ROOT}/setvars.sh
$ python setup.py bdist_wheel
$ pip install dist/*.whl

Configure the AOT (Optional)

Please refer to AOT documentation for how to configure USE_AOT_DEVLIST.

$ export USE_AOT_DEVLIST='ats-m150'

Install Intel® Extension for PyTorch*:

$ cd intel-extension-for-pytorch
$ git submodule sync
$ git submodule update --init --recursive
$ pip install -r requirements.txt
$ source {ONEAPI_ROOT}/setvars.sh # If you have sourced the oneAPI environment when compiling PyTorch, please skip this step.
$ python setup.py bdist_wheel
$ pip install dist/*.whl