ScaleHLS is a High-level Synthesis (HLS) framework on MLIR. ScaleHLS can compile HLS C/C++ or PyTorch model to optimized HLS C/C++ in order to generate high-efficiency RTL design using downstream tools, such as Xilinx Vivado HLS.
By using the MLIR framework that can be better tuned to particular algorithms at different representation levels, ScaleHLS is more scalable and customizable towards various applications coming with intrinsic structural or functional hierarchies. ScaleHLS represents HLS designs at multiple levels of abstraction and provides an HLS-dedicated analysis and transform library (in both C++ and Python) to solve the optimization problems at the suitable representation levels. Using this library, we've developed a design space exploration engine to generate optimized HLS designs automatically.
For more details, please see our HPCA'22 and DAC'22 paper:
@inproceedings{yehpca2022scalehls,
title={ScaleHLS: A New Scalable High-Level Synthesis Framework on Multi-Level Intermediate Representation},
author={Ye, Hanchen and Hao, Cong and Cheng, Jianyi and Jeong, Hyunmin and Huang, Jack and Neuendorffer, Stephen and Chen, Deming},
booktitle={2022 IEEE International Symposium on High-Performance Computer Architecture (HPCA)},
year={2022}
}
@inproceedings{yedac2022scalehls,
title={ScaleHLS: a scalable high-level synthesis framework with multi-level transformations and optimizations},
author={Ye, Hanchen and Jun, HyeGang and Jeong, Hyunmin and Neuendorffer, Stephen and Chen, Deming},
booktitle={Proceedings of the 59th ACM/IEEE Design Automation Conference},
year={2022}
}- python3
- cmake
- ninja
- clang and lld
Optionally, the following packages are required for the Python binding.
- pybind11
- numpy
$ git clone --recursive [email protected]:hanchenye/scalehls.git
$ cd scalehlsRun the following script to build ScaleHLS. Optionally, add -p ON to enable the Python binding and -j xx to specify the number of parallel linking jobs.
$ ./build-scalehls.shAfter the build, we suggest to export the following paths.
$ export PATH=$PATH:$PWD/build/bin:$PWD/polygeist/build/bin
$ export PYTHONPATH=$PYTHONPATH:$PWD/build/tools/scalehls/python_packages/scalehls_coreTo optimize C/C++ kernels with the design space exploration (DSE) engine, run:
$ cd samples/polybench/gemm
$ # Parse C/C++ kernel into MLIR.
$ cgeist test_gemm.c -function=test_gemm -S \
-memref-fullrank -raise-scf-to-affine > test_gemm.mlir
$ # Launch the DSE and emit the optimized design as C++ code.
$ scalehls-opt test_gemm.mlir -debug-only=scalehls \
-scalehls-dse-pipeline="top-func=test_gemm target-spec=../config.json" \
| scalehls-translate -scalehls-emit-hlscpp > test_gemm_dse.cppIf Python binding is enabled, we provide a pyscalehls tool to showcase the scalehls Python library:
$ pyscalehls.py test_gemm.c -f test_gemm > test_gemm_pyscalehls.cppInstall the pre-built Torch-MLIR front-end:
$ python -m venv mlir_venv
$ source mlir_venv/bin/activate
$ python -m pip install --upgrade pip
$ pip install --pre torch-mlir torchvision -f https://llvm.github.io/torch-mlir/package-index/ --extra-index-url https://download.pytorch.org/whl/nightly/cpu
Once Torch-MLIR is installed, you should be able to run the following test:
$ cd samples/pytorch/resnet18
$ # Parse PyTorch model to LinAlg dialect (with Torch-MLIR mlir_venv activated).
$ python3 resnet18.py > resnet18.mlir
$ # Optimize the model and emit C++ code.
$ scalehls-opt resnet18.mlir \
-scaleflow-pytorch-pipeline="top-func=forward loop-tile-size=8 loop-unroll-factor=4" \
| scalehls-translate -scalehls-emit-hlscpp > resnet18.cppThe project follows the conventions of typical MLIR-based projects:
include/scalehlsandlibfor C++ MLIR dialects/passes.polygeistfor the C/C++ front-end.samplesfor C/C++ and PyTorch examples.testfor holding regression tests.toolsfor command line tools.