alluxio/alluxio repository overview

⁠Purpose of this Image

This image is used to run the Alluxio servers including master, worker and job services.

Note: To run the Alluxio FUSE daemon please use the image alluxio/alluxio-fuse⁠ instead.

⁠A Note on Tags

• The SNAPSHOT tag is the latest bleeding-edge version of Alluxio based on Alluxio master branch⁠ and is not recommended for production use.
• The latest tag is linking to the latest stable release version

⁠What is Alluxio

Alluxio⁠ (formerly known as Tachyon) is a virtual distributed storage system. It bridges the gap between computation frameworks and storage systems, enabling computation applications to connect to numerous storage systems through a common interface. Read more about Alluxio Overview⁠.

The Alluxio project originated from a research project called Tachyon at AMPLab, UC Berkeley, which was the data layer of the Berkeley Data Analytics Stack (BDAS⁠). For more details, please refer to Haoyuan Li's PhD dissertation "Alluxio: A Virtual Distributed File System⁠".

⁠Who Uses Alluxio

Alluxio is used in production to manage Petabytes of data in many leading companies, with the largest deployment exceeding 1300 nodes. You can find more use cases at Powered by Alluxio⁠ or visit our first community conference (Data Orchestration Summit⁠) to learn from other community members!

⁠Community and Events

Please use the following to reach members of the community:

• Slack: alluxio-community channel⁠
• Community Events: upcoming online office hours, meetups and webinars⁠
• Meetup Groups: Global Online Meetup⁠, Bay Area Meetup⁠, New York Meetup⁠, Beijing Alluxio Meetup⁠, Austin Meetup⁠
• Twitter: @alluxio⁠
• Mailing List: alluxio-users⁠

⁠Download Alluxio Using Docker

Download and start an Alluxio master and a worker. More details can be found in documentation⁠.

# Create a network for connecting Alluxio containers
$ docker network create alluxio_nw
# Create a volume for storing ufs data
$ docker volume create ufs
# Launch the Alluxio master
$ docker run -d --net=alluxio_nw \
    -p 19999:19999 \
    --name=alluxio-master \
    -v ufs:/opt/alluxio/underFSStorage \
    alluxio/alluxio master
# Launch the Alluxio worker
$ export ALLUXIO_WORKER_MEMORY_SIZE=1G
$ docker run -d --net=alluxio_nw \
    --shm-size=${ALLUXIO_WORKER_MEMORY_SIZE} \
    --name=alluxio-worker \
    -v ufs:/opt/alluxio/underFSStorage \
    -e ALLUXIO_JAVA_OPTS="-Dalluxio.worker.memory.size=${ALLUXIO_WORKER_MEMORY_SIZE} -Dalluxio.master.hostname=alluxio-master" \
    alluxio/alluxio worker

⁠Other ways to Download

⁠Binary download

Prebuilt binaries are available to download at https://www.alluxio.io/download⁠ .

⁠MacOS Homebrew

$ brew install alluxio

⁠Quick Start

Please follow the Guide to Get Started⁠ to run a simple example with Alluxio.

⁠Report a Bug

To report bugs, suggest improvements, or create new feature requests, please open a Github Issue⁠. Our previous Alluxio JIRA system⁠ has been deprecated since December 2018.

⁠Useful Links

• Alluxio Website⁠
• Downloads⁠
• Releases and Notes⁠
• Documentation⁠