s6ui is a fast GUI for browsing AWS S3 buckets. If you like s5cmd, then you will like s6ui.
s6ui lets you browse an AWS S3 bucket with a lightweight GUI powered by DearImGui. s6ui hides latency by prefetching things when you hover your cursor over them. By the time you click on something, it will load instantly.
There are some tools built-in to help with previewing large datasets. Click on a file containing Dolma documents, and you can quickly see a preview of the contents. .gz and .zstd decoders are included. You don't even need to wait to load a full 1GB file, everything is streamed to make this as fast as possible. It's a quick way to see what's inside your bucket or dataset.
Right now we support MacOSX, (soon Linux).
Install dependencies with brew install glfw
then just run make
Just type ./s6ui to launch it.
You can specify ./s6ui s3://my_bucket/path to immediately jump to that path.
s6ui supports multiple methods for AWS authentication:
Create or edit ~/.aws/credentials with your AWS access keys:
[default]
aws_access_key_id = YOUR_ACCESS_KEY_ID
aws_secret_access_key = YOUR_SECRET_ACCESS_KEY
You can also define multiple profiles:
[default]
aws_access_key_id = YOUR_ACCESS_KEY_ID
aws_secret_access_key = YOUR_SECRET_ACCESS_KEY
[work]
aws_access_key_id = WORK_ACCESS_KEY_ID
aws_secret_access_key = WORK_SECRET_ACCESS_KEY
endpoint_url = https://custom-weka-server.org:9000
To use a specific profile, set the AWS_PROFILE environment variable:
AWS_PROFILE=work ./s6uiRegions are auto-detected.
Configure AWS SSO using the AWS CLI:
aws configure ssoFollow the prompts to set up your SSO profile. This will create configuration in ~/.aws/config.
To use an SSO profile, set the AWS_PROFILE environment variable:
AWS_PROFILE=my-sso-profile ./s6uis6ui will automatically handle SSO authentication and token refresh as needed.
s6ui is developed and maintained by the AllenNLP team, backed by the Allen Institute for Artificial Intelligence (AI2). AI2 is a non-profit institute with the mission to contribute to humanity through high-impact AI research and engineering. To learn more about who specifically contributed to this codebase, see our contributors page.
s6ui is licensed under Apache 2.0. A full copy of the license can be found on GitHub.