Thanks to visit codestin.com
Credit goes to github.com

Skip to content

derbuihan/wsfs

Repository files navigation

Databricks Workspace File System (wsfs)

A FUSE-based file system to interact with Databricks workspace files and directories as if they were part of the local file system.

Features

vim still doesn't work on mount points

  • Mount Databricks workspace.
  • List files and directories.
  • Read files.
  • Write files.
  • Make files and directories.
  • Delete files and directories.
  • Support for filesystem operations (Rename, Fsync and Setattr).
  • Cache files for faster access. (in progress)

Distribution & Development Experience

  • Automate release builds using GitHub Actions.
  • Support installation via Homebrew (brew install).
  • Expand unit and integration tests to ensure stability.
  • Allow users to develop on Databricks directly from VSCode by running wsfs within a Remote Container.

Usage

  1. Install FUSE on your system if you haven't already.
  2. Set the DATABRICKS_HOST and DATABRICKS_TOKEN environment variables with your Databricks workspace URL and personal access token.
$ cat .env
export DATABRICKS_HOST=<your-databricks-workspace-url>
export DATABRICKS_TOKEN=<your-personal-access-token>
  1. Run the application with the desired mount point.
$ source .env
$ go build -o wsfs
$ ./wsfs <mount-point>
  1. Access your Databricks workspace files through the mount point.
$ cd <mount-point>
$ ls
Repos  Shared  Users

License

GPL-3.0 License. See the LICENSE file for details.

About

FUSE filesystem for Databricks Workspaces

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published