godfish is a database migration manager, similar to the very good
dogfish, but written in golang.
It is a CLI and a library.
- use the native query language in the migration files, no other high-level DSLs
- interface with many DBs
- light on dependencies
- not terrible error messages
The Releases page of the GitHub repository has pre-built artifacts for supported platforms. Each archive file contains an executable binary per driver. Each executable binary will only work for the targeted DB. Pick the one(s) you need.
There is also an installation script at scripts/install.sh. Check it out.
An alternative to using a pre-built release to is to build your own. NOTE: these require just.
Make a CLI binary for the DB you want to use. This tool comes with some driver implementations. Build one like so:
just build-cassandra
just build-mysql
just build-postgres
just build-sqlite3
just build-sqlserver
From there you could move it to $GOPATH/bin, move it to your project or
whatever else you need to do.
Like any db migration tool, this helps you and your team manage the shape of your application's database throughout time. Migrations are written in the native language of the database, and exist as files in a directory. All migrations to consider should live in the same directory. A migration is one of these files, which may have metadata components as part of the filename:
- "direction": Migrations that introduce new changes to the DB shape are considered to have a "forward" direction. A migration intended as the inverse of a corresponding forward migration is considered to have a "reverse" direction.
- "version": Describe where a migration exists relative to the other migrations
with the same direction. By default, it's a timestamp in the layout
YYYYMMDDHHmmss. - "name": A label you give to describe the migration's contents.
The delimiter of each part is a -. Each migration filename has this format:
${direction}-${version}-${name}.sql
There is an implicit ordering to migrations, denoted by the "version", where
subsequent migrations may build upon the shape created by preceding migrations.
When a migration is successfully applied, a new row in the schema_migrations
table is inserted. A migration that has not yet been applied will be a file in
the directory, but without a corresponding entry in the DB table.
Not only is this tool a CLI, it's also a database migration library. Most of the time, you'll probably want to use it as a CLI.
This section describes basic usage of a CLI binary. For details on getting a CLI binary, see the releases section. Golang is not required here.
godfish help
godfish -h
godfish <command> -h
Configuration options are read from command line flags first. If those are not set, then it checks the configuration file.
Database connection parameters may be read from an environment variable. Set:
DB_DSN=
When using one of the pre-built binaries, the database may also be specified
with a command line flag, -dsn. If specified in both places, then the command
line value will have higher precedence than the environment variable.
Manually set path to db migration files.
godfish -files db/migrations <command>Make your life easier by creating a configuration file by invoking godfish init. This creates a file at .godfish.json, where you can configure things.
Change the path to the configuration file.
mv .godfish.json foo.json
godfish -conf foo.jsoncat .godfish.json
# { "path_to_files": "db/migrations" }
godfish create-migration -name alpha
# outputs:
# db/migrations/forward-20200128070010-alpha.sql
# db/migrations/reverse-20200128070010-alpha.sql
godfish create-migration -name bravo -reversible=false
# outputs:
# db/migrations/forward-20200128070106-bravo.sql
#
# ... write the sql in those files ...
#
# apply migrations
godfish migrate
# apply migrations to up a specific version
godfish migrate -version 20060102150405
# show status
godfish info
# apply a reverse migration
godfish rollback
# rollback and re-apply the last migration
godfish remigrate
# show build metadata
godfish version
godfish version -jsonThough most of the time you'll probably want to use one of the pre-built binaries, you could also use this as a golang library.
go get github.com/rafaelespinoza/godfish
An issue that may arise with deployments is that the migration files must be
deployed alongside the godfish binary. Migrations data and the behavior provided
by the godfish library can be combined into a single self-contained binary by
using the embed package.
See the go doc
page for an example.
Here are some notable differences between dogfish and godfish:
Filenames:
- dogfish:
migrate-${date}-${name}.sql, orrollback-${date}-${name}.sql - godfish:
forward-${date}-${name}.sql, orreverse-${date}-${name}.sql
Note, dogfish uses the words, "migrate" and "rollback" to describe the migration's direction whereas godfish uses "forward" and "reverse". They are the same in that they are two complementaries.
ls -1 /path/to/db/migrations
forward-20191112050547-init_foos.sql
forward-20221067051242-add_bars.sql
forward-20250805031405-update_more_stuff.sql
reverse-20191112050547-init_foos.sql
reverse-20221067051242-add_bars.sql
reverse-20250805031405-update_more_stuff.sqlOne of the goals of this project is to minimize the amount of dependencies.
Driver-specific code is placed in drivers/ so that building a binary for one
database does not require building code for another database.
The godfish package defines library functions, interfaces needed to build a
driver implementation.
Test infrastructure mostly lives in the .ci/ and .github/ directories. Many
integration tests may be run in isolation on your local machine without GitHub
actions.
Docker (or equivalent) is used to create environments and run the tests against
a live database. Each database has a separate configuration. All of this lives
in ci.Justfile and the .ci/ directory.
Using an OCI-compatible tool other than docker (ie: podman)?
just --set CONTAINER_TOOL podman -f ci.JustfileBuild environments and run tests
just -f ci.Justfile cassandra3-up
just -f ci.Justfile cassandra4-up
just -f ci.Justfile sqlserver-up
just -f ci.Justfile mariadb-up
just -f ci.Justfile postgres14-up
just -f ci.Justfile postgres15-up
just -f ci.Justfile sqlite3-upTeardown
just -f ci.Justfile cassandra3-down
just -f ci.Justfile cassandra4-down
just -f ci.Justfile sqlserver-down
just -f ci.Justfile mariadb-down
just -f ci.Justfile postgres14-down
just -f ci.Justfile postgres15-down
just -f ci.Justfile sqlite3-down