2019-06-09 07:24:20 +00:00
[![Build Status ](https://img.shields.io/travis/com/golang-migrate/migrate/master.svg )](https://travis-ci.com/golang-migrate/migrate)
[![GoDoc ](https://godoc.org/github.com/golang-migrate/migrate?status.svg )](https://godoc.org/github.com/golang-migrate/migrate)
[![Coverage Status ](https://img.shields.io/coveralls/github/golang-migrate/migrate/master.svg )](https://coveralls.io/github/golang-migrate/migrate?branch=master)
[![packagecloud.io ](https://img.shields.io/badge/deb-packagecloud.io-844fec.svg )](https://packagecloud.io/golang-migrate/migrate?filter=debs)
[![Docker Pulls ](https://img.shields.io/docker/pulls/migrate/migrate.svg )](https://hub.docker.com/r/migrate/migrate/)
2019-12-02 15:34:05 +00:00
![Supported Go Versions ](https://img.shields.io/badge/Go-1.11%2C%201.12-lightgrey.svg )
2019-06-09 07:24:20 +00:00
[![GitHub Release ](https://img.shields.io/github/release/golang-migrate/migrate.svg )](https://github.com/golang-migrate/migrate/releases)
2019-10-14 14:10:48 +00:00
[![Go Report Card ](https://goreportcard.com/badge/github.com/golang-migrate/migrate )](https://goreportcard.com/report/github.com/golang-migrate/migrate)
2019-06-09 07:24:20 +00:00
# migrate
__Database migrations written in Go. Use as [CLI ](#cli-usage ) or import as [library ](#use-in-your-go-project ).__
2019-07-17 22:25:42 +00:00
* Migrate reads migrations from [sources ](#migration-sources )
2019-06-09 07:24:20 +00:00
and applies them in correct order to a [database ](#databases ).
2019-07-17 22:25:42 +00:00
* Drivers are "dumb", migrate glues everything together and makes sure the logic is bulletproof.
2019-06-09 07:24:20 +00:00
(Keeps the drivers lightweight, too.)
2019-07-17 22:25:42 +00:00
* Database drivers don't assume things or try to correct user input. When in doubt, fail.
2019-06-09 07:24:20 +00:00
Forked from [mattes/migrate ](https://github.com/mattes/migrate )
## Databases
Database drivers run migrations. [Add a new database? ](database/driver.go )
2019-07-17 22:25:42 +00:00
* [PostgreSQL ](database/postgres )
* [Redshift ](database/redshift )
* [Ql ](database/ql )
* [Cassandra ](database/cassandra )
* [SQLite ](database/sqlite3 ) ([todo #165 ](https://github.com/mattes/migrate/issues/165))
* [MySQL/ MariaDB ](database/mysql )
* [Neo4j ](database/neo4j ) ([todo #167 ](https://github.com/mattes/migrate/issues/167))
* [MongoDB ](database/mongodb )
* [CrateDB ](database/crate ) ([todo #170 ](https://github.com/mattes/migrate/issues/170))
* [Shell ](database/shell ) ([todo #171 ](https://github.com/mattes/migrate/issues/171))
* [Google Cloud Spanner ](database/spanner )
* [CockroachDB ](database/cockroachdb )
* [ClickHouse ](database/clickhouse )
2019-12-02 15:34:05 +00:00
* [Firebird ](database/firebird ) ([todo #49 ](https://github.com/golang-migrate/migrate/issues/49))
2019-07-17 22:25:42 +00:00
* [MS SQL Server ](database/sqlserver )
2019-06-09 07:24:20 +00:00
### Database URLs
Database connection strings are specified via URLs. The URL format is driver dependent but generally has the form: `dbdriver://username:password@host:port/dbname?option1=true&option2=false`
Any [reserved URL characters ](https://en.wikipedia.org/wiki/Percent-encoding#Percent-encoding_reserved_characters ) need to be escaped. Note, the `%` character also [needs to be escaped ](https://en.wikipedia.org/wiki/Percent-encoding#Percent-encoding_the_percent_character )
Explicitly, the following characters need to be escaped:
`!` , `#` , `$` , `%` , `&` , `'` , `(` , `)` , `*` , `+` , `,` , `/` , `:` , `;` , `=` , `?` , `@` , `[` , `]`
It's easiest to always run the URL parts of your DB connection URL (e.g. username, password, etc) through an URL encoder. See the example Python snippets below:
2019-07-17 22:25:42 +00:00
2019-06-09 07:24:20 +00:00
```bash
$ python3 -c 'import urllib.parse; print(urllib.parse.quote(input("String to encode: "), ""))'
String to encode: FAKEpassword!#$%&'()*+,/:; =?@[]
FAKEpassword%21%23%24%25%26%27%28%29%2A%2B%2C%2F%3A%3B%3D%3F%40%5B%5D
$ python2 -c 'import urllib; print urllib.quote(raw_input("String to encode: "), "")'
String to encode: FAKEpassword!#$%&'()*+,/:; =?@[]
FAKEpassword%21%23%24%25%26%27%28%29%2A%2B%2C%2F%3A%3B%3D%3F%40%5B%5D
$
```
## Migration Sources
Source drivers read migrations from local or remote sources. [Add a new source? ](source/driver.go )
2019-07-17 22:25:42 +00:00
* [Filesystem ](source/file ) - read from filesystem
* [Go-Bindata ](source/go_bindata ) - read from embedded binary data ([jteeuwen/go-bindata](https://github.com/jteeuwen/go-bindata))
* [Github ](source/github ) - read from remote Github repositories
* [Github Enterprise ](source/github_ee ) - read from remote Github Enterprise repositories
* [Gitlab ](source/gitlab ) - read from remote Gitlab repositories
* [AWS S3 ](source/aws_s3 ) - read from Amazon Web Services S3
* [Google Cloud Storage ](source/google_cloud_storage ) - read from Google Cloud Platform Storage
2019-06-09 07:24:20 +00:00
## CLI usage
2019-07-17 22:25:42 +00:00
* Simple wrapper around this library.
* Handles ctrl+c (SIGINT) gracefully.
* No config search paths, no config files, no magic ENV var injections.
2019-06-09 07:24:20 +00:00
2019-07-17 22:25:42 +00:00
__[CLI Documentation](cmd/migrate)__
2019-06-09 07:24:20 +00:00
2019-07-17 22:25:42 +00:00
### Basic usage
2019-06-09 07:24:20 +00:00
2019-07-17 22:25:42 +00:00
```bash
2019-06-09 07:24:20 +00:00
$ migrate -source file://path/to/migrations -database postgres://localhost:5432/database up 2
```
### Docker usage
2019-07-17 22:25:42 +00:00
```bash
2019-06-09 07:24:20 +00:00
$ docker run -v {{ migration dir }}:/migrations --network host migrate/migrate
-path=/migrations/ -database postgres://localhost:5432/database up 2
```
## Use in your Go project
2019-07-17 22:25:42 +00:00
* API is stable and frozen for this release (v3 & v4).
* Uses [Go modules ](https://golang.org/cmd/go/#hdr-Modules__module_versions__and_more ) to manage dependencies.
* To help prevent database corruptions, it supports graceful stops via `GracefulStop chan bool` .
* Bring your own logger.
* Uses `io.Reader` streams internally for low memory overhead.
* Thread-safe and no goroutine leaks.
2019-06-09 07:24:20 +00:00
__[Go Documentation](https://godoc.org/github.com/golang-migrate/migrate)__
```go
import (
"github.com/golang-migrate/migrate/v4"
_ "github.com/golang-migrate/migrate/v4/database/postgres"
_ "github.com/golang-migrate/migrate/v4/source/github"
)
func main() {
m, err := migrate.New(
"github://mattes:personal-access-token@mattes/migrate_test",
"postgres://localhost:5432/database?sslmode=enable")
m.Steps(2)
}
```
Want to use an existing database client?
```go
import (
"database/sql"
_ "github.com/lib/pq"
"github.com/golang-migrate/migrate/v4"
"github.com/golang-migrate/migrate/v4/database/postgres"
_ "github.com/golang-migrate/migrate/v4/source/file"
)
func main() {
db, err := sql.Open("postgres", "postgres://localhost:5432/database?sslmode=enable")
driver, err := postgres.WithInstance(db, & postgres.Config{})
m, err := migrate.NewWithDatabaseInstance(
"file:///migrations",
"postgres", driver)
m.Steps(2)
}
```
2019-10-14 14:10:48 +00:00
## Getting started
Go to [getting started ](GETTING_STARTED.md )
## Tutorials
- [PostgreSQL ](database/postgres/TUTORIAL.md )
(more tutorials to come)
2019-06-09 07:24:20 +00:00
## Migration files
Each migration has an up and down migration. [Why? ](FAQ.md#why-two-separate-files-up-and-down-for-a-migration )
2019-07-17 22:25:42 +00:00
```bash
2019-06-09 07:24:20 +00:00
1481574547_create_users_table.up.sql
1481574547_create_users_table.down.sql
```
[Best practices: How to write migrations. ](MIGRATIONS.md )
## Versions
Version | Supported? | Import | Notes
--------|------------|--------|------
**master** | :white_check_mark: | `import "github.com/golang-migrate/migrate/v4"` | New features and bug fixes arrive here first |
**v4** | :white_check_mark: | `import "github.com/golang-migrate/migrate/v4"` | Used for stable releases |
**v3** | :x: | `import "github.com/golang-migrate/migrate"` (with package manager) or `import "gopkg.in/golang-migrate/migrate.v3"` (not recommended) | **DO NOT USE** - No longer supported |
## Development and Contributing
Yes, please! [`Makefile` ](Makefile ) is your friend,
read the [development guide ](CONTRIBUTING.md ).
Also have a look at the [FAQ ](FAQ.md ).
---
Looking for alternatives? [https://awesome-go.com/#database ](https://awesome-go.com/#database ).