Data EngineeringAdvanced9 submodules

Database CI/CD and Schema Evolution

Version, validate, package, migrate, and recover relational database schema changes using SQL scripts, DACPAC, Flyway, or Liquibase in a controlled delivery pipeline.

From concept to production evidence

Treat schema as code, detect drift, test migrations against representative data, use expand-migrate-contract for compatibility, protect connection secrets, take recoverable backups, and prefer forward repair when rollback would lose data.

Learning outcomes

  • Design database CI/CD
  • Version SQL and schemas
  • Compare DACPAC with Flyway and Liquibase
  • Plan backward-compatible migrations
  • Secure deployments and test rollback or recovery

Database CI/CD and Schema Evolution end-to-end flow

Use this sequence as the operating backbone for every submodule note and hands-on exercise.

  1. 01
    Change schema codeDatabase CI/CD and Schema Evolution stage 1: change schema code with an auditable result before the next stage begins.
  2. 02
    Build and validateDatabase CI/CD and Schema Evolution stage 2: build and validate with an auditable result before the next stage begins.
  3. 03
    Package or order migrationDatabase CI/CD and Schema Evolution stage 3: package or order migration with an auditable result before the next stage begins.
  4. 04
    Back up and approveDatabase CI/CD and Schema Evolution stage 4: back up and approve with an auditable result before the next stage begins.
  5. 05
    Deploy with lockDatabase CI/CD and Schema Evolution stage 5: deploy with lock with an auditable result before the next stage begins.
  6. 06
    Verify data and recover if neededDatabase CI/CD and Schema Evolution stage 6: verify data and recover if needed with an auditable result before the next stage begins.

Deliver a backward-compatible schema change

  1. Create versioned migration
  2. Validate on disposable database
  3. Publish artifact or migration bundle
  4. Run expand and data backfill
  5. Verify application compatibility and contract cleanup

9 full submodule notes

Read in order
01

Database CI/CD

Database CI/CD preserves durable information with explicit ownership, consistency, access, lifecycle, replication, and recovery guarantees within Database CI/CD and Schema Evolution. It is not an isolated definition: its value appears when it supports treat schema as code, detect drift, test migrations against representative data, use expand-migrate-contract for compatibility, protect connection secrets, take recoverable backups, and prefer forward repair when rollback would lose data.

Open full notes
02

SQL scripts

SQL scripts governs how a request is named, addressed, routed, filtered, transported, protected, and delivered to a healthy endpoint within Database CI/CD and Schema Evolution. It is not an isolated definition: its value appears when it supports treat schema as code, detect drift, test migrations against representative data, use expand-migrate-contract for compatibility, protect connection secrets, take recoverable backups, and prefer forward repair when rollback would lose data.

Open full notes
03

Schema versioning

Schema versioning provides a concrete platform capability that must be configured, secured, validated, observed, and owned throughout its lifecycle within Database CI/CD and Schema Evolution. It is not an isolated definition: its value appears when it supports treat schema as code, detect drift, test migrations against representative data, use expand-migrate-contract for compatibility, protect connection secrets, take recoverable backups, and prefer forward repair when rollback would lose data.

Open full notes
04

DACPAC

DACPAC provides a concrete platform capability that must be configured, secured, validated, observed, and owned throughout its lifecycle within Database CI/CD and Schema Evolution. It is not an isolated definition: its value appears when it supports treat schema as code, detect drift, test migrations against representative data, use expand-migrate-contract for compatibility, protect connection secrets, take recoverable backups, and prefer forward repair when rollback would lose data.

Open full notes
05

Flyway

Flyway provides a concrete platform capability that must be configured, secured, validated, observed, and owned throughout its lifecycle within Database CI/CD and Schema Evolution. It is not an isolated definition: its value appears when it supports treat schema as code, detect drift, test migrations against representative data, use expand-migrate-contract for compatibility, protect connection secrets, take recoverable backups, and prefer forward repair when rollback would lose data.

Open full notes
06

Liquibase

Liquibase provides a concrete platform capability that must be configured, secured, validated, observed, and owned throughout its lifecycle within Database CI/CD and Schema Evolution. It is not an isolated definition: its value appears when it supports treat schema as code, detect drift, test migrations against representative data, use expand-migrate-contract for compatibility, protect connection secrets, take recoverable backups, and prefer forward repair when rollback would lose data.

Open full notes
07

Database migrations

Database migrations preserves durable information with explicit ownership, consistency, access, lifecycle, replication, and recovery guarantees within Database CI/CD and Schema Evolution. It is not an isolated definition: its value appears when it supports treat schema as code, detect drift, test migrations against representative data, use expand-migrate-contract for compatibility, protect connection secrets, take recoverable backups, and prefer forward repair when rollback would lose data.

Open full notes
08

Rollback

Rollback restores a safe service state while preserving evidence and reducing the chance that mitigation introduces a second failure within Database CI/CD and Schema Evolution. It is not an isolated definition: its value appears when it supports treat schema as code, detect drift, test migrations against representative data, use expand-migrate-contract for compatibility, protect connection secrets, take recoverable backups, and prefer forward repair when rollback would lose data.

Open full notes
09

Secrets management

Secrets management controls which actor may perform which action on which resource, under which conditions, with evidence that can be reviewed later within Database CI/CD and Schema Evolution. It is not an isolated definition: its value appears when it supports treat schema as code, detect drift, test migrations against representative data, use expand-migrate-contract for compatibility, protect connection secrets, take recoverable backups, and prefer forward repair when rollback would lose data.

Open full notes