Skip to content

Releases: dimajix/flowman

1.3.5

28 Aug 12:10
Compare
Choose a tag to compare
  • Add new compareSchema flag to compare target.

Flowman 1.3.4

06 Aug 07:44
Compare
Choose a tag to compare

Version 1.3.4 - 2025-08-06

  • Fix column order in explode mapping
  • Upgrade several dependencies

Flowman 1.3.3

09 May 08:51
Compare
Choose a tag to compare
  • Upgrade SQL Server connector
  • Upgrade Spark to 3.3.4
  • Upgrade Spark to 3.4.4
  • Upgrade Spark to 3.5.5

Flowman 1.3.2

07 Feb 11:28
Compare
Choose a tag to compare

Version 1.3.2 - 2025-02-07

  • Fix documentation of SQL mapping
  • Fix skipping of execution targets with "update" mode
  • Use UTF-8 for pushing metrics to Prometheus

Flowman 1.3.1

19 Dec 09:46
Compare
Choose a tag to compare
Release version 1.3.1

Flowman 1.3.0

06 Dec 07:55
Compare
Choose a tag to compare

This actually is more a maintenance release for supporting an updated Cloudera version:

  • github-510: Upgrade Cloudera Spark 3.3 build profile

Flowman 0.30.3

06 Aug 07:01
Compare
Choose a tag to compare
  • github-465: (backport) Fix parsing of Swagger schema files

0.30.2

29 Jul 05:49
Compare
Choose a tag to compare
  • github-496: updated build profile for CDP 7.1.9 platform version

Flowman 1.2.0

03 Apr 17:54
Compare
Choose a tag to compare

Version 1.2.0 - 2024-04-03

  • github-464: Upgrade Cloudera CDP 7.1 to Hotfix 16
  • github-465: Fix parsing of Swagger schema files
  • github-447: Support Spark 3.5.0
  • github-444: Remove Flowman Hub
  • github-443: Remove Flowman DSL
  • github-466: Use frontend-maven-plugin for all npm packages
  • github-467: Implement "target_records" metric for "copy" target
  • github-474: Remove Flowman Studio
  • github-480: Upgrade Spark to 3.5.1
  • github-481: Fix Sphinx documentation

Flowman 1.1.0

16 Oct 15:39
Compare
Choose a tag to compare

Version 1.1.0 - 2023-10-10

  • github-413: Support Azure Key Vault for retrieving secrets
  • github-415: Improve documentation for Velocity templating
  • github-361: Remove broken support for Databricks
  • github-402: Support Spark 3.4
  • github-417: Fix URL to flowman.io in all Maven modules
  • github-416: Support specifying multiple targets separated by commas on CLI
  • github-414: Support AWS Secrets Manager for retrieving secrets
  • github-419: Add a command line option to kernel server to listen on specific address
  • github-326: Truncate target graphs at sinks
  • github-410: Support relative paths in project imports
  • github-421: Provide new 'session' environment variable
  • github-422: Upgrade Spark to 3.4.1
  • github-423: Migrating a MariaDB/MySQL table from a text type to a numeric type fails
  • github-425: Support building and running Flowman with Java 17
  • github-388: Replace Akka http with Jersey/Jetty in Flowman History Server
  • github-385: Update Flowman Tutorial
  • github-412: Create tutorial for using Flowman Maven Plugin
  • github-371: Automate EMR integration test via AWS CLI
  • github-431: Update EMR build profil to 6.12
  • github-428: Move project selector into top bar in Flowman History Server
  • github-433: Add Trino JDBC driver as plugin
  • github-434: Use sshj instead of ganymed for sftp
  • github-435: Flowman should also load a project.yaml (with an 'a' in the extension)
  • github-436: Document minimum Maven version of Flowman-maven-plugin
  • github-438: Empty or non-existing module directories should not lead to an error
  • github-452: [BUG] SQL assertions do not support empty strings as expected values
  • github-450: Update Spark to 3.3.3
  • github-454: Fix scope of netty-codec
  • github-446: Fix deadlock when running targets in parallel

Breaking changes

This version introduces some (minor) breaking changes:

  • When providing sample records (for example, via the values mapping, or in the expected outcome of sql assertions),
    empty strings will be interpreted as empty strings. Older versions interpreted empty strings as SQL NULL values. In
    case you still need a NULL value, you can simply use the YAML null value.