Generate database ERD using chartdb

[eladkal]

Body

https://github.com/chartdb/chartdb is very popular project and generate nice ERD schemas (though not sure if we can use it due to AGPL-3.0 license ?)
We should update our generation script to use it

Note: This library is to be used only for development. We are not distributing it to users thus we are OK with having it despite AGPL-3.0 license https://www.apache.org/legal/resolved.html#prohibited (Thanks to Jarek for this clarification)

Committer

• I acknowledge that I am a maintainer/committer of the Apache Airflow project.

[jx2lee]

@eladkal Can i take this?

[eladkal]

@eladkal Can i take this?

Assigned

[eladkal]

@jx2lee did you make progress on this one?

[jx2lee]

@eladkal
Oh, sorry to forget. I didn't start to work on this. If it need to be solved quickly, reassign please. otherwise, could i proceed from tomorrow? 🙏

[eladkal]

That's OK we have time. It's not urgent.

[jx2lee]

@eladkal i think it's available below steps, need for your advice

• In using generate script, run container for chartdb because It doesn't have python sdk, like eralchemy2
• To export schema, query given sql to local airflow database. (Is to be sqlite3, right?)
• With json generated by below step, request image to chartdb container

ChartDB doesn't offer python sdk, so it is the only way I could think.

[eladkal]

@jx2lee is there an open feature request to add Python SDK? Maybe upstream can support for it and then the task here would be easier

[jx2lee]

is there an open feature request to add Python SDK?

Nope. There isn't open(or close) feature request about Python SDK. Looks like I either need to request the feature(python sdk on chartdb) or implement itself.