Skip to content

store Spark properties like we do JVM properties #7471

@scottdraves

Description

@scottdraves

in beakerx.json:

    "spark_options": {
      "spark.executor.memory": "8g",
      "spark.master": "local[*]",
      "spark.executor.cores": "10",
      "user": "strings"
    }

should be:

    "spark_options": {
      "spark.executor.memory": "8g",
      "spark.master": "local[*]",
      "spark.executor.cores": "10",
      "properties": [
                {
                    "name": "user",
                    "value": "strings"
                }
            ]
    }

like the JVM options work.

Metadata

Metadata

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions