Skip to content

Complete python api rewriting #441

@dos65

Description

@dos65

Currently, we can't obtain arguments information from python jobs.
There is initial implementation which possibly can fix that problem(branch)
Also, we need to implement mist-logger for them.
Example:

from mist.decorators import *

@with_args(
    arg('numbers', type_hint=list),
    arg('multiplier', type_hint=int, default=2)
)
@on_spark_context
def simple_context(sc, numbers, multiplier):
    rdd = sc.parallelize(numbers)
    result = rdd.map(lambda s: multiplier * s).collect()
    return {"result": result}

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions