-
Notifications
You must be signed in to change notification settings - Fork 69
Closed
Milestone
Description
Currently, we can't obtain arguments information from python jobs.
There is initial implementation which possibly can fix that problem(branch)
Also, we need to implement mist-logger for them.
Example:
from mist.decorators import *
@with_args(
arg('numbers', type_hint=list),
arg('multiplier', type_hint=int, default=2)
)
@on_spark_context
def simple_context(sc, numbers, multiplier):
rdd = sc.parallelize(numbers)
result = rdd.map(lambda s: multiplier * s).collect()
return {"result": result}
austinnichols101
Metadata
Metadata
Assignees
Labels
No labels