Custom Runtime Error

[nadeshseen]

Hello, I used this Dockerfile along with this requirements.txt. Still I am getting FileNotFoundError: [Errno 2] No such file or directory: '/tmp/lithops-root/func.pickle'",

Setup - Openwhisk + Minio

ok: got activation bdfe464966974dc2be464966973dc27e
{
    "namespace": "guest",
    "name": "docker.io_nadeseen_custom_runtime_e8308bff6330e427d751713988987e93_512MB_3.1.1.dev0",
    "version": "0.0.1",
    "subject": "guest",
    "activationId": "bdfe464966974dc2be464966973dc27e",
    "start": 1707990980649,
    "end": 1707990980898,
    "duration": 249,
    "statusCode": 2,
    "response": {
        "status": "action developer error",
        "statusCode": 0,
        "success": false,
        "result": {
            "error": "The action did not return a dictionary."
        }
    },
    "logs": [
        "2024-02-15T09:56:20.647695862Z stdout: [INFO] __main__.py:43 -- Lithops v3.1.1.dev0 - Starting OpenWhisk execution",
        "2024-02-15T09:56:20.872316202Z stdout: [INFO] minio.py:61 -- MinIO client created - Endpoint: http://10.129.28.254:31600",
        "2024-02-15T09:56:20.884982695Z stdout: Traceback (most recent call last):",
        "2024-02-15T09:56:20.885014759Z stdout:   File \"/pythonAction/pythonrunner.py\", line 88, in run",
        "2024-02-15T09:56:20.885023864Z stdout:     exec('fun = %s(param)' % self.mainFn, self.global_context)",
        "2024-02-15T09:56:20.885031415Z stdout:   File \"<string>\", line 1, in <module>",
        "2024-02-15T09:56:20.885040673Z stdout:   File \"__main__.py\", line 44, in main",
        "2024-02-15T09:56:20.885048096Z stdout:     function_handler(args)",
        "2024-02-15T09:56:20.885055424Z stdout:   File \"/action/lithops/worker/handler.py\", line 70, in function_handler",
        "2024-02-15T09:56:20.885062897Z stdout:     job = create_job(payload)",
        "2024-02-15T09:56:20.885070014Z stdout:   File \"/action/lithops/worker/handler.py\", line 60, in create_job",
        "2024-02-15T09:56:20.885077584Z stdout:     job.func = get_function_and_modules(job, internal_storage)",
        "2024-02-15T09:56:20.885084785Z stdout:   File \"/action/lithops/worker/utils.py\", line 49, in get_function_and_modules",
        "2024-02-15T09:56:20.885092048Z stdout:     with open(func_path, \"rb\") as f:",
        "2024-02-15T09:56:20.885099439Z stdout: FileNotFoundError: [Errno 2] No such file or directory: '/tmp/lithops-root/func.pickle'",
        "2024-02-15T09:56:20.901494557Z stderr: The action did not initialize or run as expected. Log data might be missing."
    ],
    "annotations": [
        {
            "key": "path",
            "value": "guest/lithops_23bc4/docker.io_nadeseen_custom_runtime_e8308bff6330e427d751713988987e93_512MB_3.1.1.dev0"
        },
        {
            "key": "waitTime",
            "value": 41
        },
        {
            "key": "kind",
            "value": "blackbox"
        },
        {
            "key": "timeout",
            "value": false
        },
        {
            "key": "limits",
            "value": {
                "concurrency": 1,
                "logs": 10,
                "memory": 512,
                "timeout": 800000
            }
        }
    ],
    "publish": false
}

Config File

lithops: 
    backend: openwhisk
    storage: minio
    data_cleaner: False
    data_limit: 100  # in MiB
    execution_timeout: 1800
    include_modules: []
    exclude_modules: []
    log_level: NONE
    customized_runtime: True

openwhisk:
    endpoint: 
    namespace: 
    api_key: 
    insecure: True
    runtime: nadeseen/custom_runtime:1.9
    runtime_timeout: 800
    runtime_memory: 512

[JosepSampe]

I just tested your container image in my environment, and it is correctly built, and it works properly:

2024-02-15 18:23:08,019 [INFO] invokers.py:107 -- ExecutorID a61a2e-0 | JobID A000 - Selected Runtime: docker.io/nadeseen/custom_runtime:1.9 - 256MB
2024-02-15 18:23:08,237 [INFO] invokers.py:115 -- Runtime docker.io/nadeseen/custom_runtime:1.9 with 256MB is not yet deployed
2024-02-15 18:23:08,237 [INFO] openwhisk.py:121 -- Deploying runtime: docker.io/nadeseen/custom_runtime:1.9 - Memory: 256 - Timeout: 600
2024-02-15 18:23:28,164 [INFO] invokers.py:172 -- ExecutorID a61a2e-0 | JobID A000 - Starting function invocation: hello() - Total: 1 activations
2024-02-15 18:23:28,165 [INFO] invokers.py:208 -- ExecutorID a61a2e-0 | JobID A000 - View execution logs at /tmp/lithops-josep/logs/a61a2e-0-A000.log
2024-02-15 18:23:28,165 [INFO] executors.py:491 -- ExecutorID a61a2e-0 - Getting results from 1 function activations
2024-02-15 18:23:28,165 [INFO] wait.py:101 -- ExecutorID a61a2e-0 - Waiting for 1 function activations to complete

  100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1  
2024-02-15 18:23:48,225 [INFO] executors.py:607 -- ExecutorID a61a2e-0 - Cleaning temporary data

Hello josep! Lithops is working as expected :)

Remove customized_runtime: True from your config.
In general it is not a good idea to put data_limit: 100 # in MiB in the config. This will cause the invocation to be really slow. The invocation data (iterdata) should only include parameters. If you have to send data to the functions, send them using MiNIO objecft urls

[nadeshseen]

Thanks, it works now.
customized_runtime parameter is confusing to me. What is the purpose of this parameter?
I thought this meant to set it to true when using custom runtime.

Thanks, I misinterpreted data_limit parameter meaning.
PS: I am sending data through minio objects only.

[JosepSampe]

customized_runtime is an experimental feature used to include the function code in the runtime, instead of transferring it trough the storage backend. I renamed this parameter to avoid confusion #1259