cublas64_100.dll got exception after return from main

[xinyu391]

Describe the bug
got exception after main() return.

Urgency

System information

• OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Windows10
• ONNX Runtime installed from (source or binary): binary
• ONNX Runtime version: 1.1.2
• Python version: not used
• Visual Studio version (if applicable): VS2019(cmake project)
• GCC/Compiler version (if compiling from source):
• CUDA/cuDNN version: CUDA10.0, cuDNN7.6.5.32
• GPU model and memory: MX150， 2GMem

To Reproduce
compile and run in X64_Debug mode.

Expected behavior
normally return .no exception.

Screenshots

Additional context

#include <iostream>
#include "onnxruntime_cxx_api.h"
#ifdef GPU_CUDA
#include "cuda_provider_factory.h"
#endif

void test()
{
    static Ort::Env env_(ORT_LOGGING_LEVEL_ERROR, "ocrgt");
    Ort::SessionOptions session_options;
    session_options.SetGraphOptimizationLevel(GraphOptimizationLevel::ORT_ENABLE_ALL);
    session_options.SetExecutionMode(ExecutionMode::ORT_SEQUENTIAL); //ORT_PARALLEL  ORT_SEQUENTIAL
    auto status = OrtSessionOptionsAppendExecutionProvider_CUDA(session_options, 0);
 
    std::wstring wpath = L"c:\\work\\ocr-gt\\resnet50v2.onnx";
    Ort::Session session(env_, wpath.c_str(), session_options);
    size_t in_count = session.GetInputCount();
    size_t out_count = session.GetOutputCount();
    std::cout << "ok tolaoad model"<< in_count<<","<<out_count<<std::endl;
}
int main(int argc, char* argv[]) {
    std::cout << "Hello "<<argv[0]<<std::endl;
    test();
    std::cout << "ok:结束" << std::endl;
    return 0;
}

[snnn]

It's a NULL pointer exception. Is your program multiple threaded or single threaded?

[snnn]

Could you please help us reproduce the error? We need more information to debug it.

[xinyu391]

@snnn, I have update the issue report informaiton.

[snnn]

Please do not put Ort::Env or Ort Session into a static variable.
Please free/destroy any ort variables when the main function ends.

[xinyu391]

@snnn
ok remove static .
But how to free/destroy ort variables? use release()?
this is my code, still get this error

void test()
{
    Ort::Env env_(ORT_LOGGING_LEVEL_ERROR, "ocrgt");
    Ort::SessionOptions session_options;
    session_options.SetGraphOptimizationLevel(GraphOptimizationLevel::ORT_ENABLE_ALL);
    session_options.SetExecutionMode(ExecutionMode::ORT_SEQUENTIAL); //ORT_PARALLEL  ORT_SEQUENTIAL
    auto status = OrtSessionOptionsAppendExecutionProvider_CUDA(session_options, 0);

    std::wstring wpath = L"c:\\work\\ocr-gt\\resnet50v2.onnx";
    Ort::Session session(env_, wpath.c_str(), session_options);
    size_t in_count = session.GetInputCount();
    size_t out_count = session.GetOutputCount();
    std::cout << "ok tolaoad model" << in_count << "," << out_count << std::endl;
    session.release();
    session_options.release();
    env_.release();
}

[snnn]

If you're using pure C, then you have to call functions like ReleaseSession manually.
As you are using C++, the destructor of the objects will do the job for you.

Did removing 'static' solve the issue?

[xinyu391]

no, still got this error

[snnn]

Sorry, it's a bug, we'll fix it.