Skip to content

[AOT Build] Cannot compile all modules ahead of time #718

@yyccli

Description

@yyccli

Problem Description

I want to compile all modules ahead of time, so i use the following command to create a wheel package PREBUILD_KERNELS=1 python3 setup.py bdist_wheel
However, setup.py will exclude some modules as follows:

Image

I tried to comment some modules above, such as module_moe_ck2stages, and the compile will fail. The reason why compiling module_moe_ck2stages here will fail is that no blob_gen_cmd is passed to the configs

Image

I am not sure whether other modules will have the same problem

I hope aiter can support fully AOT build, or we can choose what modules we what via say like a config file

Operating System

Ubuntu 22.04

CPU

Null

GPU

MI308X

ROCm Version

ROCm 6.3.3

ROCm Component

No response

Steps to Reproduce

PREBUILD_KERNELS=1 python3 setup.py bdist_wheel

(Optional for Linux users) Output of /opt/rocm/bin/rocminfo --support

No response

Additional Information

No response

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions