Skip to content

Commit 9ddd2c3

Browse files
committed
[Neo] Require tp_degree in Neo Neuron script
1 parent 3ef1bb7 commit 9ddd2c3

File tree

1 file changed

+5
-0
lines changed

1 file changed

+5
-0
lines changed

serving/docker/partition/sm_neo_neuron_partition.py

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -360,6 +360,11 @@ def construct_properties_manager_from_serving_properties(self):
360360
f"serving.properties\nargs:{self.args}\nprops:{self.properties}")
361361
self.properties_manager = PropertiesManager(
362362
self.args, addl_properties=self.properties)
363+
if not self.properties_manager.properties.get(
364+
"option.tensor_parallel_degree"):
365+
raise InputConfiguration(
366+
"Tensor parallel degree not specified. This is required for Neuron compilation"
367+
)
363368

364369
def run_partition(self) -> str:
365370
"""

0 commit comments

Comments
 (0)