Skip to content

Commit fa8f3d9

Browse files
authored
remove fused layernorm (#859)
1 parent 6de8c37 commit fa8f3d9

File tree

1 file changed

+0
-2
lines changed

1 file changed

+0
-2
lines changed

llmfoundry/utils/builders.py

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -243,8 +243,6 @@ def build_algorithm(name: str, kwargs: Dict[str, Any]) -> Algorithm:
243243
return algorithms.GradientClipping(**kwargs)
244244
elif name == 'alibi':
245245
return algorithms.Alibi(**kwargs)
246-
elif name == 'fused_layernorm':
247-
return algorithms.FusedLayerNorm(**kwargs)
248246
elif name == 'gated_linear_units':
249247
return algorithms.GatedLinearUnits(**kwargs)
250248
elif name == 'low_precision_layernorm':

0 commit comments

Comments
 (0)