[API compatibility] add nn.init.* functions #74478

zhiminzhang0830 · 2025-08-08T03:43:18Z

PR Category

User Experience

PR Types

New features

Description

add init functions:

Pcard-75624

paddle-bot · 2025-08-08T03:43:23Z

你的PR提交成功，感谢你对开源项目的贡献!
请关注后续CI自动化测试结果，详情请参考Paddle-CI手册。
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

codecov-commenter · 2025-08-08T07:21:04Z

Codecov Report

❌ Patch coverage is 98.38710% with 1 line in your changes missing coverage. Please review.
⚠️ Please upload report for BASE (develop@6e31ae0). Learn more about missing BASE report.

Files with missing lines	Patch %	Lines
python/paddle/nn/init.py	98.27%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             develop   #74478   +/-   ##
==========================================
  Coverage           ?   98.38%           
==========================================
  Files              ?        5           
  Lines              ?       62           
  Branches           ?        0           
==========================================
  Hits               ?       61           
  Misses             ?        1           
  Partials           ?        0

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

zhwesky2010 · 2025-08-08T13:50:26Z

python/paddle/nn/__init__.py

@@ -319,4 +321,5 @@
    'LPPool2D',
    'ZeroPad1D',
    'ZeroPad3D',
+    'init',


这个导出来是作为1个api吗，好像不用导出来

应该是由于__all__的原因，不导出的话这样使用会报错：

import paddle tensor = paddle.zeros([32, 64]) paddle.nn.init.kaiming_uniform_(tensor)

AttributeError: module 'paddle.nn' has no attribute 'init'

zhwesky2010 · 2025-08-08T13:52:53Z

python/paddle/nn/init.py

+
+def _no_grad_uniform_(tensor, a, b):
+    with paddle.no_grad():
+        tensor.set_value(


静态图下这个能跑不，如果不能跑可以考虑复用之前的initializer，先实例化然后call：

init = paddle.nn.initializer() init(param)

zhwesky2010 · 2025-08-11T10:54:25Z

test/legacy_test/test_nn_init_function.py

+        return (b - a) * random.random() + a
+
+    def calculate_gain(self, nonlinearity, param):
+        recommended_gain = {


这些是从torch的calculate_gain里查到的吗，也补充到paddle的calculate_gain里吧

这个函数paddle也有一个在nn.initializer.initializer下，为了能够与torch的torch.nn.init.calculate_gain的调用接口对应，也将这个函数引用到了paddle.nn.init文件中，可以paddle.nn.init.calculate_gain调用使用

zhwesky2010 · 2025-08-11T11:00:50Z

python/paddle/nn/init.py

+    a: float = 0,
+    mode: str = "fan_in",
+    nonlinearity: str = "leaky_relu",
+    block: paddle.pir.Block | None = None,


这个block建议先不加，这个是老IR用的，以后如果确实需要再加。这个对用户会有一些理解成本。

好的，已经去掉

zhwesky2010 · 2025-08-11T11:01:38Z

python/paddle/nn/__init__.py

@@ -12,6 +12,8 @@
 # See the License for the specific language governing permissions and
 # limitations under the License.

+from paddle.nn import init as init


这里不需要导入init，直接paddle.nn.init会自动访问到 init.py 下面的函数吧，看torch是这样的

torch也导入这个模块了，不导入的话确实会报错：https://github.com/pytorch/pytorch/blob/134179474539648ba7dee1317959529fbd0e7f89/torch/nn/__init__.py#L12

zhwesky2010 · 2025-08-12T11:16:55Z

python/paddle/nn/init.py

+from ..base.framework import in_dygraph_mode, in_pir_mode
+from .initializer.constant import Constant
+from .initializer.dirac import Dirac
+from .initializer.initializer import calculate_gain as calculate_gain_


这个为何需要先别名成其他的，然后又别名回来

zhwesky2010 · 2025-08-12T11:22:51Z

python/paddle/nn/init.py

+        )
+        return new_tensor
+    else:
+        new_tensor = paddle.eye(


这里应该要像这样把输入tensor作为out来inplace。

这一系列API目前都不支持老IR，没有block，可以先不管 helper.append这个分支。如果后续要支持这个分支，就需要block这个参数。

zhiminzhang0830 · 2025-08-13T07:48:05Z

/re-run all-failed

zhwesky2010

LGTM

zhiminzhang0830 · 2025-08-14T05:56:03Z

/re-run coverage build

XiaoguangHu01

LGTM

* add nn.init.kaiming_uniform_ * update kaiming_uniform_ * update unit test for kaiming_uniform_ * add nn.init.kaiming_uniform_ * update kaiming_uniform_ * update unit test for kaiming_uniform_ * add xavier_uniform_, kaiming_normal_, uniform_ * add unit test for xavier_uniform_, kaiming_normal_, uniform_ * add xavier_normal_ and its unit test * add normal_ and its unit test * fix: remove 'block' parameter from init.*() function * fix * add nn.init.constant_, nn.init.ones_, nn.init.zeros_ * support paddle.pir.Value type * add dirac_, eye_, orthogonal_ * update unit test for nn.init.* * update init * add paddle.pir.Value * update unit test for nn.init.orthogonal_ * fix unit test for nn.init.eye_ * fix: skip unit test on dcu

add nn.init.kaiming_uniform_

8696c3d

zhiminzhang0830 changed the title ~~add nn.init.kaiming_uniform_~~ [API compatibility] add nn.init.kaiming_uniform_ Aug 8, 2025

zhiminzhang0830 added the API Compatibility label Aug 8, 2025

zhwesky2010 reviewed Aug 8, 2025

View reviewed changes

zhiminzhang0830 added 2 commits August 11, 2025 07:03

update kaiming_uniform_

87d9313

update unit test for kaiming_uniform_

5b8a1a5

zhwesky2010 reviewed Aug 11, 2025

View reviewed changes

zhiminzhang0830 added 9 commits August 11, 2025 11:36

add nn.init.kaiming_uniform_

3eaa19b

update kaiming_uniform_

b8e6b9c

update unit test for kaiming_uniform_

e791c18

add xavier_uniform_, kaiming_normal_, uniform_

e2b2cc9

add unit test for xavier_uniform_, kaiming_normal_, uniform_

d2d614a

add xavier_normal_ and its unit test

50cfb5c

add normal_ and its unit test

2c08d23

fix: remove 'block' parameter from init.*() function

c4c6917

fix

d31e3d3

zhiminzhang0830 force-pushed the init branch from 5b8a1a5 to d31e3d3 Compare August 11, 2025 11:39

zhiminzhang0830 changed the title ~~[API compatibility] add nn.init.kaiming_uniform_~~ [API compatibility] add nn.init.* functions Aug 11, 2025

zhiminzhang0830 added 5 commits August 11, 2025 12:26

add nn.init.trunc_normal_ and its unit test

b5ccf0a

add nn.init.constant_, nn.init.ones_, nn.init.zeros_

31cdc8b

support paddle.pir.Value type

44d9d26

add dirac_, eye_, orthogonal_

5afa04c

update unit test for nn.init.*

ecb4da0

zhwesky2010 reviewed Aug 12, 2025

View reviewed changes

zhiminzhang0830 added 3 commits August 12, 2025 13:19

update init

0c8bfd1

add paddle.pir.Value

4d4334f

update unit test for nn.init.orthogonal_

08a85c6

zhiminzhang0830 mentioned this pull request Aug 13, 2025

[API Compatibility] add paddle.nn.init.* PaddlePaddle/docs#7382

Open

zhwesky2010 previously approved these changes Aug 13, 2025

View reviewed changes

zhwesky2010 requested a review from SigureMo August 13, 2025 12:14

SigureMo previously approved these changes Aug 13, 2025

View reviewed changes

Merge remote-tracking branch 'upstream/develop' into init

1d4550e

fix unit test for nn.init.eye_

d330635

zhiminzhang0830 dismissed stale reviews from SigureMo and zhwesky2010 via d330635 August 14, 2025 06:06

zhwesky2010 previously approved these changes Aug 14, 2025

View reviewed changes

SigureMo previously approved these changes Aug 14, 2025

View reviewed changes

zhiminzhang0830 added 2 commits August 14, 2025 12:33

fix: skip unit test on dcu

02555a7

Merge remote-tracking branch 'upstream/develop' into init

d10e3bc

zhiminzhang0830 dismissed stale reviews from SigureMo and zhwesky2010 via d10e3bc August 14, 2025 12:34

zhiminzhang0830 requested review from SigureMo and zhwesky2010 August 15, 2025 08:05

SigureMo approved these changes Aug 15, 2025

View reviewed changes

zhwesky2010 approved these changes Aug 15, 2025

View reviewed changes

luotao1 approved these changes Aug 15, 2025

View reviewed changes

XiaoguangHu01 approved these changes Aug 18, 2025

View reviewed changes

zhwesky2010 merged commit cc7cae4 into PaddlePaddle:develop Aug 18, 2025
52 of 54 checks passed

[API compatibility] add nn.init.* functions #74478

[API compatibility] add nn.init.* functions #74478

Uh oh!

Conversation

zhiminzhang0830 commented Aug 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

PR Category

PR Types

Description

Uh oh!

paddle-bot bot commented Aug 8, 2025

Uh oh!

codecov-commenter commented Aug 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

zhiminzhang0830 Aug 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

zhwesky2010 Aug 12, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

zhiminzhang0830 commented Aug 13, 2025

Uh oh!

zhwesky2010 left a comment

Choose a reason for hiding this comment

Uh oh!

zhiminzhang0830 commented Aug 14, 2025

Uh oh!

XiaoguangHu01 left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

zhiminzhang0830 commented Aug 8, 2025 •

edited

Loading

codecov-commenter commented Aug 8, 2025 •

edited

Loading

zhiminzhang0830 Aug 11, 2025 •

edited

Loading

zhwesky2010 Aug 12, 2025 •

edited

Loading