[Bug]: mt5-base报错

[Amy234543]

软件环境

- paddlepaddle:
- paddlepaddle-gpu: 2.3.2.post112
- paddlenlp: 是git clone的最新版git clone https://github.com/PaddlePaddle/PaddleNLP.git

重复问题

• I have searched the existing issues

错误描述

Traceback (most recent call last):
  File "mt5_test.py", line 5, in <module>
    model = MT5ForConditionalGeneration.from_pretrained(model_name)
  File "/var/www/translate_mt5_paddle/paddlenlp/PaddleNLP/paddlenlp/transformers/model_utils.py", line 485, in from_pretrained
    pretrained_model_name_or_path, from_hf_hub=from_hf_hub, subfolder=subfolder, *args, **kwargs
  File "/var/www/translate_mt5_paddle/paddlenlp/PaddleNLP/paddlenlp/transformers/model_utils.py", line 1326, in from_pretrained_v2
    **kwargs,
  File "/var/www/translate_mt5_paddle/paddlenlp/PaddleNLP/paddlenlp/transformers/configuration_utils.py", line 735, in from_pretrained
    config_dict, kwargs = cls.get_config_dict(pretrained_model_name_or_path, **kwargs)
  File "/var/www/translate_mt5_paddle/paddlenlp/PaddleNLP/paddlenlp/transformers/configuration_utils.py", line 762, in get_config_dict
    pretrained_model_name_or_path, cache_dir=cache_dir, from_hf_hub=from_hf_hub, **kwargs
  File "/var/www/translate_mt5_paddle/paddlenlp/PaddleNLP/paddlenlp/transformers/configuration_utils.py", line 836, in _get_config_dict
    raise FileNotFoundError(f"configuration file<{CONFIG_NAME}> or <{LEGACY_CONFIG_NAME}> not found")
FileNotFoundError: configuration file<config.json> or <model_config.json> not found

稳定复现步骤 & 代码

from paddlenlp.transformers import MT5ForConditionalGeneration, T5Tokenizer
model_name = "google/mt5-base"

model = MT5ForConditionalGeneration.from_pretrained(model_name)
model.eval()

[gongel]

你好，已定位问题，我们正在上传mt5-base的权重哈。

[gongel]

已解决

[Amy234543]

@gongel mt5-base模型什么时候能加速呢

[gongel]

@Amy234543 mt5和t5结构完全一致，可以参考t5修改一下。

[Amy234543]

mt5 fastgeneration 的加速按照t5的实现，现在报这个错，指定什么原因吗 @gongel

[gongel]

mt5 fastgeneration 的加速按照t5的实现，现在报这个错，指定什么原因吗 @gongel

收到，你方便提个PR上来不？我看下你的代码，可参考t5的PR：#3763 @Amy234543