Skip to content

Conversation

@wawltor
Copy link
Contributor

@wawltor wawltor commented Jul 21, 2022

PR types

New features

PR changes

APIs

Description

New features

for the Transformers models serving

from paddlenlp import SimpleServer
service = SimpleServer()
service.register('seq_cls', model_path='checkpoints/model_100/')

for the Taskflow serving

from paddlenlp import SimpleServer
from paddlenlp import Taskflow 
task = Taskflow('ner')
service = SimpleServer()
service.register_taskflow('ner', task)

start the service

paddlenlp server app:service --port 8182 --host 0.0.0.0

@wawltor wawltor marked this pull request as draft July 21, 2022 07:46
Copy link
Member

@ZeyuChen ZeyuChen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

对名字做个讨论明晰下利弊。另外文档中的专业术语编写
如server,service,serving,最好有个清晰的界定,什么场合用什么词

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

一会Serving一会Server,这里的专用术语是否有个明确的界定?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

一会Serving一会Server,这里的专用术语是否有个明确的界定?

service、serving 服务化,服务化在硬件层面和软件层面分为server、client,server意指提供服务的服务器、服务软件,client接收服务的客户端、客户软件

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Simple Serving你这里需要有空格吗?关于名字是否再做一个讨论?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Simple Serving你这里需要有空格吗?关于名字是否再做一个讨论?

SimpleServing这里之前的考虑是一个专有名词,目前这个PR还是一个Draft PR

Copy link
Member

@ZeyuChen ZeyuChen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

明确一个命令行入口后再做功能扩展

而不把命令行入口局限在一个server功能

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

我在想命令行入口是否同意用paddlenlp
paddlenlp server -xxxx
paddlenlp train -xxxx
将来可以往更高阶的自动化训练扩展的同时保持同一个命令行入口

@linjieccc linjieccc marked this pull request as ready for review November 21, 2022 04:53
Copy link
Contributor

@linjieccc linjieccc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@wawltor wawltor merged commit 351cb20 into PaddlePaddle:develop Nov 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants