triton-inference-server/fastertransformer_backend General · Discussions · GitHub

Welcome to fastertransformer_backend Discussions!
Announcements byshiue

Sort by: Latest activity

General Discussions

Chat about anything and everything here

You must be logged in to vote

Using GEMM files in fastertransformer_backend.

SnoozingSimian started Sep 22, 2022 in General

3
You must be logged in to vote

Running on Jetson Xavier

haritsahm started Mar 19, 2023 in General

2
You must be logged in to vote

How to run BERT model fine-tuned as Tensorflow checkpoint with FT backend?

churinga started Jan 29, 2023 in General

3
You must be logged in to vote

Running BERT QA as ensemble + performance results

vblagoje started Sep 25, 2022 in General

0