解读FastAPI异步化为transformers模型打造高性能接口解析
from fastapi import FastAPI from transformers import AutoModel, AutoTokenizer import numpy as np from starlette.responses import JSONResponseapp FastAPI()加载模型和分词器 model AutoModel.from_pretrained("distilbert-base-uncased")tokenizer Aut…
2024-11-08