From 05ff5c03a788dbc387169bcdf13641ac7b01d0a5 Mon Sep 17 00:00:00 2001 From: kthui <18255193+kthui@users.noreply.github.com> Date: Mon, 8 Jan 2024 12:36:22 -0800 Subject: [PATCH 1/2] Update docs --- README.md | 13 +++++++++++-- 1 file changed, 11 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 521307c..0f9a44e 100644 --- a/README.md +++ b/README.md @@ -80,8 +80,8 @@ used to execute both TensorFlow 1 and TensorFlow 2 models. The [tensorflow_backend](https://github.com/triton-inference-server/tensorflow_backend) repo contains the documentation and source for the backend. -**PyTorch**: The PyTorch backend is used to execute TorchScript -models. The +**PyTorch**: The PyTorch backend is used to execute PyTorch models in both +TorchScript and PyTorch 2.0 formats. The [pytorch_backend](https://github.com/triton-inference-server/pytorch_backend) repo contains the documentation and source for the backend. @@ -215,6 +215,15 @@ Triton image as: ... # other files needed by mybackend ``` +Starting from 24.01, the default backend shared library name can be changed by +providing the `runtime` setting in the model configuration. For example, + +``` +runtime: "my_backend_shared_library_name.so" +``` + +A model may choose a specific runtime implementation provided by the backend. + ### Triton Backend API A Triton backend must implement the C interface defined in From 48af0d04c0875d8c4c531bb571e3f94d8a6d7fe5 Mon Sep 17 00:00:00 2001 From: kthui <18255193+kthui@users.noreply.github.com> Date: Mon, 8 Jan 2024 15:29:40 -0800 Subject: [PATCH 2/2] Update copyright --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 0f9a44e..b57d44e 100644 --- a/README.md +++ b/README.md @@ -1,5 +1,5 @@