Regarding deployment using TF serving or Pytroch serving

[chintanshrinath]

Dear
I want to deploy the model either on TF Serving or pytorch serving.

I have few dobuts, can you help for same.
1). How to use weights for tf_model.h5 to reduce the size of model. Or same for pytorch_model.bin
2) Or can you help me deploy in production mode.

Thanks

[Vamsi995]

Please visit this link Vamsi/T5_Paraphrase_Paws. You can find the t5_model.h5 and the pytorch_model.bin files for this model. Maybe you can follow this guide for quantizing the weights https://spell.ml/blog/pytorch-quantization-X8e7wBAAACIAHPhT.