Inheritance diagram for tensorflow::serving::TfrtSavedModelServable:
Collaboration diagram for tensorflow::serving::TfrtSavedModelServable:
Public Member Functions | |
| TfrtSavedModelServable (absl::string_view name, int64_t version, const TfrtSavedModelConfig &config, const SavedModelConfig &model_config, std::unique_ptr< tfrt_stub::SavedModel > saved_model, ThreadPoolFactory *thread_pool_factory) | |
| TfrtSavedModelServable (absl::string_view name, int64_t version, const TfrtSavedModelConfig &config, const SavedModelConfig &model_config, std::unique_ptr< tfrt_stub::SavedModel > saved_model, ThreadPoolFactory *thread_pool_factory, std::function< std::unique_ptr< RequestRecorder >(TfrtSavedModelServable &)> recorder_creator) | |
| absl::Status | Classify (const RunOptions &run_options, const ClassificationRequest &request, ClassificationResponse *response) override |
| absl::Status | Regress (const RunOptions &run_options, const RegressionRequest &request, RegressionResponse *response) override |
| absl::Status | Predict (const RunOptions &run_options, const PredictRequest &request, PredictResponse *response) override |
| absl::StatusOr< std::unique_ptr< PredictStreamedContext > > | PredictStreamed (const RunOptions &run_options, absl::AnyInvocable< void(absl::StatusOr< PredictResponse >)> response_callback) override |
| absl::Status | MultiInference (const RunOptions &run_options, const MultiInferenceRequest &request, MultiInferenceResponse *response) override |
| absl::Status | GetModelMetadata (const GetModelMetadataRequest &request, GetModelMetadataResponse *response) override |
| bool | SupportsPaging () const override |
| absl::Status | Suspend () override |
| absl::Status | Resume () override |
| tfrt_stub::SavedModel & | saved_model () const |
| void | set_resume_fn (absl::AnyInvocable< absl::Status(TfrtSavedModelServable *)> resume_fn) |
| void | set_suspend_fn (absl::AnyInvocable< absl::Status(TfrtSavedModelServable *)> suspend_fn) |
 Public Member Functions inherited from tensorflow::serving::Servable | |
| Servable (absl::string_view name, int64_t version, bool is_critical=false) | |
| absl::string_view | name () const |
| int64_t | version () const |
| bool | IsCritical () const |
Additional Inherited Members | |
| Public Types inherited from tensorflow::serving::Servable | |
| using | RunOptions = tensorflow::serving::servables::RunOptions |
Detailed Description
Definition at line 56 of file tfrt_servable.h.
The documentation for this class was generated from the following files:
- tensorflow_serving/servables/tensorflow/tfrt_servable.h
- tensorflow_serving/servables/tensorflow/tfrt_servable.cc
