Inheritance diagram for tensorflow::serving::SavedModelBatchingTask:
Collaboration diagram for tensorflow::serving::SavedModelBatchingTask:
Static Public Member Functions | |
| static std::string | Name () |
 Static Public Member Functions inherited from tensorflow::serving::BatchingSessionTask | |
| static std::string | Name () |
Public Attributes | |
| tfrt::HostContext * | host_context |
| absl::Span< const Tensor > | tfrt_inputs |
| std::vector< Tensor > * | tfrt_outputs |
| tfrt::SavedModel::RunOptions | run_options |
| std::vector< Tensor > | tfrt_partial_inputs |
| ThreadSafeStatus * | partial_status = nullptr |
| Public Attributes inherited from tensorflow::serving::BatchingSessionTask | |
| uint64_t | enqueue_time_micros |
| RunOptions | run_options |
| size_t | zeroth_dim_size |
| const std::vector< std::pair< string, Tensor > > * | inputs |
| const std::vector< string > * | output_tensor_names |
| Notification * | done |
| Status * | status |
| std::vector< Tensor > * | outputs |
| RunMetadata * | run_metadata |
| absl::optional< thread::ThreadPoolOptions > | thread_pool_options |
| bool | is_partial = false |
| std::unique_ptr< std::vector< std::pair< string, Tensor > > > | owned_split_inputs |
| int | split_index = 0 |
| std::function< void()> | done_callback |
| std::shared_ptr< TensorMatrix > | shared_outputs |
| std::shared_ptr< ThreadSafeStatus > | thread_safe_status |
| std::shared_ptr< std::vector< RunMetadata > > | split_run_metadatas |
Additional Inherited Members | |
| Public Types inherited from tensorflow::serving::BatchingSessionTask | |
| typedef std::vector< std::vector< Tensor > > | TensorMatrix |
| Public Member Functions inherited from tensorflow::serving::BatchingSessionTask | |
| size_t | size () const override |
Detailed Description
Definition at line 68 of file tfrt_saved_model_with_batching.h.
The documentation for this struct was generated from the following file:
- tensorflow_serving/batching/tfrt_saved_model_with_batching.h
