TensorFlow Serving C++ API Documentation
Public Member Functions | Static Public Member Functions | List of all members
tensorflow::serving::TfLiteSession Class Reference
Inheritance diagram for tensorflow::serving::TfLiteSession:
Inheritance graph
[legend]
Collaboration diagram for tensorflow::serving::TfLiteSession:
Collaboration graph
[legend]

Public Member Functions

Status Run (const std::vector< std::pair< string, Tensor >> &inputs, const std::vector< string > &output_tensor_names, const std::vector< string > &target_node_names, std::vector< Tensor > *outputs) override
 
Status Run (const RunOptions &run_options, const std::vector< std::pair< string, Tensor >> &inputs, const std::vector< string > &output_tensor_names, const std::vector< string > &target_node_names, std::vector< Tensor > *outputs, RunMetadata *run_metadata) override
 
Status Run (const RunOptions &run_options, const std::vector< std::pair< string, Tensor >> &inputs, const std::vector< string > &output_tensor_names, const std::vector< string > &target_node_names, std::vector< Tensor > *outputs, RunMetadata *run_metadata, const thread::ThreadPoolOptions &thread_pool_options) override
 
Status ListDevices (std::vector< DeviceAttributes > *response) override
 
Status SetScheduler (const SchedulerCreator &scheduler_creator, const BasicBatchScheduler< TfLiteBatchTask >::Options &options)
 
BasicBatchScheduler< TfLiteBatchTask >::Options GetSchedulerOptions ()
 
- Public Member Functions inherited from tensorflow::serving::ServingSession
Status Create (const GraphDef &graph) final
 
Status Extend (const GraphDef &graph) final
 
Status Close () final
 

Static Public Member Functions

static Status Create (string &&buffer, const SessionOptions &options, int num_pools, int num_interpreters_per_pool, std::unique_ptr< TfLiteSession > *tflite_session, ::google::protobuf::Map< string, SignatureDef > *signatures)
 
static Status CreateDefaultBasicBatchScheduler (const BasicBatchScheduler< TfLiteBatchTask >::Options &options, std::function< void(std::unique_ptr< Batch< TfLiteBatchTask >>)> process_batch_callback, std::unique_ptr< BasicBatchScheduler< TfLiteBatchTask >> *batch_scheduler)
 
static Status SplitTfLiteInputTask (std::unique_ptr< TfLiteBatchTask > *input_task_ptr, int open_batch_remaining_slot, int max_batch_size, std::vector< std::unique_ptr< TfLiteBatchTask >> *output_tasks)
 

Detailed Description

Definition at line 129 of file tflite_session.h.


The documentation for this class was generated from the following files: