tensorflow::serving::StreamingBatchScheduler< TaskType >::Options Struct Reference

Collaboration diagram for tensorflow::serving::StreamingBatchScheduler< TaskType >::Options:

Public Attributes
size_t	max_batch_size = 1000
int64_t	batch_timeout_micros = 0
string	thread_pool_name = "batch_threads"
int	num_batch_threads = port::MaxParallelism()
Env *	env = Env::Default()
uint64_t	no_tasks_wait_time_micros = 1000

Detailed Description

template<typename TaskType>
struct tensorflow::serving::StreamingBatchScheduler< TaskType >::Options

Definition at line 116 of file streaming_batch_scheduler.h.

---

The documentation for this struct was generated from the following file:

• tensorflow_serving/batching/streaming_batch_scheduler.h