TensorFlow Serving C++ API Documentation
|
#include <caching_manager.h>
Public Attributes | |
std::unique_ptr< ResourceTracker > | resource_tracker |
uint32 | num_load_threads = 0 |
uint32 | num_unload_threads = 0 |
EventBus< ServableState > * | servable_event_bus = nullptr |
uint32 | max_num_load_retries = 5 |
int64_t | load_retry_interval_micros = 1LL * 60 * 1000 * 1000 |
Env * | env = Env::Default() |
Config options and pluggable objects that will be used by the CachingManager.
Definition at line 49 of file caching_manager.h.