|
TensorFlow Serving C++ API Documentation
|
#include <caching_manager.h>

Public Attributes | |
| std::unique_ptr< ResourceTracker > | resource_tracker |
| uint32 | num_load_threads = 0 |
| uint32 | num_unload_threads = 0 |
| EventBus< ServableState > * | servable_event_bus = nullptr |
| uint32 | max_num_load_retries = 5 |
| int64_t | load_retry_interval_micros = 1LL * 60 * 1000 * 1000 |
| Env * | env = Env::Default() |
Config options and pluggable objects that will be used by the CachingManager.
Definition at line 49 of file caching_manager.h.