TensorFlow Serving C++ API Documentation
|
#include <basic_manager.h>
Public Attributes | |
std::unique_ptr< ResourceTracker > | resource_tracker |
uint32 | num_load_threads = 0 |
uint32 | num_unload_threads = 0 |
std::function< bool(absl::Status)> | should_retry_model_load |
EventBus< ServableState > * | servable_event_bus = nullptr |
uint32 | max_num_load_retries = 5 |
int64_t | load_retry_interval_micros = 1LL * 60 * 1000 * 1000 |
bool | flush_filesystem_caches = false |
Env * | env = Env::Default() |
PreLoadHook | pre_load_hook |
Config options and pluggable objects that will be used by the BasicManager.
Definition at line 113 of file basic_manager.h.