|
TensorFlow Serving C++ API Documentation
|
#include <basic_manager.h>

Public Attributes | |
| std::unique_ptr< ResourceTracker > | resource_tracker |
| uint32 | num_load_threads = 0 |
| uint32 | num_unload_threads = 0 |
| std::function< bool(absl::Status)> | should_retry_model_load |
| EventBus< ServableState > * | servable_event_bus = nullptr |
| uint32 | max_num_load_retries = 5 |
| int64_t | load_retry_interval_micros = 1LL * 60 * 1000 * 1000 |
| bool | flush_filesystem_caches = false |
| Env * | env = Env::Default() |
| PreLoadHook | pre_load_hook |
Config options and pluggable objects that will be used by the BasicManager.
Definition at line 113 of file basic_manager.h.