TensorFlow Serving C++ API Documentation
|
Public Member Functions | |
absl::optional< ServableAction > | GetNextAction (const std::vector< AspiredServableStateSnapshot > &all_versions) const override |
Additional Inherited Members | |
![]() | |
enum class | Action : int { kLoad , kUnload } |
The different actions that could be recommended by a policy. More... | |
![]() | |
static absl::optional< ServableId > | GetHighestAspiredNewServableId (const std::vector< AspiredServableStateSnapshot > &all_versions) |
Definition at line 39 of file availability_preserving_policy.h.
|
overridevirtual |
Takes in a vector of state snapshots of all versions of a servable stream and returns an action to be performed for a particular servable version, depending only on the states of all the versions.
If no action is to be performed, we don't return an action, meaning that the servable stream is up to date.
Implements tensorflow::serving::AspiredVersionPolicy.
Definition at line 48 of file availability_preserving_policy.cc.