What about inference? Inference may be done outside of the Python script that was used to train the model. If you do this, it will not have references to the Horovod library.
To run inference on a checkpoint generated by the Horovod-enabled training script you should optimize the graph and only keep operations necessary for a forward pass through model. The Optimize for Inference script from the TensorFlow repository will do that for you.
ValueError: No op named HorovodAllreduce in defined operations.