INNER CODE UNIT · Python

_DistributedOptimizer

horovod/horovod · horovod/_keras/__init__.py:36

    class _DistributedOptimizer(*optimizer.__class__.__bases__):
        _HAS_AGGREGATE_GRAD = True

        def __init__(self, **kwargs):
            super(self.__class__, self).__init__(**kwargs)

            self._name = name or "Distributed%s" % self.__class__.__base__.__name__
            self._aggregated_gradients = False

            self._allreduce_grads = hvd._make_allreduce_grads_fn(
                self._name,
                device_dense,
                device_sparse,
                compression,
                sparse_as_dense,
                op,
                gradient_predivide_factor,
                groups,

View source record →