INNER CODE UNIT · Python

prob_for_sample

lucidrains/vector-quantize-pytorch · vector_quantize_pytorch/binary_mapper.py:148

        prob_for_sample = (logits / temperature).sigmoid()

        # sampling

        if not deterministic:
            sampled_bits = prob_for_sample.bernoulli().long()
        else:
            sampled_bits = (prob_for_sample > 0.5).long()

        indices = (self.power_two * sampled_bits).sum(dim = -1)

        one_hot = F.one_hot(indices, self.num_codes).float()

        # maybe calculate aux loss

        aux_kl_loss = self.zero

        if calc_aux_loss:

View source record →