INNER CODE UNIT · Python

actual

KwaiAppTeam/KOOM · koom-common/kwai-android-base/src/main/cpp/fmtlib/support/compute-powers.py:28

    actual = result.f * 10 ** exp_offset10
    if result.e > 0:
        actual *= 2 ** result.e
    else:
        for j in range(-result.e):
            actual /= 2
    expected = 10 ** (exp_offset10 + exp)
    precision = len('{}'.format(expected)) - len('{}'.format(actual - expected))
    if precision < 19:
        print('low precision:', precision)
        exit(1)

print('Significands:', end='')
for i, fp in enumerate(powers):
    if i % 3 == 0:
        print(end='\n ')
    print(' {:0<#16x}'.format(fp.f, ), end=',')

View source record →

📰 Research Paper
Loading…
⏳ Fetching content…