M8 / Protocols

Signature verification performance: the right frame

PractitionerAdvisor

After this lesson you can

  • Present the raw data of BIS othp107 (SOURCED) and derive the ~7.47x ratio from it, showing the division (DERIVED)
  • Justify why BIS's own wording 'at least an order of magnitude' is loosely inconsistent with its own data, and why this must be kept separate from the corpus's own ESTIMATED local-lab estimate

Before thisTLS 1.3 hybrid key exchange: your own measurement

Mental model

In the previous three lessons you saw the cost (in bytes) on the key exchange side of TLS, IKEv2 and SSH. This lesson focuses on the performance cost (in time) on the signature side, and in doing so shows one of this course’s most repeated disciplines with its clearest example: an institution’s raw data, a ratio derived from that data, and the fact that the ratio may not even fully match the institution’s own verbal statement.

BIS’s raw data: two numbers, straight from the source

The Bank for International Settlements’ Project Leap Phase 2 report (othp107) gives two average verification times in Graph 5 on page 23: PQC signature verification 209.9 msSOURCED, RSA signature verification 28.1 msSOURCED. These are figures BIS really measured and really published; the SOURCED tag means exactly that.

The derived ratio: division, shown

BIS’s report does not compute a ratio (how many times slower) from these two figures; it gives only the two raw numbers. This course itself derives a ratio by dividing them: 7.47×DERIVED (209.9 / 28.1 = 7.47…). This is a live example of exactly what the DERIVED tag means: the number itself does not appear in BIS’s report, but we compute it ourselves, with demonstrable arithmetic, from the two figures BIS published. Keeping this distinction clear matters: “BIS says 7.47x” is wrong; “the two figures BIS gives produce 7.47x” is right.

Loose inconsistency with BIS’s own wording

There is an interesting detail here: the prose of BIS’s own report says PQC verification is “at least an order of magnitude” (that is, at least ~10 times) slower than classical verification. But the real ratio derived from its own raw data is ~7.47x, below 10. That does not mean BIS is lying (“at least an order of magnitude” may be a rough rounding, or may cover different test scenarios), but it is an example of BIS’s own prose not fully matching its own chart. Showing an architect this nuance is a concrete application of the discipline “check even the source’s own text, not just a number”.

A third, separate figure: the corpus’s own local-lab estimate

During this research a third figure appeared, completely independent of BIS’s: the corpus’s own preparation notes contain an estimate that “ML-DSA-65 verification is 5-15x×ESTIMATED slower than RSA-2048 (hardware-dependent)”, explicitly not attributed to BIS, as an expectation for a local lab measurement. These three figures (BIS’s 209.9ms/28.1ms raw data, the 7.47x derived from it, and the corpus’s independent 5-15x estimate) do not “converge” and do not “confirm” each other; they come from different sources, different hardware and different methods. When presenting all three to an architect, the right frame is not “which is right” but “what does each measure, and on which hardware does each hold”. If you want to know the real performance impact on your own bank, you need to make your own measurement on your own hardware; none of these three figures replaces it.

Numbers to know

  • Raw data from BIS othp107 (SOURCED, p.23 Graph 5): PQC signature verification averages 209.9 ms, RSA signature verification averages 28.1 ms
  • The ratio derived from these two figures by division (DERIVED): 209.9 / 28.1 = ~7.47x; BIS's own prose says 'at least an order of magnitude' (10x or more), which is loosely inconsistent with its own data
  • The corpus's own local-lab estimate (ESTIMATED, not attributed to BIS): 5-15x, hardware-dependent; this does not 'converge' with or 'confirm' BIS's 7.47x, because it is a different estimate on different hardware; the two must stand separately

Lab: Derive the ratio from BIS's own chart

[not run] This is a reading and calculation exercise, not a runnable command

Requires: internet access. Check your setup

shell
# Open bis.org/publ/othp107.pdf and find Graph 5 on page 23
Recorded output
The chart shows an average PQC verification time of ~209.9 ms and an average RSA time of ~28.1 ms; if you compute 209.9/28.1 yourself you get ~7.47

At the table

How to say this in a bank meeting.

To an executive
PQC signature verification is about 7.5 times slower than RSA according to BIS's own measurement; that is real, but it is one institution's measurement in one environment, not a universal constant. We should measure this ratio ourselves on our own infrastructure instead of copying BIS's figure directly.
To an architect
There are three different figures, and none replaces another: BIS's raw data (209.9ms/28.1ms, SOURCED), the ratio derived by dividing them (~7.47x, DERIVED, loosely inconsistent with BIS's own prose), and the corpus's own hardware-dependent estimate (5-15x, ESTIMATED, never attributed to BIS). When presenting to an architect, do not mix the three; keep clear where each comes from.
Objection
“"Does the BIS report say PQC verification is 7.5 times slower?"”
Answer
No, BIS says that nowhere; BIS gives only two raw figures (209.9ms, 28.1ms) and says in prose 'at least an order of magnitude' (that is, at least 10 times). The 7.47x figure is a number we derived ourselves by dividing those two raw figures, not a direct claim by BIS; and that derived figure does not even fully match BIS's own '10 times' wording. Ignoring this difference and saying '7.5x, BIS says so' is exactly the mistake this course corrected earlier.

Sources

  • Bank for International Settlements (BIS), 2026. The primary source for real raw data on signature verification time (PQC versus RSA), measured by a single institution

    p.23, Graph 5 / 10 min

  • internal project document, 2026. Verification that the corpus's own local-lab estimate (5-15x) was never attributed to BIS and was correctly hedged (lines 13, 75)

    lines 13, 75 / 3 min

Checkpoint

Answer first, then compare with the model answer and score yourself against the rubric. Saved in this browser only.

  1. 01Recall

    What is the raw data of BIS othp107 (two figures), and how is ~7.47x derived from it?

  2. 02Recall

    What is the difference between BIS's own prose ('at least an order of magnitude') and its own raw data?

  3. 03Scenario

    A colleague has heard both BIS's 7.47x and the corpus's 5-15x estimate and asks 'they contradict each other, which is right?' How do you explain it?

  4. 04Hostile

    An auditor asks 'What is the source of your 7.5x figure? Is it BIS's own sentence?' Show exactly, step by step, where it comes from.

Project linkA concrete template, for the performance section of Project 1 (hybrid key exchange measurement and cost analysis), for presenting three separate figures (SOURCED/DERIVED/ESTIMATED) while keeping them correctly apart.