Description
Issue summary: When EVP_PKEY_derive_set_peer() is called with a DHX (X9.42) peer key, the peer key is not properly checked for the subgroup membership. Impact summary: A malicious peer which presents an X9.42 key carrying the victim's p and g parameters, a forged q = r (a small prime factor of the cofactor (p−1)/q_local), and a public value Y of order r can recover the victim's private key after a small number of key exchange attempts. When EVP_PKEY_derive_set_peer() is called with a DHX (X9.42) peer key, the subgroup membership check Y^q ≡ 1 (mod p) is performed using the peer's own q parameter, not the local key's q. The peer's domain parameters are then matched against the domain parameters of the private key, but the value of q is not compared. A malicious peer who presents an X9.42 key carrying the victim's p, g, a forged q = r (a small prime factor of the cofactor), and a public value Y of order r passes all checks. The shared secret then takes only r distinct values, leaking priv mod r. Repeating for each small-prime factor of the cofactor and combining via CRT recovers the full private key (Lim–Lee / small-subgroup-confinement attack). The realistic attack surface is narrow: principally CMP deployments with long-lived RA/CA DHX keys and bespoke enterprise or government applications using X9.42 DHX static keys with interactive protocols and therefore this issue was assigned Low severity. The FIPS modules in 4.0, 3.6, 3.5, 3.4, and 3.0 are affected by this issue.
Problem types
CWE-325 Missing Cryptographic Step
Product status
4.0.0 (semver) before 4.0.1
3.6.0 (semver) before 3.6.3
3.5.0 (semver) before 3.5.7
3.4.0 (semver) before 3.4.6
3.0.0 (semver) before 3.0.21
Credits
Alex Gaynor (Anthropic)
Alex Gaynor (Anthropic)
Viktor Dukhovni
Norbert Pócs
References
openssl-library.org/news/secadv/20260609.txt (OpenSSL Advisory)
github.com/...ommit/3da5a516cd2635a320ff748503db2cef7c4b0f02 (4.0.1 git commit)
github.com/...ommit/3ddbb7ab50bd93dfc59cbe08e269a67605aeebdb (3.6.3 git commit)
github.com/...ommit/ca2237ab5615641b662183b077f62c08d75e8070 (3.5.7 git commit)
github.com/...ommit/5f452bba2c681423d8fcffd120a19b757ee42e3c (3.4.6 git commit)
github.com/...ommit/7fbfde7677ed8808828bf00ff01c937ca04bdda2 (3.0.21 git commit)