LeanMachineLearning

Bandits.ETC.probReal_sumRewards_le_sumRewards_le๐Ÿ”—

Lemma

No docstring.

๐Ÿ”—theorem
Bandits.ETC.probReal_sumRewards_le_sumRewards_le.{u_1} {K : โ„•} {hK : 0 < K} {m : โ„•} {ฮฝ : ProbabilityTheory.Kernel (Fin K) โ„} [ProbabilityTheory.IsMarkovKernel ฮฝ] {ฮฉ : Type u_1} {mฮฉ : MeasurableSpace ฮฉ} {P : MeasureTheory.Measure ฮฉ} [MeasureTheory.IsProbabilityMeasure P] {A : โ„• โ†’ ฮฉ โ†’ Fin K} {R : โ„• โ†’ ฮฉ โ†’ โ„} {ฯƒ2 : NNReal} [Nonempty (Fin K)] (h : Learning.IsAlgEnvSeq A R (etcAlgorithm hK m) (Learning.stationaryEnv ฮฝ) P) (hฮฝ : โˆ€ (a : Fin K), ProbabilityTheory.HasSubgaussianMGF (fun x => x - โˆซ (x : โ„), id x โˆ‚ฮฝ a) ฯƒ2 (ฮฝ a)) (a : Fin K) : MeasureTheory.Measure.real P {ฯ‰ | Learning.sumRewards A R (bestArm ฮฝ) (K * m) ฯ‰ โ‰ค Learning.sumRewards A R a (K * m) ฯ‰} โ‰ค Real.exp (-โ†‘m * gap ฮฝ a ^ 2 / (4 * โ†‘ฯƒ2))
Bandits.ETC.probReal_sumRewards_le_sumRewards_le.{u_1} {K : โ„•} {hK : 0 < K} {m : โ„•} {ฮฝ : ProbabilityTheory.Kernel (Fin K) โ„} [ProbabilityTheory.IsMarkovKernel ฮฝ] {ฮฉ : Type u_1} {mฮฉ : MeasurableSpace ฮฉ} {P : MeasureTheory.Measure ฮฉ} [MeasureTheory.IsProbabilityMeasure P] {A : โ„• โ†’ ฮฉ โ†’ Fin K} {R : โ„• โ†’ ฮฉ โ†’ โ„} {ฯƒ2 : NNReal} [Nonempty (Fin K)] (h : Learning.IsAlgEnvSeq A R (etcAlgorithm hK m) (Learning.stationaryEnv ฮฝ) P) (hฮฝ : โˆ€ (a : Fin K), ProbabilityTheory.HasSubgaussianMGF (fun x => x - โˆซ (x : โ„), id x โˆ‚ฮฝ a) ฯƒ2 (ฮฝ a)) (a : Fin K) : MeasureTheory.Measure.real P {ฯ‰ | Learning.sumRewards A R (bestArm ฮฝ) (K * m) ฯ‰ โ‰ค Learning.sumRewards A R a (K * m) ฯ‰} โ‰ค Real.exp (-โ†‘m * gap ฮฝ a ^ 2 / (4 * โ†‘ฯƒ2))

Code

lemma probReal_sumRewards_le_sumRewards_le [Nonempty (Fin K)]
    (h : IsAlgEnvSeq A R (etcAlgorithm hK m) (stationaryEnv ฮฝ) P)
    (hฮฝ : โˆ€ a, HasSubgaussianMGF (fun x โ†ฆ x - (ฮฝ a)[id]) ฯƒ2 (ฮฝ a)) (a : Fin K) :
    P.real {ฯ‰ | sumRewards A R (bestArm ฮฝ) (K * m) ฯ‰ โ‰ค sumRewards A R a (K * m) ฯ‰} โ‰ค
      Real.exp (-โ†‘m * gap ฮฝ a ^ 2 / (4 * ฯƒ2))
Proof
by
  have h1 := Bandits.probReal_sumRewards_le_sumRewards_le h a (K * m) m m
  have h2 := probReal_sum_le_sum_streamMeasure hฮฝ a m
  refine le_trans (le_of_eq ?_) (h1.trans h2)
  simp_rw [measureReal_def]
  congr 1
  refine measure_congr ?_
  rw [Filter.eventuallyEq_set]
  filter_upwards [pullCount_mul h a, pullCount_mul h (bestArm ฮฝ)] with ฯ‰ ha h_best
  simp [ha, h_best]

Actions: Source ยท Open Issue

Meaning last changed in v4.34.0-rc2-14-gf86702d (2026-08-25), the 5th recorded change.

Self-contained, with its dependencies inlined and proofs replaced by sorry: download the raw file ยท open it in the Lean web editor.

Dependency graph

Audit surface: 19 project declarations, 147 external constants

โœ“ Proved: no sorry anywhere in its closure

This is the tool's own reading of one build's recorded axioms, and it is not robust against an author who wants it to pass. Checking meant to be relied on should go through Comparator, which replays the proof through the kernel from an export against an explicit list of permitted axioms.