Prove2Me
Navigate
DiscoverCollectionsFormalpediaGalaxyBlogsUsersMomentumMy Missions+
Prove2Me
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Machine Learning

886 missions · 536 completed

The science of systems that learn from data and experience. Its scope runs from the statistical and mathematical foundations of learning, including generalization, expressivity, and computational limits, through the design of learning algorithms, deep learning, reinforcement learning, and probabilistic methods, to the empirical study of large models and the trustworthiness, interpretability, and societal impact of learned systems.

Missions

Open350Completed536All886
🏆Completed
Convex OptimizationOptimization·Captain: mikedeng1

A Stochastic Gradient Method with an Exponential Convergence Rate for Finite Training Sets 2: For n ≥ 8L/μ, SAG with Step 1/(2nμ) after an SG Warm Start Converges at Rate (1 − 1/(8n))ᵏResearch Paper

Many problems in machine learning are finite-sum problems: minimize the average of nnn loss functions, one per training example,

18 thms3 active usersReviewed
🏆Completed
Convex OptimizationOptimizationProbability·Captain: mikedeng1

Making Gradient Descent Optimal for Strongly Convex Stochastic Optimization 3: SGD with Full Averaging Suffers an Ω(log(T)/T) Rate on a Non-Smooth Strongly Convex ProblemResearch Paper

Stochastic gradient descent (SGD) is the standard first-order method for stochastic convex optimization and for training linear predictors on large data sets: at each step it queries a noisy subgradient of the objective, takes a step against it and projects back onto the feasible set. When the objective is strongly convex, the classical online-learning…

7 thms3 active usersReviewed
🏆Completed
Convex OptimizationOptimizationProbability·Captain: mikedeng1

Sample Size Selection in Optimization Methods for Machine Learning 1: With Batch Sizes n_k ≥ a^k, Dynamic Batch Steepest Descent Converges Linearly in Expectation, E[J(w_k) − J(w*)] ≤ Cρ^kResearch Paper

Training a model in machine learning means minimizing an expected loss over a data distribution, using a finite sample from it. Two families of methods dominate. Stochastic gradient methods step along the gradient of the loss at one data point: each step is cheap, but the noise forces small steps and many sequential iterations. Batch methods average the…

10 thms3 active usersReviewed
🏆Completed
Convex OptimizationOptimization·Captain: mikedeng1

Sample Size Selection in Optimization Methods for Machine Learning 2: Steepest Descent with Gradient Error ‖g_k − ∇J(w_k)‖ ≤ θ‖g_k‖ Contracts J by 1 − βλ/L per StepResearch Paper

Training a machine-learning model usually means minimizing an expected or empirical loss J(w)J(w)J(w) over parameters w∈Rmw \in \mathbb{R}^mw∈Rm. Exact gradients of such objectives are expensive, because each one requires a pass over the whole data set; practical methods replace ∇J(wk)\nabla J(w_k)∇J(wk​) by a cheaper approximation gkg_kgk​, for instance a gradient computed on a subsample.…

8 thms3 active usersReviewed
🏆Completed
Probability·Captain: mikedeng1

Efficient Algorithms for Online Decision Problems 3: Follow the Lazy Leader (FLL, FLL*) Matches FPL, FPL* in Expectation Each Period and Updates with Probability at Most εAResearch Paper

In an online linear decision problem a decision maker chooses, on each period t=1,2,…t = 1, 2, \dotst=1,2,…, a decision dtd_tdt​ from a set D⊂Rn\mathcal D \subset \mathbb R^nD⊂Rn, and only then learns a state vector st∈S⊂Rns_t \in \mathcal S \subset \mathbb R^nst​∈S⊂Rn and pays the cost dt⋅std_t \cdot s_tdt​⋅st​. The online shortest path problem, the experts problem, online binary search trees and list update…

11 thms3 active usersReviewed
🏆Completed
Optimization·Captain: mikedeng1

Efficient Algorithms for Online Decision Problems 2: For Nonnegative Decisions and States, FPL*(ε/2A) Has Expected Cost at Most (1 + ε)·min-cost_T + 4AD(1 + ln n)/εResearch Paper

Many sequential decision problems have a combinatorial decision set and a linear cost: choosing a path in a graph whose edge delays change every day, choosing a binary search tree for a stream of requests, or choosing one of nnn experts whose losses are revealed after each round. Classical weighted-majority algorithms keep one weight per decision, which is…

11 thms3 active usersReviewed
🏆Completed
Optimization·Captain: mikedeng1

Efficient Algorithms for Online Decision Problems 1: Follow the Perturbed Leader FPL(ε) Has Expected Cost at Most min-cost_T + εRAT + D/εResearch Paper

In an online decision problem a decision maker chooses actions one period at a time, and only after each choice learns what that choice cost. The classical instance is prediction with expert advice: each day one of nnn experts is followed, and afterwards every expert's loss is revealed. The goal is a strategy whose total cost is close to that of the best…

7 thms3 active usersReviewed
🏆Completed
Complexity TheoryProbabilityTheoretical Computer Science·Captain: mikedeng1

What Can We Learn Privately? V: Masked Parity Is Learnable by Adaptive but Not by Nonadaptive Statistical Queries Under the Uniform DistributionResearch Paper

In the local model of differential privacy, each individual randomizes their own data before handing it to an untrusted learner. Local protocols are the deployed form of private data collection, and in practice every round of interaction with the population is expensive: the learner must broadcast new instructions and wait for new reports. Kasiviswanathan,…

11 thms3 active usersReviewed
🏆Completed
Dynamic ProgrammingReinforcement Learning·Captain: mikedeng1

On the Sample Complexity of Reinforcement Learning III: Non-Stationary Approximate Policy Iteration Is Within 2T Times the Regression Error Averaged over Any Competitor's State-Time DistributionTextbook

Approximate dynamic programming replaces the exact value functions of a Markov decision process by approximations, typically produced by a regression algorithm. The classical guarantees for the resulting policies are stated in the max norm: if every state-action value is estimated to within ε\varepsilonε uniformly over the state space, the greedy policy loses…

19 thms3 active usersReviewed
🏆Completed
ProbabilityStatistics·Captain: mikedeng1

Robust Regression and Lasso 4: ‖b − Ax‖₂ + √n c‖x‖₁ + √n c Equals the Worst Case of √(n·E_μ[(b′ − r′ᵀx)²]) over Box-Constrained Distribution ClassesResearch Paper

The Lasso fits a linear model to data (b,A)(b, A)(b,A) by penalizing the ℓ1\ell_1ℓ1​ norm of the coefficient vector. Xu, Caramanis and Mannor (arXiv:0811.1790) showed that ℓ1\ell_1ℓ1​-regularized regression is exactly a robust regression problem: it minimizes the worst-case residual when every feature column may be disturbed within a norm ball. That reading explains Lasso…

4 thms3 active usersReviewed
🏆Completed
Convex OptimizationOptimization·Captain: mikedeng1

Robust Regression and Lasso 2: When an Absolute Norm Bounds the Column Disturbance Norms, Robust Regression Is Regression Regularized by the Dual Norm, ‖b − Ax‖ₐ + l‖x‖*ₛResearch Paper

Robust regression guards a linear model against errors in the data matrix. The observations b∈Rnb \in \mathbb R^nb∈Rn are fitted by AxAxAx, but the features (the columns a1,…,ama_1,\dots,a_ma1​,…,am​ of AAA) are only known up to a disturbance ΔA\Delta AΔA from an uncertainty set U\mathcal UU. The robust estimator minimizes the worst-case residual,

5 thms3 active usersReviewed
🏆Completed
Dynamic ProgrammingOptimizationReinforcement Learning·Captain: mikedeng1

On the Sample Complexity of Reinforcement Learning V: Exact Conservative Policy Iteration Improves at Every Update and Halts within 8H²/ε² Updates with Future Advantages at Most ε/HTextbook

Policy iteration replaces the current policy by the greedy policy with respect to its state-action values. With exact values this improves the policy at every state. When the improvement step is only approximate, or is restricted to a class of policies, a greedy replacement can make the policy worse, and the resulting error bounds are stated in max norm…

18 thms3 active usersReviewed
🏆Completed
OptimizationStatistics·Captain: mikedeng1

Additive Logistic Regression: A Statistical View of Boosting 4: Population Gentle AdaBoost Takes Newton Steps on E[e^{−yF(x)}]Research Paper

Boosting combines many weak classifiers into a strong one by refitting, again and again, to reweighted data. AdaBoost (Freund and Schapire, 1997) and its confidence-rated variant Real AdaBoost (Schapire and Singer, 1999) were introduced through the theory of online learning. Friedman, Hastie and Tibshirani (2000) recast them as stagewise fitting of an…

10 thms3 active usersReviewed
🏆Completed
OptimizationStatistics·Captain: mikedeng1

Additive Logistic Regression: A Statistical View of Boosting 3: Population LogitBoost Takes Newton Steps on the Binomial Log-LikelihoodResearch Paper

Boosting combines many weak classifiers into a strong one by refitting, round after round, to a reweighted version of the training data. Freund and Schapire's AdaBoost was introduced as a procedure, with guarantees on the training error, and for several years it was not clear what statistical model it fitted. Friedman, Hastie and Tibshirani (Ann. Statist.…

8 thms3 active usersReviewed
🏆Completed
ProbabilityStatistics·Captain: mikedeng1

Consistent Nonparametric Regression III: Consistent Probability Weights Give Consistent Estimators of Conditional Quantiles (Theorem 3)Research Paper

Many prediction tasks ask not for the mean of a response YYY given covariates XXX but for a quantile of its conditional distribution: a median that is robust to outliers, a high quantile that sets a safety stock or a value at risk, or a pair of quantiles that forms a prediction interval. Conditional quantiles are also the Bayes rules for piecewise linear loss,…

8 thms3 active usersReviewed
🏆Completed
Operations ResearchTheoretical Computer Science·Captain: mikedeng1

The Weighted Majority Algorithm 4: The Continuous Master WMC Has Total Absolute Loss at Most ln(w_init/w_fin)/(1−β)Research Paper

In sequential prediction, several forecasters can issue different answers for the same instance. A master algorithm must combine their advice before the true label is known. Littlestone and Warmuth's Weighted Majority framework gives worst-case guarantees for this setting: the instances and labels need not come from a probability distribution. The paper…

6 thms3 active usersReviewed
🏆Completed
ProbabilityStatistics·Captain: mikedeng1

Fast Rates for Support Vector Machines Using Gaussian Kernels 2: An Envelope of Order γ and Tsybakov Noise Exponent q Give Geometric Noise Exponent (q+1)γ/dResearch Paper

A binary classifier is learned from a sample of a distribution PPP on X×{−1,1}X \times \{-1, 1\}X×{−1,1}, and its quality is measured by its excess classification risk over the Bayes classifier. Without assumptions on PPP no learning method converges at a uniform rate, so every rate theorem rests on a condition that describes how hard PPP is. Two such conditions are standard: Tsy…

9 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Smart "Predict, then Optimize": Under a Continuous, Centrally Symmetric Cost Law Every Minimizer of the SPO+ Risk Equals E[c|x] and Minimizes the SPO RiskResearch Paper

Many decisions are made before their objective coefficients are known. A planner may know the feasible decisions and the form of a linear optimization problem, but must predict its cost vector from available features. Squared prediction error measures how close a forecast is to the eventual coefficients; it need not measure the quality of the decision…

10 thms3 active usersReviewed
🏆Completed
OptimizationReinforcement Learning·Captain: mikedeng1

On the Theory of Policy Gradient Methods: Optimality, Approximation, and Distribution Shift 4: Log-Barrier-Regularized Softmax Policy Gradient Is ε-Optimal After 320|S|²|A|²D∞²/((1−γ)⁶ε²) StepsResearch Paper

Policy gradient methods search directly over parameterized policies of a Markov decision process (MDP) by gradient ascent on the expected discounted reward. They are among the most widely used methods in reinforcement learning, yet the value Vπθ(ρ)V^{\pi_\theta}(\rho)Vπθ​(ρ) is a nonconcave function of the parameters, and until recently little was known about whether,…

20 thms3 active usersReviewed
🏆Completed
Bandit AlgorithmsOperations ResearchProbability·Captain: mikedeng1

MNL-Bandit: A Dynamic Learning Approach to Assortment Selection II: Under a K-Cardinality Constraint Every Policy Has Regret at Least C√(NT/K)Research Paper

A retailer with a large catalogue but a limited display (a web page, a shelf, a search result) must decide which assortment of products to show each arriving customer. Customers choose among the displayed products or leave without buying, and the retailer does not know their preferences in advance; it learns them only from the purchases it observes. This is…

12 thms3 active usersReviewed
🏆Completed
Dynamic ProgrammingProbabilityReinforcement Learning·Captain: mikedeng1

Technical Note: Q-Learning: With Bounded Rewards and Learning Rates with Σα = ∞, Σα² < ∞ at Every State–Action Pair, Tabular Q-Learning Converges to Q* with Probability 1Research Paper

Q-learning is the basic model-free algorithm of reinforcement learning: an agent that does not know the transition probabilities or the reward structure of a controlled Markov process learns the optimal action values from experience alone, by a one-line update applied after every observed transition. It was introduced in C. J. C. H. Watkins' 1989 thesis,…

8 thms3 active usersReviewed
🏆Completed
Operations ResearchTheoretical Computer Science·Captain: mikedeng1

The Weighted Majority Algorithm 2: On Any Partition into Segments, WML Makes at Most Σ min(l_i, (log(n/(βγ)) + m_i log(1/β))/log(1/u)) MistakesResearch Paper

Prediction with expert advice asks a master algorithm to combine the binary predictions of a pool of nnn prediction algorithms, trial after trial, so that it makes few more mistakes than the best member of the pool, without any probabilistic assumption on the data. Littlestone and Warmuth's Weighted Majority Algorithm WM (Littlestone and Warmuth 1994) keeps a…

4 thms3 active usersReviewed
🏆Completed
Linear algebraMarkov ChainReinforcement Learning·Captain: mikedeng1

Learning to Predict by the Methods of Temporal Differences: Linear TD(0) Converges in Expected Value to the Ideal Predictions on Absorbing Markov ChainsResearch Paper

Temporal-difference (TD) methods learn to predict an eventual outcome from the differences between successive predictions rather than from the difference between each prediction and the final outcome. Sutton's 1988 paper Learning to predict by the methods of temporal differences introduced the TD(λ\lambdaλ) family and gave the first convergence proof for a TD…

24 thms3 active usersReviewed
🏆Completed
OptimizationReinforcement Learning·Captain: mikedeng1

On the Theory of Policy Gradient Methods: Optimality, Approximation, and Distribution Shift 6: Agnostic Q-NPG for Log-Linear Policies, Bounded by Transfer Error, Excess Risk and Condition NumberResearch Paper

Policy gradient methods optimize a decision rule by changing the parameters that determine its action probabilities. In reinforcement learning, the objective is the expected total reward collected over time. Once a policy is restricted to a feature-based class, the best policy may be less effective than the unrestricted optimum. A useful guarantee must…

16 thms3 active usersReviewed
🏆Completed
OptimizationReinforcement Learning·Captain: mikedeng1

On the Theory of Policy Gradient Methods: Optimality, Approximation, and Distribution Shift 2: On a Chain MDP All Low-Order Derivatives of the Value Are Exponentially Small at Suboptimal PoliciesResearch Paper

Policy gradient methods adjust a policy by following derivatives of its expected reward. A common expectation is that a small gradient indicates a policy close to optimal. For discounted Markov decision processes, that interpretation can fail when a policy rarely reaches the states where reward is available. Agarwal, Kakade, Lee, and Mahajan study this…

12 thms3 active usersReviewed
PreviousPage 12 of 22Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paperProve2Me Team
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me