Prove2Me
Navigate
DiscoverCollectionsFormalpediaGalaxyBlogsUsersMomentumMy Missions+
Prove2Me
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Control Theory

214 missions · 87 completed

Missions

Open127Completed87All214
🏆Completed
Dynamic ProgrammingOperations ResearchOptimization·Captain: mikedeng1

Robust Control of Markov Decision Processes with Uncertain Transition Matrices 2: The Robust Bellman Recursion for Discounted Infinite-Horizon MDPsResearch Paper

A Markov decision process (MDP) is solved by dynamic programming only when its transition probabilities are known. In practice they are estimated from data, and the optimal policy of the estimated model can perform badly on the true one. Nilim and El Ghaoui (Oper. Res. 53(5), 2005) showed that, when the uncertainty on the transition matrices has a product…

10 thms4 active usersReviewed
🏆Completed
Dynamic ProgrammingOperations ResearchOptimization·Captain: mikedeng1

Robust Control of Markov Decision Processes with Uncertain Transition Matrices 1: Perfect Duality and the Robust Dynamic Programming Recursion for Finite-Horizon MDPsResearch Paper

A Markov decision process (MDP) is solved by dynamic programming once its transition probabilities are known. In practice they are estimated from data, and the optimal policy of an MDP can be sensitive to estimation error: a policy computed from point estimates may perform much worse under the true transition matrices. Nilim and El Ghaoui (Oper. Res. 53(5),…

11 thms4 active usersReviewed
🏆Completed
Dynamic ProgrammingOperations ResearchOptimization·Captain: mikedeng1

Monotone Mappings with Application in Dynamic Programming I: Compactness Gives Convergence of the DP Algorithm and an Optimal Stationary Policy under Uniform IncreaseResearch Paper

Infinite-horizon optimal control problems with nonnegative costs (Strauch's negative dynamic programming, the positive-cost counterpart of Blackwell's positive model) are among the settings where the standard tools of discounted dynamic programming fail: there is no contraction, costs may be infinite, and the value-iteration algorithm started from zero may…

13 thms4 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

Resource Allocation and Cross-Layer Control in Wireless Networks I: The Network Layer Capacity RegionTextbook

Every wireless network control algorithm — routing, scheduling, power control, admission control — is ultimately judged against one question: which traffic loads can it keep stable? Answering that question requires a precise, algorithm-independent notion of queueing stability under random arrivals and a randomly time-varying, possibly non-ergodic-looking…

8 thms4 active users
🏆Completed
Functional AnalysisMachine Learning·Captain: olivier

Universal Reservoir Computers from Non-Homogeneous State-Affine SystemsResearch Paper

A reservoir computer learns a dynamical input/output relation with a recurrent network whose internal weights are fixed once and never trained; only a linear readout on the state is fitted. The method works in practice — it is a standard tool for learning chaotic dynamics — but its justification requires an approximation theorem: the family of reservoirs…

8 thms4 active usersReviewed
🏆Completed
Dynamic ProgrammingOperations ResearchProbability·Captain: Shuze Chen

Dynamic Programming and Optimal Control V: LQG and Certainty EquivalenceTextbook

The separation theorem — certainty equivalence for linear-quadratic control with imperfect state information — is one of the celebrated structural results of stochastic control: the optimal controller splits into a least-squares estimator and the deterministic LQR actuator, designed independently. It underlies every LQG autopilot and Kalman-filter-based…

5 thms4 active usersReviewed
Operations ResearchProbabilityStochastic Systems·Captain: iris

The Exact Online Threshold for the Asymmetric Binary PerceptronResearch Paper

The asymmetric binary perceptron (ABP) is a random constraint satisfaction problem. Given a matrix G∈RM×NG\in\mathbb R^{M\times N}G∈RM×N with independent standard Gaussian entries and a margin κ∈R\kappa\in\mathbb Rκ∈R, one asks for a sign vector σ∈{±1}N\sigma\in\{\pm1\}^Nσ∈{±1}N with Gσ/N≥κ1MG\sigma/\sqrt N\ge\kappa\mathbf 1_MGσ/N​≥κ1M​ coordinatewise. When M/N→αM/N\to\alphaM/N→α, the largest density at which a…

36 thms3 active usersReviewed
Dynamic ProgrammingOperations ResearchStochastic Systems·Captain: iris

Condition-Based Production for Stochastically Deteriorating Systems: Optimal Policies and Learning: The Optimal Production Rate Decreases in Deterioration, Time to Maintenance and Base RateResearch Paper

Production systems such as wind turbines and assembly equipment can often be run faster or slower, and running faster usually wears them out faster. Between scheduled maintenance visits, an operator can therefore trade revenue now against deterioration later. Condition-based production, a term coined by Uit het Broek et al. (2020), makes this trade-off…

16 thms3 active usersReviewed
Operations ResearchProbabilityStochastic Systems·Captain: iris

Managing Customer Churn via Service Mode Control: A Myopic-or-Sandwich Interval Policy Is Optimal Among All Admissible Service-Mode ControlsResearch Paper

Subscription businesses, online platforms and service providers lose revenue when customers leave, and the marketing literature models churn as a hazard driven by the customer's state, for instance through logit hazard functions (Rust, Lemon and Zeithaml, Return on marketing: Using customer equity to focus marketing strategy, Journal of Marketing 68(1),…

25 thms3 active usersReviewed
Dynamic ProgrammingOperations Research·Captain: iris

Sales Effort Management Under All-or-Nothing Constraint: The Optimal Sales Rate Has a Watershed Structure in the Time-to-Go, With a Cutoff Strictly Increasing in the Sales Still NeededResearch Paper

Sales targets with a bonus are a standard incentive in practice: a car dealership earns a manufacturer bonus only if it sells a quota of vehicles in a quarter, and a salesperson earns a lump sum only when a quota is met. Contracts of this all-or-nothing type pay nothing below the target and a bonus plus a per-unit commission above it. They raise a dynamic…

13 thms3 active usersReviewed
Algorithmic Game TheoryOperations ResearchProbability+1·Captain: iris

Quantitative Convergence for Displacement Monotone Mean Field Games with Controlled Volatility: Open-Loop Nash Equilibria Converge to the Mean Field Equilibrium at Rate 1/NResearch Paper

Mean field games describe Nash equilibria of stochastic differential games with very many symmetric players, each of whom interacts with the others only through the empirical distribution of their states. The limiting model, introduced by Lasry and Lions and by Huang, Malhamé and Caines, replaces the population by a measure flow and the NNN-player equilibrium…

17 thms3 active usersReviewed
ProbabilityStochastic Systems·Captain: iris

Indefinite Linear-Quadratic Partially Observed Mean-Field Game: With a Relaxed Compensator, the Decentralized Strategies Form an O(1/√N)-Nash EquilibriumResearch Paper

Mean-field games model a large population of agents in which each agent's dynamics and cost depend on the others only through population averages. In the linear-quadratic (LQ) case the agents' states follow linear stochastic differential equations and costs are quadratic, so the equilibrium can be computed from Riccati equations. A standard way to use the…

26 thms3 active usersReviewed
EconomicsOperations ResearchProbability·Captain: iris

Mean-Variance Portfolio Selection with Dynamic Targets for Expected Terminal Wealth: Closed-Form Equilibrium Strategies for the Three Targets, Each Unique in Its ClassResearch Paper

Mean-variance analysis is the standard model of portfolio choice: an investor fixes a target for expected wealth and minimizes the variance of wealth. In continuous time the problem is time-inconsistent: the strategy that is optimal at time 0 is no longer optimal for the same investor at a later date, because variance is not additive across time. Dynamic…

43 thms3 active usersReviewed
Operations ResearchProbabilityStochastic Systems·Captain: iris

A Mean-Field Control Problem of Optimal Portfolio Liquidation with Semimartingale Strategies: The Value Function Is Linear-Quadratic in the State's Law and the Optimal Strategy Jumps Only at t and TResearch Paper

A large investor who must sell a position of x0x_0x0​ shares by a deadline TTT moves the price against their own position: every sale depresses the price, and the depression decays only gradually. Optimal liquidation models this trade-off between trading fast (incurring impact) and trading slowly (bearing inventory risk), and it is a standard problem in market…

24 thms3 active usersReviewed
Operations ResearchStochastic Systems·Captain: Shuze Chen

Finite-State Contract Theory with a Principal and a Field of Agents: Optimal contracting as McKean–Vlasov controlResearch Paper

A principal may influence a population by offering payments tied to each individual's observed history. In epidemic containment, for example, an authority may reward behavior that reduces infection while accounting for how individuals move between locations. The principal must anticipate both each individual's response and the population distribution…

10 thms3 active usersReviewed
Algorithmic Game TheoryOperations Research·Captain: Shuze Chen

Optimizing Free-to-Play Multiplayer Games with Premium Subscription: Optimal advertising and subscription pricingResearch Paper

A free-to-play multiplayer game earns subscription revenue only if players value the premium experience enough to pay for it. Yet converting free players into premium players also changes the experience of everyone else. Premium players may enjoy owning items that others lack, while free players may dislike comparisons with premium players. Advertising…

7 thms3 active usersReviewed
Operations ResearchOptimizationPartial Differential Equations·Captain: mikedeng1

Hamilton-Jacobi Equations with Semilinear Costs and State Constraints, with Applications to Large Deviations in Games: Verification Theorem for the State-Constrained Target ProblemResearch Paper

Stochastic evolutionary game dynamics model a population of NNN agents who occasionally revise their actions by a noisy best-response rule with noise level η>0\eta>0η>0. As η→0\eta\to0η→0, the population spends long periods near Nash equilibria and occasionally transits between them; the exponential rates of these transitions, and hence which equilibrium is stochastically…

13 thms3 active usersReviewed
🏆Completed
Dynamic ProgrammingOperations Research·Captain: mikedeng1

Driving Supply to Marketplaces: Optimal Platform Pricing When Suppliers Share Inventory: The Supplier Shares Its n-th Unit Exactly When the Time-to-Go Is at Most a Threshold tₙResearch Paper

Online marketplaces such as Zalando, Amazon or Farfetch let brands sell through the platform's storefront in addition to their own stores. One common arrangement is inventory sharing: the brand keeps ownership of its stock, but makes it visible to the platform's customers, and pays the platform a commission on every unit the platform sells. For a supplier…

11 thms3 active usersReviewed
Dynamical SystemsOperations Research·Captain: mikedeng1

Optimal Control of an Epidemic through Social Distancing: Under Limited Capacity Effects Every Optimal Policy Is Single-Peaked and Infections Are Log-Concave While Measures EscalateResearch Paper

During the Covid-19 epidemic, governments had to decide not only whether to impose social distancing but how to schedule it over time: when to escalate, when to relax, and whether a relaxation might later have to be reversed. Epidemiology supplies the dynamics (the SIR model of Kermack and McKendrick, 1927), and optimal control supplies the language for…

17 thms3 active usersReviewed
🏆Completed
AnalysisOperations Research·Captain: mikedeng1

Optimal Dynamic Momentum Strategies: For Horizons Within the Look-Back Period, the Optimal Weight Is the Mean-Variance Weight Plus a Hedging Term Weighted Toward Recent ReturnsResearch Paper

Time-series momentum is the empirical regularity that an asset's recent excess return predicts its future excess return. It has been documented across equity indices, currencies, commodities and bonds (Moskowitz, Ooi & Pedersen 2012), and momentum portfolios are among the most widely traded systematic strategies. Most of that literature builds portfolios…

7 thms3 active usersReviewed
Operations ResearchProbabilityStochastic Systems·Captain: mikedeng1

Infinite Horizon Stochastic Impulse Control with Delay and Random Coefficients: The Strategy Built from Iterated Snell Envelopes Is Optimal over All Admissible Delayed Impulse StrategiesResearch Paper

Impulse control models a decision maker who acts on a system by discrete interventions rather than continuously: a central bank adjusting a rate, a firm switching production capacity, a portfolio manager rebalancing with fixed transaction costs. Each intervention has a fixed cost, so the controller chooses both when to act and how much. In many applications…

17 thms3 active usersReviewed
EconomicsOperations ResearchStochastic Systems·Captain: mikedeng1

Optimal Contracting with Unobservable Managerial Hedging: The Principal's Value Solves a Concave Free-Boundary HJB Problem and the Contract Reflected at the Payment Boundary Is OptimalResearch Paper

A manager can influence a project's output through effort, but the owner observes output rather than effort. When the manager can also trade privately in a financial market, a contract based on output and market returns changes both effort incentives and the manager's ability to hedge risk. The owner must decide what the contract pays, how sensitive it is…

9 thms3 active usersReviewed
EconomicsOperations ResearchProbability·Captain: mikedeng1

Endogenous Credit, Business Cycle, and Portfolio Selection: Under Limited Commitment the Credit Limit Is a Closed-Form Multiple m* of Income, and Below It the Household Defaults at OnceResearch Paper

A household can borrow against expected future income only while repayment remains preferable to default. In the baseline model of Choi, Koo, Lim and Yoo, this choice is imposed through a participation condition at every date: the household's remaining utility from its planned consumption must be at least its remaining utility after default. The constraint…

14 thms3 active usersReviewed
🏆Completed
Operations ResearchStochastic Systems·Captain: mikedeng1

New Venture Creation: A Drift-Variance Diffusion Control Model: The Optimal Policy Is at Most a Two-Interval PolicyResearch Paper

An entrepreneur developing a venture repeatedly chooses between strategies that differ in speed, risk and cost: a safe, slow approach or a fast, risky one. Wang and Zenios model this as a drift–variance diffusion control problem (SSRN 3667132; published in Operations Research, 2021, doi:10.1287/opre.2021.2171): the controller chooses not only the drift of a…

19 thms3 active usersReviewed
🏆Completed
AnalysisEconomicsOperations Research·Captain: mikedeng1

Punish Underperformance with Suspension: Optimal Dynamic Contracts in the Presence of Switching Cost II: Condition 2, High Switching Cost, Not-Hiring Value Functions Meet the Optimality ConditionsResearch Paper

Firms that outsource work to an agent whose effort they cannot observe often punish poor performance by suspending the relationship for a while, even though restarting costs money: a new set-up, re-training, re-mobilisation. Cao, Sun and Tian (Management Science, 2024) study this trade-off in a continuous-time principal–agent model with Poisson arrivals and…

5 thms3 active usersReviewed
PreviousPage 2 of 9Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paperProve2Me Team
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me