Prove2Me
Navigate
DiscoverCollectionsFormalpediaGalaxyBlogsUsersMomentumMy Missions+
Prove2Me
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Control Theory

214 missions · 87 completed

Missions

Open127Completed87All214
🏆Completed
Dynamic ProgrammingOperations ResearchOptimization·Captain: mikedeng1

Stochastic Optimal Control: The Discrete-Time Case III: Monotone Increase Models — Accumulation Points of DP-Optimal Controls Give an Optimal Stationary PolicyTextbook

Infinite-horizon dynamic programming with positive (nonnegative) costs and no discounting, or with discount factors that do not make the Bellman operator a contraction, is the setting of Blackwell's and Strauch's positive and negative programming models and of many deterministic control and reachability problems. In this regime the classical contraction…

21 thms6 active usersReviewed
🏆Completed
Dynamic ProgrammingOptimizationProbability·Captain: iris

Markov Decision Processes with Applications to Finance III: The Stochastic Linear-Quadratic Problem Has Quadratic Value Functions and Linear Optimal Controls Given by a Riccati RecursionTextbook

A linear-quadratic (LQ) problem asks for a control that keeps a linear stochastic system close to zero at quadratic cost. It is the one model of sequential decision making under uncertainty with general Euclidean state and action spaces whose optimal value and optimal policy are known in closed form, which is why it serves as the reference model of control…

19 thms5 active usersReviewed
🏆Completed
Operations ResearchReinforcement LearningStochastic Systems·Captain: mikedeng1

Convergence of Finite Memory Q Learning for POMDPs and Near Optimality of Learned Policies Under Filter Stability: Finite-Window Q-Learning Converges Almost Surely, with a Filter-Stability Loss BoundResearch Paper

A partially observed Markov decision process (POMDP) is a controlled Markov chain whose state the controller never sees. Only noisy observations are available. Such models describe sensor-based control, maintenance under imperfect inspection, and most reinforcement-learning tasks in which the agent sees an image or a measurement rather than the system's…

14 thms5 active usersReviewed
Algorithmic Game TheoryMarkov ChainStochastic Systems·Captain: mikedeng1

Strong and Weak Equilibria for Time-Inconsistent Stochastic Control in Continuous Time 1: Weak and Strong Equilibria Exist When the Admissible Generator Rows Form Convex Compact SetsResearch Paper

An agent whose preferences change over time cannot simply optimize. Under non-exponential discounting, for instance hyperbolic or pseudo-exponential discount functions, a plan that is optimal today stops being optimal tomorrow, and a later self deviates from it. Strotz (1955) proposed that a sophisticated agent treat future selves as players in a game and…

17 thms5 active usersReviewed
Dynamic ProgrammingMarkov ChainStochastic Systems·Captain: mikedeng1

Strong and Weak Equilibria for Time-Inconsistent Stochastic Control in Continuous Time 3: Discrete-Time Equilibria Exist on an Infinite Horizon for Closed Convex Admissible Transition RowsResearch Paper

In many dynamic decision problems the criterion an agent uses today is not the one it will use tomorrow. The standard example is non-exponential discounting: if a payoff received ttt periods from now is weighted by δ(t)\delta(t)δ(t) and δ\deltaδ is not geometric, then the plan that is optimal from today's point of view will be abandoned by the agent's future selves.…

11 thms5 active usersReviewed
🏆Completed
Convex OptimizationLinear algebraOptimization·Captain: mikedeng1

Quadratic Matrix Inequalities with Applications to Data-Based Control III: Petersen's Lemma Recovered from the Matrix S-LemmasResearch Paper

Robust control repeatedly meets linear matrix inequalities that must hold for every value of an unknown, norm-bounded matrix. A typical instance is

12 thms5 active usersReviewed
Dynamical SystemsGraph TheoryLinear algebra·Captain: mikedeng1

Synchronization via Pinning Control on General Complex Networks I: A Kronecker LMI Weighted by the Positive Left Null Vector of G Globally Synchronizes a Pinned Strongly Connected NetworkResearch Paper

Many engineered and natural systems are networks of identical dynamical units coupled through a directed interaction graph: arrays of oscillators, power grids, sensor and multi-agent networks, gene regulatory circuits. A basic control question for such a network is how to force every unit onto a prescribed reference trajectory (an equilibrium, a periodic…

10 thms5 active users
🏆Completed
Dynamic ProgrammingLinear algebraMarkov Chain+2·Captain: mikedeng1

Bellman's Dynamic Programming IX: Markovian Decision Processes and the Maximal Perron RootTextbook

Chapter XI of Richard Bellman's Dynamic Programming (Princeton University Press, 1957; DOI 10.2307/j.ctv1nxcw0f) studies decision processes whose state is a vector of nonnegative quantities, for example the probabilities that a system is in each of NNN states, or the stocks of NNN commodities, and whose transitions are linear maps chosen stage by stage by a…

13 thms5 active usersReviewed
🏆Completed
AnalysisDynamical SystemsOperations Research+1·Captain: mikedeng1

Generalized Gradients and Applications II: Flow-Invariant Sets of Lipschitz Differential InclusionsResearch Paper

A closed set F⊆RnF\subseteq\mathbb R^nF⊆Rn is flow-invariant for a dynamical system when every trajectory that starts in FFF stays in FFF. Invariance of sets underlies state constraints in optimal control, safety certificates for controlled systems, comparison and maximum principles for differential equations, and the positivity of solutions of kinetic and population…

17 thms5 active usersReviewed
Operations ResearchOptimizationStochastic Systems·Captain: mikedeng1

Resource Allocation and Cross-Layer Control in Wireless Networks IV: The Energy-Constrained Control AlgorithmTextbook

Battery-powered and energy-harvesting wireless devices cannot treat transmission power as free: a control algorithm that maximizes throughput without regard to energy will drain a device long before the network's other resources are exhausted. Chapter 6 of Georgiadis, Neely & Tassiulas's survey Resource Allocation and Cross-Layer Control in Wireless Networks…

15 thms5 active users
🏆Completed
Dynamic ProgrammingOperations ResearchOptimization·Captain: Shuze Chen

Dynamic Programming and Optimal Control IV: LQR and the Riccati EquationTextbook

The discrete-time Riccati equation is the central object of linear-quadratic optimal control — the design equation behind LQR/LQG controllers in every modern control stack. Proposition 4.4.1 of Bertsekas, Dynamic Programming and Optimal Control, Vol. I (3rd ed., 2005, §4.1) packages its asymptotic theory: under controllability and observability the Riccati…

9 thms5 active usersReviewed
🏆Completed
Dynamic ProgrammingOptimization·Captain: Shuze Chen

Dynamic Programming and Optimal Control III: The Minimum PrincipleTextbook

The Pontryagin Minimum (Maximum) Principle is the fundamental necessary condition of optimal control, in continuous use since 1956 across aerospace guidance, robotics, and mathematical economics. Chapter 3 of Bertsekas, Dynamic Programming and Optimal Control, Vol. I (3rd ed., 2005) develops it from the dynamic programming side: the HJB sufficiency theorem…

18 thms5 active usersReviewed
🏆Completed
Optimization·Captain: wenxinzhang

Vector Space Methods XII: Pontryagin Minimum PrincipleTextbook

Pontryagin's principle as presented by Luenberger is the decisive necessary condition in continuous-time optimal control. It converts an optimization over functions into a pointwise comparison of a Hamiltonian, coupled to the original state equation and a backward costate equation. Luenberger derives the minimum-Hamiltonian convention from vector-space…

7 thms5 active usersReviewed
Algorithmic Game TheoryProbabilityReinforcement Learning+1·Captain: iris

Exploration Noise for Learning Linear-Quadratic Mean Field Games: With Common Noise, the Tilted Geometric Fictitious Play Converges to the Equilibrium at Rate ϖ−nexp⁡(C/ε2)\varpi^{-n}\exp(C/\varepsilon^2)ϖ−nexp(C/ε2)Research Paper

A mean field game (MFG) describes a continuum of identical players, each controlling its own state and paying a cost that depends on the statistical distribution of the population. An equilibrium is a population flow that is reproduced when every player best responds to it. Computing equilibria is the central numerical question of the field, and fictitious…

16 thms4 active usersReviewed
Operations ResearchProbabilityStochastic Systems·Captain: mikedeng1

Stationary Discounted and Ergodic Mean Field Games with Singular Controls: The Discounted Equilibria and Their Rescaled Values Converge to the Ergodic Equilibrium as the Discount Rate VanishesResearch Paper

Firms invest to raise their productivity, investment is irreversible, and the return on productivity depends on what the rest of the market does. Cao, Dianetti and Ferrari model this as a stationary mean field game (MFG) of singular control: a representative firm controls a one-dimensional diffusion through a nondecreasing investment process. Its running…

19 thms4 active usersReviewed
🏆Completed
Mathematical PhysicsQuantum Information·Captain: mikedeng1

Stabilizing qubit coherence via tracking-control: Under Pure Dephasing, Coherence Can Be Held Constant Exactly Until t_b = v_z(0)²/(2γc), Where the Control Fields DivergeResearch Paper

A qubit coupled to an environment loses the phase relation between its basis states ∣0⟩|0\rangle∣0⟩ and ∣1⟩|1\rangle∣1⟩: the off-diagonal entries of its density matrix decay. This decoherence is the main obstacle to storing quantum information, and a large body of work tries to counter it with external control fields. Lidar and Schneider (arXiv:quant-ph/0410048,…

9 thms4 active usersReviewed
Operations ResearchProbabilityStochastic Systems·Captain: mikedeng1

On System-Wide Safety Staffing of Large-Scale Parallel Server Networks: Positive SWSS Makes the Limiting Diffusion Exponentially Ergodic, Negative SWSS Makes It Transient Under Every Markov ControlResearch Paper

Large service systems such as call centres, hospital wards and cloud server farms route several customer classes to several server pools, with each pool trained for only some of the classes. Staffing such a network sits between two failure modes: too few servers make queues explode, and too many waste capacity. In the Halfin–Whitt (quality-and-efficiency-dri…

26 thms4 active usersReviewed
🏆Completed
Convex OptimizationLinear algebraOptimization·Captain: mikedeng1

Quadratic Matrix Inequalities with Applications to Data-Based Control IV: Noisy Data Are Informative for Quadratic Stabilization iff an LMI in (P, L, β) Is FeasibleResearch Paper

Data-driven control asks for a controller computed directly from measured trajectories of an unknown system, without first identifying a model. When the measurements are corrupted by unknown process noise, many systems explain the same data, and a controller designed from the data alone is only trustworthy if it stabilizes every one of them. Van Waarde,…

17 thms4 active usersReviewed
🏆Completed
Convex OptimizationLinear algebraOptimization·Captain: mikedeng1

Quadratic Matrix Inequalities with Applications to Data-Based Control I: Nonemptiness, Convexity, Boundedness and Interior of QMI Solution SetsResearch Paper

Quadratic matrix inequalities (QMIs) describe sets of matrices rather than sets of vectors. They appear whenever an unknown matrix is constrained by a quadratic bound: in robust control, where an uncertain block of a system is only known to lie in a norm ball or a sector, and in data-driven control, where the system matrices (A,B)(A, B)(A,B) of a linear system …

9 thms4 active usersReviewed
🏆Completed
Convex OptimizationGraph TheoryOptimization·Captain: mikedeng1

Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs 1: DIGing Converges R-Linearly over Time-Varying Undirected Graphs for Every Step Size Below 1.5(1−δ)²/(μ̄J₁)Research Paper

In distributed optimization, nnn agents each hold a private function fi:Rp→Rf_i:\mathbb R^p\to\mathbb Rfi​:Rp→R and must jointly solve

11 thms4 active usersReviewed
🏆Completed
Numerical AnalysisOptimization·Captain: mikedeng1

A Real-Time Iteration Scheme for Nonlinear Optimization in Optimal Feedback Control: The Real-Time Iterates Contract and Approach the Exact Stationary Points GeometricallyResearch Paper

Nonlinear model predictive control (NMPC) computes a feedback law by solving, at every sampling time, an optimal control problem that starts from the currently measured state. The control actually applied is the first control of that problem's solution. When the dynamics are fast relative to the time an optimizer needs, solving each problem to convergence…

10 thms4 active usersReviewed
🏆Completed
Dynamical SystemsGraph Theory·Captain: mikedeng1

Synchronization and Transient Stability in Power Networks and Nonuniform Kuramoto Oscillators 1: Γ_min > Γ_critical Gives Phase Cohesiveness and Exponential Frequency SynchronizationResearch Paper

Transient stability asks whether a power grid, after a large disturbance such as a fault or a line trip, returns to synchronous operation in which all generators rotate at a common frequency. The classical approach builds energy functions for the swing equations and estimates regions of attraction numerically; it gives no closed-form test relating…

12 thms4 active usersReviewed
🏆Completed
AnalysisDynamical SystemsPartial Differential Equations·Captain: mikedeng1

An Example on the Effect of Time Delays in Boundary Feedback Stabilization of Wave Equations: The Spectral Stability Trichotomy at the Feedback Gain k = (1 − K)/(1 + K), K = e^{−2a}Research Paper

Boundary feedback is the standard way to stabilize vibrating structures governed by wave equations: a sensor measures the velocity at the boundary and an actuator applies a force proportional to it. For the one-dimensional damped wave equation with such feedback, the closed loop is uniformly exponentially stable (Chen, 1979). In practice the measured…

16 thms4 active usersReviewed
🏆Completed
Operations ResearchStochastic Systems·Captain: mikedeng1

Maximum Pressure Policies in Stochastic Processing Networks II: Under Assumptions 1 and 2, the Maximum Pressure Fluid Model Empties in Finite Time When the Static Planning LP Has ρ < 1Research Paper

Stochastic processing networks (Harrison 2000) model manufacturing lines, data switches, call centers and multiclass queueing networks in one framework: jobs wait in buffers, activities process jobs from one or several buffers at once, each activity may need several processors simultaneously, and routing after service may depend on the activity used. A…

10 thms4 active usersReviewed
Dynamic ProgrammingOperations ResearchProbability+1·Captain: mikedeng1

Stochastic Optimal Control: The Discrete-Time Case VIII: The Infinite-Horizon Borel Models — the Optimality Equation J* = T(J*) under (P), (N), (D)Textbook

Infinite horizon dynamic programming asks for the least expected cost of controlling a stochastic system forever, and for a policy attaining it. On finite or countable state spaces the theory has been classical since Bellman, Blackwell (1965) and Strauch (1966). Many models in operations research, inventory control, queueing and economics have continuous…

23 thms4 active usersReviewed
PreviousPage 1 of 9Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paperProve2Me Team
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me