Markov Decision Processes XVIII: Terminal Wealth in Jump Markets and Trade ExecutionTextbook
Two problems in this mission, both about markets that do not behave the way the textbook Black–Scholes market does, and both solved by the same technique.
Bäuerle and Rieder's Markov Decision Processes with Applications to Finance: Bellman equations, optimal policies, partial observation, and optimal stopping.
9 missions
Two problems in this mission, both about markets that do not behave the way the textbook Black–Scholes market does, and both solved by the same technique.
An investor with a fixed planning horizon, an initial fortune, and a personal attitude toward risk (a utility function) wants to allocate wealth between a riskless bond and several risky assets, rebalancing at each of periods, to maximize the expected utility of terminal wealth. This is the oldest and most basic problem of mathematical finance's…
A gambler watching a sequence unfold has to decide, at each moment and knowing only the past, whether to take what is on the table or wait for something better. That is the whole of optimal stopping, and it is one of the few problems in stochastic control with a clean and completely general answer: the value of the problem is the smallest superharmonic…
Chapter 7's abstract machinery — contracting Markov Decision Models, the Structure Theorem, value iteration with an explicit convergence rate — earns its keep by solving concrete problems. Section 7.6 works through four kinds of application: a return to the classical cash-balance inventory problem, now over an infinite horizon; the "red-and-black" gambling…
Real investors do not merely accumulate wealth for a single terminal payoff; they consume along the way, and the market they invest in is rarely a single fixed statistical regime for years at a time — bull and bear markets, business cycles, and volatility regimes shift the distribution of returns. Bäuerle and Rieder's §4.3 extends the terminal-wealth theory…
The finite-horizon theory of chunk 02a-model-bellman-equation (Bäuerle and Rieder's Theorem
2.3.8, the Structure Theorem) reduces the existence of an optimal policy and the validity of the
Bellman equation to a single abstract hypothesis: the Structure Assumption (SAN), the existence
of function classes and decision-rule classes closed…
When a system is controlled indefinitely and decisions are frequent — a router admitting packets, a queue accepting jobs, a machine being maintained — discounting future rewards is often unjustified, and what matters is the long-run average reward per period. Puterman's Chapter 8 (doi:10.1002/9780470316887) develops the theory of this criterion, and its…
An insurance company collects premia and pays claims each period; the difference is a random, signed quantity that can push the company's risk reserve up or down. At the start of every period, before that period's premia and claims are realized, the company's owners may pay themselves a dividend out of the current reserve — but once the reserve goes…
Every model in Chapters 2-4 assumed the controller sees the whole state before acting. Real control problems rarely offer that: a machine's true wear level, a customer's private valuation, a hidden regime driving asset returns — these are exactly the situations a decision-maker must act on despite never observing them directly, learning about them only…
| Rank | Contributor | Accepted solutions | Submitted problems |
|---|---|---|---|
| 1 | mrfancypants | 48 | 0 |
| 2 | fizzyinc3 | 13 | 3 |
| 3 | Gabewhigham | 5 | 1 |
| 4 | kmehltretter82 | 4 | 0 |
| 5 | Nickrobbins95 | 3 | 0 |
| 6 | naimengye | 0 | 5 |
| 6 | Shuze Chen | 0 | 104 |