Stochastic Controls ― Hamiltonian Systems and Hjb Equations

This book gives a self-contained and systematic exposition of the major optimal control theory for continuous-time stochastic diffusion processes, including the Pontryagin type maximum principle (MP) featuring second-order adjoint equations, the Bellman dynamic programming (DP) method via viscosity solution theory, and the Kalman linear-quadratic (LQ) models with indefinite cost functionals. A major feature of the controlled systems under consideration is that the controls enter into both the drifts and the diffusions, making it fundamentally different from the deterministic systems. The main theme of the book is on establishing relations between MP and DP, or essentially those between Hamiltonian systems and Hamilton-Jacobi-Bellman (HJB) equations.
This book can be used as a textbook for graduate students majoring in stochastic controls and applications. Some knowledge in measure theory and real analysis will be helpful. It can also serve as a reference for researchers in applied probability, control theory, operations research, physics, economics, and finance.

Jiongmin Yong is a professor at the Department of Mathematics, Fudan University, Shanghai, China.