Abstract
Motivated by a duopoly game problem, the authors study an optimal control problem where the system is driven by Brownian motion and Poisson point process and has elephant memory for the control variable and the state variable. Firstly, the authors establish the unique solvability of an anticipated backward stochastic differential equation, derive a stochastic maximum principle, and prove a verification theorem for the aforementioned optimal control problem. Furthermore, the authors generalize these results to nonzero-sum stochastic differential game problems. Finally, the authors apply the theoretical results to the duopoly game problem and obtain the corresponding Nash equilibrium solution.
Similar content being viewed by others
References
Mohammed S E A, Stochastic Functional Differential Equations: S.-E.A. Mohammed, Pitman Advanced Pub. Program, Boston, 1984.
Yan F and Mohammed S E A, A stochastic calculus for systems with memory, Stochastic Analysis and Applications, 2005, 23(3): 613–657.
Mohammed S E A, Stochastic differential systems with memory: Theory, examples and applications, Stochastic Analysis and Related Topics VI, 1998, 42): 1–77.
Kazmerchuk Y I, Swishchuk A V, and Wu J H, The pricing of options for securities markets with delayed response, Mathematics and Computers in Simulation, 2007, 75): 69–79.
Chen L and Wu Z, Maximum principle for the stochastic optimal control problem with delay and application, Automatica, 2010, 46(6): 1074–1080.
Du H, Huang J H, and Qin Y L, A stochastic maximum principle for delayed mean-field stochastic differential equations and its applications, IEEE Transactions on Automatic Control, 2013, 58(12): 3212–3217.
Wu S and Wang G C, Optimal control problem of backward stochastic differential delay equation under partial information, Systems and Control Letters, 2015, 82): 71–78.
Shi J T and Wang G C, A nonzero sum differential game of BSDE with time-delayed generator and applications, IEEE Transactions on Automatic Control, 2016, 61): 1959–1964.
Huang J H and Li N, Linear-quadratic mean-field game for stochastic delayed systems, IEEE Transactions on Automatic Control, 2018, 63(8): 2722–2729.
Chen L and Wu Z, Stochastic optimal control problem in advertising model with delay, Journal of Systems Science & Complexity, 2020, 33(4): 968–987.
Øksendal B and Sulem A, A maximum principle for optimal control of stochastic systems with delay, with applications to finance, Optimal Control and Partial Differential Equations, IOS, Amsterdam, 2001.
Øksendal B, Sulem A, and Zhang T, Optimal control of stochastic delay equations and time-advanced backward stochastic differential equations, Advances in Applied Probability, 2011, 43(2): 572–596.
Agram N, Haadem S, Øksendal B, et al., A maximum principle for infinite horizon delay equations, SIAM Journal on Mathematical Analysis, 2013, 45(4): 2499–2522.
Mao X R, Stochastic Differential Equations and Applications, Horwood Publishing Limited, England, 2008.
Kushner H J, Numerical Methods for Controlled Stochastic Delay Systems, Birkhauser, Boston, 2008.
Shen Y, Meng Q X, and Shi P, Maximum principle for mean-field jump-diffusion stochastic delay differential equations and its application to finance, Automatica, 2014, 50(6): 1565–1579.
Banos D R, Cordoni F, Di Nunno G, et al., Stochastic systems with memory and jumps, Journal of Differential Equations, 2019, 266(9): 5772–5820.
Agram N and Øksendal B, Stochastic control of memory mean-field processes, Applied Mathematics & Optimization, 2019, 79): 181–204.
Dupire B, Functional Itocalculus, Quantitative Finance, 2019, 19(5): 721–729.
Dynkin E B, Path processes and historical superprocesses, Probability Theory and Related Fields, 1991, 90(1): 1–36.
Agram N and Øksendal B, Mean-field stochastic control with elephant memory in finite and infinite time horizon, Stochastics, 2019, 91(7): 1041–1066.
Peng S G and Yang Z, Anticipated backward stochastic differential equations, The Annals of Probability, 2009, 37(3): 877–902.
Ikeda N and Watanabe S, Stochastic Differential Equations and Diffusion Process, North Holland, Kodanska, 1981.
Chen L and Yu Z Y, Maximum principle for nonzero-sum stochastic differential game with delays, IEEE Transactions on Automatic Control, 2015, 60(5): 1422–1426.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
The authors declare no conflict of interest.
Additional information
This research was supported by the National Key R&D Program of China under Grant No. 2022YFA1006103, the National Natural Science Foundation of China under Grant Nos. 61821004, 61925306, 11831010, 71973084, and 61977043, and the National Science Foundation of Shandong Province under Grant Nos. ZR2019ZD42 and ZR2020ZD24.
This paper was recommended for publication by Editor LI Xun.
Rights and permissions
About this article
Cite this article
Feng, S., Gao, L., Wang, G. et al. Maximum Principle for Stochastic Control System with Elephant Memory and Jump Diffusion. J Syst Sci Complex 37, 1392–1412 (2024). https://doi.org/10.1007/s11424-024-3163-7
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11424-024-3163-7