DIMITRI P. BERTSEKAS
Scholarly Publications
Textbooks
1. D. P. Bertsekas, Dynamic Programming and Stochastic Control, Academic
Press, 1976.
2. D. P. Bertsekas and S. E. Shreve, Stochastic Optimal Control: The
Discrete Time Case, Academic Press, 1978, (translated in Russian);
republished by Athena Scientific, 1997.
3. D. P. Bertsekas, Lagrange Multiplier Methods in Constrained
Optimization, Academic Press, 1982, (translated in Russian); republished
by Athena Scientific, 1996.
4. D. P. Bertsekas and R. G. Gallager, Data Communication Networks,
Prentice-Hall, 1987, (translated in Russian and Japanese); second edition
published in 1991.
5. D. P. Bertsekas, Dynamic Programming: Deterministic and Stochastic
Models, Prentice-Hall, 1987.
6. D. P. Bertsekas and J. N. Tsitsiklis, Parallel and Distributed
Computation: Numerical Methods, Prentice-Hall, 1989; republished by
Athena Scientific, 1997.
7. D. P. Bertsekas, Linear Network Optimization: Algorithms and Codes,
MIT Press, 1991.
8. D. P. Bertsekas, Dynamic Programming and Optimal Control, (2 Vols.),
Athena Scientific, 1995; 4th edition of Vol. 1 published
in 2017; 4th edition of Vol. 2 published in 2012.
9. D. P. Bertsekas, Nonlinear Programming, Athena Scientific, 1995;
3rd edition published in 2016.
10. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming,
Athena Scientific, 1996; awarded the 1997 INFORMS CSTS prize for reserach
excellence in the interface between operations research and computer
science.
11. D. P. Bertsekas, Network Optimization: Continuous and Discrete
Models, Athena Scientific, 1998.
12. D. P. Bertsekas and J. N. Tsitsiklis, Introduction to
Probability, Athena Scientific, 2002; 2nd edition published in 2008.
13. D. P. Bertsekas, with A. Nedic and A. Ozdaglar, Convex Analysis and
Optimization, Athena Scientific, 2003.
14. D. P. Bertsekas, Convex Optimization Theory, Athena Scientific, 2009.
15. D. P. Bertsekas, Abstract Dynamic Programming, Athena Scientific, 2013; 3rd edition, 2022.
16. D. P. Bertsekas, Convex Optimization Algorithms, Athena Scientific, 2015.
17. D. P. Bertsekas, Reinforcement Learning and Optimal Control, Athena Scientific, 2019.
18. D. P. Bertsekas, Rollout, Policy Iteration, and Distributed Reinforcement Learning, Athena Scientific, 2020.
19. D. P. Bertsekas, Lessons from AlphaZero for Optimal, Model Predictive, and Adaptive Control, Athena Scientific, 2022.
20. D. P. Bertsekas, A Course in Reinforcement Learning, Athena Scientific, 2023.
Journal Papers and Chapters in Edited Volumes
1. D. P. Bertsekas, "Note on the Design of Linear Regulators with
Piece-wise Constant Gains," IEEE Trans. on Automatic Control, (Corresp.),
Vol. AC-15, pp. 262-263, April 1970.
2. D. P. Bertsekas and I. B. Rhodes, "Recursive State Estimation with a
Set-Membership Description of the Uncertainty," IEEE Trans. on Automatic
Control, Vol. AC-16, pp. 117-128, April 1971.
3. D. P. Bertsekas and I. B. Rhodes, On the Minimax Reachability of
Target Sets and Target Tubes," Automatica, Vol. 7, pp. 233-241, March
1971.
4. D. P. Bertsekas, "Infinite Time Reachability of State Space Regions
by Using Feedback Control," IEEE Trans. on Automatic Control, Vol. AC-17,
pp. 604-613, October 1972.
5. D. P. Bertsekas and I. B. Rhodes, "Sufficiently Informative
Functions and the Minimax Feedback Control of Uncertain Dynamic Systems,"
IEEE Trans. on Automatic Control, Vol. AC-18, pp. 117-124, April 1973.
6. D. P. Bertsekas, "Stochastic Optimization Problems with
Nondifferentiable Cost Functionals," Journal of Optimization Theory and
Applications, Vol. 12, pp. 218-231, August 1973.
7. D. P. Bertsekas and S. K. Mitter, "Descent Numerical Methods for
Optimization Problems with Nondifferentiable Cost Functions," SIAM
Journal on Control, Vol. II, pp. 637-652, November 1973.
8. D. P. Bertsekas, "Linear Convex Stochastic Control Problems Over an
Infinite Time Horizon," IEEE Trans. on Automatic Control, (Corresp.),
Vol. AC-18, pp. 314-315, June 1973.
9. D. P. Bertsekas, "Partial Conjugate Gradient Methods for a Class of
Optimal Control Problems," IEEE Trans. on Automatic Control, Vol. AC-19,
pp. 209-217, June 1974.
10. D. P. Bertsekas, "Necessary and Sufficient Conditions for Existence
of and Optimal Portfolio," Journal of Economic Theory, Vol. 8, No. 2, pp.
235-247, 1974.
11. D. P. Bertsekas, On Penalty and Multiplier Methods for Constrained
Minimization," in Nonlinear Programming 2, by O. L. Mangasarian, R.
Meyer, S. Robinson, (eds.), Academic Press, New York, pp. 165-191, 1975.
12. D. P. Bertsekas, "Necessary and Sufficient Conditions for a Penalty
Method to be Exact," Mathematical Programming, Vol. 9, pp. 87-99, 1975.
13. D. P. Bertsekas,"Convergence of Discretization Procedures in Dynamic
Programming," IEEE Trans. on Automatic Control, Vol. AC-20, pp. 415-419,
1975.
14. D. P. Bertsekas, "On the Method of Multipliers for Convex
Programming," IEEE Trans. on Automatic Control, vol. AC-20, pp. 385-388,
1975.
15. D. P. Bertsekas, "Nondifferentiable Optimization via Approximation,"
in Mathematical Programming Study 3, Nondifferentiable Optimization, M.
L. Balinski, P. Wolfe, (eds.), North-Holland Publ. Co., pp. 1-15, 1975.
16. D. P. Bertsekas, "Combined Primal-Dual and Penalty Methods for
Constrained Minimization," SIAM Journal on Control, Vol. 13, No. 3, pp.
521-544, May 1975.
17. D. P. Bertsekas, "On Penalty and Multiplier Methods for Constrained
Minimization," SIAM Journal on Control, Vol. 14, pp. 216-235, 1976.
18. B. W. Kort and D. P. Bertsekas, "Combined Primal-Dual and Penalty
Methods for Convex Programming," SIAM Journal on Control, Vol. 14, pp.
268-294, 1976.
19. D. P. Bertsekas, "Multiplier Methods: A Survey," Automatica, Vol.
12, pp. 133-145, 1976.
20. D. P. Bertsekas, "On the Goldstein-Levitin-Polyak Gradient Projection
Method," IEEE Trans. on Automatic Control, Vol. AC-21, pp. 174-184, 1976.
21. D. P. Bertsekas, Review of "Numerical Methods for Constrained
Optimization," P. E. Gill and W. Murray (eds.), Academic Press, 1974,
IEEE Trans. on Automatic Control, Vol. AC-21, pp. 435-436, 1976.
22. D. P. Bertsekas, "On Error Bounds for Successive Approximation
Methods," IEEE Trans on Automatic Control, (Corresp.), Vol. AC-21, 1976,
pp. 394-396.
23. D. P. Bertsekas, "A New Algorithm for Solution of Nonlinear Resistive
Networks Involving Diodes," IEEE Trans. on Circuit Theory, Vol. CAS-23,
pp. 599-608, 1976.
24. D. P. Bertsekas, "Monotone Mappings with Application in Dynamic
Programming," SIAM J. on Control and Optimization, Vol. 15, pp. 438-464,
1977.
25. D. P. Bertsekas, "Approximation Procedures Based on the Method of
Multipliers," Journal of Optimization Theory and Applications, Vol. 23,
1977, pp. 487-510.
26. D. P. Bertsekas, Review of "A Vector Space Approach to Vector Spaces
and Optimization," by N. Dorny, J. Wiley, 1975, IEEE Transactions on
Automatic Control, Vol. AC-22, p. 686, 1977.
27. D. P. Bertsekas, "On the Convergence Properties of Second Order
Methods of Multipliers," Journal of Optimization Theory and Applications,
June 1978.
28. S. E. Shreve and D. P. Bertsekas, "Alternative Theoretical Frameworks
for Finite Horizon Discrete Time Stochastic Optimal Control," SIAM
Journal on Control and Optimization, Vol. 16, 1978, pp. 953-978.
29. S. E. Shreve and D. P. Bertsekas, "Dynamic Programming in Borel
Spaces," in Dynamic Programming and Its Applications, M. L. Puterman
(ed.), Academic Press, 1978, pp. 115-130.
30. D. P. Bertsekas, "Convexification Procedures and Decomposition
Methods for Nonconvex Optimization Problems," Journal of Optimization
Theory and Applications, Vol. 29, 1979, pp. 169-197.
31. D. P. Bertsekas
and S. E. Shreve, "Existence of Optimal Stationary Policies in
Deterministic Optimal Control," J. of Math. Analysis and Applications,
Vol. 69, 1979, pp. 607-620.
32. S. E. Shreve and D. P. Bertsekas, "Universally Measurable Policies in
Dynamic Programming," Mathematics of Operations Research, Vol. 4, 1979,
pp. 15-30.
33. D. P. Bertsekas, "Algorithms for Nonlinear Multicommodity Network
Flow Problems," International Symposium on Systems Optimization and
Analysis, A. Bensoussan and J. L. Lions (eds.), Springer-Verlag, 1979,
pp. 210-224.
34. D. P. Bertsekas, "A Convergence Analysis of the Method of Multipliers
for Nonlinear Noncovex Optimization," in Proc. of Workshop on Augmented
Lagrangians, by A. Wierzbicki (ed.), IAASA, Vienna, 1979, to be published
by North-Holland.
35. D. P. Bertsekas, Penalty and Multiplier Methods," in Nonlinear
Optimization Theory and Algorithms, by L.C.W. Dison, E. Spedicato and
G.P. Szego (eds.) Birkhauser, Boston 1980.
36. D. P. Bertsekas, "A New Algorithm for the Assignment Problem," Math.
Programming, Vol. 21, 1981, pp. 152-171.
37. E. Gafni and D. P. Bertsekas, "Distributed Algorithms for Generating
Loopfree Routes in Networks with Frequently Changing Topology," IEEE
Trans. on Comm., Vol. COM-29, pp. 11-18, 1981.
38. D. P. Bertsekas, "Enlarging the Region of Convergence of Newton's
Method for Constrained Minimization," J.O.T.A., Vol. 36, 1982, pp.
221-252.
39. D. P. Bertsekas, "Dynamic Behavior of Shortest Path Routing
Algorithms for Communication Networks," IEEE Trans. on Aut. Control, Vol.
AC-27, 1982, pp. 60-74.
40. D. P. Bertsekas and E. Gafni, "Projection Methods for Variational
Inequalities with Applications to the Traffic Assignment Problem," Math.
Progr. Studies, Vol. 17, 1982, pp. 139-159.
41. D. P. Bertsekas, "Augmented Lagrangians and Differentiable Exact
Penalty Functions," in Nonlinear Optimization 1981 (Proc. of NATO
Workshop on Nonlinear Optimization), by M.J.D. Powell (ed.), Cambridge,
England, 1981, Academic Press, 1982, pp. 223-234.
42. G. Lauer, D. P. Bertsekas, N. Sandell, and T. Posbergh, "Solution of
Large Scale Optimal Unit Commitment Problems," IEEE Trans. on Power
Systems and Apparatus, Vol. PAS-101, 1982, pp. 79-86.
43. D. P. Bertsekas, "Projected Newton Methods for Optimization Problems
with Simple Constraints," SIAM J. Control and Optimization, Vol. 20,
1981, pp. 221-246.
44. D. P. Bertsekas, "Distributed Dynamic Programming," IEEE Transactions
on Aut. Control, Vol AC-27, 1982, pp. 610-616.
45. D. P. Bertsekas, "Optimal Routing and Flow Control Methods for
Communication Networks," in Analysis and Optimization of Systems, (Proc.
of 5th International Conference on Analysis and Optimization of Systems,
A. Bensoussan and J. L. Lions, eds.), Versailles, France,
Springer-Verlag, Berlin & N.Y., 1982, pp. 615-643.
46. J. Kimemia, S. B. Gershwin, and D. P. Bertsekas, "Computation of
Production Control Policies by a Dynamic Programming Technique," in
Analysis and Optimization of Systems, (Proc. of 5th International
Conference on Analysis and Optimization of Systems, A. Bensoussan and J.
L. Lions, eds.), Versailles, France, Springer-Verlag, Berlin, & N.Y.,
1982, pp. 243-259.
47. D. P. Bertsekas, G. Lauer, N. Sandell, and T. Posbergh, "Optimal
Short Term Scheduling of Large Scale Power Systems," IEEE Trans. on Aut.
Control, Vol. AC-28, 1983, pp. 1-11.
48. D. P. Bertsekas and E. Gafni, "Projected Newton Methods and
Optimization of Multicommodity Flows," IEEE Trans. on Aut. Control, Vol.
AC-28, 1983, pp. 1090-1096.
49. D. P. Bertsekas, "Asynchronous Distributed Computation of Fixed
Points," Math. Programming, Vol. 27, 1983, pp. 107-120.
50. E. Gafni and D. P. Bertsekas "Two-Metric Projection Methods for
Constrained Optimization," SIAM J. Control and Optimization, Vol. 22,
1984, pp. 936-964.
51. E. M. Gafni and D. P. Bertsekas, "Dynamic Control of Input Session
Rates in Communication Networks," IEEE Trans. on Automatic Control, Vol.
AC-29, 1984, pp. 1009-1016.
52. D. P. Bertsekas, E. M. Gafni, and R. G. Gallager, "Second Derivative
Algorithms for Minimum Delay Distributed Routing in Networks," IEEE
Trans. on Communications, Vol. COM-32, 1984, pp. 911-919.
53. J. J. Shaw, D. P. Bertsekas, and R. F. Gendron, "Optimal Scheduling
of Large Hydrothermal Power Systems," IEEE Transactions of Power
Apparatus and Systems, Vol. PAS-104, 1985, pp. 286-293.
54. D. P. Bertsekas, "A Unified Framework for Primal-Dual Methods in
Minimum Cost Network Flow Problems," Math. Programming, Vol. 32, pp.
125-145, 1985.
55. D. P. Bertsekas, Review of "Network Flows and Monotropic
Optimization," by R. T. Rockafellar, SIAM Review, 1985.
56. D. P. Bertsekas, J. N. Tsitsiklis, and M. Athans, "Convergence
Theories of Distributed Asynchronous Computation: A Survey," LIDS Report
P-1412, M.I.T., Oct.1984; also in Stochastic Programming, by F. Archetti,
G. DiPillo, and M. Lucertini (eds.), Springer-Verlag, N.Y., pp. 107-139.
57. J. N. Tsitsiklis, D. P. Bertsekas, and M. Athans, "Distributed
Asynchronous Deterministic and Stochastic Gradient Optimization
Algorithms," IEEE Trans. on Aut. Control, Vol. AC-31, 1986, pp. 803-812.
58. J. N. Tsitsiklis and D. P. Bertsekas, "Distributed Asynchronous
Optimal Routing in Data Networks," IEEE Trans. on Aut. Control, Vol.
AC-31, pp. 325-332, 1986.
59. D. P. Bertsekas and D. ElBaz, "Distributed Asynchronous Relaxation
Algorithms for Convex Network Flow Problems," SIAM J. Control and
Optimization, Vol. 25, 1987, pp. 74-85.
60. E. M. Gafni and D. P. Bertsekas, "Asymptotic Optimality of Shortest
Path Routing Algorithms," IEEE Trans. on Information Theory, Vol. IT-33,
1987, pp. 83-90.
61. D. P. Bertsekas, P. Hosein, and P. Tseng, "Relaxation Methods for
Network Flow Problems with Convex Arc Costs," SIAM J. on Control and
Opt., Vol. 25, pp. 1219-1243, 1987.
62. P. Tseng and D. P. Bertsekas, "Relaxation Methods for Problems with
Strictly Convex Separable Costs and Linear Constraints," Math.
Programming, Vol. 38, pp. 303-321, 1987.
63. P. Tseng and D. P. Bertsekas, "Relaxation Methods for Linear
Programs," Math. of Operations Research, Vol. 12, 1987, pp. 569-596.
64. D. P. Bertsekas and P. Tseng, "Relaxation Methods for Minimum Cost
ordinary and Generalized Network Flow Problems," LIDS Report P-1462,
M.I.T, May 1985, Operations Research Journal, Vol. 36, 1988, pp. 93-114.
65. D.P. Bertsekas, "The Auction Algorithm: A Distributed Relaxation
Method for the Assignment Problem," Annals of Operations Research, Vol.
14, 1988, pp. 105-123.
66. D. P. Bertsekas and P. Tseng, "The RELAX Codes for Linear Minimum
Cost Network Flow Problems," in "FORTRAN Codes for Network Optimization,"
B. Simeone (ed.), Annals of Operations Research, Vol. 13, 1988, pp.
125-190.
67. D. P. Bertsekas, "Distributed Asynchronous Fixed Point Algorithms:
General Convergence Theory," in Systems & Control Encyclopedia, M. S.
Singh (ed.), Pergamon Press, 1988.
68. D. P. Bertsekas and J. Eckstein, "Dual Coordinate Step Methods for
Linear Network Flow Problems," Mathematical Programming, Series B, Vol.
42, 1988, pp. 203-243.
69. D. P. Bertsekas and D. A. Castanon, "Adaptive Aggregation Methods for
Infinite Horizon Dynamic Programming," IEEE Trans. on Aut. Control, Vol.
34, 1989, pp. 589-598.
69a. D. P. Bertsekas and D. A. Castanon, "The Auction Algorithm for the
Tranportation Problem," Annals of Operations Research, Vol. 20, 1989, pp.
67-96.
70. J. C. Dunn and D. P. Bertsekas, "Efficient Dynamic Programming
Implementations of Newton's Method for Unconstrained Optimal Control
Problems," J.O.T.A., Vol. 63, 1989, pp. 23-38.
71. P. Tseng and D. P. Bertsekas, "Relaxation Methods for Monotropic
Programming," Math. Programming Journal, Vol. 46, 1990, pp. 127-151.
72. P. Tseng and D. P. Bertsekas, "Relaxation Methods for Problems with
Strictly Convex Costs and Linear Constraints," Math. of Operations
Research, Vol. 16, 1991, pp. 462-481.
73. P. Tseng, D. P. Bertsekas, and J. N. Tsitsiklis, "Partially
Asynchronous Algorithms for Network Flow and Other Problems," SIAM J. on
Control and Optimization, Vol. 28, 1990, pp. 678-710.
74. D. P. Bertsekas and J. N. Tsitsiklis, "An Analysis of Stochastic
Shortest Path Problems," Mathematics of Operations Research, Vol. 16,
1991, pp. 580-595.
75. D. P. Bertsekas and J. N. Tsitsiklis, "A Survey of Some Aspects of
Parallel and Distributed Iterative Algorithms," Automatica, Vol. 27,
1991, pp. 3-21.
76. D. P. Bertsekas, "The Auction Algorithm for Assignment and Other
Network Flow Problems: A Tutorial," Interfaces, Vol. 20, 1990, pp.
133-149.
77. J. Eckstein and D. P. Bertsekas, "On the Douglas-Rachford Splitting
Method and the Proximal Point Algorithm for Maximal Monotone Operators,"
Math. Programming, Vol. 55, 1992, pp. 293-318.
78. D. P. Bertsekas, C. Ozveren, G. Stamoulis, P. Tseng, and J. N.
Tsitsiklis, "Optimal Communication Algorithms for Hypercubes," J. of
Parallel and Distributed Computation, Vol. 11, 1991, pp. 263-275.
79. D. P. Bertsekas and D. A. Castanon, "Parallel Synchronous and
Asynchronous Implementations of the Auction Algorithm," Parallel
Computing, Vol. 17, 1991, pp. 707-732.
80. D. P. Bertsekas, "An Auction Algorithm for Shortest Paths," SIAM J.
on Optimization, Vol. 1, 1991, pp. 425-447.
82. D. P. Bertsekas and D. A. Castanon, "A Forward/Reverse Auction
Algorithm for Asymmetric Assignments Problems", Computational
Optimization and Applications, Vol. 1, pp. 277-297, 1992.
83. E. Varvarigos and D. P. Bertsekas, "Multinode Broadcast in
Hypercubes and Rings with Randomly Distributed Length of Packets", IEEE
Trans. on Parallel and Distributed Systems, Vol. 4, pp. 144-154, 1993.
84. E. A. Varvarigos and D. P. Bertsekas, "Communication Algorithms for
Isotropic Tasks in Hypercubes and Wraparound Meshes", Parallel Computing,
Vol. 18, pp. 1233-1257, 1992.
85. D. P. Bertsekas and D. A. Castanon, "Asynchronous Hungarian Methods
for the Assignment Problem," ORSA J. on Computing, Vol. 5, pp. 261-274,
1993.
86. D. P. Bertsekas, "Auction Algorithms for Network Flow Problems: A
Tutorial Introduction," Computational Optimization and Applications, Vol.
1, pp. 7-66, 1992.
86a. D. P. Bertsekas, D. A. Castanon, and H. Tsaknakis,
"Reverse Auction and the Solution of Inequality Constrained Assignment
Problems," SIAM J. on Optimization, Vol. 3, pp. 268-299, 1993.
87. P. Tseng and D. P. Bertsekas, "On the Convergence of the Exponential
Multiplier Method for Convex Programming," Math Programming, Vol. 60, pp.
1-19, 1993.
88. D. P. Bertsekas and D. A. Castanon, "Parallel Primal-Dual Methods
for the Minimum Cost Flow Problem," Computational Optimization and its
Applications, Vol. 2, pp. 317-336, 1993.
89. D. B. Bertsekas, "Mathematical Equivalence of the Auction Algorithm
for Assignment and the e-Relaxation (Preflow-Push) Method for Min Cost
Flow", Large Scale Optimization: State of the Art, pp. 27-46, W. W.
Hager, D. W. Hearn and P. M. Pardalos, Eds., Kluwer, 1993.
90. D. P. Bertsekas, "A Simple and Fast Label Correcting Algorithm for
Shortest Paths", Networks, Vol. 23, pp. 703-709, 1993.
91. D. P. Bertsekas and D. A. Castanon, "A Generic Auction Algorithm for
the Minimum Cost Network Flow Problem", Computational Optimization and
Applications, Vol. 2, pp. 229-260, 1993.
92. E. A. Varvarigos and D. P. Bertsekas, "Transposition of Banded
Matrices in Hybercubes: A Nearly Isotropic Task", Parallel Computing,
Vol. 21, 1995, pp. 243-264.
93. D. P. Bertsekas, "The Auction Algorithm for Assignment and Shortest
Path Problems", Ricerca Operativa, Vol. 22, 1993, pp. 5-36.
94. E. A. Varvarigos and D. P. Bertsekas, "Dynamic Broadcasting in
Parallel Computing", IEEE Trans. on Parallel and Distributed Systems,
Vol. 6, 1995, pp. 120-131.
95. L. C. Polymenakos and D. P. Bertsekas, "Parallel Shortest Path
Auction Algorithms", Parallel Computing, Vol. 20, 1994, pp. 1221-1247.
96. D. P. Bertsekas and P. Tseng, "Partial Proximal Minimization
Algorithms for Convex Programming", SIAM J. on Optimization, Vol. 4,
1994, pp. 551-572.
97. E. A. Varvarigos and D. P. Bertsekas, "Performance of Hypercube
Routing Schemes With or Without Buffering", IEEE/ACM Transactions on
Networking, Vol. 2, 1994, pp. 299-311.
98. D. P. Bertsekas, "An Auction Algorithm for the Max-Flow Problem",
JOTA , Vol. 87, 1995, pp. 69-101.
99. D. P. Bertsekas, "A Counterexample on Temporal Differences
Learning", Neural Computation, Vol. 7, 1995, pp. 270-279.
100. E. A. Varvarigos and D. P. Bertsekas, "Partial Multinode Broadcasts
and Partial Exchange Algorithms for d-Dimensional Meshes", J. of Parallel
and Distributed Computing, Vol. 23, 1994, pp. 177-189.
101. E. A. Varvarigos and D.P. Bertsekas, "A Conflict Sense Routing
Protocol and Its Performance for Hypercubes", IEEE Trans. Computers,
Vol. 45, 1996, pp. 693-703.
102. D. P. Bertsekas, S. Pallottino, and M. G. Scutella, "Polynomial
Auction Algorithms for Shortest Paths", Computational Optimization and
Applications, Vol. 4, 1995, pp. 99-125.
103. D. P. Bertsekas, F. Guerriero and R. Musmanno, "Parallel
Asynchronous Label Correcting Methods for Shortest Paths", J. of
Optimization Theory and Applications, Vol. 88, 1996, pp. 297-320.
104. D. P. Bertsekas, "Generic Rank One Corrections for Value Iteration
in Markovian Decision Problems", Operations Research Letters, Vol. 17,
1995, pp. 111-119.
105. D. P. Bertsekas, "Incremental Least Squares Methods and the Extended
Kalman Filter", SIAM J. on Optimization, Vol. 6, 1996, pp. 807-822.
106. S. A. Savari and D. P. Bertsekas, "Finite Termination of
Asynchronous Iterative Algorithms", MIT, Laboratory for Information and
Decision Systems, Parallel Computing, Vol. 22, 1996, pp. 39-56.
107. D. P. Bertsekas, "Thevenin Decomposition and Network Optimization",
JOTA, Vol. 89, 1996, pp. 1-15.
108. D. P. Bertsekas, D. A. Castanon, J. Eckstein, and S. Zenios,
"Parallel Computing in Network Optimization", Handbooks in OR & MS, (M.
O. Ball, et. al, Eds.), Vol. 7, 1995, pp. 331-399.
109. D. P. Bertsekas, F. Guerriero and R. Musmanno, "Parallel Shortest
Path Methods for Globally Optimal Trajectories", in High Performance
Computing: Technology, Methods, and Applications, (J. Dongarra et.al.,
Eds.), Elsevier, 1995, pp. 303-315.
110. D. P. Bertsekas, "A New Class of Incremental Gradient Methods for
Least Squares Problems", SIAM J. on Optimization, Vol. 4, 1997, pp.
913-926.
111. D. P. Bertsekas, Polymenakos, L, and Tseng, P., "An e-Relaxation
Method for Convex Cost Network Flow Problems," SIAM J. on Optimization,
Vol. 7, 1997, pp. 853-870.
112. D. P. Bertsekas, "A New Value Iteration Method for the Average Cost
Dynamic Programming Problem," SIAM J. on Control and Optimization, Vol.
5, 1998, pp. 742-759.
113. L. C. Polymenakos, D. P. Bertsekas, and J. N. Tsitsiklis,
"Implementation of Efficient Algorithms for Globally Optimal
Trajectories", IEEE Trans. on Aut. Control, Vol. AC-43, 1998, pp. 278-283.
114. D. P. Bertsekas, Polymenakos, L, and Tseng, P., "Epsilon-Relaxation
and Auction Methods for Separable Convex Cost Network Flow Problems," in
Network Optimization, Pardalos, P. M., Hearn, D. W., and Hager, W. W.
(eds.), Lecture Notes in Economics and Mathematical Systems,
Springer-Verlag, N.Y., 1998, pp. 103-126.
115. D. P. Bertsekas, J. N. Tsitsiklis, and C. Wu, "Rollout Algorithms
for Combinatorial Optimization'', Journal of Heuristics, Vol. 3, 1997,
pp. 245-262.
116. D. P. Bertsekas, and D. A. Castanon, "Rollout Algorithms for
Stochastic Scheduling Problems'', Journal of Heuristics, Vol. 5, 1999,
pp. 89-108.
117. S. D. Patek, and D. P. Bertsekas, "Stochastic Shortest Path
Games", SIAM J. on Control and Opt., Vol. 37, 1999, pp. 804-824.
118. D. P. Bertsekas, "A Note on Error Bounds for Convex nad Nonconvex
Problems", Computational Optimization and Applications, Vol. 12, 1999,
pp. 41-51.
119. D. P. Bertsekas, M. L. Homer, D. A. Logan, S. D. Patek, and N. R.
Sandell, "Missile Defense and Interceptor Allocation by Neuro-Dynamic
Programming", IEEE Trans. on Systems Man and Cybernetics, Vol. 30,
2000, pp. 42-51.
120. J. Abounadi, D. P. Bertsekas, and V. Borkar, "Learning
Algorithms for Markov Decision Processes with Average Cost", SIAM J. on
Control and Opt., Vol. 40, 2001, pp. 681-698.
121. J. Abounadi, D. P. Bertsekas, and V. Borkar, "Approximation for Non-Expansive
Maps: Application to Q-Learning Algorithms", SIAM J. on Control and Opt., Vol. 41,
2002, pp. 1-22.
122. C. Wu, and D. P. Bertsekas, "Distributed Power Control Algorithms
for Wireless Networks'', IEEE Trans. on Vehicular Technology, 2001.
123. P. Tseng and D. P. Bertsekas, "Auction Algorithms for Convex
Generalized Network Problems," Math.\ Programming, Vol.\ 88, 2000, pp.\ 85-104.
124. D. P. Bertsekas, and J.N. Tsitsiklis, "Gradient Convergence in
Gradient Methods", SIAM J. on Optimization, Vol. 36, 2000, pp. 627-642.
125. A. Nedic and D. P. Bertsekas, "Incremental Subgradient Methods for Nondifferentiable
Optimization," SIAM J. on Optimization, Vol. 12, 2001, pp. 109-138.
126. D. P. Bertsekas and A. E. Ozdaglar, "Pseudonormality and a Lagrange Multiplier Theory for
Constrained Optimization," J. Optim. Theory Appl. Vol. 114 (2002), pp. 287--343.
127. A. Nedic, D. P. Bertsekas, and V. Borkar, Distributed Asynchronous Incremental Subgradient Methods, Proceedings of the
March 2000 Haifa Workshop ``Inherently Parallel Algorithms in Feasibility and Optimization and Their Applications", D.
Butnariu, Y. Censor, and S. Reich, Eds., Elsevier, Amsterdam, 2001.
128. A. Nedic and D. P. Bertsekas, "Convergence Rate of Incremental Subgradient Algorithms," ps format version, Stochastic
Optimization: Algorithms and Applications (S. Uryasev and P. M. Pardalos, Editors), pp. 263-304, Kluwer Academic Publishers,
2000.
129. A. Nedic and D. P. Bertsekas, "Least-Squares Policy Evaluation Algorithms with Linear
Function Approximation," LIDS Report LIDS-P-2537, Dec. 2001; J. of Discrete Event Systems,
Vol. 13, 2003.
130. C. C. Wu and D. P. Bertsekas, "Admission Control for Wireless Networks," IEEE Trans. on Vehicular
Technology,IEEE Trans. on Vehicular Technology, Vol. 50, pp. 504-514, 2001.
131. D. P. Bertsekas, A. Nedic, and A. E. Ozdaglar, "Min Common/Max Crossing Duality: A Simple
Geometric Framework for Convex Optimization and Minimax Theory," Report LIDS-P-2536, Jan.
2002.
132. A. E. Ozdaglar and D. P. Bertsekas, "Routing and Wavelength Assignment in Optical
Networks," IEEE Trans. on Networking,
Apr. 2003 pp. 259-272.
133. A. E. Ozdaglar and D. P. Bertsekas,
"The Relation Between Pseudonormality and
Quasiregularity in Constrained Optimization," Optimization Methods and
Software, Vol. 19, 2004, pp. 493-506.
134. D. P. Bertsekas, V. Borkar, and A. Nedic,
"Improved Temporal Difference Methods with Linear Function
Approximation," in "Learning and Approximate
Dynamic Programming", by A. Barto, W. Powell, J. Si, (Eds.), IEEE Press, 2004.
135. D. P. Bertsekas, A. E. Ozdaglar, and P. Tseng,
"Enhanced Fritz John Conditions for Convex
Programming," Lab. for Information and Decision Systems Report 2631, MIT, July 2004; SIAM J. on
Optimization, Vol. 16, 2006, p. 766.
136. D. P. Bertsekas and J. N. Tsitsiklis, "Comment on
Coordination of Groups of Mobile Autonomous
Agents Using Nearest Neighbor Rules," Lab. for Information and Decision
Systems Report, MIT, June 2006; EEE Trans. on Aut. Control, Vol. 52, pp. 968-969, 2007.
137. H. Yu and D. P. Bertsekas, "On Near-Optimality of the Set of Finite-State Controllers for Average Cost POMDP," Mathematics of Operations Research, 33(1), pp. 1-11, 2008.
138. D. P. Bertsekas, "Extended Monotropic Programming and Duality," Lab. for Information and Decision
Systems Report 2692, MIT, March 2006 (revised March 2007), to appear in JOTA.
139. D. P. Bertsekas, "Separable Dynamic Programming and Approximate Decomposition Methods," Lab. for Information and Decision
Systems Report 2684, MIT, Feb. 2006; to appear in IEEE Trans. on Aut. Control.
140. D. P. Bertsekas, "Dynamic Programming and Suboptimal Control: A Survey from ADP to MPC," in Fundamental Issues in Control, European J. of Control, Vol. 11, Nos. 4-5, 2005.
141. D. P. Bertsekas, and P. Tseng,
"Set Intersection Theorems and Existence of Optimal
Solutions," Math. Programming J., Vol. 110, 2007 pp. 287-314.
142. D. P. Bertsekas, A. E. Ozdaglar, and P. Tseng,
"Enhanced Fritz John Conditions for Convex
Programming," SIAM J. on
Optimization, Vol. 16, 2006, p. 766.
143. A. Nedich and D. P. Bertsekas, "The Effect of Deterministic Noise in Subgradient Methods," Math. Programming, Ser. A, Vol. 125, pp. 75-99, 2010.
144. D. P. Bertsekas, "Separable Dynamic Programming and Approximate Decomposition Methods," IEEE Trans. on Aut. Control, Vol. 52, 2007, pp. 911-916.
145. H. Yu and D. P. Bertsekas, "Convergence Results for Some Temporal Difference Methods Based on Least Squares," IEEE Trans. on Aut. Control, Vol. 54, 2009, pp. 1515-1531.
146. D. P. Bertsekas, "Extended Monotropic Programming and Duality," JOTA, Vol. 139, 2008, pp. 209-225.
147. D. P. Bertsekas and H. Yu, "A Unifying Polyhedral Approximation Framework for Convex Optimization," SIAM J. on Optimization, Vol. 21, 2011, pp. 333-360.
148. D. P. Bertsekas and H. Yu, "Projected Equation Methods for Approximate Solution of Large Linear Systems," Journal of Computational and Applied Mathematics, Vol. 227, 2009, pp. 27-50.
149. A. Nedich and D. P. Bertsekas, "The Effect of Deterministic Noise in Subgradient Methods," Math. Programming, Ser. A, Vol. 125, pp. 75-99, 2010.
150. D. P. Bertsekas, "Temporal Difference Methods for General Projected Equations," IEEE Trans. on Automatic Control, Vol. 56, pp. 2128 - 2139, 2011.
151. H. Yu and D. P. Bertsekas, "Error Bounds for Approximations from Projected Linear Equations," Mathematics of Operations Research, Vol. 35, 2010, pp. 306-329.
152. D. P. Bertsekas, "Incremental Proximal Methods for Large Scale Convex Optimization," Lab. for Information and Decision Systems Report LIDS-P-2847, MIT, August 2010; Mathematical Programming, Vol. 129, 2011, pp.163-195.
153. D. P. Bertsekas, "Approximate Policy Iteration: A Survey and Some New Methods," Journal of Control Theory and Applications, Vol. 9, 2011, pp. 310-335.
154. D. P. Bertsekas, "Weighted Sup-Norm Contractions in Dynamic Programming: A Review and Some New Applications", Lab. for Information and Decision Systems Report LIDS-P-2884, MIT, May 2012.
155. M. Wang and D. P. Bertsekas, "Stabilization of Stochastic Iterative Methods for Singular and Nearly Singular Linear Systems", Lab. for Information and Decision
Systems Report LIDS-P-2878, MIT, December 2011 (revised March 2012); Math. of Operations Research (to appear).
156. D. P. Bertsekas, "Lambda-Policy Iteration: A Review and a New Implementation", Lab. for Information and Decision Systems Report LIDS-P-2874, MIT, October 2011. In "Reinforcement Learning and Approximate Dynamic Programming for Feedback Control," by F. Lewis and D. Liu (eds.), IEEE Press Computational Intelligence Series.
157. D. P. Bertsekas and H. Yu, "Q-Learning and Enhanced Policy Iteration in Discounted Dynamic Programming," Lab. for Information and Decision Systems Report LIDS-P-2831, MIT, April, 2010 (revised November 2011); Math. of Operations Research, Vol. 37, 2012, pp. 66-94.
158. H. Yu and D. P. Bertsekas, "Q-Learning and Policy Iteration Algorithms for Stochastic Shortest Path Problems," Annals of Operations Research Vol. 208, 2013, pp. 95-132.
159. H. Yu and D. P. Bertsekas, "On Boundedness of Q-Learning Iterates for Stochastic Shortest Path Problems," Mathematics of Operations Research 38(2), pp. 209-227, 2013.
160. M. Wang and D. P. Bertsekas, "Convergence of Iterative Simulation-Based Methods for Singular Linear Systems," Stochastic Systems, Vol. 3, 2013, pp 39-96.
161. M. Wang and D. P. Bertsekas, "Stochastic First-Order Methods with Random Constraint Projection", SIAM Journal on Optimization, Vol. 26, 2016, pp. 681-717.
162. M. Wang and D. P. Bertsekas, "Incremental Constraint Projection Methods for Variational Inequalities", Lab. for Information and Decision Systems Report LIDS-P-2898, MIT, December 2012; Mathematical Programming, Vol. 150, 2015, pp. 321-363.
163. M. Wang and D. P. Bertsekas, "Stabilization of Stochastic Iterative Methods for Singular and Nearly Singular Linear Systems", Mathematics of Operations Research, Vol. 39, pp. 1-30, 2013.
164. H. Yu and D. P. Bertsekas, "A Mixed Value and Policy Iteration Method for Stochastic Control with Universally Measurable Policies," Lab. for Information and Decision Systems Report LIDS-P-2905, MIT, July 2013; Math. of Operations Research, Vol. 40, 2015, pp. 926-968.
165. D. P. Bertsekas, "Robust Shortest Path Planning and Semicontractive Dynamic Programming", Lab. for Information and Decision Systems Report LIDS-P-2915, MIT, Feb. 2014 (revised Jan. 2015 and June 2016); arXiv preprint arXiv:1608.01670; to appear in Naval Research Logistics.
166. D. P. Bertsekas, "Value and Policy Iteration in Deterministic Optimal Control and Adaptive Dynamic Programming", IEEE Transactions on Neural Networks and Learning Systems, Vol. 28, 2017, pp. 500-509.
167. D. P. Bertsekas, "Regular Policies in Abstract Dynamic Programming", SIAM J. on Optimization, Vol. 27, No. 3, pp. 1694-1727.
168. D. P. Bertsekas, "Affine Monotonic and Risk-Sensitive Models in Dynamic Programming", Lab. for Information and Decision Systems Report LIDS-3204, MIT, June 2016 (revised Nov. 2017); arXiv preprint arXiv:1608.01393; IEEE Transactions on Automatic Control, to appear.
169. D. P. Bertsekas, "Proper Policies in Infinite-State Stochastic Shortest Path Problems", Lab. for Information and Decision Systems Report LIDS-3507, MIT, May 2017; to appear in IEEE Transactions on Aut. Control.
170. D. P. Bertsekas, "Stable Optimal Control and Semicontractive Dynamic Programming", SIAM J. on Control and Optimization, Vol. 56, 2018, pp. 231-252.
171. D. P. Bertsekas, "Feature-Based Aggregation and Deep Reinforcement Learning: A Survey and Some New Implementations," IEEE/CAA Journal of Automatica Sinica, 2020.
172. S. Bhattacharya, S. Badyal, T. Wheeler, S. Gil, D. P. Bertsekas, "Reinforcement Learning for POMDP: Partitioned Rollout and Policy Iteration with Application to Autonomous Sequential Repair Problems," IEEE Robotics and Automation Letters, Vol. 5, pp. 3967-3974, 2020.
173. D. P. Bertsekas, "Multiagent Value Iteration Algorithms in Dynamic Programming and Reinforcement Learning," Results in Control and Optimization J., Vol. 1, 2020.
174. Liu, M., Pedrielli, G., Sulc, P., Poppleton, E., and D. P. Bertsekas, "ExpertRNA: A New Framework for RNA Structure Prediction," INFORMS J. on Computing, 34(5), pp.2464-2484.
175. D. P. Bertsekas, "Multiagent Reinforcement Learning: Rollout and Policy Iteration," IEEE/CAA Journal of Automatica Sinica, Vol. 8, 2021, pp. 249-271.
176. Bhattacharya, S., Kailas, S., Badyal, S., Gil, S., Bertsekas, D.,"Multiagent Reinforcement Learning: Rollout and Policy Iteration for POMDP with Application to Multi-Robot Repair Problems," to be published in the IEEE Transactions on Robotics.
177. D. P. Bertsekas, "Newton's Method for Reinforcement Learning and Model Predictive Control," Results in Control and Optimization, Vol. 7, 2022, pp. 100-121.
178. Agrawal, G., Bertsekas, D., Liu, H., "Auction-Based Learning for Question Answering over Knowledge Graphs," Information 2023, 14, 336.
Selected Conference Proceedings Papers
1. D. P. Bertsekas and S. K. Mitter, "Steepest Descent for Optimization
Problems With Nondifferentiable Cost Functions," Proc. 5th Annual
Princeton Conference on Information Sciences and Systems, Princeton,
N.J., March 1971.
2. D. P. Bertsekas and I. B. Rhodes, "Minimax Feedback Control of
Uncertain Dynamic Systems," Proc. IEEE Decision and Control Conference,
Miami, Florida, December 1971.
3. D. P. Bertsekas, "Convergence of the Feasible Region in Infinite
Horizon Optimization Problems," Proc. 1972 Joint Automatic Control
Conference, Stanford University, Stanford, Calif., August 1972.
4. D. P. Bertsekas, "On the Solution of Some Minimax Problems," Proc.
1972 IEEE Decision and Control Conference, New Orleans, LA, December 1972.
5. B. W. Kort and D. P. Bertsekas, "A New Penalty Function Method for
Constrained Minimization," Proc. 1971 IEEE Decision and Control
Conference, New Orleans, LA, December 1972.
6. D. P. Bertsekas, "Stochastic Optimization Problems with
Nondifferentiable Cost Functionals with an Application in Stochastic
Programming," Proc. 1972 IEEE Decision and Control Conference, New
Orleans, LA, December 1972.
7. B. W. Kort and D. P. Bertsekas, "Multiplier Methods for Convex
Programming," Proc. 1973 IEEE Decision and Control Conference, San Diego,
CA, December 1973, pp. 260-264.
8. D. P. Bertsekas, "Convergence Rate of Penalty and Multiplier
Methods," Proc. 1973 IEEE Decision and Control Conference, San Diego, CA,
December 1973, pp. 260-264.
9. D. P. Bertsekas, "On the Goldstein-Levitin-Polyak Gradient Projection
Method," Proc. 1974 IEEE Decision and Control Conference, Phoenix, AZ,
Nov. 1974, pp. 47-52.
10. D. P. Bertsekas, "Nondifferentiable Optimization Via Approximation,"
Proc. Twelfth Annual Allerton Conference on circuit and System Theory,
Allerton Park, Ill., Oct. 1974, pp. 41-52
11. D. P. Bertsekas, "Multiplier Methods: A Survey," Proc. 1975 IFAC
Congress, Boston, MA, August 1975.
12. D. P. Bertsekas, "A New Algorithm for Analysis of Nonlinear Resistive
Networks," Proc. Thirteenth Annual Allerton Conference on Circuit &
System Theory, Allerton Park, Illinois, October 1975, pp. 622-632.
13. D. P. Bertsekas, "A General Method for Approximation Based on the
Method of Multipliers," Proc. Thirteenth Annual Allerton Conference on
Circuit and System Theory, Allerton Park, Ill., October 1975, pp. 192-203.
14. D. P. Bertsekas, "Monotone Mappings in Dynamic Programming," Proc. of
1975 IEEE Conference on Decision and Control, Houston, Texas, Dec. 1975,
pp. 20-25.
15. D. P. Bertsekas, "Newton's Method for Linear Optimal Control
Problems," Proc. of IFAC Symposium on Large Scale Systems, Udine, Italy,
June 1976, pp. 353-359.
16. S. Shreve and D. P. Bertsekas, "Equivalent Deterministic and
Stochastic Optimal Control Problems," Proc. of 1976 IEEE Conf. on
Decision and Control, Clearwater Beach, Fla., Dec. 1976, pp. 705-709.
17. D. P. Bertsekas, "Decomposition Methods for Large-Scale Nonconvex
Optimization Problems," Proc. of 1976 IEEE Conf. on Decision and Control,
Clearwater Beach, Fla., Dec. 1976, pp. 532-536.
18. S. Shreve and D. P. Bertsekas, "A New Theoretical Framework for
Finite Horizon Stochastic Control," Proc. Fourteen Annual Allerton
Conference on Circuit and System Theory, Allerton Park, Ill. Oct. 1976,
pp. 336-343.
19. D. P. Bertsekas, "Minimax Methods Based on Approximation," Proc. of
the 1976 Johns Hopkins Conference on Information and Sciences and
Systems, Baltimore, MD, March 1976, pp. 463-465.
20. D. P. Bertsekas, "Local Convex Conjugacy and Fenchel Duality,"
Preprints of Seventh Triennial World Congress of IFAC, Helsinki, June
1978, Vol. 2, pp. 1079-1084.
21. D. P. Bertsekas, "Routing Algorithms for Data Communication
Networks," Proc. of MECO'78, Athens, Greece, June 1978.
22. D. P. Bertsekas, E. Gafni, and K. Vastola, "Validation of Algorithms
for Optimal Routing of Flow in Networks," Proc. 1978 IEEE Conference on
Decision and Control, San Diego, CA, Jan. 1979, pp. 220-227.
23. D. P. Bertsekas, "Globally Convergent Newton Methods for Constrained
Optimization Using Differentiable Exact Penalty Functions," Proc. of 19th
IEEE Conference on Decision and Control, Albuquerque, NM, Dec. 1980, pp.
234-238.
24. D. P. Bertsekas, "Dynamic Models of Shortest Path Routing Algorithms
for Communication Networks with Multiple Destinations," Proceedings 1979
IEEE Conference on Decision and Control, Ft. Lauderdale, Fla., Dec. 1979.
25. D. P. Bertsekas, "An Algorithm for the Hitchcock Transportation
Problem," Proceedings Seventeenth Annual Allerton Conference on
Communication , Control, and Computing, Allerton Park, Ill., Oct. 1979.
26. D. P. Bertsekas, "Variable Metric Methods for Constrained
Optimization Using Differentiable Exact Penalty Functions," Proc.
Eighteenth Annual Allerton Conf. on Comm., Control, and Computing,
Allerton Park, Ill., Oct. 1980.
27. D. P. Bertsekas, Class of Optimal Routing Algorithms for
Communication Networks," Proc. of the Fifth International Conference on
Computer Communication, Atlanta, GA, Oct. 1980, pp. 71-76.
28. D. P. Bertsekas, G. Lauer, N. Sandell, and T. Posbergh, "Optimal
Short-Term Scheduling of Large-Scale Power Systems," Proc. of 1981 IEEE
Conference on Decision and Control, San Diego, CA, Dec. 1981.
29. D. P. Bertsekas, "A Model for Uncoordinated Distributed Computation
of Fixed Points," Proc. of Nineteenth Annual Allerton Conference on
Communication, Control, and Computing, Allerton Park, Ill., Oct. 1981.
30. D. P. Bertsekas, "Distributed Dynamic Programming," Proc. 1981 IEEE
Conference on Decision and Control, San Diego, CA, Dec. 1981.
31. N. Sandell, D. P. Bertsekas, J. Shaw, S. Gully, and R. Gendron,
"Optimal Scheduling of Hydro-Electric Power Plants," Proc. of 1982 IEEE
International Large Scale Systems Symposium, Virginia Beach, VA, Oct.
1982.
32. J. Kimemia, S. B. Gershwin, and D. P. Bertsekas, "Computation of
Production Control Policies by a Dynamic Programming Technique," Proc. of
1982 IEEE International Large Scale Systems Symposium, Virginia Beach,
VA, Oct. 1982, pp. 393-397.
33. E. Gafni and D. P. Bertsekas, "Dynamic Control of Input Session Rates
in Communication Networks," Proc of MILCOM'82, Bedford, MA, Oct. 1982.
34. D. P. Bertsekas and E. Gafni, "Projected Newton Methods and
Optimization of Multicommodity Flows," Proc. of 1982 IEEE Conf. on
Decision and Control, Orlando, Fla., Dec. 1982.
35. D. P. Bertsekas and N. R. Sandell, "Estimates of the Duality Gap for
Large-Scale Separable Nonconvex Optimization Problems," Proc. of 1981
IEEE Conf. on Decision and Control, Orlando, Fla., Dec. 1982.
36. E. M. Gafni and D. P. Bertsekas, "Path Assignment for Virtual Circuit
Routing," SIGCOMM 83 Symposium on Communications Architectures and
Protocols, Austin, TX, March 1983, pp. 21-25.
37. K. R. Pattipati, J. J. Shaw, D. P. Bertsekas, J. C.. Deckert, M. P.
Kastner, L. K. Beean, and R. F. Gendron, "A Model for the Optimal
Synthesis and Analysis of Maintenance Facilities," Proc. of IEEE Autotest
Conference, Nov. 1983, pp. 449-456.
38. J. Tsitsiklis, D. P. Bertsekas, and M. Athans, "Distributed
Optimization Algorithms with Communications," Proc. 6th MIT/ONR Workshop
on C3 Systems, Dec. 1983, pp. 215-218.
39. J. Tsitsiklis, D. P. Bertsekas, and M. Athans, "Distributed
Deterministic and Stochastic Optimization Algorithms with Applications in
Systems Identification," Proc. 1983 Melecon Conference, Athens, Greece,
May 1983.
40. D. P. Bertsekas, I. J. Shaw, and R. F. Gendron, "Preconditioned
Conjugate Gradient Methods for Optimal Control Problems with Delays with
Application in Hydroelectric Power Systems Scheduling," Proc.of 22nd IEEE
Conf. on Dec. and Control, San Antonio, TX, Dec. 1983, pp. 1434-1442.
41. D. P. Bertsekas, "A Model for Distributed Asynchronous Computation,"
Trans. of the Second Army Conference on Applied Mathematics and
Computing, Rensselaer Poly. Inst., Troy, N.Y., Feb. 1985, pp. 943-948.
42. J. N. Tsitsiklis and D. P. Bertsekas, "Distributed Asynchronous
Optimal Routing in Data Networks," Proc. of 23rd Conference on Decision
and Control, Las Vegas, NM, Dec. 1984, pp. 1133-1138.
43. D. P. Bertsekas, "Distributed Relaxation Methods for Linear Network
Flow Problems," Proc. 25th IEEE Conference on Decision and Control,
Athens, Greece, 1986.
44. D. P. Bertsekas and D. A. Castanon, "Adaptive Aggregation Methods for
Discounted Dynamic Programming," Proc. 25th IEEE Conference on Decision
and Control, Athens, Greece, Dec. 1986.
45. W. K. Tsai, J. N. Tsitsiklis, and D. P. Bertsekas, "Some Issues in
Distributed Asynchronous Routing in Virtual Circuit Data Networks," Proc.
25th Conference on Decision and Control, Athens, Greece, Dec. 1986.
46. D. P. Bertsekas and J. Eckstein, "Distributed Relaxation Methods for
Linear Network Flow Problems," Proc. of IFAC 1987, Munich, Germany, July
1987.
47. D. P. Bertsekas and J. N. Tsitsiklis, "Convergence Rate and
Termination of Asynchronous Iterative Algorithms", Proceedings of the
1989 International Conference on Supercomputing, Crete, Greece, pp.
461-470, June 1989.
48. D. P. Bertsekas, "Auction Algorithms for Network Flow Problems: A
Tutorial Introduction," Proc. 29th Annual Allerton Conference on
Communication, Control, and Computing, Allerton Park, Ill., Oct. 1991.
49. E. A. Varvarigos and D. P. Bertsekas, "Partial Multinode Broadcast
for D-Dimensional Meshes", 1992 International Conference on Parallel
Processing, pp. III-51-III-54.
50. D. P. Bertsekas, "Some Communication Aspects of Parallel Computing
Systems", Proc. of LAAS Symposium, Toulouse, France, pp. 141-145, 1993.
51. E. A. Varvarigos, and D. P. Bertsekas, "Partial Multinode Broadcast
and Partial Exchange in d-Dimensional Meshes", Proc. of 1992 Int'l
Confer. on Parall. Proces., Vol. 3, 1992, pp. 51-54.
52. E. A. Varvarigos, and D. P. Bertsekas, "Comparison of Five Routing
Schemes for Multiprocessor Communications", Proc. 4th Int'l Confer. on
Adva. in Comm. and Control, 1993, pp. 22-33.
53. D. P. Bertsekas, "Differential Training of Rollout Policies", Proc.
35th Allerton Conference on Communication, Control, and Computing,
Allerton Park, Ill., 1997, pp. 913-922.
54. D. P. Bertsekas, "New Value Iteration and Q-Learning Methods for the
Average Cost Dynamic Programming Problem," Proc. 1998 IEEE Conference on
Decision and Control Conference.
55. A. Geary, and D. P. Bertsekas, "Incremental Subgradient Methods for
Nondifferentiable Optimization," Proc. 1999 IEEE Conference on Decision
and Control Conference.
56. C. Wu, and D. P. Bertsekas, "Didtributed Power Control Algorithms
for Wireless Networks'', Proc. 1999 IEEE Conference on Decision and
Control Conference.
57. D. P. Bertsekas, D. A. Castanon, M. L. Curry, and D. Logan, "Adaptive Multi-Platform
Scheduling in a Risky Environment," Proceedings of Symposium on Advances in Enterprise Control, San
Diego, CA, November 1999.
58. C. Wu, M. L. Curry, D. P. Bertsekas and D. A. Castanon, "Approximate Dynamic Programming for
Multi-Platform Scheduling in a Risky Environment," Proceedings of Symposium on Advances in Enterprise
Control, Minneapolis, MN, June 2000.
59. D. P. Bertsekas and A. E. Ozdaglar-Koksal, "Enhanced Optimality Conditions and Exact Penalty
Functions," Proceedings of Allerton Conference Allerton Park, Ill., Oct. 2000.
60. A. Nedic and D. P. Bertsekas, "Convergence Rate of Incremental Subgradient Algorithms,"
Stochastic Optimization: Algorithms and Applications (S. Uryasev and P. M. Pardalos, Editors), pp.
263-304, Kluwer Academic Publishers, 2000.
61. D. P. Bertsekas, "Auction Algorithms," Encyclopedia of
Optimization, Kluwer, 2002.
62. D. P. Bertsekas, "Neuro-Dynamic Programming," Encyclopedia of
Optimization, Kluwer, 2002.
63. A. Nedic, D. Bertsekas, and V. Borkar, "Distributed Asynchronous Subgradient Methods for
Nondifferentiable Optimization," in Inherently Parallel Algorithms in Optimization, by D. Butnariou
and Y. Censor (eds.), Kluwer, 2001.
64. A. E. Ozdaglar and D. P. Bertsekas, "Optimal Solution of Integer Multicommodity Flow Problems with
Application in Optical Networks," Proc. of Symposium on Global Optimization, Santorini, Greece, June 2003;
Frontiers in global optimization, pp. 411--435, Nonconvex Optim. Appl., 74, Kluwer Acad. Publ., Boston, MA,
2004.
65. H. Yu and D. P. Bertsekas,
"Discretized Approximations for POMDP with Average Cost," Proc. of 20th Conference on Uncertainty in
Artificial Intelligence, Banff, Canada, July 2004.
66. H. Yu and D. P. Bertsekas, "Q-Learning Algorithms for Optimal Stopping Based on Least Squares," Proc. European Control Conference 2007, Kos, Greece, July 2007.
67. H. Yu and D. P. Bertsekas, "Basis Function Adaptation Methods for Cost Approximation in MDP," Proc. of IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning 2009, Nashville, TN.
68. N. Polydorides, M. Wang, and D. P. Bertsekas, "A Quasi Monte Carlo Method for Large Scale Inverse Problems," Proc. of The 9th International Conference on Monte Carlo and Quasi-Monte Carlo Methods in Scientific Computing (MCQMC 2010); to be published in "Monte Carlo and Quasi-Monte Carlo Methods 2010," by H. Wozniakowski and L. Plaskota (eds), Springer-Verlag.
69. D. P. Bertsekas and H. Yu, "Distributed Asynchronous Policy Iteration in Dynamic Programming," Proc. of 2010 Allerton Conference on Communication, Control, and Computing, Allerton Park, ILL, Sept. 2010.