Book chapters

  1. W. P. Tay and J. N. Tsitsiklis, "Error Exponents for Decentralized Detection in Tree Networks," in Networked Sensing Information and Control, V. Saligrama (Ed.), Springer Verlag, 2008, pp. 73-92.

  2. R. Johari and J. N. Tsitsiklis, "A Game Theoretic View of Efficiency Loss in Resource Allocation,", in Advances in Control, Communication Networks, and Transportation Systems: In Honor of Pravin Varaiya, E. H. Abed (Ed.), Systems and Control: Foundations and Applications Series, Birkhauser, Boston, 2005, pp. 203-223.

  3. J. N. Tsitsiklis, "Decentralized Detection", in Advances in Signal Processing, Vol. 2, H. V. Poor and J. B. Thomas, editors, JAI Press, 1993, pp. 297-344.

Preprints (and some recent conference papers)

  1. H. Eydgahi, W. W. Chen, J. Muhlich, D. Vitkup, J. N. Tsitsiklis, and P. K. Sorger, "Properties of cell death models calibrated and compared using Bayesian approaches,'' October 2012 (revised December 2012); to appear in Molecular Systems Biology.

  2. M. G. Markakis, E. Modiano, and J. N. Tsitsiklis, "Delay Stability Regions of the Max-Weight Policy under Heavy-Tailed Traffic,'' working paper, July 2012.

  3. K. Drakopoulos, A. Ozdaglar, and J. N. Tsitsiklis, "On Learning with Finite Memory", submitted, July 2012.

  4. J. N. Tsitsiklis and Y. Xu, "Pricing of Fluctuations in Electricity Markets,'' submitted July 2012.

  5. J. Li, P. Rusmevichientong, D. Simester, J. N. Tsitsiklis, and S. Zoumpoulis, The Practical Value of Field Experiments,'' submitted, May 2012.

  6. J. N. Tsitsiklis and Y. Xu, "Profit Loss in Cournot Oligopolies,'' submitted, April 2012.

  7. M. G. Markakis, E. Modiano, and J. N. Tsitsiklis, "Max-Weight Scheduling in Queueing Networks with Heavy-Tailed Traffic,'', February 2012, revised December 2012; to appear in the IEEE/ACM Transactions on Networking.

  8. M. Dahleh, A. Tahbaz-Salehi, J. N. Tsitsiklis, and S. Zoumpoulis, "On Global Games of Regime Change in Networks,'', working paper, February 2012; presented at the 6th Workshop on the Economics of Networks, Systems, and Computation, San Jose, CA, June 2011.

  9. J. N. Tsitsiklis and Y. Xu, "Efficiency Loss in a Cournot Oligopoly with Convex Market Demand,'' submitted, October 2011; revised March 2012.

  10. D. Shah, J. N. Tsitsiklis, and Y. Zhong, "Qualitative properties of alpha-fair policies in bandwidth-sharing networks'', submitted, April 2011; revised September 2012; to appear in the Annals of Applied Probability.

  11. A. Olshevsky, and J. N. Tsitsiklis, "Degree Fluctuations and the Convergence Time of Consensus Algorithms,'' submitted, January 2012; revised September 2012; to appear in the IEEE Transactions on Automatic Control.

  12. J. M. Hendrickx and J. N. Tsitsiklis, "Convergence of Type-Symmetric and Cut-Balanced Consensus Seeking Systems", February 2011; revised, June 2012; to appear in the IEEE Transactions on Automatic Control.

  13. A. A. Ahmadi, A. Olshevsky, P. A. Parrilo, J. N. Tsitsiklis, "NP-hardness of Deciding Convexity of Quartic Polynomials and Related Problems", submitted, December 2010; revised October 2011; to appear in Mathematical Programming.

  14. K. P. Jagannathan, M. Markakis, E. Modiano, and J. N. Tsitsiklis, Throughput Optimal Scheduling in the Presence of Heavy-Tailed Traffic, Proceedings of the Forty-Seventh Annual Allerton Conference on Communication, Control, and Computing, Monticello, Illinois, September 2010.

  15. S. Mannor and J. N. Tsitsiklis, "Algorithmic Aspects of Mean-Variance Optimization in Markov Decision Processes", submitted, June 2010; revised June 2012; shorter version in Proceedings of the 28th International Conference on Machine Learning (ICML 2011), June 2011.

Journal papers

  1. J. N. Tsitsiklis and K. Xu, "On the power of (even a little) resource pooling", Stochastic Systems, Vol. 2, 2012, pp. 1-66.

  2. K. Jagannathan, M. Markakis, E. Modiano, and J. N. Tsitsiklis, "Queue length asymptotics for generalized max-weight scheduling in the presence of heavy-tailed traffic", IEEE/ACM Transactions on Networking, Vol. 20, No. 4, August 2012, pp. 1096-1111.

  3. J. Ramakrishnan, D. Craft, T. Bortfeld, and J. N. Tsitsiklis, "A dynamic programming approach to adaptive fractionation", Physics in Medicine and Biology, Vol. 57, No. 5, 2012, pp. 1203-1216.

  4. D. Shah, D. N. C. Tse, and J. N. Tsitsiklis, "Hardness of Low Delay Network Scheduling", IEEE Transactions on Information Theory, Vol. 57, No. 12, December 2011, pp. 7810-7818.

  5. A. Olshevsky and J. N. Tsitsiklis, "A Lower Bound for Distributed Averaging Algorithms on the Line Graph", IEEE Transactions on Automatic Control, Vol. 56, No. 11, November 2011, pp. 2694-2698.

  6. J. M. Hendrickx, A. Olshevsky, and J. N. Tsitsiklis, "Distributed Anonymous Discrete Function Computation and Averaging", IEEE Transactions on Automatic Control, Vol. 56, No. 10, October 2011, pp. 2276-2289. [extended version]

  7. R. Johari and J. N. Tsitsiklis, "Parameterized Supply Function Bidding: Equilibrium and Efficiency,'' Operations Research, Vol. 59, No. 5, September-October 2011, pp. 1079-1089.

  8. A. Olshevsky and J. N. Tsitsiklis, "Convergence Speed in Distributed Consensus and Averaging,'' SIAM Review, Vol. 53, No. 4, 2011, pp. 747-772.

  9. D. Shah, J. N. Tsitsiklis, Y. Zhong, "Optimal scaling of average queue sizes in an input-queued switch: an open problem", Queueing Systems: Theory and Applications, Vol. 68, No. 3-4, August 2011, pp. 375-384.

  10. O. P. Kreidl, J. N. Tsitsiklis, and S. Zoumpoulis, "On Decentralized Detection with Partial Information Sharing among Sensors", IEEE Transactions on Signal Processing, Vol. 59, No. 4, 2011, pp. 1759-1765.

  11. V. D. Blondel, J. M. Hendrickx, and J. N. Tsitsiklis, "Continuous-Time Average-Preserving Opinion Dynamics with Opinion-Dependent Communications," SIAM Journal on Control and Optimization, Vol. 48, No. 8, 2010, pp. 5214-5240.
    [supplement on existence and uniqueness of solutions]

  12. P. Rusmevichientong, and J. N. Tsitsiklis, "Linearly Parameterized Bandits", Mathematics of Operations Research, Vol. 35, No. 2, May 2010, pp. 395-411. [extended version]

  13. S. Das and J. N. Tsitsiklis, "When is it Important to Know You've Been Rejected? A Search Problem with Probabilistic Appearance of Offers", Journal of Economic Behavior and Organization, Vol. 74, No. 1-2, 2010, pp. 104-122.

  14. J. N. Tsitsiklis, "Perspectives on Stochastic Optimization Over Time, INFORMS Journal on Computing, Vol. 22, No. 1, 2010, pp. 18-19.

  15. T. C. Y. Chan, J. N. Tsitsiklis, and T. Bortfeld, "Optimal margin and edge-enhanced intensity maps in the presence of motion and uncertainty", Physics in Medicine and Biology, Vol. 55, No. 2, 2010, pp. 515-533.

  16. A. J. Mersereau, P. Rusmevichientong, and J. N. Tsitsiklis, "A Structured Multiarmed Bandit Problem and the Greedy Policy", IEEE Transactions on Automatic Control, Vol. 54, No. 12, December 2009, pp. 2787-2802.

  17. V. D. Blondel, J. M. Hendrickx, and J. N. Tsitsiklis, "On Krause's multi-agent consensus model with state-dependent connectivity," IEEE Transactions on Automatic Control, Vol. 54, No. 11, November 2009, pp. 2586-2597. [extended version]

  18. A. Nedic, A. Olshevsky, A. Ozdaglar, and J. N. Tsitsiklis, "On Distributed Averaging Algorithms and Quantization Effects, IEEE Transactions on Automatic Control, Vol. 54, No. 11, November 2009, pp. 2506-2517.

  19. W. P. Tay, J. N. Tsitsiklis, and M. Z. Win, "Bayesian Detection in Bounded Height Tree Networks", IEEE Transactions on Signal Processing, Vol. 57, No. 10, October 2009, pp. 4042-4051.

  20. R. Johari and J. N. Tsitsiklis, "Efficiency of Scalar-Parameterized Mechanisms", Operations Research, Vol. 57, No. 4, July-August 2009, pp. 823-839; electronic companion.

  21. S. Mannor and J. N. Tsitsiklis, "Approachability in Repeated Games: Computational Aspects and a Stackelberg Variant", Games and Economic Behavior, Vol. 66, No. 1, 2009, pp. 315-325.

  22. S. Mannor, J. N. Tsitsiklis, and J. Y. Yu, "Online Learning with Sample Path Constraints," Journal of Machine Learning Research, Vol. 10, March 2009, pp. 569-590.

  23. A. Olshevsky and J. N. Tsitsiklis, "Convergence Speed in Distributed Consensus and Averaging", SIAM Journal on Control and Optimization, Vol. 48, No. 1, 2009, pp. 33-55.

  24. D. Shah and J. N. Tsitsiklis, "Bin Packing with Queues," Journal of Applied Probability, Vol. 45, No. 4, December 2008, pp. 922-939.

  25. A. Olshevsky and J. N. Tsitsiklis, "On the Nonexistence of Quadratic Lyapunov Functions for Consensus Algorithms", IEEE Transactions on Automatic Control, Vol. 53, No. 11, December 2008, pp. 2642-2645.

  26. T. Bortfeld, T. C. Y. Chan, A. Trofimov, and J. N. Tsitsiklis, "Robust Management of Motion Uncertainty in Intensity-Modulated Radiation Therapy", Operations Research, Vol. 56, No. 6, November-December 2008, pp. 1461-1473.

  27. A. Muharremoglu and J. N. Tsitsiklis, "A Single-Unit Decomposition Approach to Multi-Echelon Inventory Systems", Operations Research, Vol. 56, No. 5, September-October 2008, pp. 1089-1103. Electronic companion (appendix).

  28. W. P. Tay, J. N. Tsitsiklis, and M. Z. Win, "On the Sub-exponential Decay of Detection Error Probabilities in Long Tandems", IEEE Transactions on Information Theory, Vol. 54, No. 10, October 2008, pp. 4767-4771.

  29. W. P. Tay, J. N. Tsitsiklis, and M. Z. Win, "Data Fusion Trees for Detection: Does Architecture Matter?", IEEE Transactions on Information Theory, Vol. 54, No. 9, September 2008, pp. 4155-4168.

  30. W. P. Tay, J. N. Tsitsiklis, and M. Z. Win, "On the Impact of Node Failures and Unreliable Communications in Dense Sensor Networks", IEEE Transactions on Signal processing, Vol. 56, No. 6, June 2008, pp. 2535-2546.

  31. W. P. Tay, J. N. Tsitsiklis, and M. Z. Win, "Asymptotic Performance of a Censoring Sensor Network ,'' IEEE Transactions on Information Theory, Vol. 53, No. 11, pp. 4191-4209, November 2007.

  32. J. Sethuraman and J. N. Tsitsiklis, "Stochastic Search in a Forest Revisited," Mathematics of Operations Research, Vol. 32, No. 3, August 2007, pp. 589-593.

  33. D. P. Bertsekas and J. N. Tsitsiklis, "Comment on `Coordination of Groups of Mobile Autonomous Agents Using Nearest Neighbor Rules'," IEEE Transactions on Automatic Control, Vol. 52, No. 5, May 2007, pp. 968-969.

  34. J. N. Tsitsiklis, "NP-Hardness of Checking the Unichain Condition in Average Cost MDPs," Operations Research Letters, Vol. 35, No. 3, May 2007, pp. 319-323.

  35. A. Ganti, E. Modiano, and J. N. Tsitsiklis, "Optimal Transmission Scheduling in Symmetric Communication Models with Intermittent Connectivity," IEEE Transactions on Information Theory, Vol. 5, No. 3, March 2007, pp. 998-1008.

  36. S. Mannor, D. I. Simester, P. Sun, and J. N. Tsitsiklis, "Bias and Variance Approximation in Value Function Estimates," Management Science, Vol. 53, No. 2, February 2007, pp. 308-322; Appendix.

  37. R. Johari, S. Mannor, and J. N. Tsitsiklis, "A Contract-Based Model for Directed Network Formation," Games and Economic Behavior, Vol. 56, 2006, pp. 201-224.

  38. R. Johari and J. N. Tsitsiklis, "A Scalable Network Resource Allocation Mechanism with Bounded Efficiency Loss", IEEE JSAC Special issue: Price-Based Access Control and Economics for Communication Networks, Vol. 24, No. 5, May 2006, pp. 992-999; Expanded version: "Efficiency Loss in Cournot Games," technical report LIDS-P-2639, Laboratory for Information and Decision Systems, MIT, January 2005.

  39. D. I. Simester, P. Sun, and J. N. Tsitsiklis, "Dynamic Catalog Mailing Policies," Management Science, Vol. 52, No. 5, May 2006, pp. 683-696.

  40. T. C. Y. Chan, T. Bortfeld, and J. N. Tsitsiklis, "A Robust Approach to IMRT Optimization," Physics in Medicine and Biology, Vol. 51, 2006, pp. 2567-2583.

  41. A. Fu, E. Modiano, and J. N. Tsitsiklis, "Optimal Transmission Scheduling over a Fading Channel with Energy and Deadline Constraints," IEEE Transactions on Wireless Communications, Vol. 5, No. 3, March 2006, pp. 630-641.

  42. R. Johari, S. Mannor, and J. N. Tsitsiklis, "Efficiency Loss in a Network Resource Allocation Game: The Case of Elastic Supply," IEEE Transactions on Automatic Control, Vol. 50, No. 11, November 2005, pp. 1712-1724; expanded version, technical report LIDS-P-2605, June 2004.

  43. S. Mannor and J. N. Tsitsiklis, "On the Empirical State-Action Frequencies in Markov Decision Processes Under General Policies", Mathematics of Operations Research, Vol. 30, No. 3, August 2005, pp. 545-561.

  44. R. Johari and J. N. Tsitsiklis, "Efficiency Loss in a Network Resource Allocation Game,", Mathematics of Operations Research, Vol. 29, No. 3, August 2004, pp. 407-435.

  45. S. Mannor and J. N. Tsitsiklis, "The Sample Complexity of Exploration in the Multi-Armed Bandit Problem," Journal of Machine Learning Research, Vol. 5, June 2004, pp. 623-648.

  46. V. R. Konda and J. N. Tsitsiklis, "Convergence Rate of Linear Two-Time Scale Stochastic Approximation", Annals of Applied Probability, Vol. 14, No. 2, 2004, pp. 796-819.

  47. V. R. Konda and J. N. Tsitsiklis, "Actor-Critic Algorithms" , SIAM Journal on Control and Optimization, Vol. 42, No. 4, 2003, pp. 1143-1166. Appendix

  48. A. Fu, E. Modiano, and J. N. Tsitsiklis, "Optimal Energy Allocation and Admission Control for Communications Satellites" IEEE/ACM Transactions on Networking, Vol. 11, No. 3, June 2003, pp. 488-500.

  49. V. R. Konda and J. N. Tsitsiklis, "Linear Stochastic Approximation Driven by Slowly Varying Markov Chains", Systems and Control Letters, Vol. 50, No. 2, 2003, pp. 95-102.

  50. P. Marbach and J. N. Tsitsiklis, "Approximate Gradient Methods in Policy-Space Optimization of Markov Reward Processes", Journal of Discrete Event Dynamical Systems, Vol. 13, pp. 111-148, 2003. (preliminary version: "Simulation-based optimization of Markov reward processes: implementation issues," in Proceedings of the 38th IEEE Conference on Decision and Control, December 1999, pp. 1769-1774.)

  51. N. Agarwal, J. Basch, P. Beckmann, P. Bharti, S. Bloebaum, S. Casadei, A. Chou, P. Enge, W. Fong, N. Hathi, W. Mann, A. Sahai, J. Stone, J. Tsitsiklis, and B. Van Roy, "Algorithms for GPS Operation Indoors and Downtown," GPS Solutions, Vol. 6, No. 3, pp. 149-160, December 2002.

  52. J. N. Tsitsiklis, "On the Convergence of Optimistic Policy Iteration", Journal of Machine Learning Research, Vol. 3, July 2002, pp. 59-72.

  53. J. N. Tsitsiklis and B. Van Roy, "On Average Versus Discounted Reward Temporal-Difference Learning" , Machine Learning, Vol. 49, No. 2, pp. 179-191, November 2002.

  54. D. Bertsimas, D. Gamarnik, and J. N. Tsitsiklis, "Performance of Multiclass Markovian Queueing Networks via Piecewise Linear Lyapunov Functions", Annals of Applied Probability, Vol. 11, No. 4, pp. 1384-1428, 2001.

  55. J. N. Tsitsiklis and B. Van Roy, "Regression Methods for Pricing Complex American-Style Options," IEEE Trans. on Neural Networks, Vol. 12, No. 4, July 2001, pp. 694-703.

  56. V. D. Blondel, O. Bournez, P. Koiran, and J. N. Tsitsiklis, "The stability of saturated linear systems is undecidable,", Journal of Computer Systems Science, Journal of Computer and System Sciences, Vol. 62, pp. 442-462, 2001.

  57. V. D. Blondel, O. Bournez, P. Koiran, C. H. Papadimitriou, and J. N. Tsitsiklis, "Deciding stability and mortality of piecewise affine systems", Theoretical Computer Science, Vol. 255, No. 1-2, pp. 687-696, 2001.

  58. P. Marbach and J. N. Tsitsiklis, "Simulation-Based Optimization of Markov Reward Processes", IEEE Transactions on Automatic Control, Vol. 46, No. 2, pp. 191-209, February 2001.

  59. V. D. Blondel, S. Gaubert, and J. N. Tsitsiklis, "Approximating the spectral radius of sets of matrices in the max-algebra is NP-hard, IEEE Transactions on Automatic Control, Vol. 45, No. 9, pp. 1762-1765, September 2000.

  60. V. D. Blondel and J. N. Tsitsiklis, "The boundedness of all products of a pair of matrices is undecidable", Systems and Control Letters, Vol. 41, No. 2, pp. 135-140, 2000.

  61. V. D. Blondel and J. N. Tsitsiklis, "A Survey of Computational Complexity Results in Systems and Control", Automatica, Vol. 36, No. 9, pp. 1249-1274, September 2000.

  62. D. P. Bertsekas and J. N. Tsitsiklis, "Gradient Convergence in Gradient Methods with Errors," SIAM Journal in Optimization, Vol. 10, No. 3, 2000, pp. 627-642.

  63. I. C. Paschalidis and J. N. Tsitsiklis, "Congestion-Dependent Pricing of Network Services", IEEE/ACM Transactions on Networking, Vol. 8, No. 2, April 2000, pp. 171-184.

  64. P. Marbach, O. Mihatsch, and J. N. Tsitsiklis, "Call Admission Control and Routing in Integrated Service Networks Using Neuro-Dynamic Programming," IEEE Journal on Selected Areas in Communications, Vol. 18, No. 2, February 2000, pp. 197-208.

  65. D. Bertsimas, I. C. Paschalidis, and J. N. Tsitsiklis, "Large Deviations Analysis of the Generalized Processor Sharing Policy", Queueing Systems, Vol. 32, 1999, pp. 319-349.

  66. J. N. Tsitsiklis, and B. Van Roy, "Average Cost Temporal-Difference Learning", Automatica, Vol. 35, No. 11, November 1999, pp. 1799-1808.

  67. J. N. Tsitsiklis and B. Van Roy, "Optimal Stopping of Markov Processes: Hilbert Space Theory, Approximation Algorithms, and an Application to Pricing Financial Derivatives", IEEE Transactions on Automatic Control, Vol. 44, No. 10, October 1999, pp. 1840-1851.

  68. D. Bertsimas, D. Gamarnik, and J. N. Tsitsiklis, "Estimation of Time-Varying Parameters in Statistical Models; an Optimization Approach," Machine Learning,, Vol. 35, No. 3, 1999, pp. 225-245.

  69. C. H. Papadimitriou and J. N. Tsitsiklis, "The Complexity of Optimal Queueing Network Control", Mathematics of Operations Research, Vol. 24, No. 2, May 1999, pp. 293-305.

  70. V. D. Blondel, and J. N. Tsitsiklis, "Complexity of Stability and Controllability of Elementary Hybrid Systems", Automatica, Vol. 35, No. 3, March 1999.

  71. D. Bertsimas, I. C. Paschalidis, and J. N. Tsitsiklis, "On the Large Deviations Behavior of Acyclic Networks of G/G/1 Queues", Annals of Applied Probability , Vol. 8, No. 4, November 1998, pp. 1027-1069.

  72. D. Bertsimas, I. C. Paschalidis, and J. N. Tsitsiklis, Asymptotic Buffer Overflow Probabilities in Multiclass Multiplexers: An Optimal Control Approach", IEEE Transactions on Automatic Control. Vol. 43, No. 3, March 1988, pp. 315-335.

  73. L. C. Polymenakos, D. P. Bertsekas, and J. N. Tsitsiklis, "Implementation of Efficient Algorithms for Globally Optimal Trajectories", IEEE Transactions on Automatic Control, Vol. 43, No. 2, February 1998, pp. 278-283.

  74. V. Blondel and J. N. Tsitsiklis, "NP-hardness of some linear control design problems", SIAM J. on Control and Optimization , Vol. 35, No. 6, November 1997, pp. 2118-2127.

  75. D. P. Bertsekas, J. N. Tsitsiklis, and C. Wu, "Rollout Algorithms for Combinatorial Optimization", Journal of Heuristics, Vol. 3, 1997, pp. 245-262.

  76. V. D. Blondel and J. N. Tsitsiklis, "When is a Pair of Matrices Mortal?", Information Processing Letters , Vol. 63, No. 5, 1997, pp. 283-286.

  77. J. N. Tsitsiklis and V. D. Blondel, "The Lyapunov exponent and joint spectral radius of pairs of matrices are hard - when not impossible - to compute and to approximate", Mathematics of Control, Signals and Systems, Vol. 10, No. 1, 1997, pp. 31-40; correction in Vol. 10, No. 4, p. 381.

  78. J. N. Tsitsiklis and B. Van Roy, "An Analysis of Temporal-Difference Learning with Function Approximation", IEEE Transactions on Automatic Control, Vol. 42, No. 5, May 1997, pp. 674-690.

  79. D. Bertsimas, D. Gamarnik, J. N. Tsitsiklis, "Stability Conditions for Multiclass Fluid Queueing Networks", IEEE Transactions on Automatic Control, Vol. 41, No. 11, November 1996, pp. 1618-1631.

  80. G. H. Polychronopoulos and J. N. Tsitsiklis, "Stochastic Shortest Path Problems with Recourse", Networks, Vol. 27, No. 2, 1996, pp. 133-143.

  81. J. N. Tsitsiklis and B. Van Roy, Feature-Based Methods for Large Scale Dynamic Programming", Machine Learning, Vol. 22, 1996, pp. 59-94.

  82. D. Bertsimas, I. Paschalidis and J. N. Tsitsiklis, "Branching Bandits and Klimov's Problem: Achievable Region and Side Constraints" , IEEE Transactions on Automatic Control, Vol. 40, No. 12, December 1995, pp. 2063-2075.

  83. J. N. Tsitsiklis, "Efficient Algorithms for Globally Optimal Trajectories", IEEE Transactions on Automatic Control, Vol. 40, No. 9, September 1995, pp. 1528-1538.

  84. J. N. Tsitsiklis and G. D. Stamoulis, "On the Average Communication Complexity of Asynchronous Distributed Algorithms", Journal of the ACM, Vol. 42, No. 2, March 1995, pp. 382-400.

  85. D. N. C. Tse, R. G. Gallager, and J. N. Tsitsiklis, "Statistical Multiplexing of Multiple Time-Scale Markov Streams", IEEE Journal on Selected Areas in Communications, Vol. 13, No. 6, August 1995, pp. 1028-1038.

  86. M. A. Dahleh, E. D. Sontag, D. N. C. Tse, and J. N. Tsitsiklis, "Worst-Case Identification of Nonlinear Fading Memory Systems", Automatica, Vol. 31, No. 3, March 1995, pp. 503-508.

  87. G. D. Stamoulis and J. N. Tsitsiklis, "The Efficiency of Greedy Routing in Hypercubes and Butterflies", IEEE Transactions on Communications, Vol. 42, No. 11, November 1994, pp. 3051-3061.

  88. Z.-Q. Luo and J. N. Tsitsiklis, "Data Fusion with Minimal Communication", IEEE Transactions on Information Theory, Vol. 40, No. 5, September 1994, pp. 1551-1563.

  89. J. N. Tsitsiklis, "Asynchronous Stochastic Approximation and Q-learning", Machine Learning, 16, 1994, pp. 185-202. Correction.

  90. S. R. Kulkarni, S. K. Mitter, T. J. Richardson, and J. N. Tsitsiklis, "Local versus Non-Local Computation of Length of Digitized Curves", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 16, No. 7, July 1994.

  91. W. W. Irving and J. N. Tsitsiklis, "Some Properties of Optimal Thresholds in Decentralized Detection", IEEE Transactions on Automatic Control, Vol. 39, No. 4, April 1994, pp. 835-838.

  92. D. Bertsimas, I. C. Paschalidis, and J. N. Tsitsiklis, "Optimization of Multiclass Queueing Networks: Polyhedral and Nonlinear Characterizations of Achievable Performance", Annals of Applied Probability, Vol. 4, No. 1, 1994, pp. 43-75.

  93. J. N. Tsitsiklis, "A Short Proof of the Gittins Index Theorem", Annals of Applied Probability, Vol. 4, No. 1, 1994, pp. 194-199.

  94. Z.-Q. Luo and J. N. Tsitsiklis, "On the Communication Complexity of Distributed Algebraic Computation", Journal of the ACM, Vol. 40, No. 5, pp. 1019-1047, November 1993.

  95. S. R. Kulkarni, S. K. Mitter, J. N. Tsitsiklis, and O. Zeitouni, "PAC Learning with Generalized Samples and an Application to Stochastic Geometry", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 15, No. 9, September 1993.

  96. D. Bertsimas and J. N. Tsitsiklis, "Simulated Annealing", Statistical Science, Vol. 8, No. 1, 1993, pp. 10-15.

  97. G. D. Stamoulis and J. N. Tsitsiklis, "Efficient Routing Schemes for Multiple Broadcasts in Hypercubes", IEEE Transactions on Parallel and Distributed Systems, Vol. 4, No. 7, July 1993, pp. 725-739.

  98. D. N. C. Tse, M. A. Dahleh, J. N. Tsitsiklis, "Optimal Asymptotic Identification under Bounded Disturbances", IEEE Transactions on Automatic Control, Vol. AC-38, No. 8, 1993, pp. 1176-1190.

  99. G. D. Stamoulis and J. N. Tsitsiklis, "An Efficient Algorithm for Multiple Simultaneous Broadcasts in the Hypercube", Information Processing Letters, Vol. 46, 1993, pp. 219-224.

  100. J. N. Tsitsiklis, "Extremal Properties of Likelihood-Ratio Quantizers", IEEE Transactions on Communications, Vol. 41, No. 4, 1993, pp. 550-558.

  101. S. R. Kulkarni, S. K. Mitter and J. N. Tsitsiklis, "Active Learning Using Arbitrary Binary Valued Queries", Machine Learning, Vol. 11, 1993, pp. 23-35.

  102. M. A. Dahleh, T. Theodosopoulos, and J. N. Tsitsiklis, "The Sample Complexity of Worst-Case Identification of F.I.R. Linear Systems", Systems and Control Letters, Vol. 20, 1993, pp. 157-166.

  103. H. N. Psaraftis and J. N. Tsitsiklis, "Dynamic Shortest Paths in Acyclic Networks with Markovian Arc Costs", Operations Research, Vol. 41, 1, 1993, pp. 91-101.

  104. J. N. Tsitsiklis, "Special Cases of Traveling Salesman and Repairman Problems with Time Windows", Networks., Vol. 22,No. 3, 1992, pp. 263-282.

  105. S. Buss, C. H. Papadimitriou, and J. N. Tsitsiklis, "On the Predictability of Coupled Automata: an Allegory about Chaos", Complex Systems, Vol. 5, No. 5, 1991, pp. 525-539.

  106. Z.-Q. Luo and J. N. Tsitsiklis, "On the Communication Complexity of Solving a Polynomial Equation", SIAM J. on Computing, Vol. 20, No. 5, October 1991, pp. 936-950.

  107. D. P. Bertsekas and J. N. Tsitsiklis, "An Analysis of Stochastic Shortest Path Problems", Mathematics of Operations Research, Vol. 16, No. 3, August 1991, pp. 580-595.

  108. C.-S. Chow and J. N. Tsitsiklis, "An Optimal One-Way Multigrid Algorithm for Discrete-Time Stochastic Control", IEEE Transactions on Automatic Control, Vol. AC-36, No. 8, 1991, pp. 898-914.

  109. N. Pippenger, G. D. Stamoulis, and J. N. Tsitsiklis, "On a Lower Bound for the Redundancy of Reliable Networks with Noisy Gates", IEEE Transactions on Information Theory, Vol. IT-37, May 1991, pp. 639-643.

  110. D. P. Bertsekas, C. Ozveren, G. D. Stamoulis, P. Tseng, and J. N. Tsitsiklis, "Optimal Communication Algorithms for Hypercubes" Journal of Parallel and Distributed Computing, Vol. 11, 1991, pp. 263-275.

  111. D. P. Bertsekas and J. N. Tsitsiklis, "Some Aspects of Parallel and Distributed Iterative Algorithms - A Survey", Automatica, Vol. 27, No. 1, 1991, pp. 3-21.

  112. G. D. Stamoulis and J. N. Tsitsiklis, "On the Settling Time of the Congested GI/G/1 Queue", Advances in Applied Probability, Vol. 22, 1990, pp. 929-956.

  113. P. Tseng, D. P. Bertsekas, and J. N. Tsitsiklis, "Partially Asynchronous, Parallel Algorithms for Network Flow and other Problems", SIAM Journal on Control and Optimization, Vol. 28, No. 3, May 1990, pp. 678-710.

  114. G. Polychronopoulos and J. N. Tsitsiklis, "Explicit Solutions for some Simple Decentralized Detection Problems", IEEE Transactions on Aerospace and Electronic Systems, Vol. 26, 1990, pp. 282-291.

  115. C.-S. Chow and J. N. Tsitsiklis, "The Complexity of Dynamic Programming", Journal of Complexity, Vol. 5, No. 4, 1989, pp. 466-488. (errata)

  116. J. N. Tsitsiklis, "A Comparison of Jacobi and Gauss-Seidel Parallel Iterations", Applied Mathematics Letters, Vol. 2, No. 2, 1989, pp. 167-170.

  117. J. N. Tsitsiklis, "On the Use of Random Numbers in Asynchronous Simulation via Rollback", Information Processing Letters, Vol. 31, 1989, pp. 139-144.

  118. J. N. Tsitsiklis, "On the Control of Discrete Event Dynamical Systems", Mathematics of Control, Signals and Systems, Vol. 2, No. 2, 1989, pp. 95-107.

  119. J. N. Tsitsiklis, "Markov Chains with Rare Transitions and Simulated Annealing", Mathematics of Operations Research, Vol. 14, No. 1, 1989, pp. 70-90.

  120. D. E. Knuth, C. H. Papadimitriou, J. N. Tsitsiklis, "A Note on Strategy Elimination in Bimatrix Games", Operations Research Letters, Vol. 7, No. 3, 1988, pp. 103-107.

  121. J. N. Tsitsiklis, "Decentralized Detection by a Large Number of Sensors", Mathematics of Control, Signals and Systems, Vol. 1, No. 2, 1988, pp. 167-182.

  122. J. N. Tsitsiklis, "On the Stability of Asynchronous Iterative Processes", Mathematical Systems Theory, Vol. 20, No. 2-3, 1987, pp. 137-153.

  123. J. N. Tsitsiklis and Z.-Q. Luo, "Communication Complexity of Convex Optimization", Journal of Complexity, Vol. 3, No. 3, 1987, pp. 231-243.

  124. J. N. Tsitsiklis, "Analysis of a Multiaccess Control Scheme", IEEE Transactions on Automatic Control, Vol. 32, No. 11, 1987, pp. 1017-1020.

  125. C. H. Papadimitriou and J. N. Tsitsiklis, "The Complexity of Markov Decision Processses", Mathematics of Operations Research, Vol. 12, No. 3, 1987, pp. 441-450.

  126. C. H. Papadimitriou and J. N. Tsitsiklis, "Stochastic Scheduling with In-Tree Precedence Constraints", SIAM Journal on Computing, Vol. 16, No. 1, 1987, pp. 1-6.

  127. J. N. Tsitsiklis, D. P. Bertsekas and M. Athans, "Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms," IEEE Transactions on Automatic Control, Vol. 31, No. 9, 1986, pp. 803-812.

  128. J. N. Tsitsiklis, C. H. Papadimitriou and P. Humblet, "The Performance of a Precedence-Based Queueing Discipline", Journal of the ACM, Vol. 33, No. 3, 1986, pp. 593-602.

  129. C. H. Papadimitriou and J. N. Tsitsiklis, "Intractable Problems in Control Theory", SIAM Journal on Control and Optimization, Vol. 24, No. 4, 1986, pp. 639-654.

  130. J. N. Tsitsiklis, "A Lemma on the Multi-Armed Bandit Problem", IEEE Transactions on Automatic Control, Vol. 31, No. 6, 1986, pp. 576-577.

  131. J. N. Tsitsiklis and D. P. Bertsekas, "Distributed Asynchronous Optimal Routing in Data Networks", IEEE Transactions on Automatic Control, Vol. 31, No. 4, 1986, pp. 325-332.

  132. B. C. Levy and J. N. Tsitsiklis, "A Fast Algorithm for the Linear Estimation of Two-Dimensional Isotropic Random Fields", IEEE Transactions on Information Theory, Vol. 31, No. 5, 1985, pp. 635-644.

  133. J. N. Tsitsiklis and M. Athans, "On the Complexity of Decentralized Decision Making and Detection Problems", IEEE Transactions on Automatic Control, Vol. 30, No.5, 1985, pp. 440-446.

  134. J. N. Tsitsiklis, "Periodic Review Inventory Systems with Continuous Demand and Discrete Order Sizes", Management Science, Vol. 30, No. 10, 1984, pp. 1250-1254.

  135. C. H. Papadimitriou and J. N. Tsitsiklis, "A Simple Criterion for Structurally Fixed Modes", Systems and Control Letters, Vol. 4, 1984, pp. 333-337.

  136. J. N. Tsitsiklis, "Convexity and Characterization of Optimal Policies in a Dynamic Routing Problem", Journal of Optimization Theory and Applications, Vol. 44, No. 1, 1984, pp. 105-136.

  137. J. N. Tsitsiklis and M. Athans, "Guaranteed Robustness Properties of Multivariable Nonlinear Stochastic Optimal Regulators", IEEE Transactions on Automatic Control, Vol. 29, No. 8, 1984, pp. 690-696.

  138. J. N. Tsitsiklis and M. Athans, "Convergence and Asymptotic Agreement in Distributed Decision Problems", IEEE Transactions on Automatic Control, Vol. 29, No. 1, 1984, pp. 42-50.

  139. C. H. Papadimitriou and J. N. Tsitsiklis, "On the Complexity of Designing Distributed Protocols", Information and Control, Vol. 53, No. 3, 1982, pp. 211-218.

  140. J. N. Tsitsiklis, "Conditions for Finiteness of a Constructive Algorithm for Determining Stability", IEEE Transactions on Circuits and Systems, Vol. 29, No. 6, 1982, pp. 400-402.

Theses

  1. J. N. Tsitsiklis, "Linear Optimization Problems with Dynamical Structure", B.Sc. Thesis, Department of EECS, MIT, January 1980.

  2. J. N. Tsitsiklis, "Optimal Dynamic Routing in an Unreliable Manufacturing System", M.Sc. Thesis, Department of EECS, MIT, February 1981; technical report LIDS-TH-1069, Laboratory for Information and Decision Systems, MIT.

  3. J. N. Tsitsiklis, "Problems in Decentralized Decision Making and Computation," Ph.D. Thesis, Department of EECS, MIT, November 1984; technical report LIDS-TH-1424, Laboratory for Information and Decision Systems, MIT.

Selected non-journal publications

  1. W. P. Tay and J. N. Tsitsiklis, "The Value of Feedback for Decentralized Detection in Large Sensor Networks", Proceedings of the IEEE International Symposium on Wireless Pervasive Computing (ISWPC 2011), Hong Kong, China, February 2011.

  2. D. Shah, J. N. Tsitsiklis, and Y. Zhong, Qualitative Properties of alpha-Weighted Scheduling Policies, Proceedings of the ACM Sigmetrics 2010, New York, NY, June 2010.

  3. F. Benezit, V. Blondel, P. Thiran, J. Tsitsiklis, and M. Vetterli, "Weighted Gossip: Distributed Averaging Using Non-Doubly Stochastic Matrices," 2010 IEEE International Symposium on Information Theory, Austin, Texas, June 2010.

  4. M. G. Markakis, E. M. Modiano, and J. N. Tsitsiklis, "Scheduling policies for single-hop networks with heavy-tailed traffic," Proceedings of the Forty-Seventh Annual Allerton Conference on Communication, Control, and Computing, Monticello, Illinois, September 2009.

  5. A. Nedic, A. Olshevsky, A. Ozdaglar, and J. N. Tsitsiklis, "Distributed Subgradient Methods and Quantization Effects," Proceedings of the 47th IEEE Conference on Decision and Control, Cancun, Mexico, December 2008.

  6. N. Sabbaghi, Y. Sheffi, and J. N. Tsitsiklis, "Coordination capability of linear wholesale price contracts ", technical report LIDS-P-2749, Laboratory for Information and Decision Systems, MIT, February 2007.

  7. V. D. Blondel, J. M. Hendrickx, A. Olshevsky, and J. N. Tsitsiklis, "Convergence in Multiagent Coordination, Consensus, and Flocking," in Proceedings of the Joint 44th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC'05), Seville, Spain, December 2005. [corrected version]

  8. R. Johari and J. N. Tsitsiklis, "Routing and Peering in a Competitive Internet", technical report LIDS-P-2570, January 2003; condensed version in Proceedings of the 2004 IEEE Conference on Decision and Control, Bahamas, December 2004.

  9. A. Muharremoglu and J. N. Tsitsiklis, "Dynamic Leadtime Management in Supply Chains," unpublished manuscript, June 2003.

  10. V. D. Blondel and J. N. Tsitsiklis, "Three Problems on the Decidability and Complexity of Stability," in Open Problems in Mathematical Systems and Control Theory, V.D. Blondel, E.D. Sontag, M. Vidyasagar, J.C. Willems (editors), Springer Verlag, Heidelberg, 1998.

  11. V. D. Blondel and J. N. Tsitsiklis, "Overview of complexity and decidability results for three classes of elementary nonlinear systems", in Learning, Control and Hybrid Systems, Y. Yamamoto and S. Hara (Eds), Springer Verlag, Heidelberg, 1998, 46-58.

  12. D. Bertsimas, D. Gamarnik, and J. N. Tsitsiklis, "Geometric Bounds for Stationary Distributions of Infinite Markov Chains Via Lyapunov Functions," technical report LIDS-P-2426, September 1998.

  13. P. Marbach, and J. N. Tsitsiklis, "A Neuro-Dynamic Programming Approach to Call Admission Control in Integrated Service Networks: The Single Link Case," Technical Report LIDS-P-2402, Laboratory for Information and Decision Systems, M.I.T., November 1997. Short version in Proceedings of the 2003 IEEE Conference on Decision and Control, Maui, Hawaii, December 2003.

  14. B. Van Roy, D. P. Bertsekas, Y. Lee, and J. N. Tsitsiklis, "A Neuro-Dynamic Programming Approach to Retailer Inventory Management", November 1996. Short version in Proceedings of the 36th IEEE Conference on Decision and Control, San Diego, California, December 1997, pp. 4052-4057.

  15. C. E. Padilla, V. I. Karlov, J. N. Tsitsiklis, R. D. Reasenberg, H. M. Chun, "Problem of Fringe Acquisition in High-Precision Space-Based Interferometers", SPIE Conference # 2477 on Spaceborne Interferometry II, Orlando, Florida, April 1995, p. 47.

  16. C. E. Padilla, V. I. Karlov, J. N. Tsitsiklis, R. D. Reasenberg, H. M. Chun, "A Study of Fringe Tracking for High-Precision Space-Based Interferometers", SPIE Conference # 2477 on Spaceborne Interferometry II, Orlando, Florida, April 1995, p. 63.

  17. G. D. Stamoulis and J. N. Tsitsiklis, "Optimal Distributed Policies for Choosing Among Multiple Servers", Proceedings of the 30th IEEE Conference on Decision and Control, Brighton, England, December 1991, pp. 815-820.

  18. D. P. Bertsekas and J. N. Tsitsiklis, "Convergence Rate and Termination of Asynchronous Iterative Algorithms", in Proceedings of the 1989 International Conference on Supercomputing, Irakleion, Greece, June 1989, pp. 461-470.

  19. Z.-Q. Luo and J. N. Tsitsiklis, "Lower Bounds on the Time to Compute a Simple Boolean Function on a Parallel Random Access Machine," Technical Report LIDS-P-1616, Laboratory for Information and Decision Systems, M.I.T., October 1986.

  20. J. N. Tsitsiklis and B. C. Levy, "Integral Equations and Resolvents of Toeplitz plus Hankel Kernels", Technical Report LIDS-P-1170, Laboratory for Information and Decision Systems, M.I.T., December 1981.

  21. B. C. Levy and J. N. Tsitsiklis, "Linear Estimation of Stationary Stochastic Processes, Vibrating Strings, and Inverse Scattering", Technical Report LIDS-P-1155, Laboratory for Information and Decision Systems, M.I.T., November 1982.