Kohlhoff, KJ, Shukla, D, Lawrenz, M, Bowman, GR, Konerding, DE, Belov, D, Altman, RB, Pande, VS. Cloud‐based simulations on Google Exacycle reveal ligand modulation of GPCR activation pathways. Nat Chem 2014, 6:15–21.

Da, L‐T, Pardo‐Avila, F, Xu, L, Silva, D‐A, Zhang, L, Gao, X, Wang, D, Huang, X. Bridge helix bending promotes RNA polymerase II backtracking through a critical and conserved threonine residue. Nat Commun 2016, 7:ncomms11244.

Jiang, H, Sheong, FK, Zhu, L, Gao, X, Bernauer, J, Huang, X. Markov state models reveal a two‐step mechanism of miRNA loading into the human Argonaute protein: selective binding followed by structural re‐arrangement. PLoS Comput Biol 2015, 11:e1004404.

Shukla, D, Meng, Y, Roux, B, Pande, VS. Activation pathway of Src kinase reveals intermediate states as targets for drug design. Nat Commun 2014, 5:ncomms4397.

Bowman, GR, Bolin, ER, Hart, KM, Maguire, BC, Marqusee, S. Discovery of multiple hidden allosteric sites by combining Markov state models and experiments. Proc Natl Acad Sci USA 2015, 112:2734–2739.

Wagner, JR, Lee, CT, Durrant, JD, Malmstrom, RD, Feher, VA, Amaro, RE. Emerging computational methods for the rational discovery of allosteric drugs. Chem Rev 2016, 116:6370–6390.

Kendrew, JC, Bodo, G, Dintzis, HM, Parrish, RG, Wyckoff, H, Phillips, DC. A three‐dimensional model of the myoglobin molecule obtained by x‐ray analysis. Nature 1958, 181:662–666.

Wüthrich, K. Protein structure determination in solution by NMR spectroscopy. J Biol Chem 1990, 265:22059–22062.

Nogales, E, Scheres, SHW. Cryo‐EM: a unique tool for the visualization of macromolecular complexity. Mol Cell 2015, 58:677–689.

Callender, R, Dyer, RB. Probing protein dynamics using temperature jump relaxation spectroscopy. Curr Opin Struct Biol 2002, 12:628–633.

Clore, GM, Tang, C, Iwahara, J. Elucidating transient macromolecular interactions using paramagnetic relaxation enhancement. Curr Opin Struct Biol 2007, 17:603–616.

Ha, T, Ting, AY, Liang, J, Caldwell, WB, Deniz, AA, Chemla, DS, Schultz, PG, Weiss, S. Single‐molecule fluorescence spectroscopy of enzyme conformational dynamics and cleavage mechanism. Proc Natl Acad Sci USA 1999, 96:893–898.

Shaw, DE, Deneroff, MM, Dror, RO, Kuskin, JS, Larson, RH, Salmon, JK, Young, C, Batson, B, Bowers, KJ, Chao, JC, et al. Anton, a special‐purpose machine for molecular dynamics simulation. Commun ACM 2008, 51:91–97.

Eastman, P, Friedrichs, MS, Chodera, JD, Radmer, RJ, Bruns, CM, Ku, JP, Beauchamp, KA, Lane, TJ, Wang, L‐P, Shukla, D, et al. OpenMM 4: a reusable, extensible, hardware independent library for high performance molecular simulation. J Chem Theory Comput 2013, 9:461–469.

Salomon‐Ferrer, R, Götz, AW, Poole, D, Le Grand, S, Walker, RC. Routine microsecond molecular dynamics simulations with AMBER on GPUs. 2. Explicit solvent particle mesh Ewald. J Chem Theory Comput. 2013, 9:3878–3888.

Fitch, BG, Germain, RS, Mendell, M, Pitera, J, Pitman, M, Rayshubskiy, A, Sham, Y, Suits, F, Swope, W, Ward, TJC, et al. Blue matter, an application framework for molecular simulation on blue gene. J Parallel Distrib Comput 2003, 63:759–773.

Maximova, T, Moffatt, R, Ma, B, Nussinov, R, Shehu, A. Principles and overview of sampling methods for modeling macromolecular structure and dynamics. PLoS Comput Biol 2016, 12:e1004619.

Mitsutake, A, Sugita, Y, Okamoto, Y. Generalized‐ensemble algorithms for molecular simulations of biopolymers. Biopolym‐Pept Sci Sect 2001, 60:96–123.

Zheng, L, Chen, M, Yang, W. Random walk in orthogonal space to achieve efficient free‐energy simulation of complex systems. Proc Natl Acad Sci USA 2008, 105:20227–20232.

Gao, YQ. An integrate‐over‐temperature approach for enhanced sampling. J Chem Phys 2008, 128:64105.

Zhang, BW, Dai, W, Gallicchio, E, He, P, Xia, J, Tan, Z, Levy, RM. Simulating replica exchange: Markov state models, proposal schemes, and the infinite swapping limit. J Phys Chem B 2016, 120:8289–8301.

Barducci, A, Bonomi, M, Parrinello, M. Metadynamics. Wiley Interdiscip Rev Comput Mol Sci 2011, 1:826–843.

Bolhuis, PG, Chandler, D, Dellago, C, Geissler, PL. Transition path sampling: throwing ropes over Rough Mountain passes, in the dark. Annu Rev Phys Chem 2002, 53:291–318.

Bello‐Rivas, JM, Elber, R. Exact milestoning. J Chem Phys 2015, 142:94102.

Hamelberg, D, Mongan, J, McCammon, JA. Accelerated molecular dynamics: a promising and efficient simulation method for biomolecules. J Chem Phys 2004, 120:11919–11929.

Bowman, GR, Pande, VS, Noé, F. An Introduction to Markov State Models and their Application to Long Timescale Molecular Simulation, vol. 797. Netherlands: Springer Science %26 Business Media; 2014.

Da, L‐T, Sheong, FK, Silva, D‐A, Huang, X. Application of Markov state models to simulate long timescale dynamics of biological macromolecules. In: Han, K, Zhang, X, Yang, M, eds. Protein Conformational Dynamics [Internet]. Advances in Experimental Medicine and Biology. Switzerland: Springer International Publishing; 2014, 29–66 Available at: http://link.springer.com/chapter/10.1007/978‐3‐319‐02970‐2_2. (Accessed June 25, 2017).

Prinz, J‐H, Wu, H, Sarich, M, Keller, B, Senne, M, Held, M, Chodera, JD, Schütte, C, Noé, F. Markov models of molecular kinetics: generation and validation. J Chem Phys 2011, 134:174105.

Noé, F, Schütte, C, Vanden‐Eijnden, E, Reich, L, Weikl, TR. Constructing the equilibrium ensemble of folding pathways from short off‐equilibrium simulations. Proc Natl Acad Sci USA 2009, 106:19011–19016.

Beauchamp, KA, McGibbon, R, Lin, Y‐S, Pande, VS. Simple few‐state models reveal hidden complexity in protein folding. Proc Natl Acad Sci USA 2012, 109:17807–17813.

Lane, TJ, Shukla, D, Beauchamp, KA, Pande, VS. To milliseconds and beyond: challenges in the simulation of protein folding. Curr Opin Struct Biol 2013, 23:58–65.

Voelz, VA, Jäger, M, Yao, S, Chen, Y, Zhu, L, Waldauer, SA, Bowman, GR, Friedrichs, M, Bakajin, O, Lapidus, LJ, et al. Slow unfolded‐state structuring in acyl‐CoA binding protein folding revealed by simulation and experiment. J Am Chem Soc 2012, 134:12565–12577.

Buchete, N‐V, Hummer, G. Coarse master equations for peptide folding dynamics. J Phys Chem B 2008, 112:6057–6069.

Da, L‐T, Avila, FP, Wang, D, Huang, X. A two‐state model for the dynamics of the pyrophosphate ion release in bacterial RNA polymerase. PLoS Comput Biol 2013, 9:e1003020.

Da, L‐T, E C, Duan, B, Zhang, C, Zhou, X, Yu, J. A jump‐from‐cavity pyrophosphate ion release assisted by a key lysine residue in T7 RNA polymerase transcription elongation. PLoS Comput Biol 2015, 11:e1004624.

Da, L‐T, Wang, D, Huang, X. Dynamics of pyrophosphate ion release and its coupled trigger loop motion from closed to open state in RNA polymerase II. J Am Chem Soc 2012, 134:2399–2406.

Silva, D‐A, Weiss, DR, Avila, FP, Da, L‐T, Levitt, M, Wang, D, Huang, X. Millisecond dynamics of RNA polymerase II translocation at atomic resolution. Proc Natl Acad Sci USA 2014, 111:7665–7670.

Weber, M, Bujotzek, A, Haag, R. Quantifying the rebinding effect in multivalent chemical ligand‐receptor systems. J Chem Phys 2012 Aug, 137:54111.

Plattner, N, Doerr, S, De Fabritiis, G, Noé, F. Complete protein–protein association kinetics in atomic detail revealed by molecular dynamics simulations and Markov modelling. Nat Chem 2017, 9:1005–1011.

Vanatta, DK, Shukla, D, Lawrenz, M, Pande, VS. A network of molecular switches controls the activation of the two‐component response regulator NtrC. Nat Commun 2015, 6:ncomms8283.

Silva, D‐A, Bowman, GR, Sosa‐Peinado, A, Huang, X. A role for both conformational selection and induced fit in ligand binding by the LAO protein. PLoS Comput Biol 2011, 7:e1002054.

Malmstrom, RD, Kornev, AP, Taylor, SS, Amaro, RE. Allostery through the computational microscope: cAMP activation of a canonical signalling domain. Nat Commun 2015 Jul, 6:ncomms8588.

Lawrenz, M, Shukla, D, Pande, VS. Cloud computing approaches for prediction of ligand binding poses and pathways. Sci Rep 2015, 5:srep07918.

Buch, I, Giorgino, T, Fabritiis, GD. Complete reconstruction of an enzyme‐inhibitor binding process by molecular dynamics simulations. Proc Natl Acad Sci USA 2011, 108:10184–10189.

Zhang, L, Jiang, H, Sheong, FK, Pardo‐Avila, F, Cheung, PP‐H, Huang, X. Constructing kinetic network models to elucidate mechanisms of functional conformational changes of enzymes and their recognition with ligands. Methods Enzymol 2016, 578:343–371.

Zhang, L, Pardo‐Avila, F, Unarta, IC, Cheung, PP‐H, Wang, G, Wang, D, Huang, X. Elucidation of the dynamics of transcription elongation by RNA polymerase II using kinetic network models. Acc Chem Res 2016, 49:687–694.

Zhu, L, Sheong, FK, Zeng, X, Huang, X. Elucidating conformational dynamics of multi‐body systems by constructing Markov state models. Phys Chem Chem Phys 2016, 18:30228–30235.

Schütte, C, Sarich, M. A critical appraisal of Markov state models. Eur Phys J Spec Top 2015, 224:2445–2462.

Shukla, D, Hernández, CX, Weber, JK, Pande, VS. Markov state models provide insights into dynamic modulation of protein function. Acc Chem Res 2015, 48:414–422.

Schwantes, CR, McGibbon, RT, Pande, VS. Perspective: Markov models for long‐timescale biomolecular dynamics. J Chem Phys 2014 Sep, 141:90901.

Chodera, JD, Noé, F. Markov state models of biomolecular conformational dynamics. Curr Opin Struct Biol 2014, 25:135–144.

Pande, VS, Beauchamp, K, Bowman, GR. Everything you wanted to know about Markov state models but were afraid to ask. Methods 2010, 52:99–105.

Zwanzig, R. Nonequilibrium Statistical Mechanics. Oxford, UK: Oxford University Press; 2001.

Zwanzig, R. From classical dynamics to continuous time random walks. J Stat Phys 1983, 30:255–262.

Mori, H. Transport, collective motion, and Brownian motion. Prog Theor Phys 1965, 33:423–455.

Zwanzig, R. Ensemble method in the theory of irreversibility. J Chem Phys 1960, 33:1338–1341.

Nüske, F, Keller, BG, Pérez‐Hernández, G, Mey, ASJS, Noé, F. Variational approach to molecular kinetics. J Chem Theory Comput. 2014, 10:1739–1752.

Husic, BE, McGibbon, RT, Sultan, MM, Pande, VS. Optimized parameter selection reveals trends in Markov state models for protein folding. J Chem Phys 2016, 145:194103.

McGibbon, RT, Pande, VS. Variational cross‐validation of slow dynamical modes in molecular kinetics. J Chem Phys 2015, 142:124105.

Schwantes, CR, Pande, VS. Improvements in Markov state model construction reveal many non‐native interactions in the folding of NTL9. J Chem Theory Comput. 2013, 9:2000–2009.

Pérez‐Hernández, G, Paul, F, Giorgino, T, De Fabritiis, G, Noé, F. Identification of slow molecular order parameters for Markov model construction. J Chem Phys 2013, 139:15102.

Naritomi, Y, Fuchigami, S. Slow dynamics of a protein backbone in molecular dynamics simulation revealed by time‐structure based independent component analysis. J Chem Phys 2013, 139:215102.

Schütte, C, Noé, F, Lu, J, Sarich, M, Vanden‐Eijnden, E. Markov state models based on milestoning. J Chem Phys 2011 May 24, 134:204105.

Harrigan, MP, Sultan, MM, Hernandez, CX, Husic, BE, Eastman, P, Schwantes, CR, Beauchamp, KA, McGibbon, RT, Pande, VS. MSMBuilder: statistical models for biomolecular dynamics. *bioRxiv* 2016;84020.

Beauchamp, KA, Bowman, GR, Lane, TJ, Maibaum, L, Haque, IS, Pande, VS. MSMBuilder2: modeling conformational dynamics on the picosecond to millisecond scale. J Chem Theory Comput. 2011, 7:3412–3419.

Bowman, GR, Huang, X, Pande, VS. Using generalized ensemble simulations and Markov state models to identify conformational states. Methods 2009, 49:197–201.

Scherer, MK, Trendelkamp‐Schroer, B, Paul, F, Pérez‐Hernández, G, Hoffmann, M, Plattner, N, Wehmeyer, C, Prinz, J‐H, Noé, F. PyEMMA 2: a software package for estimation, validation, and analysis of Markov models. J Chem Theory Comput 2015, 11:5525–5542.

Harvey, MJ, De Fabritiis, G. High‐throughput molecular dynamics: the powerful new tool for drug discovery. Drug Discov Today 2012, 17:1059–1062.

Liu, S, Zhu, L, Sheong, FK, Wang, W, Huang, X. Adaptive partitioning by local density‐peaks: an efficient density‐based clustering algorithm for analyzing molecular dynamics trajectories. J Comput Chem 2017, 38:152–160.

Frank, J. Three‐Dimensional Electron Microscopy of Macromolecular Assemblies: Visualization of Biological Molecules in Their Native State. Oxford, UK: Oxford University Press; 2006.

Rhee, YM, Pande, VS. Multiplexed‐replica exchange molecular dynamics method for protein folding simulation. Biophys J 2003, 84:775–786.

Sugita, Y, Okamoto, Y. Replica‐exchange molecular dynamics method for protein folding. Chem Phys Lett 1999, 314:141–151.

Weiss, DR, Levitt, M. Can morphing methods predict intermediate structures? J Mol Biol 2009, 385:665–674.

Isralewitz, B, Gao, M, Schulten, K. Steered molecular dynamics and mechanical functions of proteins. Curr Opin Struct Biol 2001, 11:224–230.

Schlitter, J, Engels, M, Krüger, P. Targeted molecular dynamics: a new approach for searching pathways of conformational transitions. J Mol Graph 1994, 12:84–89.

Chovancova, E, Pavelka, A, Benes, P, Strnad, O, Brezovsky, J, Kozlikova, B, Gora, A, Sustr, V, Klvana, M, Medek, P, et al. CAVER 3.0: a tool for the analysis of transport pathways in dynamic protein structures. PLOS Comput Biol 2012, 8:e1002708.

Zhang, L, Silva, D‐A, Pardo‐Avila, F, Wang, D, Huang, X. Structural model of RNA polymerase II elongation complex with complete transcription bubble reveals NTP entry routes. PLoS Comput Biol 2015, 11:e1004354.

Zimmerman, MI, Bowman, GR. FAST conformational searches by balancing exploration/exploitation trade‐offs. J Chem Theory Comput 2015, 11:5747–5757.

Gan, W, Yang, S, Roux, B. Atomistic view of the conformational activation of Src kinase using the string method with swarms‐of‐trajectories. Biophys J 2009, 97:L8–L10.

Maragliano, L, Fischer, A, Vanden‐Eijnden, E, Ciccotti, G. String method in collective variables: minimum free energy paths and isocommittor surfaces. J Chem Phys 2006, 125:24106.

Pan, AC, Roux, B. Building Markov state models along pathways to determine free energies and rates of transitions. J Chem Phys 2008, 129:64107.

Pan, AC, Sezer, D, Roux, B. Finding transition pathways using the string method with swarms of trajectories. J Phys Chem B 2008, 112:3432–3440.

Maragliano, L, Vanden‐Eijnden, E. On‐the‐fly string method for minimum free energy paths calculation. Chem Phys Lett. 2007, 446:182–190.

Díaz Leines, G, Ensing, B. Path finding on high‐dimensional free energy landscapes. Phys Rev Lett 2012, 109:20601.

Pelt, DM, Batenburg, KJ. Fast tomographic reconstruction from limited data using artificial neural networks. IEEE Trans Image Process 2013, 22:5238–5251.

Theobald, DL. Rapid calculation of RMSDs using a quaternion‐based characteristic polynomial. Acta Crystallogr A 2005, 61:478–480.

Ernst, M, Sittel, F, Stock, G. Contact‐ and distance‐based principal component analysis of protein dynamics. J Chem Phys 2015, 143:244114.

Schwantes, CR, Pande, VS. Modeling molecular kinetics with tICA and the kernel trick. J Chem Theory Comput 2015, 11:600–608.

Pérez‐Hernández, G, Noé, F. Hierarchical time‐lagged independent component analysis: computing slow modes and reaction coordinates for large molecular systems. J Chem Theory Comput 2016, 12:6118–6129.

Boninsegna, L, Gobbo, G, Noé, F, Clementi, C. Investigating molecular kinetics by variationally optimized diffusion maps. J Chem Theory Comput 2015, 11:5947–5960.

Rohrdanz, MA, Zheng, W, Clementi, C. Discovering mountain passes via torchlight: methods for the definition of reaction coordinates and pathways in complex macromolecular reactions. Annu Rev Phys Chem 2013, 64:295–316.

Noé, F, Clementi, C. Collective variables for the study of long‐time kinetics from molecular trajectories: theory and methods. Curr Opin Struct Biol 2017, 43:141–147.

Noé, F, Clementi, C. Kinetic distance and kinetic maps from molecular dynamics simulation. J Chem Theory Comput 2015, 11:5002–5011.

Sculley, D. Web‐scale K‐means clustering. In: *Proceedings of the 19th International Conference on World Wide Web [Internet] (WWW ‘10)*. New York: ACM; 2010, 1177–1178. Available at: http://doi.acm.org/10.1145/1772690.1772862

Gonzalez, TF. Clustering to minimize the maximum intercluster distance. Theor Comput Sci 1985, 38:293–306.

Zhao, Y, Sheong, FK, Sun, J, Sander, P, Huang, X. A fast parallel clustering algorithm for molecular simulation trajectories. J Comput Chem 2013, 34:95–104.

Sheong, FK, Silva, D‐A, Meng, L, Zhao, Y, Huang, X. Automatic state partitioning for multibody systems (APM): an efficient algorithm for constructing Markov state models to elucidate conformational dynamics of multibody systems. J Chem Theory Comput 2015, 11:17–27.

Ward, JH. Hierarchical grouping to optimize an objective function. J Am Stat Assoc 1963, 58:236–244.

Husic, BE, Pande, VS. Ward clustering improves cross‐validated Markov state models of protein folding. J Chem Theory Comput 2017, 13:963–967.

Sittel, F, Stock, G. Robust density‐based clustering to identify metastable conformational states of proteins. J Chem Theory Comput 2016, 12:2426–2435.

Bowman, GR, Beauchamp, KA, Boxer, G, Pande, VS. Progress and challenges in the automated construction of Markov state models for full protein systems. J Chem Phys 2009, 131:124101.

Scalco, R, Caflisch, A. Equilibrium distribution from distributed computing (simulations of protein folding). J Phys Chem B 2011 May, 115:6358–6365.

Metzner, P, Noé, F, Schütte, C. Estimating the sampling error: distribution of transition matrices and functions of transition matrices for given trajectory data. Phys Rev E 2009, 80:21106.

Efron, B, Tibshirani, RJ. An Introduction to the Bootstrap. New York: Chapman %26 Hall; 1994.

Bowman, GR, Ensign, DL, Pande, VS. Enhanced modeling via network theory: adaptive sampling of Markov state models. J Chem Theory Comput 2010, 6:787–794.

Doerr, S, Harvey, MJ, Noé, F, De Fabritiis, G. HTMD: high‐throughput molecular dynamics for molecular discovery. J Chem Theory Comput 2016, 12:1845–1852.

Hinrichs, NS, Pande, VS. Calculation of the distribution of eigenvalues and eigenvectors in Markovian state models for molecular dynamics. J Chem Phys 2007, 126:244101.

Voelz, VA, Elman, B, Razavi, AM, Zhou, G. Surprisal metrics for quantifying perturbed conformational dynamics in Markov state models. J Chem Theory Comput 2014, 10:5716–5728.

Weinan, E, Vanden‐Eijnden, E. Transition‐path theory and path‐finding algorithms for the study of rare events. Annu Rev Phys Chem 2010, 61:391–420.

Metzner, P, Schütte, C, Vanden‐Eijnden, E. Transition path theory for Markov jump processes. Multiscale Model Simul 2009, 7:1192–1219.

Meng, L, Sheong, FK, Zeng, X, Zhu, L, Huang, X. Path lumping: an efficient algorithm to identify metastable path channels for conformational dynamics of multi‐body systems. J Chem Phys 2017, 147:44112.

Zhou, G, Pantelopulos, GA, Mukherjee, S, Voelz, VA. Bridging microscopic and macroscopic mechanisms of p53‐MDM2 binding using molecular simulations and kinetic network models. *bioRxiv* 2016;86272.

Zheng, X, Zhu, L, Zeng, X, Meng, L, Zhang, L, Wang, D, Huang, X. Kinetics‐controlled amphiphile self‐assembly processes. J Phys Chem Lett 2017, 8:1798–1803.

Bowman, GR, Meng, L, Huang, X. Quantitative comparison of alternative methods for coarse‐graining biological networks. J Chem Phys 2013, 139:121905.

Deuflhard, P, Huisinga, W, Fischer, A, Schütte, C. Identification of almost invariant aggregates in reversible nearly uncoupled Markov chains. Linear Algebra Appl 2000, 315:39–59.

Deuflhard, P, Weber, M. Robust Perron cluster analysis in conformation dynamics. Linear Algebra Appl 2005, 398:161–184.

Röblitz, S, Weber, M. Fuzzy spectral clustering by PCCA+: application to Markov state models and data classification. Adv Data Anal Classif 2013, 7:147–179.

Shi, J, Malik, J. Normalized cuts and image segmentation. IEEE Trans Pattern Anal Mach Intell 2000, 22:888–905.

Ng, AY, Jordan, MI, Weiss, Y. On spectral clustering: analysis and an algorithm. In: *Proceedings of the 14th International Conference on Neural Information Processing Systems: Natural and Synthetic [Internet] (NIPS’01)*. Cambridge, MA: MIT Press; 2001, 849–856. Available at: http://dl.acm.org/citation.cfm?id=2980539.2980649

Chodera, JD, Singhal, N, Pande, VS, Dill, KA, Swope, WC. Automatic discovery of metastable states for the construction of Markov models of macromolecular conformational dynamics. J Chem Phys 2007, 126:155101.

Bowman, GR. Improved coarse‐graining of Markov state models via explicit consideration of statistical uncertainty. J Chem Phys 2012, 137:134111.

Jain, A, Stock, G. Identifying metastable states of folding proteins. J Chem Theory Comput 2012, 8:3810–3819.

Huang, X, Yao, Y, Bowman, GR, Sun, J, Guibas, LJ, Carlsson, G, Pande, VS. Constructing multi‐resolution Markov state models (MSMS) to elucidate RNA hairpin folding mechanisms. In: *Biocomputing 2010 [Internet]*. World Scientific; 2009, 228–239. Available at: http://www.worldscientific.com/doi/abs/10.1142/9789814295291_0025

Yao, Y, Cui, RZ, Bowman, GR, Silva, D‐A, Sun, J, Huang, X. Hierarchical Nyström methods for constructing Markov state models for conformational dynamics. J Chem Phys 2013, 138:174106.

Orioli, S, Faccioli, P. Dimensional reduction of Markov state models from renormalization group theory. J Chem Phys 2016, 145:124120.

Bacallado, S, Chodera, JD, Pande, V. Bayesian comparison of Markov models of molecular dynamics with detailed balance constraint. J Chem Phys 2009, 131:45106.

Noé, F, Wu, H, Prinz, J‐H, Plattner, N. Projected and hidden Markov models for calculating kinetics and metastable states of complex molecules. J Chem Phys 2013, 139:184114.

McGibbon, R, Ramsundar, B, Sultan, M, Kiss, G, Pande, V. Understanding protein dynamics with L1‐regularized reversible hidden Markov models. In: *International Conference on Machine Learning*; 2014, 1197–1205.

Shukla, S, Shamsi, Z, Moffett, A, Selvam, B, Shukla, D. Application of hidden Markov models in biomolecular simulations. In: Westhead, DR, Vijayabaskar, MS, eds. Hidden Markov Models [Internet]. Methods in Molecular Biology. New York: Springer; 2017, 29–41. https://doi.org/10.1007/978-1-4939-6753-7_3.

Hummer, G, Szabo, A. Optimal dimensionality reduction of multistate kinetic and Markov‐state models. J Phys Chem B 2015, 119:9029–9037.

Wu, H, Paul, F, Wehmeyer, C, Noé, F. Multiensemble Markov models of molecular thermodynamics and kinetics. Proc Natl Acad Sci USA 2016, 113:E3221–E3230.

Mey, ASJS, Wu, H, Noé, F. xTRAM: estimating equilibrium expectations from time‐correlated simulation data at multiple thermodynamic states. Phys Rev X 2014, 4:41018.

Wu, H, Mey, ASJS, Rosta, E, Noé, F. Statistically optimal analysis of state‐discretized trajectory data from multiple thermodynamic states. J Chem Phys 2014, 141:214106.

Lemke, O, Keller, BG. Density‐based cluster algorithms for the identification of core sets. J Chem Phys 2016, 145:164104.