7.52. Stochastic processes (Elective)

7.52. Stochastic processes (Elective)

Figure 7.52: Connection Map. MA352 Stochastic processes

7.52.1. Justification ↑ Back to top

This course introduces the theory of stochastic processes, providing mathematical foundations for the study of systems that evolve randomly over time. It develops skills for modeling random phenomena in finance, engineering, and sciences through Markov chains, Poisson processes, and Brownian motion, with applications in simulation and analysis of stochastic systems.

7.52.2. Generales Goals ↑ Back to top

  1. Understand fundamental concepts of stochastic processes
  2. Model systems using discrete and continuous time Markov chains
  3. Analyze Poisson processes and their applications
  4. Apply stochastic processes to problems in finance and sciences

7.52.3. Contribution to Outcomes ↑ Back to top

ABET-1) An ability to identify, formulate, and solve broadly defined technical or scientific problems by applying knowledge of mathematics and science and/or technical topics to areas relevant to the discipline. (Usage)
ABET-3) An ability to develop and conduct experiments or test hypotheses, analyze and interpret data, and use scientific judgment to draw conclusions. (Usage)

7.52.4. Content ↑ Back to top

7.52.4.1. Advanced Probability and Stochastic Processes (20 hours) [Skills ABET-1,ABET-3] ↑ Back to top

Bibliography: (Ross, 2019; Karlin and Taylor, 2014)

Topics

  1. Measure-theoretic probability foundations
  2. Random variables and distributions
  3. Stochastic processes characterization
  4. Markov chains and Markov processes
  5. Brownian motion and diffusion processes

Learning Outcomes

  1. Apply measure-theoretic concepts to probability spaces [Familiarity]
  2. Characterize different types of stochastic processes [Assessment]
  3. Analyze Markov chains for steady-state and transient behavior [Usage]
  4. Model systems using continuous-time stochastic processes [Usage]
7.52.4.2. Discrete Systems Simulation (20 hours) [Skills ABET-1,ABET-3] ↑ Back to top

Bibliography: (Ross, 2019; Karlin and Taylor, 2014)

Topics

  1. Queueing theory and models
  2. Cellular automata and agent-based models
  3. Monte Carlo simulation methods
  4. Markov chains and processes
  5. Discrete-event simulation

Learning Outcomes

  1. Formulate and analyze simple queueing models [Usage]
  2. Implement cellular automata and agent-based simulations [Usage]
  3. Apply Monte Carlo methods for probabilistic simulation [Usage]
  4. Analyze Markov chains for state transitions and steady-state behavior [Assessment]
  5. Design discrete-event simulations for system analysis [Usage]
7.52.4.3. Computational Statistical Inference (20 hours) [Skills ABET-1,ABET-3] ↑ Back to top

Bibliography: (Ross, 2019; Karlin and Taylor, 2014)

Topics

  1. Maximum Likelihood Estimation (MLE)
  2. Bayesian inference methods
  3. Markov Chain Monte Carlo (MCMC) methods
  4. Expectation-Maximization (EM) algorithm
  5. Bootstrap and jackknife resampling

Learning Outcomes

  1. Implement Maximum Likelihood Estimation for various distributions [Usage]
  2. Apply Bayesian methods for parameter estimation [Usage]
  3. Implement MCMC algorithms for posterior sampling [Usage]
  4. Use EM algorithm for models with latent variables [Usage]
  5. Apply bootstrap methods for confidence intervals [Usage]
7.52.4.4. Continuous Systems Simulation (20 hours) [Skills ABET-1,ABET-3] ↑ Back to top

Bibliography: (Ross, 2019; Karlin and Taylor, 2014)

Topics

  1. Ordinary Differential Equations (ODEs) models
  2. Partial Differential Equations (PDEs) models
  3. Finite difference methods for PDEs
  4. Solver selection and implementation
  5. Stiff systems and adaptive methods

Learning Outcomes

  1. Formulate ODE and PDE models for physical systems [Usage]
  2. Implement finite difference methods for simple PDEs [Usage]
  3. Select appropriate numerical solvers for different types of ODEs/PDEs [Assessment]
  4. Handle stiff systems using appropriate numerical methods [Usage]

7.52.5. Bibliography ↑ Back to top

Ross, S. M. (2019). Introduction to Probability Models. Academic Press, 12th edition.

Karlin, S. and Taylor, H. M. (2014). A First Course in Stochastic Processes. Academic Press, 2nd edition.

Spotted a typo, an outdated course, a broken link, or have a suggestion? Let us know.

Scan to open on your phone