Modeling and Analysis of Stochastic Systems

by Kulkarni, Vidyadhar G.

• ISBN13: 9780412049910
• ISBN10: 0412049910
• Format: Hardcover
• Copyright: 1995-03-01
• Publisher: Chapman & Hall

Summary

This practical and accessible text enables readers from engineering, business, operations research, public policy and computer science to analyze stochastic systems. Emphasizing the modeling of real-life situations with stochastic elements and analyzing the resulting stochastic model, it presents the major cases of useful stochastic processes-discrete and continuous time Markov chains, renewal processes, regenerative processes, and Markov regenerative processes.The author provides reader-friendly yet rigorous coverage. He follows a set pattern of development for each class of stochastic processes and introduces Markov chains before renewal processes, so that readers can begin modeling systems early. He demonstrates both numerical and analytical solution methods in detail and dedicates a separate chapter to queueing applications.Modeling and Analysis of Stochastic Systems includes numerous worked examples and exercises, conveniently categorized as modeling, computational, or conceptual and making difficult concepts easy to grasp. Taking a practical approach to working with stochastic models, this book helps readers to model and analyze the increasingly complex and interdependent systems made possible by recent advances.

Table of Contents

Introduction

Discrete-Time Markov Chains: Transient Behavior

Discrete-Time Markov Chains: Limiting Behavor

Discrete-Time Markov Chains: First Passage Times

Poisson Processes

Continuous-Time Markov Chains

Applications of Markov Chains to Queueing Theory

Renewal Processes

Markov Renewal Processes

Epilogue

Appendices

Answers to Selected Problems

Bibliography