Markov processes.

Cycle representations of Markov processes / by: (Language materials, printed)

Statistical analysis of behavioural data :an approach based on time-structured models / by: (Language materials, printed)

Design and analysis of simulation experiments / by: (Language materials, printed)

Image textures and Gibbs random fields / by: (Language materials, printed)

Computational probability / by: (Language materials, printed)

Markov random field modeling in image analysis / by: (Language materials, printed)

Bioinformatics :the machine learning approach / by: (Language materials, printed)

Diffusions, Markov processes, and martingales / by: (Language materials, printed)

Markov chain Monte Carlo in practice / by: (Language materials, printed)

Markov chains :Gibbs fields, Monte Carlo simulation, and queues / by: (Language materials, printed)

Hidden Markov models :applications in computer vision / by: (Language materials, printed)

Graph directed Markov systems :geometry and dynamics of limit sets / by: (Language materials, printed)

Martingales and Markov chains :solved exercises and elements of theory / by: (Language materials, printed)

Markov models and optimization / by: (Language materials, printed)

Markov chain Monte Carlo :stochastic simulation for Bayesian inference / by: (Language materials, printed)

Matrix-geometric solutions in stochastic models :an algorithmic approach / by: (Language materials, printed)

Introduction to matrix analytic methods in stochastic modeling / by: (Language materials, printed)

An introduction to Markov processes / by: (Language materials, printed)

Applied probability and queues / by: (Language materials, printed)

Diffusions, Markov processes, and martingales / by: (Language materials, printed)

Finite Markov chains and algorithmic applications / by: (Language materials, printed)

Diffusions, Markov processes, and martingales / by: (Language materials, printed)

Inference in hidden Markov models / by: (Language materials, printed)

Queueing networks and Markov chains :modeling and performance evaluation with computer science applications / by: (Language materials, printed)

Structured stochastic matrices of M/G/1 type and their applications / by: (Language materials, printed)

Non-negative matrices and Markov chains / by: (Language materials, printed)

Likelihood, Bayesian and MCMC methods in quantitative genetics / by: (Language materials, printed)

Limit theorems for Markov chains and stochastic properties of dynamical systems by quasi-compactness / by: (Language materials, printed)

Hidden Markov and other models for discrete-valued time series / by: (Language materials, printed)

Hidden Markov models :estimation and control / by: (Language materials, printed)

Markov processes from K. It緌's perspective / by: (Language materials, printed)

Discrete-time Markov chains :two-time-scale methods and applications / by: (Language materials, printed)

Controlled Markov processes and viscosity solutions / by: (Language materials, printed)

Applied semi-Markov processes / by: (Language materials, printed)

Bayesian models for categorical data by: (Electronic resources)

Queueing networks and Markov chains modeling and performance evaluation with computer science applications / by: (Electronic resources)

Pseudo differential operators & Markov processes / by: (Language materials, printed)

DNA, words and models / by: (Language materials, printed)

Bayesian models for categorical data / by: (Language materials, printed)

Semi-Markov risk models for finance, insurance and reliability / by: (Language materials, printed)

Markov Decision Processes With Their Applications / by: (Electronic resources)

Markov Models for Pattern Recognition :From Theory to Applications / by: (Electronic resources)

Control of Singular Systems with Abrupt Changes / by: (Electronic resources)

Approximation of population processes by: (Electronic resources)

Introduction to matrix analytic methods in stochastic modeling by: (Electronic resources)

Semi-Markov chains and hidden semi-Markov models toward applicationstheir use in reliability and DNA analysis / by: (Language materials, printed)

Mathematical theory of reliability of time dependent systems with practical applications / by: (Language materials, printed)

Bioinformatics :the machine learning approach / by: (Language materials, printed)

Discrete-time Markov control processes :basic optimality criteria / by: (Language materials, printed)

Limit theorems for Markov chains and stochastic properties of dynamical systems by quasi-compactness / by: (Language materials, printed)

Markov processes from K. It�o's perspective / by: (Language materials, printed)

Markov processes :characterization and convergence / by: (Language materials, printed)

Handbook of hidden Markov models in bioinformatics / by: (Language materials, printed)

Hidden Markov models and dynamical systems / by: (Language materials, printed)

Markov-modulated processes & semiregenerative phenomena / by: (Language materials, printed)

Applied stochastic processes and control for Jump-diffusions :modeling, analysis, and computation / by: (Language materials, printed)

Markov processes, Gaussian processes, and local times / by: (Language materials, printed)

Applied probability and queues by: (Electronic resources)

Hidden Markov models :applications to financial economics by: (Electronic resources)

Monotonicity in markov reward and decision chainstheory and applications / by: (Electronic resources)

Boundary value problems and Markov processes by: (Electronic resources)

Continuous-time markov decision processestheory and applications / by: (Electronic resources)

Markov processes and applications :algorithms, networks, genome and finance / by: (Language materials, printed)

Stochastic differential equations with Markovian switching / by: (Language materials, printed)

Markov chain Monte Carlo :innovations and applications / by: (Language materials, printed)

Markov chains and mixing times / by: (Language materials, printed)

Cycle representations of Markov processes / by: (Language materials, printed)

Bioinformatics :sequence alignment and Markov models by: (Electronic resources)

Markov chain Monte Carlo :stochastic simulation for Bayesian inference / by: (Language materials, printed)

Functional inequalities, Markov semigroups and spectral theory by: (Electronic resources)

Markovian demand inventory models by: (Electronic resources)

Introducing Monte Carlo methods with R by: (Electronic resources)

Continuous strong Markov processes in dimension onea stochastic calculus approach / by: (Electronic resources)

Markov set-chains by: (Electronic resources)

Limit theorems for Markov chains and stochastic propertiesof dynamical systems by quasi-compactness by: (Electronic resources)

Interactive Markov chains and the quest for quantified quality by: (Electronic resources)

Likelihood, Bayesian and MCMC methods in quantitative genetics by: (Electronic resources)

An inductive logic programming approach to statistical relational learning by: (Electronic resources)

Stochastic models of systems / by: (Language materials, printed)

Markov processes :an introduction for physical scientists / by: (Language materials, printed)

The geometry of filtering by: (Electronic resources)

Hidden Markov models for time series :an introduction using R / by: (Language materials, printed)

Measure-valued branching markov processes by: (Electronic resources)

Markov decision processes with applications to finance by: (Electronic resources)

Markov paths, loops and fieldsEcole d'Ete de Probabilites de Saint-Flour XXXVIII - 2008 / by: (Electronic resources)

Markov decision processes and the belief-desire-intention modelbridging the gap for autonomous agents / by: (Electronic resources)

Markov models for handwriting recognition by: (Electronic resources)

Advanced Markov chain Monte Carlo methods :learning from past samples / by: (Language materials, printed)

Handbook of Markov chain Monte Carlo / by: (Language materials, printed)

Finite Markov chains / by: (Language materials, printed)

Nonlinear Markov processes and kinetic equations / by: (Language materials, printed)

Markov Processes, Gaussian Processes, and Local Times. by: (Electronic resources)

Hamiltonian cycle problem and markov chains by: (Electronic resources)

Markov networks in evolutionary computation by: (Electronic resources)

Markov processes for stochastic modeling / by: (Language materials, printed)

Markov bases in algebraic statistics by: (Electronic resources)

Analyzing markov chains using kronecker productstheory and applications / by: (Electronic resources)

Fluctuations in markov processestime symmetry and martingale approximation / by: (Electronic resources)

Optimization, control, and applications of stochastic systemsin honor of Onesimo Hernandez-Lerma / by: (Electronic resources)

Hidden Markov models for time seriesan introduction using R / by: (Electronic resources)

Stochastic population processesanalysis, approximations, simulations / by: (Electronic resources)

Applied stochastic processes and control for Jump-diffusionsmodeling, analysis, and computation / by: (Electronic resources)

Hidden Markov models and dynamical systems by: (Electronic resources)

Nonlinear financial econometrics.Markhov switching models, persistence and nonlinear cointegration by: (Electronic resources)

Examples in Markov Decision Processes by: (Electronic resources)

Markov processes, Feller semigroups and evolution equations by: (Electronic resources)

Selected topics on continuous-time controlled Markov chains and Markov games by: (Electronic resources)

Markov chains :theory, algorithms and applications / by: (Language materials, printed)

Markov's theorem and 100 years of the uniqueness conjecture :a mathematical journey from irrational numbers to perfect matchings / by: (Language materials, printed)

Algorithms for random generation and counting :a Markov chain approach / by: (Language materials, printed)

Distribution theory of runs and patterns and its applications :a finite Markov chain imbedding approach / by: (Language materials, printed)

Sample efficient multiagent learning in the presence of Markovian agents by: (Electronic resources)

An introduction to Markov processes by: (Electronic resources)

Geometrically constructed Markov chain Monte Carlo study of quantum spin-phonon complex systems by: (Electronic resources)

An introduction to Markov State Models and their application to long timescale molecular simulation by: (Electronic resources)

Spatial Fleming-Viot models with selection and mutation by: (Electronic resources)

Markov models for pattern recognitionfrom theory to applications / by: (Electronic resources)

Input modeling with phase-type distributions and Markov modelstheory and applications / by: (Electronic resources)

Invariant probabilities of transition functions by: (Electronic resources)

Markov processes, semigroups, and generators by: (Electronic resources)

Semigroups, boundary value problems and markov processes by: (Electronic resources)

Handbook of Markov chain Monte Carlo by: (Electronic resources)

Markov chainstheory, algorithms and applications / by: (Language materials, printed)

A first course in probability and Markov chains by: (Language materials, printed)

Markov processes for stochastic modeling by: (Electronic resources)

A first course in probability and Markov chains / by: (Language materials, printed)

The dynamics of discrete populations and series of events / by: (Language materials, printed)

Markov chains :analytic and Monte Carlo computations / by: (Language materials, printed)

Optimization of stochastic discrete systems and control on complex networkscomputational networks / by: (Electronic resources)

Optimized response-adaptive clinical trialssequential treatment allocation based on Markov decision problems / by: (Electronic resources)

Algorithms for reinforcement learning by: (Electronic resources)

Performance modeling of communication networks with Markov chains by: (Electronic resources)

Markov chainsanalytic and Monte Carlo computations / by: (Electronic resources)

Semi-Markov processesapplications in system reliability and maintenance / by: (Electronic resources)

Poisson point processes and their application to Markov processes by: (Electronic resources)

Selected topics on continuous-time controlled Markov chains and Markov games / by: (Language materials, printed)

Markov chain aggregation for agent-based models by: (Electronic resources)

Transmission channels of financial shocks to stock, bond, and asset-backed marketsan empirical model / by: (Electronic resources)

Building dialogue POMDPs from expert dialoguesan end-to-end approach / by: (Electronic resources)

Approximate iterative algorithms by: (Electronic resources)

Nonlinear mixture modelsa Bayesian approach / by: (Electronic resources)

Computing characterizations of drugs for ion channels and receptors using Markov models by: (Electronic resources)

Advances in the control of markov jump linear systems with no mode observation by: (Electronic resources)

Rabi N. Bhattacharyaselected papers / by: (Electronic resources)

Stochastic models with power-law tailsthe equation X = AX + B / by: (Electronic resources)

VaR methodology for non-Gaussian finance by: (Electronic resources)

Nonlinear mixture models :a Bayesian approach / by: (Language materials, printed)

Pseudodifferential equations over non-Archimedean spaces by: (Electronic resources)

Markov decision processes in practice by: (Electronic resources)

Latent Markov models for longitudinal data by: (Electronic resources)

Matrix-Exponential Distributions in Applied Probability by: (Electronic resources)

Piecewise deterministic processes in biological models by: (Electronic resources)

Nonlinearly perturbed semi-Markov processes by: (Electronic resources)

System dependability evaluation including S-dependency and uncertaintyModel-Driven Dependability Analyses / by: (Electronic resources)

Semi-Markov migration models for credit risk by: (Electronic resources)

Markov chainsfrom theory to implementation and experimentation / by: (Electronic resources)

Approximate quantum Markov chains by: (Electronic resources)

Understanding Markov chainsexamples and applications / by: (Electronic resources)

Kronecker modeling and analysis of multidimensional Markovian systems by: (Electronic resources)

Dynamic Markov bridges and market microstructuretheory and applications / by: (Electronic resources)

Markov chains by: (Electronic resources)

Dependence with complete connections and its applications / by: (Language materials, printed)

Introduction to hidden semi-Markov models / by: (Language materials, printed)

Next generation and advanced network reliability analysisusing Markov models and software reliability engineering / by: (Electronic resources)

Many agent games in socio-economic systemscorruption, inspection, coalition building, network growth, security / by: (Electronic resources)

Hidden Markov processestheory and applications to biology / by: (Electronic resources)

Random walks and heat kernels on graphs / by: (Language materials, printed)

Zero-sum discrete-time Markov games with unknown disturbance distributiondiscounted and average criteria / by: (Electronic resources)

Markov chainsGibbs fields, Monte Carlo simulation and queues / by: (Electronic resources)

Semi-markov modelscontrol of restorable systems with latent failures / by: (Electronic resources)

Continuous-time Markov decision processesBorel space models and general control strategies / by: (Electronic resources)

Copula-based Markov models for time seriesparametric inference and process control / by: (Electronic resources)

Boundary value problems and Markov processesfunctional analysis methods for Markov processes / by: (Electronic resources)

Boundary value problems and Markov processes :functional analysis methods for Markov processes / by: (Language materials, printed)

Structured dependence between stochastic processes / by: (Language materials, printed)

Copula-based Markov models for time series :parametric inference and process control / by: (Language materials, printed)

Foundations of average-cost nonhomogeneous controlled Markov chains by: (Electronic resources)

Hidden semi-Markov modelstheory, algorithms and applications / by: (Electronic resources)

Markov renewal and piecewise deterministic processes by: (Electronic resources)

Markov processes and quantum theory by: (Electronic resources)

Multi-level bayesian models for environment perception by: (Electronic resources)

Functional analytic techniques for diffusion processes by: (Electronic resources)

Perturbed semi-markov type processes.II,Ergodic theorems for multi-alternating regenerative processes by: (Electronic resources)

Perturbed semi-Markov type processes.I,Limit theorems for rare-event times and processes by: (Electronic resources)

Mixture and hidden markov models with R by: (Electronic resources)

Large deviations for Markov chains by: (Electronic resources)

Stochastic exponential growth and lattice gasesstatistical mechanics of stochastic compounding processes / by: (Electronic resources)

MCMC from scratcha practical introduction to Markov Chain Monte Carlo / by: (Electronic resources)

Markov chains on metric spacesa short course / by: (Electronic resources)

Measure-valued branching Markov processes by: (Electronic resources)

Robust control for discrete-time Markovian jump systems in the finite-time domain by: (Electronic resources)

Control synthesis for semi-markovian switching systems by: (Electronic resources)

Local limit theorems for inhomogeneous Markov chains by: (Electronic resources)

Continuous parameter markov processes and stochastic differential equations by: (Electronic resources)

Stochastic neutron transportand non-local branching markov processes / by: (Electronic resources)

Non-homogeneous Markov chains and systems :theory and applications / by: (Language materials, printed)

Optimization and games for controllable Markov chainsnumerical methods with application to finance and engineering / by: (Electronic resources)

Markov decision processes and stochastic positional gamesoptimal control on complex networks / by: (Electronic resources)

Hilbert C*- modules and quantum Markov semigroups by: (Electronic resources)

Real analysis methods for markov processessingular integrals and Feller semigroups / by: (Electronic resources)

Structured dependence between stochastic processes by: (Electronic resources)

Turnpike phenomenon for markov decision processes by: (Electronic resources)

Hidden Markov processes and adaptive filtering by: (Electronic resources)

Markov decision processes and reinforcement learning for timely UAV-IoT data collection applications by: (Electronic resources)

Coupling and Ergodic theorems for semi-Markov-type processes.I,Markov chains, renewal, and regenerative processes by: (Electronic resources)

Coupling and Ergodic theorems for semi-Markov-type processes.II,Semi-Markov processes and multi-alternating regenerative processes with semi-markov modulation by: (Electronic resources)