Free

Book Description

Table of Contents

- Overview
- Markov decision processes
- Preliminaries
- Markov Decision Processes
- Value functions
- Dynamic programming algorithms for solving MDPs

- Value prediction problems
- Temporal difference learning in finite state spaces
- Tabular TD(0)
- Every-visit Monte-Carlo
- TD(): Unifying Monte-Carlo and TD(0)

- Algorithms for large state spaces
- TD() with function approximation
- Gradient temporal difference learning
- Least-squares methods
- The choice of the function space

- Temporal difference learning in finite state spaces
- Control
- A catalog of learning problems
- Closed-loop interactive learning
- Online learning in bandits
- Active learning in bandits
- Active learning in Markov Decision Processes
- Online learning in Markov Decision Processes

- Direct methods
- Q-learning in finite MDPs
- Q-learning with function approximation

- Actor-critic methods
- Implementing a critic
- Implementing an actor

- For further exploration
- Further reading
- Applications
- Software
- Acknowledgements

- The theory of discounted Markovian decision processes
- Contractions and Banach's fixed-point theorem
- Application to MDPs

You May Also Like

Pattern Recognition and Machine Learning (Information Science and Statistics)

By Christopher M. Bishop

Also Available On

Categories

Arts & Photography472Biographies & Memoirs72Business & Money73Children's Books1438Christian Books & Bibles851Computers & Technology705Cookbooks, Food & Wine31Crafts, Hobbies & Home204Education & Teaching3651Health, Fitness & Dieting12History5749Humor & Entertainment160Law142Literature & Fiction19591Medical Books1Mystery, Thriller & Suspense16Other3105Parenting & Relationships6Politics & Social Sciences1382Professional & Technical19Reference8Religion & Spirituality1620Romance235Science & Math1128Science Fiction & Fantasy204Self-Help48Sports & Outdoors45Teen & Young Adult125Test Preparation77Travel112

Curated Lists

#### Free Machine Learning Books

11 Books

- Pattern Recognition and Machine Learning (Information Science and Statistics)
- by Christopher M. Bishop
- Data mining
- by I. H. Witten
- The Elements of Statistical Learning: Data Mining, Inference, and Prediction
- by Various

#### Free Chemistry Textbooks

9 Books

- CK-12 Chemistry
- by Various
- Concept Development Studies in Chemistry
- by John Hutchinson
- An Introduction to Chemistry - Atoms First
- by Mark Bishop

#### Free Mathematics Textbooks

21 Books

- Microsoft Word - How to Use Advanced Algebra II.doc
- by Jonathan Emmons
- Advanced Algebra II: Activities and Homework
- by Kenny Felder
- de2de
- by

#### Free Children Books

38 Books

- The Sun Who Lost His Way
- by
- Tania is a Detective
- by Kanika G
- Firenze_s-Light
- by

#### Free Java Books

10 Books

- Java 3D Programming
- by Daniel Selman
- The Java EE 6 Tutorial
- by Oracle Corporation
- JavaKid811
- by