Deep Reinforcement Learning in Unity: With Unity ML Toolkit

Chapter 1: Introduction to Reinforcement Learning

Sub -Topics

1. Markov Models and State Based Learning

2. Bellman Equations

3. Creating a Multi Armed Bandit RL simulation.

4. Value and Policy iteration.

Chapter 2: Pathfinding and Navigation

Sub - Topics

1. Pathfinding in Unity

2. Navigation Meshes

3. Creating Enemy AI

Chapter 3: Setting Up ML Agents Toolkit SDK

Sub - Topics:

1. Installing ML Agents

2. Configuring Brain Academy

3. Linking ML Agents with Tensorflow with Jupyter Notebooks

4. Playing with ML agents samples

Chapter 4: Understanding Brain Agents and Academy

Sub - Topics:

1. Understanding the architecture of Brain

2. Training different Agents with Single Brain

3. Generic Hyperparameters

Chapter 5: Deep Reinforcement Learning

Sub - Topics:

1. Fundamentals of Mathematical Machine Learning with Python

2. Deep Learning with Keras and Tensorflow

3. Deep Reinforcement Learning Algorithms

4. Writing neural network for Deep Q learning for Brain

5. Hyperparameter Tuning for Optimization

6. Memory-based LSTM Network Design with Keras for Brain

7. Building an AI Agent for Kart Game Using Trained Network

Chapter 6: Competitive Networks for AI Agents

Sub - Topics:

1. Cooperative Network and Adversarial Network

2. Extended Reinforcement Learning-Deep Policy Gradients

3. Simulations Made with Unity ML Agents

4. Simulating AI Autonomous Agent for Self-driving

Chapter 7: Case Study - Obstacle Tower Challenge

Sub - Topics:

1. Obstacle Tower Challenge

2. Unity ML Agents Challenge

3. Research Developments from Unity AI

4. Playing with the Open AI Gym Wrapper

Author: Abhilash Majumder
Publisher: Apress
Published: 01/15/2021
Pages: 564
Binding Type: Paperback
Weight: 2.20lbs
Size: 10.00h x 7.00w x 1.18d
ISBN13: 9781484265024
ISBN10: 1484265025
BISAC Categories:
- Computers | Programming | Games
- Computers | Artificial Intelligence | General

About the Author

Abhilash Majumder is a natural language processing research engineer for HSBC (UK/India) and technical mentor for Udactiy (ML). He also has been associated with Unity Technologies and was a speaker at Unite India-18, and has educated close to 1,000 students from EMEA and SEPAC (India) on Unity. He is an ML contributor and curator for Open Source Google Research and Tensorflow, and creator of ML libraries under Python Package Index (Pypi). He is an online educationalist for Udemy and a deep learning mentor for Upgrad.

Abhilash was an apprentice/student ambassador for Unity Technologies where he educated corporate employees and students on using general Unity for game development. He was a technical mentor (AI programming) for the Unity Ambassadors Community and Content Production. He has been associated with Unity Technologies for general education, with an emphasis on graphics and machine learning. He is one of the first content creators for Unity Technologies India since 2017.