deep_learning_cookbook.pdf

(11915 KB) Pobierz
Deep
Learning
Cookbook
PRACTICAL RECIPES TO GET STARTED QUICKLY
Douwe Osinga
Practical Recipes to Get Started Quickly
Deep Learning Cookbook
Douwe Osinga
Deep Learning Cookbook
by Douwe Osinga
Copyright © 2018 Douwe Osinga. All rights reserved.
Printed in the United States of America.
Published by O’Reilly Media, Inc., 1005 Gravenstein Highway North, Sebastopol, CA 95472.
O’Reilly books may be purchased for educational, business, or sales promotional use. Online editions are
also available for most titles (http://oreilly.com/safari). For more information, contact our corporate/insti‐
tutional sales department: 800-998-9938 or
corporate@oreilly.com.
Editors:
Rachel Roumeliotis and Jeff Bleiel
Production Editor:
Colleen Cole
Copyeditor:
Rachel Head
Proofreader:
Charles Roumeliotis
June 2018:
First Edition
Indexer:
WordCo Indexing Services, Inc.
Interior Designer:
David Futato
Cover Designer:
Randy Comer
Illustrator:
Rebecca Demarest
Revision History for the First Edition
2018-05-23:
First Release
See
http://oreilly.com/catalog/errata.csp?isbn=9781491995846
for release details.
The O’Reilly logo is a registered trademark of O’Reilly Media, Inc.
Deep Learning Cookbook,
the cover
image, and related trade dress are trademarks of O’Reilly Media, Inc.
While the publisher and the author have used good faith efforts to ensure that the information and
instructions contained in this work are accurate, the publisher and the author disclaim all responsibility
for errors or omissions, including without limitation responsibility for damages resulting from the use of
or reliance on this work. Use of the information and instructions contained in this work is at your own
risk. If any code samples or other technology this work contains or describes is subject to open source
licenses or the intellectual property rights of others, it is your responsibility to ensure that your use
thereof complies with such licenses and/or rights.
978-1-491-99584-6
[LSI]
Table of Contents
Preface. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii
1. Tools and Techniques. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
1.1 Types of Neural Networks
1.2 Acquiring Data
1.3 Preprocessing Data
1
11
18
25
26
28
29
31
32
36
38
40
41
45
47
2. Getting Unstuck. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
2.1 Determining That You Are Stuck
2.2 Solving Runtime Errors
2.3 Checking Intermediate Results
2.4 Picking the Right Activation Function (for Your Final Layer)
2.5 Regularization and Dropout
2.6 Network Structure, Batch Size, and Learning Rate
3. Calculating Text Similarity Using Word Embeddings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
3.1 Using Pretrained Word Embeddings to Find Word Similarity
3.2 Word2vec Math
3.3 Visualizing Word Embeddings
3.4 Finding Entity Classes in Embeddings
3.5 Calculating Semantic Distances Inside a Class
3.6 Visualizing Country Data on a Map
4.1 Collecting the Data
4.2 Training Movie Embeddings
4.3 Building a Movie Recommender
4.4 Predicting Simple Movie Properties
4. Building a Recommender System Based on Outgoing Wikipedia Links. . . . . . . . . . . . . . 49
49
53
56
57
iii

Plik z chomika:

Inne pliki z tego folderu:

Inne foldery tego chomika:

Zgłoś jeśli naruszono regulamin