Deep Learning on Edge Computing Devices: Design Challenges of Algorithm and Architecture 1st Edition Xichuan Zhou - eBook PDFinstant download
Deep Learning on Edge Computing Devices: Design Challenges of Algorithm and Architecture 1st Edition Xichuan Zhou - eBook PDFinstant download
https://ebooksecure.com/download/deep-learning-on-edge-computing-
devices-design-challenges-of-algorithm-and-architecture-ebook-
pdf/
https://ebooksecure.com/download/artificial-intelligence-and-
machine-learning-for-edge-computing-ebook-pdf/
http://ebooksecure.com/product/ebook-pdf-deep-learning-for-
medical-image-analysis-by-s-kevin-zhou/
http://ebooksecure.com/product/ebook-pdf-algorithm-design-by-jon-
kleinberg/
https://ebooksecure.com/download/fractional-order-design-devices-
circuits-and-systems-ebook-pdf/
Medical image recognition, segmentation and parsing :
machine learning and multiple object approaches 1st
Edition Zhou - eBook PDF
https://ebooksecure.com/download/medical-image-recognition-
segmentation-and-parsing-machine-learning-and-multiple-object-
approaches-ebook-pdf/
http://ebooksecure.com/product/original-pdf-algorithm-design-and-
applications-by-michael-t-goodrich/
https://ebooksecure.com/download/artificial-intelligence-and-
deep-learning-in-pathology-ebook-pdf/
https://ebooksecure.com/download/deep-learning-in-bioinformatics-
techniques-and-applications-in-practice-ebook-pdf/
https://ebooksecure.com/download/circular-design-for-zero-
emission-architecture-and-building-practice-ebook-pdf/
DEEP LEARNING
ON EDGE
COMPUTING
DEVICES
This page intentionally left blank
DEEP LEARNING
ON EDGE
COMPUTING
DEVICES
Design Challenges of Algorithm
and Architecture
XICHUAN ZHOU
HAIJUN LIU
CONG SHI
JI LIU
Elsevier
Radarweg 29, PO Box 211, 1000 AE Amsterdam, Netherlands
The Boulevard, Langford Lane, Kidlington, Oxford OX5 1GB, United Kingdom
50 Hampshire Street, 5th Floor, Cambridge, MA 02139, United States
Copyright © 2022 Tsinghua University Press. Published by Elsevier Inc. All rights reserved.
No part of this publication may be reproduced or transmitted in any form or by any means,
electronic or mechanical, including photocopying, recording, or any information storage and
retrieval system, without permission in writing from the publisher. Details on how to seek
permission, further information about the Publisher’s permissions policies and our arrangements
with organizations such as the Copyright Clearance Center and the Copyright Licensing Agency,
can be found at our website: www.elsevier.com/permissions.
This book and the individual contributions contained in it are protected under copyright by the
Publisher (other than as may be noted herein).
Notices
Knowledge and best practice in this field are constantly changing. As new research and experience
broaden our understanding, changes in research methods, professional practices, or medical
treatment may become necessary.
Practitioners and researchers must always rely on their own experience and knowledge in
evaluating and using any information, methods, compounds, or experiments described herein. In
using such information or methods they should be mindful of their own safety and the safety of
others, including parties for whom they have a professional responsibility.
To the fullest extent of the law, neither the Publisher nor the authors, contributors, or editors,
assume any liability for any injury and/or damage to persons or property as a matter of products
liability, negligence or otherwise, or from any use or operation of any methods, products,
instructions, or ideas contained in the material herein.
ISBN: 978-0-323-85783-3
Preface vii
Acknowledgements ix
PART 1 Introduction
1. Introduction 3
1.1. Background 3
1.2. Applications and trends 5
1.3. Concepts and taxonomy 8
1.4. Challenges and objectives 13
1.5. Outline of the book 14
References 16
v
vi Contents
Index 179
Preface
Xichuan Zhou
Acknowledgements
First of all, we would like to thank all the students who participated in the
relevant work for their contributions to this book, including Shuai Zhang,
Kui Liu, Rui Ding, Shengli Li, Songhong Liang, Yuran Hu, etc.
We would like to take the opportunity to thank our families, friends,
and colleagues for their support in the course of writing this monograph.
We would also like to thank our organization, School of Microelectron-
ics and Communication Engineering, Chongqing University, for providing
supportive conditions to do research on intelligence edge computing.
The main content of this book is compiled from a series of research,
partly supported by the National Natural Science Foundation of China
(Nos. 61971072 and 62001063).
We are most grateful to the editorial staff and artists at Elsevier and
Tsinghua University Press for giving us all the support and assistance needed
in the course of writing this book.
ix
This page intentionally left blank
PART 1
Introduction
1
This page intentionally left blank
CHAPTER 1
Introduction
1.1 Background
At present, the human society is rapidly entering the era of Internet of
Everything. The application of the Internet of Things based on the smart
embedded device is exploding. The report “The mobile economy 2020”
released by Global System for Mobile Communications Assembly (GSMA)
has shown that the total number of connected devices in the global Inter-
net of Things reached 12 billion in 2019 [1]. It is estimated that by 2025
the total scale of the connected devices in the global Internet of Things
will reach 24.6 billion. Applications such as smart terminals, smart voice
assistants, and smart driving will dramatically improve the organizational
efficiency of the human society and change people’s lives. With the rapid
development of artificial intelligence technology toward pervasive intelli-
gence, the smart terminal devices will further deeply penetrate the human
society.
Looking back at the development process of artificial intelligence, at
a key time point in 1936, British mathematician Alan Turing proposed
an ideal computer model, the general Turing machine, which provided
a theoretical basis for the ENIAC (Electronic Numerical Integrator And
Computer) born ten years later. During the same period, inspired by
the behavior of the human brain, American scientist John von Neumann
wrote the monograph “The Computer and the Brain” [2] and proposed
an improved stored program computer for ENIAC, i.e., Von Neumann
Architecture, which became a prototype for computers and even artificial
intelligence systems.
The earliest description of artificial intelligence can be traced back to
the Turing test [3] in 1950. Turing pointed out that “if a machine talks
with a person through a specific device without communication with the
outside, and the person cannot reliably tell that the talk object is a machine
or a person, this machine has humanoid intelligence”. The word “artificial
intelligence” actually appeared at the Dartmouth symposium held by John
McCarthy in 1956 [4]. The “father of artificial intelligence” defined it as
“the science and engineering of manufacturing smart machines”. The pro-
posal of artificial intelligence has opened up a new field. Since then, the
Deep Learning on Edge Computing Devices Copyright © 2022 Tsinghua University Press.
https://doi.org/10.1016/B978-0-32-385783-3.00008-9 Published by Elsevier Inc. All rights reserved. 3
4 Deep Learning on Edge Computing Devices
Figure 1.4 Comparison of computing power demands and algorithms for deep learn-
ing model.
the word “training” to describe the parameter estimation process. The data
required in the training process is called a training dataset. The training al-
gorithm is usually described as an optimization task. The model parameters
with the smallest prediction error of the data labels on the training sample
set are estimated through gradient descent [25], and the neural network
model with better generalization is acquired through regularization [26].
In the second stage, the trained neural network model is deployed in the
system to predict the labels of the unknown data obtained by the sensor in
real time. This process is called the inference process. Training and inference
of models are like two sides of the same coin, which belong to different
stages and are closely related. The training quality of the model determines
the inference accuracy of the model.
For the convenience of understanding the subsequent content of this
book, we summarize the main concepts of machine learning involved in
the training and inference process as follows.
Dataset. The dataset is a collection of known data with similar at-
tributes or features and their labels. In deep learning, signals such as voices
and images acquired by the sensor are usually converted into data expres-
sion forms of vectors, matrices, or tensors. The dataset is usually classified
into a training dataset and a test dataset, which are used for the estimation
of the parameters of the neural network model and the evaluation of neural
network inference performance respectively.
Deep learning model. In this book, we will name a function f (x; θ)
from the known data x to the label y to be estimated as the model, where
θ is a collection of internal parameters of the neural network. It is worth
mentioning that in deep learning, the parameters and function forms of
the model are diverse and large in scale. It is usually difficult to write the
analytical form of the function. Only a formal definition is provided here.
Objective function. The process of deep learning model training is
defined as an optimization problem. The objective function of the op-
timization problem generally includes two parts, a loss function and a
regularization term. The loss function is used to describe the average error
of the label prediction of the neural network model on the training sam-
ples. The loss function is minimized to enhance the accuracy of the model
on the training sample set. The regularization term is usually used to con-
trol the complexity of the model to improve the accuracy of the model for
unknown data labels and the generalization performance of the model.
12 Deep Learning on Edge Computing Devices
ebooksecure.com