Tensor Computation for Data Analysis Yipeng Liu

download

https://ebookmeta.com/product/tensor-computation-for-data-
analysis-yipeng-liu/

Download full version ebook from https://ebookmeta.com

We believe these products will be a great fit for you. Click
the link to download now, or visit ebookmeta.com
to discover even more!

Tensors for Data Processing 1st Edition Yipeng Liu

https://ebookmeta.com/product/tensors-for-data-processing-1st-
edition-yipeng-liu/

Tensors for Data Processing: Theory, Methods, and

Applications 1st Edition Yipeng Liu (Ed.)

https://ebookmeta.com/product/tensors-for-data-processing-theory-
methods-and-applications-1st-edition-yipeng-liu-ed/

Tensor Analysis for Engineers 3rd Edition Mehrzad

Tabatabaian

https://ebookmeta.com/product/tensor-analysis-for-engineers-3rd-
edition-mehrzad-tabatabaian/

Human Development: A Cultural Approach, 3rd edition

Jeffery Jensen Arnett

https://ebookmeta.com/product/human-development-a-cultural-
approach-3rd-edition-jeffery-jensen-arnett/
Freedom s Dominion A Saga of White Resistance to
Federal Power 1st Edition Jefferson R Cowie

https://ebookmeta.com/product/freedom-s-dominion-a-saga-of-white-
resistance-to-federal-power-1st-edition-jefferson-r-cowie/

Deep Learning Applications and Intelligent Decision

Making in Engineering 1st Edition Balamurugan Shanmugam
(Editor)

https://ebookmeta.com/product/deep-learning-applications-and-
intelligent-decision-making-in-engineering-1st-edition-
balamurugan-shanmugam-editor/

Io: A New View of Jupiter's Moon, 2nd Edition Rosaly M.

C. Lopes

https://ebookmeta.com/product/io-a-new-view-of-jupiters-moon-2nd-
edition-rosaly-m-c-lopes/

Mobilization Constraints and Military Privatization:

The Political Cost-Effectiveness of Outsourcing
Security 1st Edition Eugenio Cusumano

https://ebookmeta.com/product/mobilization-constraints-and-
military-privatization-the-political-cost-effectiveness-of-
outsourcing-security-1st-edition-eugenio-cusumano/

Principles of Pathophysiology 2nd Edition Shane Bullock

https://ebookmeta.com/product/principles-of-pathophysiology-2nd-
edition-shane-bullock/
Dearest Ivie Black Dagger Brotherhood 15 5 2nd Edition
J R Ward

https://ebookmeta.com/product/dearest-ivie-black-dagger-
brotherhood-15-5-2nd-edition-j-r-ward/
Yipeng Liu
Jiani Liu
Zhen Long
Ce Zhu

Tensor
Computation
for Data
Analysis
Tensor Computation for Data Analysis
Yipeng Liu • Jiani Liu • Zhen Long • Ce Zhu

Tensor Computation for Data

Analysis
Yipeng Liu Jiani Liu
University of Electronic Science and University of Electronic Science and
Technology of China (UESTC) Technology of China (UESTC)
Chengdu, China Chengdu, China

Zhen Long Ce Zhu

University of Electronic Science and University of Electronic Science and
Technology of China (UESTC) Technology of China (UESTC)
Chengdu, China Chengdu, China

ISBN 978-3-030-74385-7 ISBN 978-3-030-74386-4 (eBook)

https://doi.org/10.1007/978-3-030-74386-4

© Springer Nature Switzerland AG 2022

This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of
the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation,
broadcasting, reproduction on microfilms or in any other physical way, and transmission or information
storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology
now known or hereafter developed.
The use of general descriptive names, registered names, trademarks, service marks, etc. in this publication
does not imply, even in the absence of a specific statement, that such names are exempt from the relevant
protective laws and regulations and therefore free for general use.
The publisher, the authors, and the editors are safe to assume that the advice and information in this book
are believed to be true and accurate at the date of publication. Neither the publisher nor the authors or
the editors give a warranty, expressed or implied, with respect to the material contained herein or for any
errors or omissions that may have been made. The publisher remains neutral with regard to jurisdictional
claims in published maps and institutional affiliations.

This Springer imprint is published by the registered company Springer Nature Switzerland AG
The registered company address is: Gewerbestrasse 11, 6330 Cham, Switzerland
Preface

High dimensionality is a feature of big data. Classical data analysis methods rely
on representation and computation in the form of vectors and matrices, where
multi-dimensional data are unfolded into matrix for processing. However, the multi-
linear structure would be lost in such vectorization or matricization, which leads
to sub-optimal performance in processing. As a multidimensional array, a tensor
is a generalization of vectors and matrices, and it is a natural representation for
multi-dimensional data. The tensor computation based machine learning methods
can avoid multi-linear data structure loss in classical matrix based counterparts.
In addition, the computational complexity in tensor subspaces can be much
less than that in the original form. The recent advances in applied mathematics
allow us to move from classical matrix based methods to tensor based methods
for many data related applications, such as signal processing, machine learning,
neuroscience, communication, quantitative finance, psychometric, chemometrics,
quantum physics, and quantum chemistry.
This book will first provide a basic coverage of tensor notations, preliminary
operations, and main tensor decompositions and their properties. Based on them,
a series of tensor analysis methods are presented as the multi-linear extensions of
classical matrix based techniques. Each tensor technique is demonstrated in some
practical applications.
The book contains 13 chapters and 1 appendix. It has 2 chapters in Part I for
preliminaries on tensor computation.
• Chapter 1 gives an introduction of basic tensor notations, graphical representa-
tion, some special operators, and their properties.
• Chapter 2 summarizes a series of tensor decompositions, including canonical
polyadic decomposition, Tucker decomposition and block term decomposition,
tensor singular value decomposition, tensor networks, hybrid tensor decomposi-
tion, and scalable tensor decomposition.
Part II discusses technical aspects of tensor based data analysis methods and various
applications, and it has 11 chapters.

v
vi Preface

• Chapter 3 summarizes sparse representations of tensor by a few atoms. It

extends the classical dictionary learning into its tensor versions with different
decomposition forms, and demonstrates the applications on image denoising and
data fusion.
• Chapter 4 exploits the tensor subspace properties to estimate the missing entries
of observed tensor. It extends matrix completion and gives some examples in
visual data recovery, recommendation system, knowledge graph completion, and
traffic flow prediction.
• Chapter 5 mainly deals with multi-modal data with shared latent information in a
coupled way, thus benefits the applications in image fusion, link prediction, and
visual data recovery.
• Chapter 6 extends the classical principal component analysis, which keeps a
few tensor subspaces for dimensionality reduction, and shows applications in
background extraction, video rain streak removal, and infrared small target
detection.
• Chapter 7 extends the classical regression techniques to explore multi-directional
correlations between tensors, and demonstrates its applications in weather
forecasting and human pose prediction.
• Chapter 8 extends the classical statistical classification techniques by replacing
the linear hyperplane with the tensor form based tensor planes for classification.
Applications on digit recognition from visual images and biomedical classifica-
tion from fMRI images are discussed.
• Chapter 9 extends subspace clustering by incorporating self-representation ten-
sor, and demonstrates applications on heterogeneous information networks,
multichannel ECG signal clustering, and multi-view data clustering.
• Chapter 10 summarizes different tensor decompositions used in different deep
networks, and demonstrates its application in efficient deep neural networks.
• Chapter 11 summarizes the deep learning methods for tensor estimation, and
demonstrates its applications in tensor rank approximation, snapshot compres-
sive imaging, and low-rank tensor completion.
• Chapter 12 extends the Gaussian graphical model, and demonstrates its applica-
tions on environmental prediction and mice aging study.
• Chapter 13 introduces tensor sketch which succinctly approximates the original
data using random projection, and demonstrates its applications in Kronecker
product regression and tensorized neural network approximations.
At the end of this book, the existing software for tensor computation and its data
analysis applications are summarized in the appendix.
This book has introductory parts on tensor computation, and advanced parts
on machine learning techniques and practical applications. It can serve as a text
book for graduates to systematically understand most of the tensor based machine
learning techniques. The researchers can also refer to it to follow the state of the art
on these specific techniques. As the book provides a number of examples, industrial
engineers can also consult it for developing practical data processing applications.
Preface vii

We would like to particularly thank the current and past group members in
this area. These include Lanlan Feng, Zihan Li, Zhonghao Zhang, Huyan Huang,
Yingyue Bi, Hengling Zhao, Xingyu Cao, Shenghan Wang, Yingcong Lu, Bin Chen,
Shan Wu, Longxi Chen, Sixing Zeng, Tengteng Liu, and Mingyi Zhou. We also
thank our editors Charles Glaser and Arjun Narayanan for their advice and support.
This project is supported in part by the National Natural Science Foundation of
China under grant No. 61602091.

Chengdu, China Yipeng Liu

Chengdu, China Jiani Liu
Chengdu, China Zhen Long
Chengdu, China Ce Zhu
March 2021
Contents

1 Tensor Computation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
1.1 Notations. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
1.1.1 Special Examples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
1.2 Basic Matrix Computation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.3 Tensor Graphical Representation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
1.4 Tensor Unfoldings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
1.4.1 Mode-n Unfolding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
1.4.2 Mode-n1 n2 Unfolding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
1.4.3 n-Unfolding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
1.4.4 l-Shifting n-Unfolding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
1.5 Tensor Products . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
1.5.1 Tensor Inner Product . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
1.5.2 Mode-n Product . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
1.5.3 Tensor Contraction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
1.5.4 t-Product . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
1.5.5 3-D Convolution . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
1.6 Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
2 Tensor Decomposition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
2.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
2.2 Canonical Polyadic Decomposition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
2.2.1 Tensor Rank. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
2.2.2 CPD Computation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
2.2.3 Uniqueness . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
2.3 Tucker Decomposition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
2.3.1 The n-Rank . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
2.3.2 Computation and Optimization Model . . . . . . . . . . . . . . . . . . . . 27
2.3.3 Uniqueness . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28

ix
x Contents

2.4 Block Term Decomposition. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29

2.4.1 The Computation of BTD . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
2.4.2 Uniqueness . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
2.5 Tensor Singular Value Decomposition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
2.6 Tensor Networks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
2.6.1 Hierarchical Tucker Decomposition . . . . . . . . . . . . . . . . . . . . . . . 37
2.6.2 Tensor Train Decomposition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
2.7 Hybrid Decomposition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
2.7.1 Hierarchical Low-Rank Tensor Ring Decomposition. . . . . 46
2.8 Scalable Tensor Decomposition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
2.8.1 Scalable Sparse Tensor Decomposition . . . . . . . . . . . . . . . . . . . 49
2.8.2 Strategy on Dense Tensor Decomposition. . . . . . . . . . . . . . . . . 50
2.9 Summary and Future Work . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54
3 Tensor Dictionary Learning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59
3.1 Matrix Dictionary Learning. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59
3.1.1 Sparse and Cosparse Representation . . . . . . . . . . . . . . . . . . . . . . 59
3.1.2 Dictionary Learning Methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
3.2 Tensor Dictionary Learning Based on Different
Decompositions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
3.2.1 Tucker Decomposition-Based Approaches . . . . . . . . . . . . . . . . 65
3.2.2 CP Decomposition-Based Approaches . . . . . . . . . . . . . . . . . . . . 72
3.2.3 T-Linear-Based Approaches. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74
3.3 Analysis Tensor Dictionary Learning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77
3.3.1 Analysis Tensor Dictionary Learning Based on
Mode-n Product . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77
3.3.2 Tensor Convolutional Analysis Dictionary
Learning Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80
3.4 Online Tensor Dictionary Learning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81
3.5 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 84
3.5.1 Image Denoising . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 84
3.5.2 Fusing Hyperspectral and Multispectral Images . . . . . . . . . . 86
3.6 Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 88
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 88
4 Low-Rank Tensor Recovery . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93
4.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93
4.2 Matrix Completion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94
4.2.1 Rank Minimization Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94
4.2.2 Low-Rank Matrix Completion Model . . . . . . . . . . . . . . . . . . . . . 95
4.3 Tensor Completion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95
4.3.1 Rank Minimization Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96
4.3.2 Low-Rank Tensor Factorization Model. . . . . . . . . . . . . . . . . . . . 100
Contents xi

4.4 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102

4.4.1 Visual Data Recovery . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102
4.4.2 Recommendation System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106
4.4.3 Knowledge Graph Completion. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108
4.4.4 Traffic Flow Prediction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110
4.5 Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112
5 Coupled Tensor for Data Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115
5.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115
5.2 Coupled Tensor Component Analysis Methods . . . . . . . . . . . . . . . . . . . . 116
5.2.1 Coupled Matrix and Tensor Factorization Model . . . . . . . . . 116
5.2.2 Coupled Tensor Factorization Model . . . . . . . . . . . . . . . . . . . . . . 118
5.2.3 Generalized Coupled Tensor Factorization
Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121
5.3 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124
5.3.1 HSI-MSI Fusion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124
5.3.2 Link Prediction in Heterogeneous Data . . . . . . . . . . . . . . . . . . . 125
5.3.3 Visual Data Recovery . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 128
5.4 Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 130
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 130
6 Robust Principal Tensor Component Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . 133
6.1 Principal Component Analysis: From Matrix to Tensor. . . . . . . . . . . . 133
6.2 RPTCA Methods Based on Different Decompositions . . . . . . . . . . . . . 134
6.2.1 t-SVD-Based RPTCA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 135
6.2.2 Higher-Order t-SVD-Based RPTCA . . . . . . . . . . . . . . . . . . . . . . 145
6.2.3 RTPCA Based on Other Tensor Decompositions . . . . . . . . . 146
6.3 Online RPTCA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 148
6.4 RTPCA with Missing Entries . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 151
6.5 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 152
6.5.1 Illumination Normalization for Face Images . . . . . . . . . . . . . . 152
6.5.2 Image Denoising . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153
6.5.3 Background Extraction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 155
6.5.4 Video Rain Streaks Removal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 156
6.5.5 Infrared Small Target Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . 157
6.6 Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 159
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 160
7 Tensor Regression . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 163
7.1 High-Dimensional Data-Related Regression Tasks. . . . . . . . . . . . . . . . . 163
7.2 Tensor Regression Framework. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 164
7.3 Linear Tensor Regression Models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 165
7.3.1 Simple Tensor Linear Regression . . . . . . . . . . . . . . . . . . . . . . . . . . 167
7.3.2 Generalized Tensor Linear Regression . . . . . . . . . . . . . . . . . . . . 172
7.3.3 Penalized Tensor Regression . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 174
xii Contents

7.3.4 Bayesian Approaches for Tensor Linear Regression. . . . . . 178

7.3.5 Projection-Based Tensor Regression . . . . . . . . . . . . . . . . . . . . . . 180
7.4 Nonlinear Tensor Regression . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 184
7.4.1 Kernel-Based Learning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 184
7.4.2 Gaussian Process Regression . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 186
7.4.3 Tensor Additive Models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 187
7.4.4 Random Forest-Based Tensor Regression . . . . . . . . . . . . . . . . . 188
7.5 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 189
7.5.1 Vector-on-Tensor Regression . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 189
7.5.2 Tensor-on-Vector Regression . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 191
7.5.3 Tensor-on-Tensor Regression . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 192
7.6 Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 193
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 195
8 Statistical Tensor Classification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 199
8.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 199
8.2 Tensor Classification Basics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 200
8.3 Logistic Tensor Regression . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 202
8.3.1 Logistic Regression. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 202
8.3.2 Logistic Tensor Regression . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 203
8.4 Support Tensor Machine . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 205
8.4.1 Support Vector Machine. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 205
8.4.2 Support Tensor Machine . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 207
8.4.3 Higher-Rank Support Tensor Machine . . . . . . . . . . . . . . . . . . . . 208
8.4.4 Support Tucker Machine . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 210
8.5 Tensor Fisher Discriminant Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 211
8.5.1 Fisher Discriminant Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 211
8.5.2 Tensor Fisher Discriminant Analysis . . . . . . . . . . . . . . . . . . . . . . 213
8.6 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 214
8.6.1 Handwriting Digit Recognition . . . . . . . . . . . . . . . . . . . . . . . . . . . . 214
8.6.2 Biomedical Classification from fMRI Images. . . . . . . . . . . . . 215
8.7 Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 216
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 217
9 Tensor Subspace Cluster . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 219
9.1 Background . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 219
9.2 Tensor Subspace Cluster Based on K-Means . . . . . . . . . . . . . . . . . . . . . . . 220
9.2.1 Matrix-Based K-Means Clustering . . . . . . . . . . . . . . . . . . . . . . . . 220
9.2.2 CP Decomposition-Based Clustering . . . . . . . . . . . . . . . . . . . . . . 221
9.2.3 Tucker Decomposition-Based Clustering . . . . . . . . . . . . . . . . . 223
9.3 Tensor Subspace Cluster Based on Self-Representation . . . . . . . . . . . 225
9.3.1 Matrix Self-Representation-Based Clustering . . . . . . . . . . . . 225
9.3.2 Self-Representation in Tucker Decomposition Form . . . . . 227
9.3.3 Self-Representation in t-SVD Form . . . . . . . . . . . . . . . . . . . . . . . 228
Contents xiii

9.4 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 231

9.4.1 Heterogeneous Information Networks Clustering . . . . . . . . 231
9.4.2 Biomedical Signals Clustering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 233
9.4.3 Multi-View Subspace Clustering . . . . . . . . . . . . . . . . . . . . . . . . . . 234
9.5 Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 237
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 237
10 Tensor Decomposition in Deep Networks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 241
10.1 Introduction to Deep Learning. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 241
10.1.1 Convolutional Neural Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . 243
10.1.2 Recurrent Neural Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 244
10.2 Network Compression by Low-Rank Tensor Approximation . . . . . . 245
10.2.1 Network Structure Design. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 245
10.2.2 t-Product-Based DNNs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 246
10.2.3 Tensor Contraction Layer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 247
10.2.4 Deep Tensorized Neural Networks Based on
Mode-n Product . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 248
10.2.5 Parameter Optimization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 251
10.3 Understanding Deep Learning with Tensor Decomposition . . . . . . . 252
10.4 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 256
10.4.1 MNIST Dataset Classification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 256
10.4.2 CIFAR-10 Dataset Classification . . . . . . . . . . . . . . . . . . . . . . . . . . 259
10.5 Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 261
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 261
11 Deep Networks for Tensor Approximation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 265
11.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 265
11.2 Classical Deep Neural Networks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 266
11.3 Deep Unrolling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 267
11.4 Deep Plug-and-Play . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 270
11.5 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 271
11.5.1 Classical Neural Networks for Tensor Rank
Estimation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 271
11.5.2 Deep Unrolling Models for Video Snapshot
Compressive Imaging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 275
11.5.3 Deep PnP for Tensor Completion . . . . . . . . . . . . . . . . . . . . . . . . . . 278
11.6 Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 282
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 282
12 Tensor-Based Gaussian Graphical Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 285
12.1 Background . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 285
12.2 Vector-Variate-Based Gaussian Graphical Model . . . . . . . . . . . . . . . . . . 287
12.3 Matrix-Variate-Based Gaussian Graphical Model . . . . . . . . . . . . . . . . . . 289
12.4 Tensor-Based Graphical Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 291
xiv Contents

12.5 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 294

12.5.1 Environmental Prediction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 294
12.5.2 Mice Aging Study . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 295
12.6 Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 297
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 297
13 Tensor Sketch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 299
13.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 299
13.2 Count Sketch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 301
13.3 Tensor Sketch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 302
13.4 Higher-Order Count Sketch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 304
13.5 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 305
13.5.1 Tensor Sketch for Tensor Decompositions . . . . . . . . . . . . . . . . 306
13.5.2 Tensor Sketch for Kronecker Product Regression . . . . . . . . 313
13.5.3 Tensor Sketch for Network Approximations . . . . . . . . . . . . . . 315
13.6 Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 318
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 319

A Tensor Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 323

References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 326

Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 329
Acronyms

ADMM Alternating direction method of multipliers

ALS Alternating least squares
AMP Approximate message passing
AR Autoregression
ASR Automatic speech recognition
AUC Area under curve
BCD Block coordinate descent
BP Basis pursuit
BTD Block term decomposition
CMTF Coupled matrix and tensor factorization
CNN Convolutional neural network
CPD Canonical polyadic decomposition
CS Compressed sensing/count sketch
CV Computer version
DCT Discrete cosine transform
DNN Deep neural network
ECoG Electrocorticography
EEG Electroencephalography
ERGAS Relative dimensionless global error in synthesis
EVD Eigenvalue decomposition
FDA Fisher discriminant analysis
FDP False discovery proportion
FDR False discovery rate
FFT Fast Fourier Transform
fMRI Functional magnetic resonance imaging
FOCUSS Focal under-determined system solver
GAN Generative adversarial networks
GGM Gaussian graphical model
GLM Generalized linear models
GP Gaussian process
HCL Honey-comb lattice

xv
xvi Acronyms

HCS Higher-order count sketch

HOOI Higher-order orthogonal iteration
HOSVD Higher-order singular value decomposition
HSI Hyperspectral image
HT Hierarchical Tucker
i.i.d. Independently identically distributed
KLD Kullback-Leibler Divergence
K-SVD K-singular value decomposition
LS Least squares
LSTM Long short-term memory
MAE Mean absolute error
MAP Maximum a-posteriori probability
MERA Multi-scale entanglement renormalization ansatz
MLD Maximum likelihood methods
MLMTL Multilinear multitask learning
MP Matching pursuit
MSE Mean squared error
MSI Multi-spectral image
NLP Natural language processing
NMF Nonnegative matrix factorization
OMP Orthogonal matching pursuit
PCA Principal component analysis
PDF Probability density function
PEPS Projectedentangled-pairstates
PGM Probabilistic graphical model
PLS Partial least squares
PnP Plug-and-play
RMSE Root mean square error
RNN Recurrent neural network
RPCA Robust principal component analysis
RPTCA Robust principal tensor component analysis
SAM Spectral angle mapper
SRI Super-resolution image
SSIM Structural similarity
STM Support tensor machine
SVD Singular value decomposition
SVM Support vector machine
TFNN Tensor factorization neural network
TISTA Tensor-based fast iterative shrinkage thresholding algorithm
TNN Tensor nuclear norm/tensorized neural network
TNs Tensor networks
TPG Tensor projected gradient
TR Tensor ring
TS Tensor sketch
t-SVD Tensor singular value decomposition
Another Random Scribd Document
with Unrelated Content
People say: "She is a good woman, but a worldly Christian." What?
Might as well speak of a heavenly devil. Might as well expect a
mummy to speak and bear children as that kind to move the world
Godward. Prayer draws you nearer to God.

Learning of Christ
"Teach us to pray," implies that I want to be taught. It's a great
privilege to be taught by Jesus. A friend of mine was preaching out
in Cedar Rapids, Iowa, and had to go to a hospital in Chicago for an
operation, and I was asked to go and preach in his place. Alexander
was leading the singing, and one night Charles called a little girl out
of the audience to sing. She didn't look over four or five years of
age, though she might have been a little older. I thought, "What's
the use? Her little voice can never be heard over this crowd." But
Charlie stood her up in a chair by the pulpit and she threw back her
head and out rolled some of the sweetest music I have ever heard.
It was wonderful. I sat there and the tears streamed down my
cheeks. That little girl was the daughter of a Northwestern engineer
and he took her to Chicago when her mother was away. Some one
took her to Patti. Patti took the little girl to one of her suite of rooms
and told her to stand there and sing. Then she went to the other
end of the suite and sat down on a divan and listened. The song
moved her to tears. She ran and hugged and kissed the little girl and
sat her down on the divan and said to her: "Now you sit here and I'll
go over there and sing." She took up her position where the child
had stood, and she lifted her magnificent voice and she sang "Home,
Sweet Home" and "The Last Rose of Summer"—sang them for that
little girl! And Patti used to get a thousand dollars for a song, too.
She always knew how many songs she was to sing, for she had a
check before she went on the platform. It was a great privilege the
little daughter of that Northwestern engineer had, but it's a greater
privilege to learn from Jesus Christ how to pray.
A friend of mine told me he went to hear Paganini, and the great
violinist broke one of the strings of his instrument, then another,
then another, until he had only one left, and on that one he played
so wonderfully that his audience burst into terrific applause. It was a
privilege to hear that, but it's a greater privilege to have Jesus teach
you to pray.
Let us take a few examples from the life of Christ. In Mark we learn
that he rose up early in the morning and went out to a solitary place
and prayed. He began every day with prayer. You never get up
without dressing. You never forget to wash your face and comb your
hair. You always think of breakfast. You feed your physical body. Why
do you starve your spiritual body? If nine-tenths of you were as
weak physically as you are spiritually, you couldn't walk.
When I was assistant secretary of the Y. M. C. A. at Chicago, John G.
Paton came home from the New Hebrides and was lecturing and
collecting money. He was raising money to buy a sea-going steam
yacht, for his work took him from island to island and he had to use
a row-boat, and sometimes it was dangerous when the weather was
bad, so he wanted the yacht. We had him for a week, and it was my
privilege to go to lunch with him. We would go out to a restaurant at
noon and he would talk to us. Sometimes there would be as many
as fifteen or twenty preachers in the crowd, and now and then some
of us were so interested in what he told us of the work for Jesus in
those far-away islands that we forgot to eat. I remember that he
said one day: "All that I am I owe to my Christian father and mother.
My father was one of the most prayerful men I ever knew. Often in
the daytime he would slip into his closet, and he would drop a
handkerchief outside the door, and when we children saw the white
sentinel we knew that father was talking with his God and would go
quietly away. It is largely because of the life and influence of that
same saintly father that I am preaching to the cannibals in the South
Seas." It is an insult to God and a disgrace to allow children to grow
up without throwing Christian influences around them. Seven-tenths
of professing Christians have no family prayers and do not read the
Bible. It is no wonder boys and girls are going to hell. It is no
wonder the damnable ball-rooms are wrecking the virtue of our girls.
In the fourteenth chapter of Matthew it is told that when Jesus had
sent the multitudes away he went up into the mountain and was
there alone with God. Jesus Christ never forgot to thank God for
answering his prayers. Jesus asked him to help him feed the
multitude, and he didn't neglect to thank him for it. Next time you
pray don't ask God for anything. Just try to think of all the things
you have to be thankful for, and tell him about them.

Pride Hinders Prayer

Pride keeps us from proper prayer. Being chesty and big-headed is
responsible for more failures than anything else in this world. It has
spoiled many a preacher, just as it has spoiled many an employee.
Some fellows get a job and in about two weeks they think they know
more about the business than the boss does. They think he is all
wrong. It never occurs to them that it took some brains and some
knowledge to build that business up and keep it running till they got
there.
Here's two things to guard against. Don't get chesty over success, or
discouraged over a seeming defeat.
"And when he prayed he said: 'Lazarus, come forth'; and he that
was dead came forth." If we prayed right we would raise men from
sin and bring them forth into the light of righteousness.
"And as he prayed the fashion of his countenance was altered."
Ladies, do you want to look pretty? If some of you women would
spend less on dope and cold cream and get down on your knees and
pray, God would make you prettier. Why, I can look into your faces
and tell what sort of lives you live. If you are devoting your time and
thoughts to society, your countenances will show it. If you pray, I
can see that.
Every man who has helped to light up the dark places of the world
has been a praying man. I never preach a sermon until I've soaked it
in prayer. Never. Then I never forget to thank God for helping me
when I preach. I don't care whether you read your prayers out of a
book or whether you just say them, so long as you mean them. A
man can read his prayers and go to heaven, or he may just say his
prayers and go to hell. We've got to face conditions. When I read I
find that all the saintly men who have done things from Pentecost
until today, have known how to pray. It was a master stroke of the
devil when he got the church to give up prayer. One of the biggest
farces today is the average prayer-meeting.

Praying in Secret
Matthew says, "But thou, when thou prayest, enter into thy closet,
and when thou hast shut thy door, pray to thy Father, which is in
secret; and thy Father which seeth in secret shall reward thee
openly."
Two men came to the Temple to pray—the first was the Pharisee. He
was nice and smooth, and his attitude was nice and smooth. He
prayed: "God, I thank thee that I am not as other men are,
extortioners, unjust, adulterers, or even as this publican. I fast twice
in the week, I give tithes of all I possess," and he went out. I can
imagine a lot of people sitting around the church and saying: "That
is my idea of religion; that is it. I am no sensationalist; I don't want
anything vulgar, no slang." Why don't you use a little, bud, so that
something will come your way? And it will come as straight as two
and two make four.
Services rendered in such opposite directions cannot meet with the
same results. If two men were on the top of a tall building and one
should jump and one come down the fire escape they couldn't
expect to meet with the same degree of safety. The Pharisee said,
"Thank God, I am not as other men are," and the publican said,
"God be merciful to me, a sinner." The first man went to his house
the same as when he came out of it. "God be merciful to me, a
sinner." That man was justified. I am justified in my faith in Jesus
Christ. I am no longer a sinner. I am justified as though I had never
sinned by faith in the Son of God. That man went down to his house
justified.

Praying in Humility
How many people pray in a real sense? How many people pray in
humility and truth? Some men pray for humility when it is pride they
want. Many a man gets down on his knees and says: "Our Father,
who art in heaven, hallowed be thy name: thy kingdom come—"
That is not so; they don't want God's kingdom to come. It is not so
with half the people that pray. I say to you when you pray in the
church pew and say that, it don't count a snap of my finger if you
don't live it. You pray, "Thy kingdom come," and then you go out
and do something to prevent that kingdom from coming. No man
can get down and pray "Thy kingdom come," and have a beer
wagon back up to his door and put beer in the ice box. No man can
get down on his knees and pray "Thy kingdom come," and look
through the bottom of a beer glass. God won't stand for it. If you
wanted God's will done you would do God's will, even if it took every
drop of blood in your body to do it.
"Thy will be done on earth as it is in heaven." When you say this in
your pew on Sunday it means nothing unless you live it on Monday.
You say "Thy kingdom come," and then go out and do the very thing
that will prevent God's kingdom from coming. Your prayers or
anything you do in the church on Sunday mean nothing if you don't
do the same thing in business on Monday. I don't care how loud
your wind-jamming in prayer-meeting may be if you go out and skin
somebody in a horse deal the next day.
The man who truly prays, "Thy kingdom come," cannot take his
heart out of his prayer when he is out of the church. The man who
truly prays "Thy kingdom come," will not be shrinking his measures
at the store; the load of coal he sends to you won't be half slate.
The man who truly prays "Thy kingdom come" won't cut off his
yardstick when he measures you a piece of calico. It will not take the
pure-food law to keep a man who truly prays "Thy kingdom come"
from putting chalk in the flour, sand in the sugar, brick dust in red
pepper, ground peanut shells in breakfast food.
The man who truly prays "Thy kingdom come" cannot pass a saloon
and not ask himself the question, "What can I do to get rid of that
thing that is blighting the lives of thousands of young men, that is
wrecking homes, and that is dragging men and women down to
hell?" You cannot pray "Thy kingdom come," and then rush to the
polls and vote for the thing that is preventing that kingdom from
coming. You cannot pray "Thy kingdom come" and then go and do
the things that make the devil laugh. For the man who truly prays
"Thy kingdom come" it would be impossible to have one kind of
religion on his knees and another when he is behind the counter; it
would be impossible to have one kind of religion in the pew and
another in politics. When a man truly prays "Thy kingdom come" he
means it in everything or in nothing.
A lot of church members are praying wrong. You should pray first,
"God be merciful to me a sinner," and then "Thy kingdom come."
Saying a prayer is one thing: doing God's will is another. Both should
be synonymous. Angels are angels because they do God's will. When
they refuse to do God's will they become devils.
Many a man prays when he gets in a hole. Many a man prays when
he is up against it. Many a man prays in the time of trouble, but
when he can stick his thumbs in his armholes and take a pair of
scissors and cut his coupons off, then it is "Good-bye, God; I'll see
you later." Many a man will make promises to God in his extremity,
but forget them in his prosperity. Many a man will make promises to
God when the hearse is backed up to the door to carry the baby out,
but will soon forget the promises made in the days of adversity.
Many a man will make promises when lying on his back, thinking he
is going to die, and load up just the same when he is on his feet.
 Men of Prayer
Every man and every woman that God has used to halt this sin-
cursed world and set it going Godward has been a Christian of
prayer. Martin Luther arose from his bed and prayed all night, and
when the break of day came he called his wife and said to her, "It
has come." History records that on that very day King Charles
granted religious toleration, a thing for which Luther had prayed.
John Knox, whom his queen feared more than any other man, was
in such agony of prayer that he ran out into the street and fell on his
face and cried, "O God, give me Scotland or I'll die." And God gave
him Scotland and not only that, he threw England in for good
measure.
When Jonathan Edwards was about to preach his greatest sermon
on "Sinners in the Hands of an Angry God," he prayed for days; and
when he stood before the congregation and preached it, men caught
at the seats in their terror, and some fell to the floor; and the people
cried out in their fear, "Mr. Edwards, tell us how we can be saved!"
The critical period of American history was between 1784 and 1789.
There was no common coinage, no common defense. When the
colonies sent men to a constitutional convention, Benjamin Franklin,
rising with the weight of his four score years, asked that the
convention open with prayer, and George Washington there sealed
the bargain with God. In that winter in Valley Forge, Washington led
his men in prayer and he got down on his knees to do it.
When the battle of Gettysburg was on, Lincoln, old Abe Lincoln, was
on his knees with God; yes, he was on his knees from five o'clock in
the afternoon till four o'clock in the morning, and Bishop Simpson
was with him.
"And whatsoever ye shall ask the Father in My name, that will I do,
that the Father may be glorified in the Son." No man can ever be
saved without Jesus Christ. There's no way to God unless you come
through Jesus Christ. It's Jesus Christ or nothing.
"Lord, teach us to pray."
 CHAPTER XXIII
The Revival on Trial
One spark of fire can do more to prove the power of powder
than a whole library written on the subject.—Billy Sunday.

W
hat Evangelist Sunday says to his congregations is sometimes
less significant than what he helps his congregation to say to
the world. Let us take a sample meeting in the Pittsburgh
campaign, with the tremendous deliverance which it made upon the
subject of revivals and conversions.
A "sea of faces" is a petrified phrase, which means nothing to most
readers. Anybody who will stand on the platform behind Billy Sunday
at one of his great tabernacles understands it. More than twenty
thousand faces, all turned expectantly toward one man, confront
you. The faces rather than the hair predominate. There are no hats
in sight.
Like the billows along the shore, which may be observed in detail,
the nearer reaches of this human sea are individualized. What a
Madonna-face yonder girl has! See the muscles of that young man's
jaw working, in the intensity of his interest. The old man who is
straining forward, so as not to miss a word, has put a black and
calloused hand behind his ear. That gray-haired woman with the
lorgnette and rolls of false hair started out with the full
consciousness that she was a "somebody": watch her wilt and
become merely a tired, heart-hungry old woman. And the rows and
rows of undistinguished commonplace people, just like the crowds
we meet daily in the street cars.
Somehow, though, each seems here engaged in an individual
transaction. A revival meeting accents personality. Twenty or thirty
rows down the big congregation begins to blurr in appearance, and
individual faces are merged in the mass. The host, which is but an
agglomeration of individuals, is impressive. The "sea of faces" is
more affecting than old ocean's expanse.
Where else may one so see "the people"; or fundamental human
nature so expressing itself? One compares these crowds with the
lesser throngs that followed Jesus when he walked the earth, and
recalls that "greater works than these shall they do." There is a
sermon in every aspect of the Billy Sunday meetings.
Curiously, people will reveal more of themselves, be more candid
concerning their inner experiences, in a crowd than when taken one
by one. Thus this congregation is a rare laboratory. Tonight the
evangelist is going to make an experiment upon revivals and their
value.
It is common to object to revivals and to revivalists. Billy Sunday's
reply to this is simply unanswerable: he appeals to the people
themselves for evidence. By a show of hands—and he conducts this
experiment in practically every community he visits—he gives a
convincing demonstration that it is by special evangelistic efforts that
most Christians have entered the Church of Christ. By the same
method, he shows that youth is the time to make the great decision.
When this question is put to a test a dramatic moment, the
significance of which the multitude quickly grasps, ensues. On this
occasion there are more than twenty thousand persons within the
Tabernacle. First the evangelist asks the confessed Christians to rise.
The great bulk of the congregation stands on its feet. Then he asks
for those who were converted in special meetings, revivals of some
sort or other, to raise their hands. From three-fourths to four-fifths of
the persons standing lift their hands in token that they were
converted during revivals.
Then—each time elaborating his question so that there may be no
misunderstanding—Sunday asks those who were converted before
they were twenty to indicate it. Here again the majority is so large
as to be simply overwhelming. It almost seems that the whole body
of Christians had become such before they attained their legal
majority.
Of the few hundreds that are left standing, Sunday asks in turn for
those who were converted before they were thirty, those who were
converted before they were forty, before they were fifty, before they
were sixty. When it comes to this point of age the scene is thrilling in
its significance. Usually there are only one or two persons standing
who have entered the Christian life after reaching fifty years of age.
The conclusion is irresistible. Unless a person accepts Christ in youth
the chances are enormously against his ever accepting Him
subsequently. The demonstration is an impressive vindication of
revivals, and of the importance of an early decision for Christ.
After such a showing as this, everybody is willing to listen to a
sermon upon revivals and their place in the economy of the Kingdom
of Heaven.

"THE NEED OF REVIVALS"

Somebody asks: "What is a revival?" Revival is a purely
philosophical, common-sense result of the wise use of divinely
appointed means, just the same as water will put out a fire; the
same as food will appease your hunger; just the same as water will
slake your thirst; it is a philosophical common-sense use of divinely
appointed means to accomplish that end. A revival is just as much
horse sense as that.
A revival is not material; it does not depend upon material means. It
is a false idea that there is something peculiar in it, that it cannot be
judged by ordinary rules, causes and effects. That is nonsense.
Above your head there is an electric light; that is effect. What is the
cause? Why, the dynamo. Religion can be judged on the same basis
of cause and effect. If you do a thing, results always come. The
results come to the farmer. He has his crops. That is the result. He
has to plow and plant and take care of his farm before the crops
come.
Religion needs a baptism of horse sense. That is just pure horse
sense. I believe there is no doctrine more dangerous to the Church
today than to convey the impression that a revival is something
peculiar in itself and cannot be judged by the same rules of causes
and effect as other things. If you preach that to the farmers—if you
go to a farmer and say "God is a sovereign," that is true; if you say
"God will give you crops only when it pleases him and it is no use for
you to plow your ground and plant your crops in the spring," that is
all wrong, and if you preach that doctrine and expect the farmers to
believe it, this country will starve to death in two years. The
churches have been preaching some false doctrines and religion has
died out.
Some people
think that
religion is a
good deal like a
storm. They sit
around and fold
their arms, and
that is what is
the matter. You
sit in your pews
so easy that you
become
mildewed. Such
results will be
sure to follow if
you are "You Sit in Your Pews so Easy that You Become Mildewed"
persuaded that
religion is
something mysterious and has no natural connection between the
means and the end. It has a natural connection of common sense
and I believe that when divinely appointed means are used spiritual
blessing will accrue to the individuals and the community in greater
numbers than temporal blessings. You can have spiritual blessings as
regularly as the farmer can have corn, wheat, oats, or you can have
potatoes and onions and cabbage in your garden. I believe that
spiritual results will follow more surely than temporal blessings. I
don't believe all this tommyrot of false doctrines. You might as well
sit around beneath the shade and fan yourself and say "Ain't it hot?"
as to expect God to give you a crop if you don't plow the ground and
plant the seed. Until the Church resorts to the use of divinely
appointed means it won't get the blessing.

What a Revival Does

What is a revival? Now listen to me. A revival does two things. First,
it returns the Church from her backsliding and second, it causes the
conversion of men and women; and it always includes the conviction
of sin on the part of the Church. What a spell the devil seems to cast
over the Church today!
I suppose the people here are pretty fair representatives of the
Church of God, and if everybody did what you do there would never
be a revival. Suppose I did no more than you do, then no people
would ever be converted through my efforts; I would fold my arms
and rust out. A revival helps to bring the unsaved to Jesus Christ.
God Almighty never intended that the devil should triumph over the
Church. He never intended that the saloons should walk rough-shod
over Christianity. And if you think that anybody is going to frighten
me, you don't know me yet.
When is a revival needed? When the individuals are careless and
unconcerned. If the Church were down on her face in prayer they
would be more concerned with the fellow outside. The Church has
degenerated into a third-rate amusement joint, with religion left out.
When is a revival needed? When carelessness and unconcern keep
the people asleep. It is as much the duty of the Church to awaken
and work and labor for the men and women of this city as it is the
duty of the fire department to rush out when the call sounds. What
would you think of the fire department if it slept while the town
burned? You would condemn them, and I will condemn you if you
sleep and let men and women go to hell. It is just as much your
business to be awake. The Church of God is asleep today; it is
turned into a dormitory, and has taken the devil's opiates.

Copyright, 1908, by C. U. Williams.

"I Never Look at a Child or an Older Person Without Thinking, 'There is a Casket of
Locked-up Possibilities. Only the Key of Salvation is Needed to Open it.'"
 Copyright, 1908, by C. U. Williams.

"Samson with the Holy Spirit could take the Jawbone of an Ass and Lay Dead a
Thousand Philistines."

When may a revival be expected? When the wickedness of the

wicked grieves and distresses the Christian. Sometimes people don't
seem to mind the sins of other people. Don't seem to mind while
boys and girls walk the streets of their city and know more of evil
than gray-haired men. You are asleep.
When is a revival needed? When the Christians have lost the spirit of
prayer.
When is a revival needed? When you feel the want of revival and
feel the need of it. Men have had this feeling, ministers have had it
until they thought they would die unless a revival would come to
awaken their people, their students, their deacons and their Sunday-
school workers, unless they would fall down on their faces and
renounce the world and the works and deceits of the devil. When
the Church of God draws its patrons from the theaters the theaters
will close up, or else take the dirty, rotten plays off the stage.
When the Church of God stops voting for the saloon, the saloon will
go to hell. When the members stop having cards in their homes,
there won't be so many black-legged gamblers in the world. This is
the truth. You can't sit around and fold your arms and let God run
this business; you have been doing that too long here. When may a
revival be expected? When Christians confess their sins one to
another. Sometimes they confess in a general way, but they have no
earnestness; they get up and do it in eloquent language, but that
doesn't do it. It is when they break down and cry and pour out their
hearts to God in grief, when the flood-gates open, then I want to tell
you the devil will have cold feet.

Revival Demands Sacrifice

When may a revival be expected? When the wickedness of the
wicked grieves and distresses the Church. When you are willing to
make a sacrifice for the revival; when you are willing to sacrifice
your feelings. You say, "Oh, well, Mr. Sunday hurt my feelings." Then
don't spread them all over his tabernacle for men to walk on. I
despise a touchy man or woman. Make a sacrifice of your feelings;
make a sacrifice of your business, of your time, of your money; you
are willing to give to help to advance God's cause, for God's cause
has to have money the same as a railroad or a steamship company.
When you give your influence and stand up and let people know you
stand for Jesus Christ and it has your indorsement and time and
money. Somebody has got to get on the firing line. Somebody had to
go on the firing line and become bullet meat for $13 a month to
overcome slavery. Somebody has to be willing to make a sacrifice.
They must be willing to get out and hustle and do things for God.
When may a revival be expected? A revival may be expected when
Christian people confess and ask forgiveness for their sins. When
you are willing that God shall promote and use whatever means or
instruments or individuals or methods he is pleased to use to
promote them. Yes. The trouble is he cannot promote a revival if you
are sitting on the judgment of the methods and means that God is
employing to promote a revival. The God Almighty may use any
method or means or individual that he pleases in order to promote a
revival. You are not running it. Let God have his way. You can tell
whether you need a revival. You can tell if you will have one and
why you have got one. If God should ask you sisters and preachers
in an audible voice, "Are you willing that I should promote a revival
by using any methods or means or individual language that I choose
to use to promote it?" what would be your answer? Yes. Then don't
growl if I use some things that you don't like. You have no business
to. How can you promote a revival? Break up your fallow ground, the
ground that produces nothing but weeds, briars, tin cans and brick-
bats. Fallow ground is ground that never had a glow in it. Detroit
had a mayor, Pingree, when Detroit had thousands and thousands of
acres of fallow ground. This was taken over by the municipal
government and planted with potatoes with which they fed the poor
of the city.
There are individuals who have never done anything for Jesus Christ,
and I have no doubt there are preachers as well, who have never
done anything for the God Almighty. There are acres and acres of
fallow ground lying right here that have never been touched. Look
over your past life, look over your present life and future and take
up the individual sins and with pencil and paper write them down. A
general confession will never do. You have committed your sins, one
by one, and you will have to confess them one by one. This thing of
saying, "God, I am a sinner," won't do.
"God, I am a gossiper in my neighborhood. God, I have been in my
ice-box while I am here listening to Mr. Sunday." Confess your sins.
How can you promote a revival? You women, if you found that your
husband was giving his love and attention to some other woman and
if you saw that some other woman was encroaching on his mind and
heart, and was usurping your place and was pushing you out of the
place, wouldn't you grieve? Don't you think that God grieves when
you push him out of your life? You don't treat God square. You
business men don't treat God fair. You let a thousand things come in
and take the place that God Almighty had. No wonder you are
careless. You blame God for things you have no right to blame him
for. He is not to blame for anything. You judge God. The spirit loves
the Bible; the devil loves the flesh.
If you don't do your part, don't blame God. How many times have
you blamed God when you are the liar yourself. You are wont to
blame him for the instances of unbelief that have come into your
life. When should we promote a revival? When there is a neglect of
prayer? When your prayers affect God? You never think of going out
on the street without dressing. You would be pinched before you
went a block. You never think of going without breakfast, do you? I
bet there are multitudes that have come here without reading the
Bible or praying for this meeting.
You can measure your desire for salvation by means of the amount
of self-denial you are willing to practice for Jesus Christ. You have
sinned before the Church, before the world, before God.
Don't the Lord have a hard time? Own up, now.

Persecution a Godsend
There are a lot of people in church, doubtless, who have denied
themselves—self-denial for comfort and convenience. There are a lot
of people here who never make any sacrifices for Jesus Christ. They
will not suffer any reproaches for Jesus Christ. Paul says, "I love to
suffer reproaches for Christ." The Bible says, "Woe unto you when
all men shall speak well of you." "Blessed are you when your
enemies persecute you." That is one trouble in the churches of God
today. They are not willing to suffer reproach for God's sake. It
would be a godsend if the Church would suffer persecution today;
she hasn't suffered it for hundreds of years. She is growing rich and
lagging behind. Going back.
Pride! How many times have you found yourself exercising pride?
How many times have you attempted pride of wealth? Proud
because you were related to some of the old families that settled in
the Colonies in 1776. That don't get you anything; not at all. I have
got as much to be proud of as to lineage as anyone; my great-
grandfather was in the Revolutionary War, lost a leg at Brandywine;
and my father was a soldier in the Civil War.
Envy! Envy of those that have more talent than you. Envious
because someone can own a limousine Packard and you have to ride
a Brush runabout; envious because some women can wear a
sealskin coat and you a nearseal.
Then there is your grumbling and fault-finding. When speaking of
people behind their backs, telling their faults, whether real or
imaginary, and that is slander. When you sit around and rip people
up behind their backs at your old sewing societies, when you rip and
tear and discuss your neighbors and turn the affair into a sort of a
great big gossiping society, with your fault-finding, grumbling and
growling. There is a big difference between levity and happiness,
and pleasure, and all that sort of thing.
Make up your mind that God has given himself up for you. I would
like to see something come thundering along that I would have
more interest in than I have in the cause of God Almighty! God has a
right to the first place. God is first, remember that.
Multitudes of people are willing to do anything that doesn't require
any self-denial on their part.
I am not a member of any lodge, and never expect to be, but if I
were a member of a lodge and there were a prayer-meeting and a
lodge-meeting coming on Wednesday night, I would be at the
prayer-meeting instead of at the lodge-meeting. I am not against
the lodges; they do some good work in the world, but that doesn't
save anyone for God. God is first and the lodge-meeting is second.
God is first and society second. God is first and business is second.
"In the beginning, God!" That is the way the Bible starts out and it
ought to be the way with every living being. "In the beginning, God."
Seek you first God and everything else shall be added unto you.
Christianity is addition; sin is subtraction. Christianity is peace, joy,
salvation, heaven. Sin takes away peace, happiness, sobriety, and it
takes away health. You are robbing God of the time that you
misspend. You are robbing God when you spend time doing
something that don't amount to anything, when you might do
something for Christ. You are robbing God when you go to foolish
amusements, when you sit around reading trashy novels instead of
the Word of God.
"Oh, Lord, revive thy work!"
I have only two minutes more and then I am through. Bad temper.
Abuse your wife and abuse your children; abuse your husband; turn
your old gatling-gun tongue loose. A lady came to me and said, "Mr.
Sunday, I know I have a bad temper, but I am over with it in a
minute." So is the shotgun, but it blows everything to pieces.
And, finally, you abuse the telephone girl because she doesn't
connect you in a minute. Bad temper. I say you abuse your wife, you
go cussing around if supper isn't ready on time; cussing because the
coffee isn't hot; you dig your fork into a hunk of beefsteak and put it
on your plate and then you say: "Where did you get this, in the
harness shop? Take it out and make a hinge for the door." Then you
go to your store, or office, and smile and everybody thinks you are
an angel about to sprout wings and fly to the imperial realm above.
Bad temper! You growl at your children; you snap and snarl around
the house until they have to go to the neighbors to see a smile.
They never get a kind word—no wonder so many of them go to the
devil quick.
 CHAPTER XXIV
An Army with Banners
The man who is right with God will not be wrong with anything
that is good.—Billy Sunday.

T
he oldest problem of the Christian Church, and the latest problem
of democracy, is how to reach the great mass of the people.
Frequently the charge is made that the Church merely skims the
surface of society, and that the great uncaring masses of the people
lie untouched beneath it. Commonly, a revival reaches only a short
distance outside the circumference of church circles. The wonder
and greatness of the Billy Sunday campaigns consist in the fact that
they reach to the uttermost rim of a community, to its greatest
height and its lowest depth. There can be no question that he stirs a
city as not even the fiercest political campaign stirs it. Sunday
touches life on all levels, bringing his message to bear upon the
society woman in her parlor and the humblest day laborer in the
trench.
This does not come to pass by any mere chance. Organized activity
achieves it. The method which produces the greatest results is what
is called the Delegation Idea, whereby detachments of persons from
various trades, callings and organizations and communities attend in
a body upon the services of the Sunday Tabernacle.
By pre-arrangement, seats are reserved every night for these visiting
delegations. Sometimes there will be as many as a dozen
delegations present in one evening. As the campaign progresses
towards its conclusion real difficulty is experienced in finding open
dates for all the delegations that apply. At the outset, Mr. Sunday's
assistants have to "work up" these delegations. Later, the
delegations themselves besiege the workers.
In variety the delegations range from a regiment of Boy Scouts to a
post of old soldiers; from the miners of a specified colliery to the
bankers of the city; from the telephone girls to the members of a
woman's club; from an athletic club to a Bible class.
Not only the community in which the meetings are being held
furnish these delegations, but the surrounding territory is drawn
upon. It is by no means an unknown thing for a single delegation,
numbering a thousand or fifteen hundred men, to come a distance
of fifteen or twenty-five miles to attend a Sunday Tabernacle service.
Almost every evening there are lines of special cars waiting for these
deputations who have come from afar, with their banners and their
badges and their bands, all bent upon hearing and being heard at
the Tabernacle.
The crowd spirit is appealed to by this method. The every-day
instinct of loyalty to one's craft or crowd is aroused. Each delegation
feels its own identity and solidarity, and wants to make as good a
showing as possible. There is considerable wholesome emulation
among the delegations representing the same craft or community. Of
course, the work of making ready the delegation furnishes a topic
for what is literally "shop talk" among working men; and naturally
each group zealously watches the effect of its appearance upon the
great congregation. Delegations get a very good idea of what their
neighbors think of them by the amount of applause with which they
are greeted. Thus when the whole force of a daily newspaper
appears in the Tabernacle its readers cheer vociferously. Every
delegation goes equipped with its own battle cry, and prepared to
make as favorable a showing as possible.
All this is wholesome for the community life. It fosters loyalty in the
varied groups that go to make up our society. Any shop is the better
for its workers, led by their heads of departments and by their
employers, having gone in a solid phalanx to a Tabernacle meeting.
Every incident of that experience becomes an unfailing source of
conversation for long days and weeks to follow.
The Tabernacle at Scranton, Pennsylvania, Typical of the Auditoriums That Are Erected
Wherever Campaigns are Conducted. To Deaden Sound the Floor is Covered with
Sawdust, whence the Name "Sawdust Trail." To Prevent the Possibility of a Panic, No
Board is Fastened with More than Two Nails, and There is a Door at the End of Every
Aisle.

Naturally, too, each delegation, delighted with the showing it has

made at the Tabernacle, and with the part it has borne in the
meeting, becomes one more group of partisans for the Billy Sunday
campaign. Men who would not go alone to the Tabernacle, cannot in
loyalty well refuse to stand by their own crowd. So it comes to pass
that the delegation idea penetrates every level and every section of
the community. A shrewder scheme for reaching the last man could
scarcely be devised. Thousands who are impervious to religious
appeals quickly respond to the request that they stand by their
shop-mates and associates.
Participation in the meetings makes the people themselves feel the
importance of their own part. They are not merely a crowd coming
to be talked at; they share in the meetings. The newspapers
comment upon them even as upon the sermon. All are uplifted by
the glow of geniality and camaraderie which pervades the
Tabernacle. For the songs and slogans and banners of the
delegations greatly help to swell the interest of the meetings.
All this is wholesome, democratic and typically American. This good-
natured crowd does not become unreal or artificial simply because it
is facing the fundamental verities of the human soul.
Outspokenness in loyalty, a characteristic of Sunday converts,
expresses itself through many channels. Taught by the delegation
idea, as well as by the sermon, the importance of standing up to be
counted, the friends and converts of the evangelist are always ready
for the great parade which usually is held toward the close of the
campaign. The simple basis for this street demonstration is found in
the old Scripture, "Let the redeemed of the Lord say so." The idea of
the Roman imperial triumph survives in the Billy Sunday parade. It is
a testimony to the multitudes of the loyalty of Christians to the
Gospel.
Beyond all question, a tremendous impression is made upon a city
by the thousands of marching men whom the evangelist first leads
and then reviews. A street parade is a visualization of the forces of
the Church in a community. Many a man of the street, who might be
unmoved by many arguments, however powerful, cannot escape the
impression of the might of the massed multitudes of men who
march through the streets, thousands strong. Some twenty thousand
men were in the Sunday parade at Scranton. Nobody who witnessed
them, be he never so heedless a scoffer, could again speak
slightingly of the Church. Religion loses whatever traits of femininity
it may have possessed, before the Sunday campaign is over.
Those most practical of men, the politicians, are quick to take
cognizance of this new power that has arisen in the community's life.
They know that every one of these men not only has a vote, but is a
center of influence for the things in which he believes.
The heartening effect of such a great demonstration as this upon the
obscure, lonely and discouraged saints is beyond calculation.
The great hosts of the Billy Sunday campaign are returning to first
principles by taking religion out into the highways and making it
talked about, even as the Founder of the Church created a
commotion in the highways of Capernaum and Jerusalem. These
marching men are a sermon one or two miles long. The impression
made upon youth is not to be registered by any means in the
possession of men. Every Christian the world around must be
grateful to this evangelist and his associates for giving the sort of
demonstration, which cannot be misunderstood by the world at
large, of the virility and the immensity of the hosts of heaven on
earth.
Many of the utterances of Billy Sunday are attuned to this note of
valiant witness-bearing for Christ.

"SPIRITUAL POWER"
Samson didn't realize that the Spirit of the Lord had departed from
him; he walked out and shook himself as aforetime; he weighed as
much; he was as strong physically; his mind was as active, but
although he possessed all that, there was one thing that was
necessary to make him as he had been: "He wist not that the Spirit
of the Lord had left him."
A man may have a fine physique; he may have strength; he may
have greatness; he may have a beautiful home; and a church may
be magnificent and faultless in its equipment; the preacher may be
able to reason; the choir may rival the angels in music; but if you
have not the Spirit of the Lord you are, as Paul says, as sounding
brass and tinkling cymbals, and the church is merely four walls with
a roof over it.
Nothing in the world can be substituted for the Spirit of God; no
wealth, culture nor anything in the world. By power we do not mean
numbers; there never has been a time when there were more
members in the Church than today; yet we haven't kept progress in
the number of members in the Church with the increased number of
people in the nation. Our nation has grown to over 90,000,000 of
people, but we are not correspondingly keeping pace with the
number of church members. God's Church has not increased
correspondingly in power as it has in numbers; while increasing in
numbers it has not increased in spiritual power. I am giving you
facts, not fancies. We are not dealing with theories. I am not saying
anything against the Church; you never had a man come into this
community who would fight harder for the Church of God Almighty
than I would. I am talking about her sins and the things that sap her
power—and by power I do not mean numbers. If you had an army
of 100,000 and increased it another 100,000 it ought to be doubled
in power.

Derelicts in the Church

In the Church of God today you know there are a lot of people who
are nothing but derelicts and nothing but driftwood.
By power I do not mean wealth. We are the richest people on the
earth; nineteen-twentieths of all the wealth or all the money in the
United States today is in the hands of professing Christians, Catholic
and Protestant. That ought to mean that it is in God's hands; but it
doesn't. They are robbing God. I was in a church in Iowa that had
three members who were worth $200,000 each and they paid their
preacher the measly salary of $600 a year, and I will be
hornswaggled if they did not owe him $400 then. If I ever skinned
any old fellows I did those old stingy coots. A man who doesn't pay
to the church is as big a swindler as a man who doesn't pay his
grocery bill and he is dead-beating his way to hell. You let somebody
else pay your bills, you old dead-beat. God hasn't any more use
today for a dead-beat in the church than he has for the man who
doesn't pay his grocery bill—not a bit!
By power I do not mean culture. There never was a time when the
people of America were better informed than they are today; they
have newspapers, telephones, telegraphs, rural delivery, fast trains.
You can leave home and in five days you are in Europe. If something
happens in China or Japan tonight you can read it before you go to
bed. The islands of the sea are our neighbors.
A stranger once asked: "What is the most powerful and influential
church in this town?"
"That big stone Presbyterian church on the hill."
"How many members has it?"
"I don't know, my wife is a member."
"How many Sunday-school members?"
"I don't know; my children go."
"How many go to prayer-meetings?"
"I don't know; I have never been there."
"How many go to communion?"
"I don't know, I never go; my wife goes."
Then the stranger said: "Will you please tell me why you said it was
the most powerful and influential church in the community?"
"Yes, sir; it is the only church in the town that has three millionaires
in the church." That was why he thought it was a great church. The
Church in America would die of dry rot and sink forty-nine fathoms
in hell if all members were multi-millionaires and college graduates.
That ought not to be a barrier to spiritual power. By power I do not
mean influence.
I'd hate to have to walk back nineteen hundred years to Pentecost.
There were 120 at Pentecost who saved 3,000 souls.
Some of the most powerful churches I have ever worked with were
not the churches that had the largest number or the richest
members. Out in a town in Iowa there were three women who used
to pray all night every Thursday night, one of them a colored
woman. People used to come under her windows at night and listen
to her pray. She murdered the king's English five times in every
sentence, but oh, she knew God. They had 500 names on their list
for prayer and when the meetings closed they had checked off 397
of them. Every Friday I would be called over the telephone or
receive a letter or meet those women and they would tell me what
assurances God gave them as to who would be saved. I have never
met three women that were stronger in faith than those three. That
town was Fairfield, Iowa, one of the brightest, cleanest, snappiest
little towns I ever went into.

The Meaning of Power

Samson wist not the Spirit of the Lord had departed. So might we
have money, so might we have members, so might we have increase
in culture; but we have not increased in power. I mean spiritual
power; power to bring things to pass by way of reform. What do I
mean by power? I have told you what I did not mean.
By power I mean when the power of God comes upon you and
enables you to do what you could not do without that power. That
comes to you through confidence and faith in the Lord Jesus Christ.
There was a time when the Church had more spiritual power than
she has today; there never was a time when she had more members
than she has today; there never was a time when she had more
money than she has today; more culture; but there was a time when
she had more spiritual power than today.
And when she had more spiritual power she was a separate
institution. She was not living for the devil as she is today. And the
Church had not become a clearing house for the forces of evil. We
are told that at Pentecost tongues of fire came upon the expectant
worshipers.
I don't mean this gabby stuff they have got today that they call the
things of the spirit; I don't mean that jabbering and froth and
foaming at the mouth when you can't understand a word they say.
Try the Spirit, whether it be of God, and in all ages when the Church
has stood for something she has had power.
So few of us dream of the tremendous power at our command. At
the World's Fair at Chicago the door to one of the great buildings
was without doorknob or latch, for these were not needed. There
was a great mat at the entrance, and as you stepped upon it your
weight would cause an electrical connection to be made and the
great doors would swing open. I take this old Book and stand upon
it, and all the wonders of life and eternity are opened to me. The
power of the Holy Spirit is at my command.

Church Needs Great Awakening

Let's quit fiddling with religion and do something to bring the world
to Christ. We need a Pentecost today. The Church needs a great
awakening. Now, I'll not stand anyone's saying anything against the
Church as an institution; but I will rebuke its sins and point out its
shortcomings. Nobody who loves the Church can be silent when so
much needs to be said. I love the Church. I want to explode that old
adage that "Love is blind"; I tell you, love has an eagle's eyes.
Lots of churches are wrong in their financial policy. It is a wrong that
the churches have to resort to tricks that would shame the devil in
order to filch a quarter out of a fellow's pocket to help pay the
preacher's back salary. There is hardly a church in this country that
couldn't have abundant funds if the people would only give of their
means as they are commanded by God.
Then, too often you put the wrong men in places of authority in the
church. You elect some old fellow who would look better in a
penitentiary suit, just because he had a "drag" somewhere. We must
quit putting such men in church offices.
When I was a boy I was taught how to put glass knobs on the feet
of a chair and charge the chair with electricity. So long as I didn't
touch anything but the chair I was all right, but if I touched the wall
or something else I got a shock. The power passed through and
from me. As Christians we cannot come into touch with defiling
things without suffering a loss of spiritual power. You can't go to the
dance and the card party and the cheap-skate show without losing
power. Yes, you can do those things and be a church member. But
you can be a church member without being a Christian. There's a
difference.
I read in the Bible that Lot first pitched his tents near Sodom. Next I
read that Lot moved right into Sodom, and lived there for twenty
years. He lost his power there, too. When God warned him to get
out of the city he went and told his sons and daughters, but they
wouldn't heed him. He had lost his power over them. He warned his
sons-in-law, but they wouldn't heed him. He even lost power over
his own wife, for he told her not to look back as they fled, and she
rubbered.
If you have lost spiritual power it is because you have disobeyed
some clear command of God. Maybe you're stingy. God requires
tithes. He commands you to give one tenth of your income to him,
and maybe you don't do it. It may be your temper. It may be that
you have neglected to read the Bible and haven't prayed as you
should.
The Church is a failure because she is compromising with the men
that sit in the seats and own saloons whom she never rebukes; she
is compromising with the men who rent their property for disorderly
houses, and whom she never rebukes. They are living off the
products of shame and if they buy food and clothes for their wives
and children from such money, they, too, are living off this product
of shame. We have lost our power because we have compromised.
When I played baseball I used to attend every theater in the
country. Since I was converted I have not darkened a theater's door,
except to preach the Gospel. We've lost our power because we've
lost our faith.
Our leading members are leaders in nothing but card parties and
society; they are not leaders in spiritual things. A man comes to me
and says, "Mrs. So-and-So is one of my leading members."
I ask: "Does she get to prayer-meetings?"
"No."
"Does she visit the sick?"
"No."
"Does she put her arms around some poor sinner and try to save her
for Christ?"
"No."
And I find she is a leader in nothing but society, card parties, dances
and bridge-whist clubs. I don't call that kind a leading woman in the
church; she is the devil's bell-wether. That is true. I tell you people
what I call your leading woman: She is the one who gets down on
her knees and prays; she is the one that can wrap her arms around
a sinner and lead her to Christ; that is a leading church member. You
have it doped out wrong.
Did Martin Luther trim his sails to the breeze of his day? If he had,
you would never have had a Reformation. I will tell you why we have
lost our power; I have told you what I don't mean by power.

Lost Power
We have lost our power because we have failed to insist on the
separation of the Church from the world. The Church is a separate
body of men and women; we are to be in the world, but not of the
world. She is all right in the world, all wrong when the world is in
her, and the trouble with the Church today is that she has sprung a