Download Full Version ebook - Visit ebookmeta.

com

Deep Learning for Natural Language Processing 1st

Edition Palash Goyal

https://ebookmeta.com/product/deep-learning-for-natural-
language-processing-1st-edition-palash-goyal/

OR CLICK HERE

DOWLOAD NOW

Discover More Ebook - Explore Now at ebookmeta.com

 Instant digital products (PDF, ePub, MOBI) ready for you
Download now and discover formats that fit your needs...

Start reading on any device today!

Deep Learning for Natural Language Processing Develop Deep

Learning Models for your Natural Language Problems Jason
Brownlee
https://ebookmeta.com/product/deep-learning-for-natural-language-
processing-develop-deep-learning-models-for-your-natural-language-
problems-jason-brownlee/
ebookmeta.com

Getting started with Deep Learning for Natural Language

Processing Learn how to build NLP applications with Deep
Learning 1st Edition Sunil Patel
https://ebookmeta.com/product/getting-started-with-deep-learning-for-
natural-language-processing-learn-how-to-build-nlp-applications-with-
deep-learning-1st-edition-sunil-patel/
ebookmeta.com

Transfer Learning for Natural Language Processing 1st

Edition Paul Azunre

https://ebookmeta.com/product/transfer-learning-for-natural-language-
processing-1st-edition-paul-azunre/

ebookmeta.com

Diabetes Meal Planning & Nutrition For Dummies, 2nd

Edition Simon Poole

https://ebookmeta.com/product/diabetes-meal-planning-nutrition-for-
dummies-2nd-edition-simon-poole/

ebookmeta.com
Devoted (The Bonding Trials Book 2) 1st Edition Evelyn
Flood

https://ebookmeta.com/product/devoted-the-bonding-trials-book-2-1st-
edition-evelyn-flood/

ebookmeta.com

National Geographic Readers: Mythical Beasts (L3): 100 Fun

Facts About Real Animals and the Myths They Inspire
Stephanie Warren Drimmer
https://ebookmeta.com/product/national-geographic-readers-mythical-
beasts-l3-100-fun-facts-about-real-animals-and-the-myths-they-inspire-
stephanie-warren-drimmer/
ebookmeta.com

Spell of an Omega An M M mpreg shifter romance Riverrun

Alphas 3 1st Edition Kaia Pierce

https://ebookmeta.com/product/spell-of-an-omega-an-m-m-mpreg-shifter-
romance-riverrun-alphas-3-1st-edition-kaia-pierce/

ebookmeta.com

My Hero Academia Vol 4 Kohei Horikoshi

https://ebookmeta.com/product/my-hero-academia-vol-4-kohei-horikoshi/

ebookmeta.com

The Vendetti Empire Ruthless Matteo Vendetti The Vendetti

Famiglia 1 1st Edition Sapphire Knight Knight Sapphire

https://ebookmeta.com/product/the-vendetti-empire-ruthless-matteo-
vendetti-the-vendetti-famiglia-1-1st-edition-sapphire-knight-knight-
sapphire/
ebookmeta.com
Myths of the Iroquois 1st Edition Erminnie A Smith

https://ebookmeta.com/product/myths-of-the-iroquois-1st-edition-
erminnie-a-smith/

ebookmeta.com
Deep Learning for
Natural Language
Processing
Creating Neural Networks with Python
—
Palash Goyal
Sumit Pandey
Karan Jain

www.allitebooks.com
 Deep Learning for
Natural Language
Processing
Creating Neural Networks
with Python

Palash Goyal
Sumit Pandey
Karan Jain

www.allitebooks.com
Deep Learning for Natural Language Processing: Creating Neural Networks
with Python
Palash Goyal Sumit Pandey
Bangalore, Karnataka, India Bangalore, Karnataka, India
Karan Jain
Bangalore, Karnataka, India

ISBN-13 (pbk): 978-1-4842-3684-0 ISBN-13 (electronic): 978-1-4842-3685-7

https://doi.org/10.1007/978-1-4842-3685-7
Library of Congress Control Number: 2018947502

Copyright © 2018 by Palash Goyal, Sumit Pandey, Karan Jain

This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or
part of the material is concerned, specifically the rights of translation, reprinting, reuse of
illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way,
and transmission or information storage and retrieval, electronic adaptation, computer software,
or by similar or dissimilar methodology now known or hereafter developed.
Trademarked names, logos, and images may appear in this book. Rather than use a trademark
symbol with every occurrence of a trademarked name, logo, or image, we use the names, logos,
and images only in an editorial fashion and to the benefit of the trademark owner, with no
intention of infringement of the trademark.
The use in this publication of trade names, trademarks, service marks, and similar terms, even if
they are not identified as such, is not to be taken as an expression of opinion as to whether or not
they are subject to proprietary rights.
While the advice and information in this book are believed to be true and accurate at the date of
publication, neither the authors nor the editors nor the publisher can accept any legal
responsibility for any errors or omissions that may be made. The publisher makes no warranty,
express or implied, with respect to the material contained herein.
Managing Director, Apress Media LLC: Welmoed Spahr
Acquisitions Editor: Celestin Suresh John
Development Editor: Matthew Moodie
Coordinating Editor: Aditee Mirashi
Cover designed by eStudioCalamar
Cover image designed by Freepik (www.freepik.com)
Distributed to the book trade worldwide by Springer Science+Business Media New York,
233 Spring Street, 6th Floor, New York, NY 10013. Phone 1-800-SPRINGER, fax (201) 348-4505,
e-mail orders-ny@springer-sbm.com, or visit www.springeronline.com. Apress Media, LLC is a
California LLC and the sole member (owner) is Springer Science+Business Media Finance Inc
(SSBM Finance Inc). SSBM Finance Inc is a Delaware corporation.
For information on translations, please e-mail rights@apress.com, or visit www.apress.com/
rights-permissions.
Apress titles may be purchased in bulk for academic, corporate, or promotional use. eBook
versions and licenses are also available for most titles. For more information, reference our Print
and eBook Bulk Sales web page at www.apress.com/bulk-sales.
Any source code or other supplementary material referenced by the author in this book is available
to readers on GitHub via the book’s product page, located at www.apress.com/978-1-4842-3684-0.
For more detailed information, please visit www.apress.com/source-code.
Printed on acid-free paper

www.allitebooks.com
To our parents, sisters, brothers, and friends
without whom this book would have been
completed one year earlier :)

www.allitebooks.com
Table of Contents
About the Authors��������������������������������������������������������������������������������xi
About the Technical Reviewer�����������������������������������������������������������xiii
Acknowledgments������������������������������������������������������������������������������xv
Introduction��������������������������������������������������������������������������������������xvii

Chapter 1: Introduction to Natural Language Processing and

Deep Learning���������������������������������������������������������������������1
Python Packages���������������������������������������������������������������������������������������������������3
NumPy�������������������������������������������������������������������������������������������������������������3
Pandas�������������������������������������������������������������������������������������������������������������8
SciPy��������������������������������������������������������������������������������������������������������������13
Introduction to Natural Language Processing�����������������������������������������������������16
What Is Natural Language Processing?���������������������������������������������������������16
Good Enough, But What Is the Big Deal?�������������������������������������������������������16
What Makes Natural Language Processing Difficult?�����������������������������������16
What Do We Want to Achieve Through Natural Language Processing?���������18
Common Terms Associated with Language Processing��������������������������������19
Natural Language Processing Libraries��������������������������������������������������������������20
NLTK��������������������������������������������������������������������������������������������������������������20
TextBlob���������������������������������������������������������������������������������������������������������22
SpaCy������������������������������������������������������������������������������������������������������������25
Gensim����������������������������������������������������������������������������������������������������������27

www.allitebooks.com
Table of Contents

Pattern�����������������������������������������������������������������������������������������������������������29
Stanford CoreNLP������������������������������������������������������������������������������������������29
Getting Started with NLP�������������������������������������������������������������������������������������29
Text Search Using Regular Expressions��������������������������������������������������������30
Text to List�����������������������������������������������������������������������������������������������������30
Preprocessing the Text����������������������������������������������������������������������������������31
Accessing Text from the Web������������������������������������������������������������������������32
Removal of Stopwords�����������������������������������������������������������������������������������32
Counter Vectorization������������������������������������������������������������������������������������33
TF-IDF Score��������������������������������������������������������������������������������������������������33
Text Classifier������������������������������������������������������������������������������������������������35
Introduction to Deep Learning����������������������������������������������������������������������������35
How Deep Is “Deep”?������������������������������������������������������������������������������������37
What Are Neural Networks?��������������������������������������������������������������������������������38
Basic Structure of Neural Networks��������������������������������������������������������������������40
Types of Neural Networks�����������������������������������������������������������������������������������45
Feedforward Neural Networks����������������������������������������������������������������������46
Convolutional Neural Networks���������������������������������������������������������������������46
Recurrent Neural Networks���������������������������������������������������������������������������47
Encoder-Decoder Networks���������������������������������������������������������������������������49
Recursive Neural Networks���������������������������������������������������������������������������49
Multilayer Perceptrons����������������������������������������������������������������������������������������50
Stochastic Gradient Descent�������������������������������������������������������������������������������54
Backpropagation�������������������������������������������������������������������������������������������������57
Deep Learning Libraries��������������������������������������������������������������������������������������60
Theano�����������������������������������������������������������������������������������������������������������60
Theano Installation����������������������������������������������������������������������������������������61

vi
 Table of Contents

Theano Examples������������������������������������������������������������������������������������������63
TensorFlow����������������������������������������������������������������������������������������������������64
Data Flow Graphs������������������������������������������������������������������������������������������65
TensorFlow Installation����������������������������������������������������������������������������������66
TensorFlow Examples������������������������������������������������������������������������������������67
Keras�������������������������������������������������������������������������������������������������������������69
Next Steps�����������������������������������������������������������������������������������������������������������74

Chapter 2: Word Vector Representations��������������������������������������������75

Introduction to Word Embedding�������������������������������������������������������������������������75
Neural Language Model��������������������������������������������������������������������������������79
Word2vec������������������������������������������������������������������������������������������������������������81
Skip-Gram Model�������������������������������������������������������������������������������������������82
Model Components: Architecture������������������������������������������������������������������83
Model Components: Hidden Layer�����������������������������������������������������������������84
Model Components: Output Layer�����������������������������������������������������������������86
CBOW Model��������������������������������������������������������������������������������������������������87
Subsampling Frequent Words�����������������������������������������������������������������������������88
Negative Sampling����������������������������������������������������������������������������������������91
Word2vec Code���������������������������������������������������������������������������������������������������92
Skip-Gram Code��������������������������������������������������������������������������������������������������97
CBOW Code�������������������������������������������������������������������������������������������������������107
Next Steps���������������������������������������������������������������������������������������������������������118

Chapter 3: Unfolding Recurrent Neural Networks����������������������������119

Recurrent Neural Networks������������������������������������������������������������������������������120
What Is Recurrence?�����������������������������������������������������������������������������������121
Differences Between Feedforward and Recurrent Neural Networks�����������121

vii
Table of Contents

Recurrent Neural Network Basics���������������������������������������������������������������123

Natural Language Processing and Recurrent Neural Networks������������������126
RNNs Mechanism����������������������������������������������������������������������������������������129
Training RNNs����������������������������������������������������������������������������������������������134
Meta Meaning of Hidden State of RNN��������������������������������������������������������137
Tuning RNNs������������������������������������������������������������������������������������������������138
Long Short-Term Memory Networks�����������������������������������������������������������138
Sequence-to-Sequence Models������������������������������������������������������������������145
Advanced Sequence-to-Sequence Models��������������������������������������������������152
Sequence-to-Sequence Use Case���������������������������������������������������������������157
Next Steps���������������������������������������������������������������������������������������������������������168

Chapter 4: Developing a Chatbot������������������������������������������������������169

Introduction to Chatbot�������������������������������������������������������������������������������������169
Origin of Chatbots����������������������������������������������������������������������������������������170
But How Does a Chatbot Work, Anyway?�����������������������������������������������������171
Why Are Chatbots Such a Big Opportunity?�������������������������������������������������172
Building a Chatbot Can Sound Intimidating. Is It Actually?��������������������������173
Conversational Bot��������������������������������������������������������������������������������������������175
Chatbot: Automatic Text Generation������������������������������������������������������������������191
Next Steps���������������������������������������������������������������������������������������������������������229

Chapter 5: Research Paper Implementation: Sentiment

Classification������������������������������������������������������������������231
Self-Attentive Sentence Embedding�����������������������������������������������������������������232
Proposed Approach�������������������������������������������������������������������������������������234
Visualization������������������������������������������������������������������������������������������������242
Research Findings���������������������������������������������������������������������������������������246

viii
 Table of Contents

Implementing Sentiment Classification������������������������������������������������������������246

Sentiment Classification Code��������������������������������������������������������������������������248
Model Results���������������������������������������������������������������������������������������������������261
TensorBoard������������������������������������������������������������������������������������������������261
Scope for Improvement�������������������������������������������������������������������������������������267
Next Steps���������������������������������������������������������������������������������������������������������267

Index�������������������������������������������������������������������������������������������������269

ix
About the Authors
Palash Goyal is a senior data scientist and
currently works with the applications of
data science and deep learning in the online
marketing domain. He studied Mathematics
and Computing at the Indian Institute of
Technology (IIT) Guwahati and proceeded to
work in a fast-paced upscale environment.
He has wide experience in E-commerce
and travel, insurance, and banking industries.
Passionate about mathematics and finance,
Palash manages his portfolio of multiple
cryptocurrencies and the latest Initial Coin
Offerings (ICOs) in his spare time, using deep learning and reinforcement
learning techniques for price prediction and portfolio management. He
keeps in touch with the latest trends in the data science field and shares
these on his personal blog, http://madoverdata.com, and mines articles
related to smart farming in free time.

xi
About the Authors

Sumit Pandey is a graduate of IIT Kharagpur.

He worked for about a year at AXA Business
Services, as a data science consultant. He
is currently engaged in launching his own
venture.

Karan Jain is a product analyst at Sigtuple,

where he works on cutting-edge AI-driven
diagnostic products. Previously, he worked
as a data scientist at Vitrana Inc., a health
care solutions company. He enjoys working
in fast-paced environments and at data-first
start-ups. In his leisure time, Karan deep-dives
into genomics sciences, BCI interfaces, and
optogenetics. He recently developed interest in
POC devices and nanotechnology for further portable diagnosis. He has a
healthy network of 3000+ followers on LinkedIn.

xii
About the Technical Reviewer
Santanu Pattanayak currently works at GE
Digital as a staff data scientist and is the author
of the deep learning–related book Pro Deep
Learning with TensorFlow—A Mathematical
Approach to Advanced Artificial Intelligence
in Python. He has about 12 years of overall
work experience, 8 in the data analytics/
data science field, and has a background in
development and database technologies.
Prior to joining GE, Santanu worked in
such companies as RBS, Capgemini, and IBM. He graduated with a degree
in electrical engineering from Jadavpur University, Kolkata, and is an avid
math enthusiast. Santanu is currently pursuing a master’s degree in data
science from IIT Hyderabad. He also devotes his time to data science
hackathons and Kaggle competitions, in which he ranks within the top 500
across the globe. Santanu was born and brought up in West Bengal, India,
and currently resides in Bangalore, India, with his wife.

xiii
Acknowledgments
This work would not have been possible without those who saw us through
this book, to all those who believed in us, talked things over, read, wrote,
and offered their valuable time throughout the process, and allowed us to
use the knowledge that we gained together, be it for proofreading or overall
design.
We are especially indebted to Aditee Mirashi, coordinating editor,
Apress, Springer Science+Business, who has been a constant support and
motivator to complete the task and who worked actively to provide us with
valuable suggestions to pursue our goals on time.
We are grateful to Santanu Pattanayak, who went through all the
chapters and provided valuable input, giving final shape to the book.
Nobody has been more important to us in the pursuit of this project
than our family members. We would like to thank our parents, whose love
and guidance are with us in whatever we pursue. Their being our ultimate
role models has provided us unending inspiration to start and finish the
difficult task of writing and giving shape to our knowledge.

xv
Introduction
This book attempts to simplify and present the concepts of deep learning
in a very comprehensive manner, with suitable, full-fledged examples of
neural network architectures, such as Recurrent Neural Networks (RNNs)
and Sequence to Sequence (seq2seq), for Natural Language Processing
(NLP) tasks. The book tries to bridge the gap between the theoretical and
the applicable.
It proceeds from the theoretical to the practical in a progressive
manner, first by presenting the fundamentals, followed by the underlying
mathematics, and, finally, the implementation of relevant examples.
The first three chapters cover the basics of NLP, starting with the most
frequently used Python libraries, word vector representation, and then
advanced algorithms like neural networks for textual data.
The last two chapters focus entirely on implementation, dealing with
sophisticated architectures like RNN, Long Short-Term Memory (LSTM)
Networks, Seq2seq, etc., using the widely used Python tools TensorFlow
and Keras. We have tried our best to follow a progressive approach,
combining all the knowledge gathered to move on to building a question-
and-answer system.
The book offers a good starting point for people who want to get
started in deep learning, with a focus on NLP.
All the code presented in the book is available on GitHub, in the form
of IPython notebooks and scripts, which allows readers to try out these
examples and extend them in interesting, personal ways.

xvii
CHAPTER 1

Introduction
to Natural Language
Processing and Deep
Learning
Natural language processing (NPL) is an extremely difficult task in
computer science. Languages present a wide variety of problems that
vary from language to language. Structuring or extracting meaningful
information from free text represents a great solution, if done in the
right manner. Previously, computer scientists broke a language into its
grammatical forms, such as parts of speech, phrases, etc., using complex
algorithms. Today, deep learning is a key to performing the same exercises.
This first chapter of Deep Learning for Natural Language Processing
offers readers the basics of the Python language, NLP, and Deep Learning.
First, we cover the beginner-level codes in the Pandas, NumPy, and SciPy
libraries. We assume that the user has the initial Python environment
(2.x or 3.x) already set up, with these libraries installed. We will also briefly
discuss commonly used libraries in NLP, with some basic examples.

© Palash Goyal, Sumit Pandey, Karan Jain 2018 1

P. Goyal, et al., Deep Learning for Natural Language Processing,
https://doi.org/10.1007/978-1-4842-3685-7_1
Chapter 1 Introduction to Natural Language Processing and Deep Learning

Finally, we will discuss the concepts behind deep learning and some
common frameworks, such as TensorFlow and Keras. Then, in later
chapters, we will move on to providing a higher level overview of NLP.
Depending on the machine and version preferences, one can install
Python by using the following references:

• www.python.org/downloads/

• www.continuum.io/downloads

The preceding links and the basic packages installations will provide
the user with the environment required for deep learning.
We will be using the following packages to begin. Please refer to the
following links, in addition to the package name for your reference:
Python Machine Learning

Pandas (http://pandas.pydata.org/pandas-docs/stable)

NumPy (www.numpy.org)

SciPy (www.scipy.org)

Python Deep Learning

TensorFlow (http://tensorflow.org/)

Keras (https://keras.io/)

Python Natural Language Processing

Spacy (https://spacy.io/)

NLTK (www.nltk.org/)

TextBlob (http://textblob.readthedocs.io/en/dev/)

2
 Chapter 1 Introduction to Natural Language Processing and Deep Learning

We might install other related packages, if required, as we proceed.

If you are encountering problems at any stage of the installation, please
refer to the following link: https://packaging.python.org/tutorials/
installing-packages/.

Note Refer to the Python package index, PyPI (https://pypi.

python.org/pypi), to search for the latest packages available.
Follow the steps to install pip via https://pip.pypa.io/en/
stable/installing/.

P
 ython Packages
We will be covering the references to the installation steps and the initial-­
level coding for the Pandas, NumPy, and SciPy packages. Currently,
Python offers versions 2.x and 3.x, with compatible functions for machine
learning. We will be making use of Python2.7 and Python3.5, where
required. Version 3.5 has been used extensively throughout the chapters of
this book.

N
 umPy
NumPy is used particularly for scientific computing in Python. It is designed
to efficiently manipulate large multidimensional arrays of arbitrary records,
without sacrificing too much speed for small multidimensional arrays. It
could also be used as a multidimensional container for generic data. The
ability of NumPy to create arrays of arbitrary type, which also makes NumPy
suitable for interfacing with general-purpose data-base applications, makes
it one of the most useful libraries you are going to use throughout this book,
or thereafter for that matter.

3
Chapter 1 Introduction to Natural Language Processing and Deep Learning

Following are the codes using the NumPy package. Most of the lines
of code have been appended with a comment, to make them easier to
understand by the user.

## Numpy

import numpy as np                # Importing the Numpy package

a= np.array([1,4,5,8], float)     # Creating Numpy array with
Float variables
print(type(a))                #Type of variable
> <class 'numpy.ndarray'>

# Operations on the array

a[0] = 5                #Replacing the first element of the array
print(a)
> [ 5. 4. 5. 8.]

b = np.array([[1,2,3],[4,5,6]], float)   # Creating a 2-D numpy

array
b[0,1]                # Fetching second element of 1st array
> 2.0

print(b.shape)        #Returns tuple with the shape of array

> (2, 3)

b.dtype               #Returns the type of the value stored

> dtype('float64')

print(len(b))         #Returns length of the first axis

> 2

2 in b                
#'in' searches for the element in the array
> True

0 in b
> False

4
 Chapter 1 Introduction to Natural Language Processing and Deep Learning

# Use of 'reshape' : transforms elements from 1-D to 2-D here

c = np.array(range(12), float)
print(c)
print(c.shape)
print('---')
c = c.reshape((2,6))    # reshape the array in the new form
print(c)
print(c.shape)
> [ 0. 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11.]
(12,)
---
[[ 0. 1. 2. 3. 4. 5.] [ 6. 7. 8. 9. 10. 11.]]
(2, 6)

c.fill(0)                #Fills whole array with single value,

done inplace
print(c)
> [[ 0. 0. 0. 0. 0. 0.] [ 0. 0. 0. 0. 0. 0.]]

c.transpose()            #creates transpose of the array, not

done inplace
> array([[ 0., 0.], [ 0., 0.], [ 0., 0.], [ 0., 0.], [ 0., 0.],
[ 0., 0.]])

c.flatten()              #flattens the whole array, not done

inplace
> array([ 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.])

5
Chapter 1 Introduction to Natural Language Processing and Deep Learning

# Concatenation of 2 or more arrays

m = np.array([1,2], float)
n = np.array([3,4,5,6], float)
p = np.concatenate((m,n))
print(p)
> [ 1. 2. 3. 4. 5. 6.]
(6,)

print(p.shape)

# 'newaxis' : to increase the dimensonality of the array

q = np.array([1,2,3], float)
q[:, np.newaxis].shape
> (3, 1)

NumPy has other functions, such as zeros, ones, zeros_like, ones_

like, identity, eye, which are used to create arrays filled with 0s, 1s, or 0s
and 1s for given dimensions.
Addition, subtraction, and multiplication occur on same-size arrays.
Multiplication in NumPy is offered as element-wise and not as matrix
multiplication. If the arrays do not match in size, the smaller one is
repeated to perform the desired operation. Following is an example for this:

a1 = np.array([[1,2],[3,4],[5,6]], float)
a2 = np.array([-1,3], float)
print(a1+a2)
> [[ 0. 5.] [ 2. 7.] [ 4. 9.]]

6
 Chapter 1 Introduction to Natural Language Processing and Deep Learning

Note pi and e are included as constants in the NumPy package.

One can refer to the following sources for detailed tutorials on NumPy:
www.numpy.org/ and https://docs.scipy.org/doc/numpy-dev/user/
quickstart.html.
NumPy offers few of the functions that are directly applicable on the
arrays: sum (summation of elements), prod (product of the elements), mean
(mean of the elements), var (variance of the elements), std (standard
deviation of the elements), argmin (index of the smallest element in array),
argmax (index of the largest element in array), sort (sort the elements),
unique (unique elements of the array).

a3 = np.array([[0,2],[3,-1],[3,5]], float)
print(a3.mean(axis=0))           # Mean of elements column-wise
> [ 2. 2.]

print(a3.mean(axis=1))           # Mean of elements row-wise

> [ 1. 1. 4.]

Note To perform the preceding operations on a multidimensional

array, include the optional argument axis in the command.

NumPy offers functions for testing the values present in the array,
such as nonzero (checks for nonzero elements), isnan (checks for “not
a number” elements), and isfinite (checks for finite elements). The
where function returns an array with the elements satisfying the following
conditions:

a4 = np.array([1,3,0], float)
np.where(a!=0, 1/a ,a)
> array([ 0.2 , 0.25 , 0.2 , 0.125])

7
Chapter 1 Introduction to Natural Language Processing and Deep Learning

To generate random numbers of varied length, use the random

function from NumPy.

np.random.rand(2,3)
> array([[ 0.41453991, 0.46230172, 0.78318915],
[0.54716578, 0.84263735, 0.60796399]])

Note The random number seed can be set via numpy.random.

seed (1234). NumPy uses the Mersenne Twister algorithm to
generate pseudorandom numbers.

Pandas
Pandas is an open sourced software library. DataFrames and Series are two
of its major data structures that are widely used for data analysis purposes.
Series is a one-dimensional indexed array, and DataFrame is tabular data
structure with column- and row-level indexes. Pandas is a great tool for
preprocessing datasets and offers highly optimized performance.

import pandas as pd
series_1 = pd.Series([2,9,0,1])      # Creating a series object
print(series_1.values)               # Print values of the
series object
> [2 9 0 1]

series_1.index             # Default index of the series object

> RangeIndex(start=0, stop=4, step=1)

series_1.index = ['a','b','c','d']   #Settnig index of the

series object
series_1['d']                # Fetching element using new index
> 1

8
 Chapter 1 Introduction to Natural Language Processing and Deep Learning

# Creating dataframe using pandas

class_data = {'Names':['John','Ryan','Emily'],
             'Standard': [7,5,8],
             'Subject': ['English','Mathematics','Science']}
class_df = pd.DataFrame(class_data, index = ['Student1',
'Student2','Student3'],
                       columns = ['Names','Standard','Subject'])
print(class_df)
>            Names     Standard     Subject
Student1     John      7            English
Student2     Ryan      5            Mathematics
Student3     Emily     8            Science

class_df.Names
>Student1    John
Student2     Ryan
Student3     Emily
Name: Names, dtype: object

# Add new entry to the dataframe

import numpy as np
class_df.ix['Student4'] = ['Robin', np.nan, 'History']
class_df.T                # Take transpose of the dataframe
>           Student1    Student2       Student3    Student4
Names       John        Ryan           Emily       Robin
Standard    7           5              8           NaN
Subject     English     Mathematics    Science     History

9
Chapter 1 Introduction to Natural Language Processing and Deep Learning

class_df.sort_values(by='Standard')   # Sorting of rows by one

column
>            Names     Standard     Subject
Student1     John      7.0          English
Student2     Ryan      5.0          Mathematics
Student3     Emily     8.0          Science
Student4     Robin     NaN          History

# Adding one more column to the dataframe as Series object

col_entry = pd.Series(['A','B','A+','C'],
                      index=['Student1','Student2','Student3',
'Student4'])
class_df['Grade'] = col_entry
print(class_df)
>            Names     Standard     Subject         Grade
Student1     John      7.0          English         A
Student2     Ryan      5.0          Mathematics     B
Student3     Emily     8.0          Science         A+
Student4     Robin     NaN          History         C

# Filling the missing entries in the dataframe, inplace

class_df.fillna(10, inplace=True)
print(class_df)
>            Names     Standard     Subject         Grade
Student1     John      7.0          English         A
Student2     Ryan      5.0          Mathematics     B
Student3     Emily     8.0          Science         A+
Student4     Robin     10.0         History         C

10
 Chapter 1 Introduction to Natural Language Processing and Deep Learning

# Concatenation of 2 dataframes
student_age = pd.DataFrame(data = {'Age': [13,10,15,18]} ,
                           index=['Student1','Student2',
'Student3','Student4'])
print(student_age)
>            Age
Student1     13
Student2     10
Student3     15
Student4     18

class_data = pd.concat([class_df, student_age], axis = 1)

print(class_data)
>            Names     Standard    Subject        Grade     Age
Student1     John      7.0         English        A         13
Student2     Ryan      5.0         Mathematics    B         10
Student3     Emily     8.0         Science        A+        15
Student4     Robin     10.0        History        C         18

Note Use the map function to implement any function on each of

the elements in a column/row individually and the apply function
to perform any function on all the elements of a column/row
simultaneously.

# MAP Function
class_data['Subject'] = class_data['Subject'].map(lambda x :
x + 'Sub')
class_data['Subject']

11
Chapter 1 Introduction to Natural Language Processing and Deep Learning

> Student1 EnglishSub

Student2 MathematicsSub
Student3 ScienceSub
Student4 HistorySub
Name: Subject, dtype: object

# APPLY Function
def age_add(x):                 # Defining a new function which
will increment the age by 1
    return(x+1)

print('-----Old values-----')
print(class_data['Age'])
print('-----New values-----')
print(class_data['Age'].apply(age_add))    # Applying the age
function on top of
the age column
> -----Old values-----
Student1 13
Student2 10
Student3 15
Student4 18
Name: Age, dtype: int64

-----New values-----
Student1 14
Student2 11
Student3 16
Student4 19
Name: Age, dtype: int64

12
 Chapter 1 Introduction to Natural Language Processing and Deep Learning

The following code is used to change the Datatype of the column to a

“category” type:

# Changing datatype of the column

class_data['Grade'] = class_data['Grade'].astype('category')
class_data.Grade.dtypes
> category

The following stores the results to a .csv file:

# Storing the results

class_data.to_csv('class_dataset.csv', index=False)

Among the pool of functions offered by the Pandas library, merge

functions (concat, merge, append), groupby, and pivot_table functions
have an intensive application in data processing tasks. Refer to the following
source for detailed Pandas tutorials: http://pandas.pydata.org/.

S
 ciPy
SciPy offers complex algorithms and their use as functions in NumPy. This
allocates high-level commands and a variety of classes to manipulate and
visualize data. SciPy is curated in the form of multiple small packages,
with each package targeting individual scientific computing domains. A
few of the subpackages are linalg (linear algebra), constants (physical
and mathematical constants), and sparse (sparse matrices and associated
routines).
Most of the NumPy package functions applicable on arrays are also
included in the SciPy package. SciPy offers pre-tested routines, thereby
saving a lot of processing time in the scientific computing applications.

import scipy
import numpy as np

13
Chapter 1 Introduction to Natural Language Processing and Deep Learning

Note SciPy offers in-built constructors for objects representing

random variables.

Following are a few examples from Linalg and Stats out of multiple
subpackages offered by SciPy. As the subpackages are domain-specific, it
makes SciPy the perfect choice for data science.
SciPy subpackages, here for linear algebra (scipy.linalg), are
supposed to be imported explicitly in the following manner:

from scipy import linalg

mat_ = np.array([[2,3,1], [4,9,10], [10,5,6]]) # Matrix Creation
print(mat_)
> [[ 2 3 1] [ 4 9 10] [10 5 6]]

linalg.det(mat_)                 # Determinant of the matrix

inv_mat = linalg.inv(mat_)       # Inverse of the matrix
print(inv_mat)
> [[ 0.02409639 -0.07831325 0.12650602] [ 0.45783133 0.01204819
-0.09638554] [-0.42168675 0.12048193 0.03614458]]

The code for performing singular value decomposition and storing the
individual components follows:

# Singular Value Decomposition

comp_1, comp_2, comp_3 = linalg.svd(mat_)
print(comp_1)
print(comp_2)
print(comp_3)

14
 Chapter 1 Introduction to Natural Language Processing and Deep Learning

> [[-0.1854159 0.0294175 -0.98221971]

[-0.73602677 -0.66641413 0.11898237]
[-0.65106493 0.74500122 0.14521585]]
[ 18.34661713 5.73710697 1.57709968]
[[-0.53555313 -0.56881403 -0.62420625]
[ 0.84418693 -0.38076134 -0.37731848]
[-0.02304957 -0.72902085 0.6841033 ]]

Scipy.stats is a huge subpackage, with various statistical distributions

and functions for operations on different kinds of datasets.

# Scipy Stats module

from scipy import stats

# Generating a random sample of size 20 from normal

distribution with mean 3 and standard deviation 5
rvs_20 = stats.norm.rvs(3,5 , size = 20)
print(rvs_20, '\n --- ')

# Computing the CDF of Beta distribution with a=100 and b=130

as shape parameters at random variable 0.41
cdf_ = scipy.stats.beta.cdf(0.41, a=100, b=130)
print(cdf_)
> [ -0.21654555 7.99621694 -0.89264767 10.89089263 2.63297827
-1.43167281 5.09490009 -2.0530585 -5.0128728 -0.54128795
2.76283347 8.30919378 4.67849196 -0.74481568 8.28278981
-3.57801485 -3.24949898 4.73948566 2.71580005 6.50054556]
---
0.225009574362

15
Chapter 1 Introduction to Natural Language Processing and Deep Learning

For in-depth examples using SciPy subpackages, refer to http://docs.

scipy.org/doc/.

Introduction to Natural Language

Processing
We already have seen the three most useful and frequently used libraries in
Python. The examples and references provided should suffice to start with.
Now, we are shifting our area of focus to natural language processing.

What Is Natural Language Processing?

Natural language processing, in its simplest form, is the ability for a
computer/system to truly understand human language and process it in
the same way that a human does.

Good Enough, But What Is the Big Deal?

It is very easy for humans to understand the language said/expressed by
other humans. For example, if I say “America follows a capitalist form of
economy, which works well for it, it is easy to infer that the which used in
this sentence is associated with “capitalist form of economy,” but how a
computer/system will understand this is the question.

 hat Makes Natural Language Processing

W
Difficult?
In a normal conversation between humans, things are often unsaid,
whether in the form of some signal, expression, or just silence.
Nevertheless, we, as humans, have the capacity to understand the
underlying intent of the conversation, which a computer lacks.

16
Discovering Diverse Content Through
Random Scribd Documents
—— Some Common Types of Lichen Formations. Torrey Bot. Club,
xxx. pp. 412-418, 1903.

—— A Lichen Society of a Sandstone Rip-rap. Bot. Gaz. xxxvi. pp.

265-284 (5 figs.), 1904.
—— The Nature and Classification of Lichens. i. Mycologia, iii. pp.
231-269, 1911; ii. Op. cit. v. pp. 97-116, 1913.
—— The rate of Growth and Ecesis in Lichens. Mycologia, ix. pp.
138-158, 1917.
—— A new genus and species of the Collemaceae. Mycologia, x. pp.
235-238 (1 pl.), 1918.
Fischer, Ed. Beiträge zur Kenntniss exotischen Pilze. Hedwigia, xxix.
pp. 161-171 (1 pl.), 1890.
Fitting, N. Ueber die Beziehungen zwischen den epiphyllen Flechten
und den von ihnen bewohnten Blättern. Ann. Jard. Bot.
Buitenzorg, Suppl. 3, pp. 505-519, 1910.
Fitzpatrick, Henry Morton. Sexuality in Rhizina undulata. Bot.
Gaz. lxv. pp. 201-226 (2 pls.), 1918.
Flagey, C. Lichenes algeriensis exsiccati. Rev. Mycol. xiii. pp. 83-87
and 107-117, 1901; pp. 70-79, 1892.
—— Catalogue des Lichens. Battandier and Trabut, Flore de l’Algérie.
Algiers, Part 2, i. pp. xii. and 139, 1896.
Flörke, H. G. Deutsche Lichenen. 10 Lief. Berlin, 1815-19.
—— De Cladoniis, etc. Rostock, 1828.
Flotow, Julius von. Mikroskopische Flechtenstudien. Bot. Zeit. viii.
pp. 361-369, 377-382, 1850.
Forskål, P. Descriptiones Plantarum Florae Aegyptiaco-Arabicae (5).
Hauniae, 1775.
Forssell, K. B. J. Studier öfver Cephalodierna. Bihang K. Svensk.
Vet.-Akad. Handl. viii. n. 3, 112 pp. (2 pls.), 1882.
Forssell, K. B. J. Lichenologische Untersuchungen. I. Ueber die
Cephalodien. Flora, lxvii. pp. 1-8, 33-46, 58-63, 177-193, 1884.
—— Anatomie und Systematik der Gloeolichenen. Nov. Act. Reg.
Soc. Sci. Upsal. Sér. 3, 118 pp., 1885¹.
—— Die anatomische Verhältnisse und die phylogenetische
Entwicklung der Lecanora granatina Sommerf. Bot. Centralb.
xxii. pp. 54-58 and 85-89, 1885².

—— Ueber den Polymorphismus der Algen (Flechtengonidien), etc.

Flora, lxix. pp. 49-64, 1886.
Forster, T. F. Flora Tonbrigensis. London, 1816.
Frank, A. B. Ueber die biologischen Verhältnisse des Thallus einiger
Krustenflechten. Cohn’s Beiträge zur Biologie der Pflanzen, ii.
pp. 123-200 (1 pl.), 1876.
Fraser, H. C. I. On the Sexuality and Development of the Ascocarp
in Lachnea stercorea Pers. Ann. Bot. xxi. pp. 349-360 (2 pls.),
1907.
French, G. H. Mounting Lichens. Journ. Applied Microscopy:
Rochester N. Y. i. p. 135, 1898.
Friederich, Albert. Beiträge zur Anatomie der Silikatflechten.
Fünfstück’s Beitr. Wiss. Bot. v. pp. 377-404, 1906.
Fries, Elias. Systema orbis vegetabilis, i. Lund, 1825.
—— Primitiae Geographiae Lichenum. Lund, 1831.
—— Lichenographia Europaea reformata. Lund, 1831.
Fries, Th. M. Monographia Stereocaulorum et Pilophororum. Act.
Reg. Soc. Sci. Upsala, Ser. 3, ii. pp. 307-380 (4 pls.), 1858.
—— Genera Heterolichenum Europeae recognita. Upsala, 1861.
—— Lichenes Arctoi. Nova Act. Soc. Sci. iii. pp. 103-398, 1861.
—— Beiträge zur Kenntniss der sogenannten Cephalodien bei den
Flechten. Flora, xlix. pp. 17-25, 1866.
—— Lichenes Spitsbergenses. K. Sv. Vet.-Akad. Handl. vii. n. 2, 1867.
Fritsch, F. E. The Rôle of Algal Growth in the colonization of new
ground, etc. Geographical Journal, xxx. pp. 531-547, 1907.
Fuisting, W. Beiträge zur Entwickelungsgeschichte der Lichenen.
Bot. Zeit. xxvi. pp. 641, etc. (1 pl.), 1868.
Fünfstück, M. Beiträge zur Entwickelungsgeschichte der Lichenen.
Eichler’s Jahrb. ot. Gart. Berlin, iii. pp. 155-174 (3 pls.), 1884.
—— Die Fettabscheidung der Kalkflechten in Fünfstück’s Beitr. Wiss.
Bot. i. pp. 157-220 (3 pls.), 1895 and Nachtrag, pp. 316-321,
1896.
—— Lichenes (Allgemeiner Teil). Engler und Prantl, Die Natürlichen
Pflanzenfamilien, i. 1*, pp. 1-48, 1898.
—— Weitere Untersuchungen über die Fettabscheidung der
Kalkflechten. Bot. Untersuch., Festschrift für Schwendener, pp.
341-356. Berlin, 1899.
—— Der gegenwärtige Stand der Flechtenforschung nebst
Ausblicken auf deren voraussichtliche Weiterentwickelung. Ber.
Deutsch. Bot. Ges. xx. 19te General-Versammlung, pp. 62-77,
1902.
Galløe, O. Danske Likeners Ökologi. Botan. Tidsskrift, xxviii. pp.
285-372 (3 pls.), 1908.
—— Forberedende Undersøgelser til en almindelig Likenølogi. Dansk
Botanisk Arkiv, i. n. 3, 119 pp. (240 figs.), 1913-15.
Garjeaune, A. J. M. Die Verpilzung der Lebermoosrhizoiden. Flora,
cii. pp. 147-185 (2 pls. and figs.), 1911.

Gautier, Armand. Présence de l’iode en proportions notables dans

tous les végétaux à chlorophylle de la classe des Algues et dans
les sulfuraires. Comptes Rendus, cxxix. pp. 191-194, 1899.
Georgi, I. G. Scrutamen chemicum Lichenum parasiticorum. Acta
Acad. Sci. Imp. Petropol. iii. Pars ii. pp. 282-292 [1779], 1783.
Gerard, John. The Herball or generall historie of Plantes, etc.
London, 1597.
Gibelli, Giuseppe. Sugli Organi Riproduttori del genere Verrucaria.
Memorie della Soc. Ital. Sci. Nat. Milano, i. n. 5 (1 pl.), 1866.
Gilson, E. La cristallisation de la cellulose et la composition
chimique de la membrane cellulaire végétale. La Cellule, ix. fasc.
2, 1893.
—— Recherches chimiques sur la membrane cellulaire des
Champignons. La Cellule, xi. fasc. 1. pp. 7-15, 1894.
Gleditsch, J. G. Einleitung in die neuere Forstwissenschaft, i.
Berlin, 1775.
Glück, Hugo. Entwurf zu einer Vergleichenden Morphologie der
Flechten-Spermogonien. Verh. Naturhist.-Med. Ver. vi. 2.
Heidelberg, pp. vi. and 136 (2 pls.), 1899.
Gmelin, J. F. Systema Naturae, ii. Leipzig, 1791.
Gmelin, J. G. Reise durch Sibirien. Göttingen, 1752.
Goeppert, H. R. Uebersicht der fossilen Flora Schlesiens 1844-45
(in Wimmer’s Flora von Schlesien, Breslau, 1845).
—— Ueber den Einfluss der Pflanzen auf felsige Unterlage. Flora,
xliii. pp. 161-171, 1860.

Goeppert, H. R. and Menge, A. Die Flora des Bernsteins, i.

Danzig, 1883.
Gray, S. F. A Natural Arrangement of British Plants, i. London,
1821.
Greville, R. K. Scottish Cryptogamic Flora, etc. I.-VI. Edinburgh,
1823-28.
—— Flora Edinensis. Edinburgh, 1824.
Guembel, C. W. Mittheilungen über die neue Färberflechte
Lecanora ventosa Ach. Denkschr. K. Akad. Wiss. Math.-Natur. Cl.
Wien, xi. Abth. 2, pp. 23-40 (1 pl.), 1856.
Guérin-Varry, R. J. Mémoires sur deux Produits naturels de la
Végétation considérés comme des Gommes. Ann. Chim. Phys.
Sér. 2, lvi. pp. 225-252, 1834.
Guilliermond, A. Formation des Asques et de l’épiplasme des
Ascomycètes. Rev. Gén. Bot. xvi. pp. 49-66, 1904.
Haberlandt, G. Ueber die Beziehungen zwischen Function und Lage
des Zellkernes bei den Pflanzen. Jena, pp. viii, 135 (2 pls.),
1887.
—— Physiologische Pflanzenanatomie, ed. 2. Leipzig, 1896.
Haller, Alb. von. Enumeratio Methodica Stirpium Helvetiae
indigenarum, etc. Göttingen, 1742.
—— Historia Stirpium indigenarum Helvetiae, iii. Berne, 1768.
Halsey, A. Synoptical view of the Lichens, growing in the vicinity of
the city of New York. Ann. Lyceum Nat. Hist. New York, i. pp. 3-
21, 1824.
Hamlet, W. M. and Plowright, C. B. On the occurrence of Oxalic
Acid in Fungi. Chemical News, xxxvi. pp. 93-94, 1877.
Harmand, J. Lichens de France. Fasc. i. ii. 1905; iii. 1907; iv. 1909;
v. 1913.

Harper, R. A. Cell-Division in Sporangia and Asci. Ann. Bot. xiii. pp.

467-525, 1899.
—— Sexual reproduction in Pyronema confluens, etc. Ann. Bot. xiv.
pp. 321-400 (3 pls.), 1900.
Hassall, A. H. A History of the British Freshwater Algae. London,
1845.
Hedlund, T. Kritische Bemerkungen über einige Arten der
Flechtengattungen Lecanora, Lecidea und Micarea. Bih. K.
Svensk. Vet.-Akad. Handl. xviii. Afd. iii. n. 3. 104 pp. (1 pl.),
1892.
—— Ueber Thallusbildung durch Pyknokonidien bei Catillaria
denigrata und C. prasina. Bot. Centralbl. lxiii. pp. 9-16, 1895.
Hedwig, Johann. Microscopisch-Analytische Beschreibungen und
Abbildungen neuer und zweifelhafter Laub-Moose, ii. Leipzig,
1789.
—— Theoria generationis et fructificationis plantarum
cryptogamicarum. St Petersburg, 1784. Enlarged edition.
Leipzig, 1798.
Hellbom, P. J. Norrlands Lafvar. K. Svensk. Vet.-Akad. Handl. xx. n.
8. 131 pp., 1884.
Hellbom, P. J. Lichenaea Neo-Zeelandica, etc. Bihang K. Svensk.
Vet.-Akad. Handl. xxi. Afd. iii. n. 13, 150 pp., 1896.
Henneguy, Félix. Les Lichens Utiles. Paris, 114 pp. (20 figs.), 1883.
Herbal. The Grete Herball, etc., translated from the French, printed
by Peter Treveris. London, 1526.
Herberger, J. E. Ueber den Bitterstoff des isländischen Mooses
(Cetraria islandica). Buchner’s Repertorium für Pharmacie, xxxvi.
pp. 226-237, 1830.
Herissey, H. Sur la présence de l’émulsine dans les Lichens.
Comptes Rendus Soc. Biol. Sér. 10, v. pp. 532-534, 1898; Bull.
Soc. Mycol. France, xv. pp. 44-48, 1899.
Herre, A. C. The growth of Ramalina reticulata. Bot. Gaz. xxxviii. pp.
218-219, 1904.
—— Suggestions as to the origin of California’s Lichen Flora. Plant
World, xiii. pp. 215-220, 1910.
—— The Gyrophoraceae of California. Contrib. U.S. Nat. Herb. xiii.
10, pp. 313-321 (5 pls.), 1911¹.
—— The desert Lichens of Reno, Nevada. Bot. Gaz. li. pp. 286-297,
1911².
Hesse, O. Beitrag zur Kenntniss der Flechten und ihrer
charakteristischen Bestandteile, 9 Mitth. Journ. prakt. Chem. lxx.
pp. 449-502, 1904.
Hicks, J. Braxton. Contributions to the knowledge of the
Development of the Gonidia of Lichens in relation to the
Unicellular Algae. Quart. Journ. Micros. Sci. viii. p. 239, 1860.
New series, i. p. 15, 1861.
—— Observations on the Gonidia and Confervoid Filaments of
Mosses, and on the relation of their Gonidia to those of Lichens
and of certain freshwater Algae. Trans. Linn. Soc. London, xxiii.
pp. 567-588 (2 pls.), 1862.
Hill, Sir John. History of Plants. London, 1751.
—— Flora Britannica. London, 1760.
Hoffmann, G. Fr. Enumeratio Lichenum iconibus et descriptionibus
illustrata. Erlangen, 1784.
—— Commentatio de vario Lichenum usu. Lyon, 1787.
—— Descriptio et Adumbratio plantarum e classe cryptogamica
Linnaei quae Lichenes dicuntur. Leipzig, 1790-1801.
—— Deutschland’s Flora, etc. Erlangen, 1795.
Hofmann, W. Parasitische Flechten auf Endocarpon miniatum.
Fünfstück’s Beitr. Wiss. Bot. v. pp. 259-274, 1906.
Holle, G. von. Zur Entwickelungsgeschichte von Borrera ciliaris.
Inaug.-Diss. Göttingen, 43 pp. (2 pls.), 1849.
Hooker, W. J. Flora Scotica. London, 1821.
—— English Botany Supplement. London, 1831.
—— Smith’s Engl. Fl. v. pp. 129-241, 1833.
Hooker, Sir W. J. and Arnott, G. A. Walker. The Botany of
Captain Beechey’s Voyage, etc. London, 1841.
Hornschuch, Friedrich. Einige Beobachtungen über das Entstehen
der Algen, Flechten und Laubmoose. Flora, ii. pp. 140-144,
1819.
—— Einige Beobachtungen und Bemerkungen über die Entstehung
und Metamorphose der niedern vegetabilischen Organismen.
Acad. Caes. Leop. Nov. Act. x. p. 544, etc., 1821.
How, William. Phytologia Britannica. London, 1650.
Howe, R. Heber. Classification de la Famille des Usneaceae dans
l’Amérique du Nord. 32 pp. (10 pls.), Paris, 1912.
—— North American Species of the genus Ramalina. Bryologist, xvi.
pp. 65-74, etc. 1913.
Hudson, W. Flora Anglica. London, ed. 1, 1762; ed. 2, 1778.
Hue, A. M. Lichenes exoticos a professore W. Nylander descriptos,
etc., etc. Paris, 1892.
—— Revue des Travaux sur la description et la géographie botanique
des Lichens. Rev. Gén. Bot. i. pp. 397-403, 1888; ii. pp. 403-
411, 1889; iv. pp. 31-39, 1890; v. pp. 36-48, 1891; vi. pp. 174-
185, etc. 1894; x. pp. 125-128, etc. 1898¹.
—— Causerie sur les Parmelia. Journ. de Bot. xii. pp. 177-189, 239-
250, 1898².
—— William Nylander with portrait and lists of publications. Bull.
Soc. Bot. Fr. xlvi. pp. 153-165, 1899.
—— Lichenes extra-Europaei, etc. Nouv. Arch. Mus. Hist. Nat. Paris,
Sér. 3, x. pp. 213-280, 1898; Sér. 4, i. pp. 27-220, 1899; ii. pp.
49-122, 1900; iii. pp. 21-146 (18 pls.), 1901.
—— Description de deux espèces de Lichens et de céphalodies
nouvelles. Ann. Ass. Nat. Levallois-Perret, p. 31, 1904; Bot.
Centralbl. xcix. p. 34, 1905.
—— Lichens Tarbelliens. Bull. Soc. Bot. Fr. lv. Mém. 12, 19 pp., 1908.
—— Le Mastoidea tessellata Hook. fil. et Harv. Bull. Soc. Bot. France,
lvi. pp. 315-322 (5 figs.), 1909¹.

—— Lichenes morphologice et anatomice disposuit. Nouv. Arch. Mus.

Hist. Nat. Paris, Sér. 4, viii. pp. 237-272 (figs.), 1906; op. cit. x.
pp. 169-224 (figs.), 1908; Sér. 5, i. pp. 110-166 (figs.), 1909; ii.
pp. 1-119 (figs.), 1910.
—— Lichenum Generis Crocyniae Massal, etc. Mém. Soc. Sci. Nat.
Cherb., Sér. 4, vii. pp. 223-254, 1909².
—— Sur la variation des gonidies dans le genre Solorina. Comptes
Rendus Acad. Sci. Paris, cli. pp. 332-334, 1910.
—— Monographiam Generis Solorinae Ach., etc. Mém. Soc. Sci. Nat.
Cherb. xxxviii. pp. 1-56, 1911¹.
—— Notice sur les spores des “Licheni blasteniospori” Massal. Bull.
Soc. Bot. France, lxiii. pp. lxvii-lxxxvi (2 pls.), 1911².
—— Lichenes novos vel melius cognitos. Ann. Mycol. xii. pp. 509-
534, 1914.
—— Expédition Antarctique Française (1903-1905). Dr J. Charcot,
Lichens. Paris, 1908.
—— Deuxième Expédition (1908-1910). Dr J. Charcot, Lichens. Paris,
1915.
Hulth, J. M. Ueber Reservestoffbehälter bei Flechten. Bot. Centralbl.
xlv. pp. 209-210 and 269-270, 1891.

Hutchinson, Robert. Food and the Principles of dietetics. Ed. 4.

London, Arnold. 1916.
Istvanffi, Gy. von. Ueber die Rolle der Zellkerne bei der
Entwickelung der Pilze. Ber. Deutsch. Bot. Ges. xiii. pp. 452-467,
1895.
Itzigsohn, Hermann. Die Antheridien und Spermatozoën der
Flechten. Bot. Zeit. viii. pp. 393-394 and 913-919, 1850.
—— Wie verhält sich Collema zu Nostoc und zu den Nostochineen.
Bot. Zeit. xii. pp. 521-527, 1854.
—— Gloeocapsa und Cladonia. Bot. Zeit. xiii. pp. 203-207, 1855.
—— Cultur der Glaucogonidien von Peltigera canina. Bot. Zeit. xxvi.
pp. 185-196, [1867], 1868.
Jaczewski, A. Specimina Pilocarpi leucoblephari e Caucaso. See A.
Elenkin in Bull. Jard. Imp. Bot. St Pétersb. iv. pp. 3-8, 1904.
Jatta, A. Monographia Lichenum Italiae Meridionalis. Trano, 1889.
Jennings, A. Vaughan. On two new species of Phycopeltis from
New Zealand. Proc. Roy. Irish Acad. Ser. 3, iii. pp. 753-766 (2
pls.), 1895.
John, T. F. Ueber die Ernährung der Pflanzen. Berlin, 1819.
Johnson, Charles Pierpoint. The Useful Plants of Great Britain.
Illustrated by J. E. Sowerby. London, 1861 [62].
Johow, Friedrich. Die Gruppe der Hymenolichenen, etc. Pringsh.
Jahrb. Wiss. Bot. xv. pp. 360-409 (5 pls.), 1884.
Jumelle, Henri. La vie des Lichens pendant l’Hiver. Mém. Soc. Biol.
Paris, Sér. 9, ii. pp. 115-119, 1890.
—— Recherches Physiologiques sur les Lichens. Rev. Gén. Bot. iv.
pp. 49-64, 103-121, etc. Résumé général, p. 316 (2 pls.), 1892.
Kajanus, Birger (früher Nilson). Morphologische Flechtenstudien.
Ark. Bot. x. n. 4, 47 pp. (2 pls.), 1911.
Kappen, Hubert. Kristallographisch-optische Untersuchungen
einiger Flechtensäuren. Zeitschr. Kristallogr. xxxvii. pp. 151-170,
1903.
Keeble, F. Plant-Animals. A study in Symbiosis. Cambridge, 1910.
Keegan, P. Q. The Chemistry of some Common Plants. Naturalist,
pp. 274-275, 1905; pp. 24-25, 1907.
Keiszler, Karl von. Zwei neue Flechtenparasiten aus Steiermark.
Hedwigia, l. pp. 294-298, 1911.
Keller, F. The Reindeer Age on the Lake of Constance. Athenaeum,
p. 500, 1866.
Kerner von Marilaun, A. and Oliver, F. W. The Natural History of
Plants. Vols. i. and ii. London, 1894.
Kieffer, J. J. Die Flechten Lothringens. Hedwigia, xxxiii. pp. 101-
122, 1894.
Kienitz-Gerloff, F. Neue Studien über Plasmodesmen. Ber.
Deutsch. Bot. Ges. xx. p. 93 (1 pl.), 1902.
Kihlman, A. Osw. Pflanzenbiologische Studien aus Russisch-
Lappland. Act. Soc. Faun. and Fl. Fenn. vi. 3, xxiv. 263 pp.,
1890.
Knop, W. Chemisch-physiol. Untersuchung über die Flechten. Ann.
Chem. xlix. pp. 103-124, 1844.
—— Chemischer Beitrag zur Physiologie der Flechten. Chem.
Zentralbl. iii. pp. 172-176, 1872.
Knop, W. and Schnederman, G. Chemisch-physiologische
Untersuchung der Flechten und zwar der Cetraria islandica.
Flora, xxix. pp. 238-239, 1846.
—— Chemisch-physiologische Untersuchungen über die Flechten.
Erdm. Journ. prakt. Chem. xxxix. pp. 363-367, 1846.
Knowles, Matilda C. The maritime and marine Lichens of Howth.
Sci. Proc. Roy. Dublin Soc. xiv. (N.S.), No. 6, pp. 79-143 (7 pls.),
1913.
—— Results of a Biological Survey of Blackrod Bay, Co. Mayo.
Lichenes. Dept. Agric. Techn. Instr. Ireland, pp. 22-26, 1915.
Kobert, R. Ueber Giftstoffe der Flechten. Sitzungsb. Naturf. Ges.
Dorpat, x. pp. 157-166, 1895.
Koelreuter, J. G. Das entdeckte Geheimnisz der Cryptogamie.
Carlsruhe, 1777.
Koerber, G. G. De Gonidiis Lichenum. Berlin, 1839.
—— Einige Bemerkungen über individuelle Fortpflanzung der
Flechten. Flora, xxiv. pp. 6 and 17, 1841.
—— Systema Lichenum Germaniae. Breslau, 1855.
Kotte, J. Einige neue Fälle von Nebensymbiose (Parasymbiose).
Inaug.-Diss., G. Fischer, Jena, 1909. (Bot. Centralbl. xxiii. p. 19,
1910.)
Krabbe, G. Entwickelung, Sprossung und Theilung einiger
Flechtenapothecien. Bot. Zeit. xl. pp. 65-83, 89-99, 105-116,
121-142 (2 pls.), 1882.
—— Morphologie und Entwickelungsgeschichte der Cladoniaceen.
Ber. Deutsch. Bot. Ges. i. pp. 64-77, 1883.
—— Entwickelungsgeschichte und Morphologie der polymorphen
Flechtengattung Cladonia. Leipzig (12 pls.), 1891.
Kratzmann, E. Der microchemische Nachweis und die Verteilung
des Aluminiums im Pflanzenreiche. Sitzungsb. K. Akad. Wiss.
Math.-Nat. Cl. Wien, xxvii. 2, Abt. I. pp. 311-336, 1913. (Mycol.
Centralbl. v. p. 36, 1914.)
Krempelhuber, August von. Die Lichenen-Flora Bayerns.
Regensburg, 1861.
—— Geschichte und Litteratur der Lichenologie, i. 1867: ii. 1869-
1872.
—— Beitrag zur Kenntniss der Lichenen-Flora der Südsee-Inseln.
Journ. Mus. Godeffroy, Hamburg, iv. pp. 93-100 (1 pl.), 1873.
Kützing, F. T. Phycologia Generalis. Leipzig, 1843.
Lacour, E. Analyse chimique du Lichen esculentus manne du désert
ou manne des Hébreux. Just. Bot. Jahresb. für 1880, i. p. 463,
1883.
Lang, Eugen. Beiträge zur Anatomie der Krustenflechten.
Fünfstück’s Beitr. Wiss. Bot. v. pp. 162-188 (13 figs.), 1903.
Laubert, R. Ein interessanter neuer Pilz an absterbenden
Apfelbäumen. Gartenflora, lx. p. 76, 1911.
Leighton, W. A. The British Species of Angiocarpous Lichens
elucidated by their sporidia. 101 pp. (30 pls.). London, 1851.
—— Monograph of British Graphideae. Ann. Mag. Nat. Hist., Ser. 2,
xiii. pp. 81-97, etc. (4 pls.), 1854.

—— Monograph of the British Umbilicariae. Ann. Mag. Nat. Hist., Ser.

2, xviii. pp. 273-297 (1 pl.), 1856.
—— Notes on Lichens collected by Sir John Richardson in Arctic
America. Journ. Linn. Soc. Bot. ix. pp. 184-200 (1 pl.), 1867.
—— Notulae Lichenologicae, No. xxx. Further Notes on the Lichens of
Cader Idris, North Wales. Ann. and Mag. Nat. Hist., Ser. 4, iv.
pp. 198-202, 1869.
—— The Lichens of Ceylon collected by G. H. K. Thwaites. Trans.
Linn. Soc. xxvii. pp. 161-185 (2 pls.), 1869.
—— The Lichen Flora of Great Britain, Ireland and the Channel
Islands. Shrewsbury, 1871; ed. 3, 1879.
Léorier. Rapport fait à la Société Linnéenne sur le procédé de M.
Roy de Tonnerre pour retirer de l’alcool des Lichens. Soc. Linn.
Paris, iv. pp. 219-225, 1825.
Lesdain, Bouly de. Lichens de Dunkerque. Dunkerque, 1910¹.
—— Végétation de l’argile des Polders. Comptes Rendus Congrès,
Soc. Savantes, 1909. Sciences, 8 pp. Paris, 1910².
—— Écologie d’une petite panne dans les dunes des environs de
Dunkerque. Bull. Soc. Bot. France, Sér. 4, xii. pp. 177-184, 207-
284, 1912.
Lett, H. W. Report on the Mosses, Hepatics and Lichens of the
Mourne Mountains district. Proc. Roy. Irish Acad. Ser. 3, i. pp.
 319-325, 1890.
Lettau, G. Beiträge zur Lichenographie von Thüringen. Hedwigia, li.
pp. 176-220, 1915.
—— Nachweis und Verhalten einiger Flechtensäuren. Hedwigia, lv.
pp. 1-78, 1914.
Lightfoot, John. Flora Scotica, ii. London, 1777.
Lindau, G. Ueber die Anlage und Entwickelung einiger
Flechtenapothecien. Flora, lxxi. pp. 451-489 (1 pl.), 1888.
—— Die Beziehungen der Flechten zu den Pilzen. Hedwigia, xxxiv.
pp. 195-204, 1895¹.
—— Lichenologische Untersuchungen, Heft i. Ueber Wachstum und
Anheftungsweise der Rindenflechten. 4to, 66 pp. (3 pls.),
Dresden, 1895².
—— Beiträge zur Kenntniss der Gattung Gyrophora. Festschrift für
Schwendener, pp. 19-37 (2 pls.), 1899. (Hedwigia, xxxviii. Beibl.
p. 101, 1899.)
Lindsay, W. Lauder. Experiments on the Dyeing Properties of
Lichens. Edin. New Phil. Journ. lvii. pp. 228-249, 1854, and lviii.
pp. 56-80, 1855.
—— A Popular History of British Lichens. London, 1856.
—— Monograph of the genus Abrothallus. Trans. Brit. Assoc., 41 pp.
(2 col. pls.), 1856.
—— Memoir on the Spermogones and Pycnides of Filamentous,
Fruticulose, and Foliaceous Lichens. Trans. Roy. Soc. Edin. xxii.
pp. 101-303 (11 pls.), 1859.
Lindsay, W. Lauder. Observations on new Lichenicolous Micro-
Fungi. Trans. Roy. Soc. Edinb. xxv. pp. 513-555 (2 pls.), 1869¹.
—— Observations on the Lichens collected by Dr Robert Brown in
West Greenland in 1867. Trans. Linn. Soc. xxvii. pp. 305-368 (5
pls. col.), 1869².
—— The Lichen Flora of Greenland. Trans. Bot. Soc. Edinb. x. pp. 32-
65, 1870¹.
—— Experiments on Colour-Reaction as a specific character in
Lichens. Tom. cit. pp. 82-98, 1870².
—— Enumeration of Micro-Lichens parasitic on other Lichens. Quart.
Journ. Micr. Sci. ix. pp. 49-57, etc., 1869².
—— Observations on Lichenicolous Micro-Parasites. Op. cit. xi. pp.
28-42, 1871.
—— Memoir on the Spermogones and Pycnides of Crustaceous
Lichens. Trans. Linn. Soc. xxviii. pp. 189-318 (8 pls.), 1872.
—— The true Nature of Lichens. Nature, xiii. p. 247, 1876.
—— Fossil Lichens. Gard. Chron. viii. p. 566, 1877.
—— Fossil Lichens. Trans. and Proc. Bot. Soc. Edinb. xiii. pp. 160-
165, 1879.
Link, H. F. Florae Goettingensis Specimen sistens vegetabilia saxo
calcareo propria. Hildesheim, 1789.
—— Einige Bemerkungen über den Standort (loca natalia) der
Pflanzen. Usteri, Ann. Bot. xiv. pp. 1-17, 1795.
Linkola, K. Ueber die Thallusschuppen bei Peltigera lepidophora.
Ber. Deutsch. Bot. Ges. xxxi. pp. 52-54 (1 pl.), 1913.
Linnaeus, Carolus. Flora Lapponica. Amsterdam, 1737.
—— Genera Plantarum, etc. Leyden, 1737.
—— Species Plantarum. Stockholm, 1753.
—— Plantae Tinctoriae (E. Jörlin, Upsala, 1759). Amoenitates
Academicae, Holmiae, v. pp. 314-342, 1760.
—— Oeconomia Naturae (Isacus J. Biberg, Upsala, 1749).
Amoenitates Academicae, Holmiae, ed. 2, ii. pp. 1-52, 1762.
—— Lachesis Lapponica or a Tour in Lappland ... translated by J. E.
Smith. 2 Vols. illust. London, 1811.
Lister, Gulielma. A Monograph of the Mycetozoa, ed. 2. Brit. Mus.,
London, 1911.
—— Haunts of the Mycetozoa. Essex Naturalist, xviii. pp. 301-321,
1918.
Lloyd, C. G. Synopsis of some genera of the large Pyrenomycetes.
Cincinnati, Ohio. 17 pp. (pls. and figs.). Jan. 1917.
L’Obel, Mathias de (Lobelius). Plantarum seu Stirpium Historia,
etc. illust. Antwerp, 1576.
Lotzy, J. P. Beiträge zur Biologie der Flechtenflora des Hambergs
bei Göttingen. Diss. Göttingen, 1890.
Ludwig, R. Fossile Pflanzen aus der ältesten Abtheilung der
Rheinisch-Wetterauer Tertiär-Formationen. Meyer,
Palaeontographica, viii. pp. 39-154, 1859-1861.
Lutz, K. G. Ueber die sogenannte Netzbildung bei Ramalina
reticulata Krplhbr. Ber. Deutsch. Bot. Ges. xii. pp. 207-214
(figs.), 1894.
Luyken, J. A. Tentamen Historiae Lichenum, etc. Göttingen, 1809.
McLean, R. C. Ecology of Maritime Lichens at Blakeney Point,
Norfolk. Journ. Ecol. iii. pp. 129-148 (1 pl. and figs.), 1915.
Macmillan, Conway. Observations on the Distribution of Plants
along the shore at Lake of the Woods. Minn. Bot. Stud. i. pp.
949-1022 (pls.), 1894.
Maheu, Jacques. Contribution à l’Étude de la Flore souterraine de
France. Ann. Sci. Nat. Sér. 9, iii. Chap. iv. Lichens, pp. 98-101,
1906.
—— Les Lichens des hauts Sommets du Massif de la Tarentaise
(Savoie). Bull. Soc. Bot. France, liv. pp. 232-240, 1907.
Maire, René. Recherches cytologiques sur quelques Ascomycètes.
Ann. Mycol. iii. pp. 123-154 (3 pls.), 1905.
Malinowski, E. Sur la biologie et l’écologie des lichens épilithiques.
Bull. Acad. Sci. Cracovie, Sér. B. Sci. Nat. pp. 349-390 (1 pl., 6
figs.), 1911.
Malme, G. O. Ein Fall antagonistischer Symbiose zweier
Flechtenarten. Bot. Centralbl. lxiv. pp. 46-49, 1895.
Malpighi, Marcello. Opera Omnia, ii. Londini, 1686.
Martius, Ph. V. Flora Brasiliensis, etc. i. Stuttgart and Tübingen,
1833.
Massalongo, A. B. Synopsis Lichenum blasteniospororum. Flora,
xxxv. pp. 545-576, 1852.

—— Ricerche sull’autonomia dei Licheni crostosi. Verona, 1852.

—— Monografia dei Licheni blasteniospori. Atti Ist. Sci. Lett. ed Arti,
Ser. 2, iii. Appendice iii. 131 pp. (6 pls.), 1852. (Reprint,
Venezia, 1853.)
Massee, G. On Gasterolichenes, a new type of the Group Lichenes.
Philos. Trans. Roy. Soc. London, clxxviii. pp. 305-309 (2 pls.),
1887.
Mattirolo, Oreste. Contribuzioni allo studio del genere Cora Fr.
Nuovo Giorn. Bot. Ital. xiii. pp. 245-267 (2 pls.), 1881.
Mäule, C. Ueber die Fruchtanlage bei Physcia pulverulenta. Ber.
Deutsch. Bot. Ges. ix. pp. 209-213, 1891.
Mayfield, A. The Lichens of a Boulder-Clay Area. Journ. Ipswich,
etc. Field Club, v. pp. 34-40, 1916.
Mereschkovsky, Const. Note sur une nouvelle forme de Parmelia
vivant à l’état libre. Bull. Soc. Bot. Genève, Sér. 2, x. pp. 26-34,
1918.
Merrett, Christopher. Pinax rerum naturalium Britannicarum,
continens Vegetabilia, Animalia, etc. London, 1666.
Metzger, Otto. Untersuchungen über die Entwicklung der
Flechtenfrucht. Fünfstück’s Beiträge Wiss. Bot. v. pp. 108-144 (7
 figs.), 1903.
Meyer, Arthur. Die Plasmaverbindungen und die Fusionen der Pilze
der Florideenreihe. Bot. Zeit. lx. pp. 139-178 (1 pl.), 1902.
Meyer, G. F. W. Die Entwickelung, Metamorphose und
Fortpflanzung der Flechten. Goettingen, 1825.
Michael, A. D. British Oribatidae. London Ray Society, 2 vols. (pls.),
1884.
Michaux, André. Flora Boreali-Americana, ii. p. 320 etc., Paris and
Strasburg, 1803.
Micheli, Pier Antonio. Nova Plantarum Genera. Florence, 1729.
Minks, Arthur. Das Microgonidium. Flora, lxi., Nos. 14-20, pp. 209,
etc., 1878.
—— Das Microgonidium. Ein Beitrag zur Kenntniss des wahren
Wesens der Flechten. Basel, v. and 249 pp., 6 pls. col., 1879.
Miyoshi, Manabu. Die essbare Flechte Japans, Gyrophora
esculenta n. sp. Bot. Centralbl. lvi. pp. 161-163, 1893.
—— Ueber die Sporocarpenevacuation und darauf erfolgendes
Sporenausstreuen bei einer Flechte. Journ. Coll. Sci. Imp. Univ.
Tōkyō, xv. pp. 367-370 (1 pl.), 1901.
Moebius, M. Ueber einige in Portorico gesammelte Süsswasser und
Luft-Algen. Hedwigia, xxvii. pp. 221-249 (3 pls.), 1888.
Mohl, Hugo. Einige Bemerkungen über die Entwickelung und den
Bau der Sporen der Cryptogamischen Gewächse. Flora, xvi. p.
55, 1833.
Molisch, H. Die Pflanze in ihren Beziehungen zum Eisen. Jena,
1892.
Möller, Alfred. Ueber die Cultur flechtenbildender Ascomyceten
ohne Algen. Unters. aus Bot. Inst. K. Akad. Münster i. W., 52
pp., 1887.
—— Ueber die sogenannten Spermatien der Ascomyceten. Bot. Zeit.
xlvi. pp. 421-425, 1888.

—— Ueber die eine Thelephoree, welche die Hymenolichenen, Cora.

Dictyonema und Laudatea bildet. Flora, lxxvii. pp. 254-278,
1893.
Montagne, Cam. Cryptogamia Guyanensis, etc. Ann. Sci. Nat. xvi.
pp. 47-63, 1851.
Moreau, Fernand (M. and Mme). L’évolution nucléaire et les
phénomènes de la sexualité chez les lichens du genre Peltigera.
Comptes Rendus, clx. pp. 526-528, 1915.
Moreau, Fernand (M. and Mme). Les phénomènes de la sexualité
chez les Lichens du genre Solorina. Op. cit. clxii. pp. 793-795,
1916².
—— Quelques observations sur un Ascomycète parasite du Peltigera
polydactyla. Bull. Soc. Mycol. Fr. xxxii. pp. 49-53 (3 figs.), 1916³.
—— La Biomorphogénèse chez les Lichens. Bull. Soc. Mycol. France,
xxxiv. pp. 84-85, 1918.

Moreau, Fernand. Sur le rôle de l’amyloide des asques et son

utilisation éventuelle comme matière de réserve. Bull. Soc.
Mycol. Fr. xxxii. pp. 25-26, 1916².
Morison, Robert. Plantarum Historiae Universalis Oxoniensis iii.
Oxford, 1699.
Moss, C. E. Vegetation of the Peak District. Cambridge, 1913.
Mudd, W. A Manual of British Lichens. Darlington, 1861.
—— Monograph of British Cladoniae. Cambridge, 1865.
Mühlenberg, H. Catalogue of the Plants of North America.
Philadelphia, 1813.
Mulder, G. J. Ueber das Inulin und die Moosstärke. Erdm. Journ.
Chem. xv. pp. 299-302, 1838.
Müller, Jean (Müller-Argau). Principes de Classification des
Lichens. Mém. Soc. Phys. et Hist. Nat. Genève, xvi. 2, pp. 343-
435 (3 pls.), 1862.
—— Notice sur la nature des lichens. Archiv Soc. Phys. Nat. Genève,
i. pp. 49-55, 1878.

—— Lichenes japonici. Flora, lxii. pp. 481-487, 1879.

—— Enumeratio Lichenum Aegyptiacorum. Roumeguère Rev. Mycol.
ii. pp. 73-83, 1880.

—— Lichenologische Beiträge, xii. and xiv. Flora, lxiv. p. 111 and pp.
513-527, 1881; Beiträge, xxi. op. cit. lxviii. p. 345, 1885;
Beiträge, xxxiii. op. cit. lxxiii. p. 202, 1890.
—— Lichens de Palestine. Rev. Mycol. vi. pp. 12-13, 1884.
—— Enumeratio Lichenum aegyptiacorum. Tom. cit. pp. 13-20,
1884.
—— Lichenes Persici, etc. Hedwigia, xxxi. pp. 151-159, 1892.
Müller, Karl. Die chemische Zusammensetzung der Zellmembranen
bei verschiedenen Kryptogamen. Zeitschr. Phys. Chemie, xlv. pp.
265-298, 1905.
Münster, Georg, Count. Beiträge zur Petrefacten-Kunde. Heft vi.,
1846.
Necker, N. J. de. Methodus Muscorum, etc. Mannheim, 1771.
Nees von Esenbeck. Handbuch der Botanik, i. Nürnberg, 1820.
Neubert, Adolf. i. Toxikologische Studien über einige organische
Säuren. Diss. Dorpat (Jurjew), 1893. See Zopf, Die
Flechtenstoffe, p. 376, 1907.
Neubner, Eduard. Untersuchungen über den Thallus und die
Fruchtanfänge der Calycieen. Wiss. Beil. iv. Jahresber. K.
Gymnas. Plauen I. v. 12 pp., 1893.
Nienburg, W. Beiträge zur Entwickelungsgeschichte einiger
Flechtenapothecien. Flora, xcviii. pp. 1-40 (7 pls., 3 figs.), 1908.
—— Ueber die Beziehungen zwischen den Algen und Hyphen im
Flechtenthallus. Zeitschr. für Bot. ix. pp. 529-543 (1 pl., 6 figs.),
1917.
Nilson, Birger. Zur Entwickelungsgeschichte, Morphologie und
Systematik der Flechten. Bot. Not. pp. 1-33, 1903.
—— Die Flechtenvegetation des Sarekgebirges. Hamberg’s Nat.
Wiss. Untersuch. Sarekgebirges in Schwedisch-Lappland, iii. pp.
1-70 (9 pls.), Stockholm, 1907; Bot. Centralbl cv. p. 309, 1907.
Norman, J. M. Conatus praemissus redactionis novae generum, etc.
Nyt. Mag. Naturvid. vii. pp. 213-252, 1852.
—— Fuligines lichenosae Moriolei. Bot. Not. pp. 9-20, 1872.
—— Allelositismus eller det forhold, etc. K. Norsk. Vid. Selsk. Skrift.
vii. pp. 243-255 [1872], 1874.

Notaris, G. de. Frammenti lichenografici di un lavoro inedito. Giorn.

Bot. Ital. ii. pp. 174-224 and 299-330, 1846.
Nylander, W. Conspectus Florae Helsingforsiensis. Helsingfors Act.
Soc. Sci. Fenn. iii. p. 62, 1852.
—— Observationes aliquot ad Synopsin Lichenum Holmiensium. Bot.
Not. pp. 175-180, 1852.
—— Essai d’une nouvelle classification des Lichens. Mém. Soc. Sci.
Nat. Cherbourg, ii. pp. 5-16, 1854.
—— Second Mémoire. Op. cit. iii. pp. 161-202, 1855.
—— Synopsis Lichenum. Paris, 2 vols. 1858-1860 and 1885.
—— Lichenes adnotati in Armorica, ad Pornic. Bull. Soc. Bot. Fr. viii.
pp. 753-759, 1861.
—— Adhuc circa characteres quosdam Lichenum. Flora, xlix. pp.
177-181, 1866¹.
—— Circa novum in studio Lichenum criterium chemicum. Flora, xlix.
pp. 198-201 (1866)¹.
—— Les Lichens du Jardin du Luxembourg. Bull. Soc. Bot. Fr. xiii. pp.
364-371, 1866.
—— Lichenes Kurziani e Calcutta. Flora, l. pp. 3-9, 1867.
—— Exemplum cephalodiorum in Sphaerophoro. Flora, lii. pp. 68-69,
1869.
—— Animadversio de theoria gonidiorum algologica. Flora, liii. pp.
52-53, 1870.
—— Review, including notes, on the Algo-Lichen hypothesis. Flora,
lvii. pp. 56, etc., 1874. Translation by Crombie. Grevillea, ii. pp.
145-152, 1874.
—— Addenda nova ad Lichenographiam Europaeam. Flora, lvii. p.
306, 1874.
—— Céphalodies. Baillon’s Dictionnaire de Botanique, ix. p. 69, 1878.
—— Addenda nova ad Lichenographiam Europaeam. Flora, lxvi. pp.
97-109, 1883.
—— Lichenes Novae Zelandiae. Paris, 1888.
—— Lichenes Japoniae. Paris, 1890.
—— Sertum Lichenææ Tropicæ, Labuan et Singapore. Paris, 1891.
—— Lichenes Ceylonenses, etc. Act. Soc. Sci. Fenn. xxvi. n. 10, 33
pp., 1900.
Nylander, W. and Crombie. J. M. On a collection of Lichens made
in Eastern Asia by the late Dr A. C. Maingay. Journ. Linn. Soc.
xx. pp. 48-69, 1884.

Ohlert, Arnold. Lichenologische Aphorismen, ii. Schrift. Naturf.

Ges. Danzig. Neue Folge 2, iii., Heft 4, 34 pp., 1871.
Olivier, H. Lichens d’Europe. Cherbourg, Fasc. 1 and 2, 1907, 1909.
Parkinson, John. Theatrum Botanicum: The Theater of Plants, or,
an Herball of a large extent, etc. London, 1640.
Patouillard, N. Plantes Cellulaires de la Tunisie. (Lichens by A. Hue.
pp. 136-151.) Paris, 1897.
Paulson, R. Notes on the Ecology of Lichens. Essex Naturalist, xviii.
pp. 276-286 (2 pls.), 1918.
—— The Lichen Flora of Hertfordshire. Trans. Herts. Nat. Hist. Soc.
xvii. pp. 83-96 (1 pl.), 1919.

Paulson, R. and Hastings, Somerville. A wandering Lichen.

Knowledge, xxxvii. pp. 319-323, 1914.
—— The Relation between the Alga and Fungus of a Lichen. Journ.
Linn. Soc. xliv. pp. 497-506 (2 pls.), 1920.
Paulson, R. and Thompson, P. G. Reports on the Lichens of
Epping Forest (First paper), Essex Naturalist, xvi. pp. 136-145,
1911; (Second paper), op. cit. xvii. pp. 90-105, 1913.
Peirce, G. J. Fixing and Imbedding Lichens. Journ. Applied
Microscopy. Rochester, N.Y. I. pp. 99-100, 1898.
—— On the mode of dissemination and on the reticulations of
Ramalina reticulata. Bot. Gaz xxv. pp. 404-417, 1898.
—— The Nature of the Association of Alga and Fungus in Lichens.
Proc. Calif. Acad. Sci. Ser. 3, i. pp. 207-240 (1 pl.), 1899.
Peirce, G. J. The Relation of Fungus and Alga in Lichens. The
American Naturalist, xxxiv. pp. 245-253, 1900.
Persoon, C. H. Einige Bemerkungen über die Flechten, etc. Usteri,
Ann. Bot. vii. pp. 1-32, 1794.
—— Synopsis Methodica Fungorum. Göttingen, 1801.
Petch, T. The black termite of Ceylon. Ann. Roy. Bot. Gardens,
Peradeniya, v. part 6, pp. 395-420, 1913.
Petiver, J. Musei Petiveriani. Cent. ii. and iii. London, 1695.
—— Pterigraphia Americana (Gazophylacium, Vol. ii.). London, 1712.
Pfaff, C. H. Ueber eine neue eigenthümliche Säure in dem
isländischen Moose (Cetraria islandica). Schweigger Journ.
Chem. Phys. xlvii. pp. 476-483, 1826. See Berzelius, Jahresb. vii.
pp. 216-217, 1828.
Pfeffer, W. Die Oelkörper der Lebermoose. Flora, lvii. pp. 2-6, etc.
(1 pl.), 1877.
Phillips, W. Lichens, their rate of Growth. Gard. Chron. n.s. ix. p.
624, 1878.
Plot, Robert. The Natural History of Staffordshire. Oxford, 1686.
Plowright, C. B. British Uredineae and Ustilagineae. London, 1889.
Plukenet, Leonard. Phytographia. London, 1691-1696.
Porta, Joh. Bapt. Phytognomonica ... octo libris contenta. Naples,
1588.
Porter, Lilian. Attachment Organs of corticolous Ramalinae. Proc.
Roy. Irish Acad. xxxiv. pp. 17-32 (3 pls.), 1917.
—— On the attachment organs of some common Parmeliae. Proc.
Roy. Irish Acad. xxxiv. pp. 205-211 (3 pls.), 1919.
Proust, J. L. L’utilité du Lichen d’Islande comme Aliment. Journ.
Phys. Chim. Hist. Nat. lxiii. pp. 81-96, 1806.
Raab,—. Excursion in die Gegend von Muggendorf. Flora, ii. pp.
289-304, 1819.
Radais, M. Sur la culture pure d’une algue verte; formation de
chlorophylle à l’obscurité. Comptes Rendus, cxxx. pp. 793-796,
1900.
Rave, P. Untersuchung einiger Flechten aus der Gattung
Pseudevernia in Bezug auf ihre Stoffwechselprodukte. Inaug.-
Diss. von Münter i. W. Borna, Leipzig, 1908. (Hedwigia, xlvii.
(171), 1908.)
Ray, John. Catalogus Plantarum Angliae, etc. London, 1670.
—— Historia Plantarum. London, i. 1686; ii. 1688; iii. 1704.
—— Synopsis Methodica Stirpium Britannicarum. London, ed. 1,
1690; ed. 2, 1696; ed. 3 (edited by Dillenius), 1724.
Rees, Max. Ueber die Entstehung der Flechte Collema glaucescens
Hoffm. Monatsber. K. Acad. Wiss. Berlin, pp. 523-533 (1 pl.),
1871.
Rehm, H. Die Pilze Deutschlands, etc., Ascomyceten. Rabenhorst’s
Krypt.-Flora, i. 3, 1887-1896.
Reinke, J. Ueber die anatomische Verhältnisse einiger Arten von
Gunnera. Göttingen, Nachrichten, pp. 100-108, 1872.
—— Morphologische Abhandlungen. Leipzig, 1873.
—— Abhandlungen über Flechten, i. and ii. Jahrb. Wiss. Bot. xxvi.
pp. 495-542, 1894; Abh. iii. and iv. op. cit. xxviii. pp. 39-150 and
359-486, 1895; Abh. v. op. cit. xxix. pp. 171-236, 1896.
Reinke, J. and Grisebach, A. H. R. A. S. Oersted’s System der
Pilze Lichenen und Algen. Leipzig, 1873.
Relhan, Richard. Flora Cantabrigiensis. Cambridge, 1785; ed. 3,
1820.
Richard, O.-J. Catalogue des Lichens des Deux-Sèvres. Niort, 1877.
Riddle, Lincoln Ware. The North American species of
Stereocaulon. Bot. Gaz. pp. 285-304, 1910.
—— Pyrenothrix nigra, gen. et sp. nov. Bot. Gaz. lxiv. pp. 513-515 (4
figs.), 1917.
Ronceray, P. L. Contribution à l’étude des Lichens à orseille. Paris,
94 pp. (3 pls.), 1904.
—— Orseille (Translation). The Pharmaceutical Journal, Ser. 4, xix. p.
734, 1904.
Rosendahl, F. Vergleichend anatomische Untersuchungen über den
braunen Parmelien., Dissertation Münster 1907, and in Nova
Acta Abh. K. Leop.-Carol. Deutsch. Akad. Naturf. lxxxvii. 3, pp.
403-459 (4 pls.), 1907.
Ruel, J. (Ruellius). De natura stirpium, etc. Paris, 1536.
Ruppius, Heinr. Bernh. Flora Jenensis. Frankfurt and Leipzig,
1718.
Sachs, Jul. Zur Entwickelungsgeschichte des Collema pulposum
Ach. etc. Bot. Zeitung, xii. pp. 1-9 (1 pl.), 1855.
Salter, J. H. Protoplasmic connections in Lichens. Journ. Bot. xl. p.
48, 1902.
Salter, J. W. On some Reactions of Oxalic acid. Chem. Gaz. xiv. pp.
130-131, 1856.
Sandstede, H. Rügen’s Flechtenflora. Verh. Bot. Ver. Prov.
Brandenburg, xlv. pp. 110-140, 1904.
Sappin-Trouffy, P. Recherches histologiques sur la famille des
Urédinées. Le Botaniste, Sér. 5, pp. 59-244, 1896.
Sättler, Hans. Untersuchungen und Erörterungen über die Ökologie
und Phylogenie der Cladoniapodetien. Hedwigia, liv. pp. 226-
263 (5 pls.), 1914.
Schade, A. Die Schwefelflechte der Sachseschen Schweiz. Abh.
Naturw. Gesell. “Isis” in Dresden 1916, pp. 28-44. See also Ann.
Mycol. xv. p. 511, 1917.
Schaerer, Ludov. Eman. Lichenum Helveticorum Spicilegium.
Bern, 1823-1842.
Schellenberg, H. Beiträge zur Kenntniss der verholtzten
Zellmembran. Jahr. Wiss. Bot. xxix. p. 249, 1896.
Schikorra, Walter. Ueber die Entwickelungsgeschichte von
Monascus. Zeitschr. Bot. i. pp. 378-410 (1 pl., 1 fig.), 1909.
Schimper, W. P. Traité de Paléontologie Végétale, i. Paris, 1869.
Schneider, Albert. A Text-Book of General Lichenology.
Binghampton, N.Y., 1897.
Schreber, J. C. D. Linnaei ... Genera Plantarum, ed. 8, ii. Frankfurt
am Main, 1789-1791.
Schrenk, Hermann von. On the Mode of Dissemination of Usnea
barbata. Trans. Acad. Sci. St Louis, viii. pp. 189-198 (1 pl.),
1898.
Schulte, Fritz. Zur Anatomie der Flechtengattung Usnea. Beih. Bot.
Centralbl. xviii. 2, pp. 1-22 (3 pls. and figs.), 1904.
Schwarz, Fr. Chemische-botanische Studien über die in den
Flechten vorkommenden Flechtensäuren. Cohn’s Beitr. Biol. iii.
pp. 249-265, 1880.
Schwenckfeld, Caspar. Stirpium et fossilium Silesiae catalogus,
etc. Leipzig, 1600.
Schwendener, S. Untersuchungen über den Flechtenthallus,
Naegeli’s Beitr. Wiss. Bot. Leipzig, ii. pp. 109-186 (7 col. pls.),
1860.
—— Op. cit. iii. pp. 127-198 (4 col. pls.), 1863.
—— Op. cit. iv. pp. 161-202 (2 col. pls.), 1868.
—— Ueber die Entwickelung der Apothecien von Coenogonium
Linkii. Flora, xlv. pp. 225-234 (1 pl.), 1862.
—— Ueber die “Apothecia primitus aperta” und die Entwickelung der
Apothecien im Allgemeinen. Flora, xlvii. pp. 321-332, 1864.
—— Ueber den angeblichen Protothallus der Krustenflechten. Flora,
xlix. pp. 401-412 (1 pl.), 1866.

—— Ueber den Bau des Flechtenthallus. Verh. Schweiz. Naturf. Ges.

Aarau, p. 88, 1867.
—— Die Algentypen der Flechtengonidien. Basel (3 col. pls.), 1869.
—— Erörterungen zur Gonidienfrage. Flora, lv. pp. 161-166; 177-
183; 193-202; 225-234 (1 pl.), 1872.
—— Die Flechten als Parasiten der Algen. Verh. Schweiz. Naturf.
Ges. Basel, v. pp. 551-557, 1873¹.
—— Erörterungen zur Gonidienfrage. Flora, lv. pp. 161, etc., 1872.
Translated Archer, Quart. Journ. Micros. Sci. xiii. pp. 235-251 (2
 pls.), 1873².
Scopoli, J. A. Flora carniolica. Vienna, 1760; ed. 2, 1772.
—— Anni historico-naturales, ii. Lichenis islandici vires medicae.
Leipzig, pp. 107-118, 1769.
Scott-Elliot, G. F. Notes on the Trap Flora of Renfrewshire. Ann.
Anders. Nat. Hist. Glasgow, iii. Reprint, 10 pp., 1907.
Senft, E. Ein neues Verfahren zum mikrochemischen Nachweis der
Flechtensäuren. Phar. Praxis. Vienna and Leipzig, vi. 12, 9 pp.
(text figs.). 1907. Hedwigia, xlviii. Beibl. pp. 24-25, 1908.
Sernander, R. On förekomsten af stentafvar på gammalt trä. Bot.
Notis. pp. 17-33, 1891.
—— Om de buskartade lafvarnes hapterer. Bot. Notis. 1901, pp. 21
and 107, etc. See also Bot. Centralbl. lxxxviii. p. 293, 1901.
—— Om några former för art och varietets-bildnung hos lafvarna.
Svensk. Bot. Tidskr. i. pp. 97-115 and 135-186 (5 pls.), 1907.
—— Subfossile Flechten. Flora, cxii. pp. 703-724 (7 figs.), 1918.
Servettaz, Camille. Recherches expérimentales sur le
Développement et la nutrition des Mousses en milieux stérilisés.
Ann. Sci. Nat., Sér. 9, xvii. p. 111, 1913.
Servit, Mir. Zur Flechtenflora Böhmens und Mährens. Hedwigia, l.
pp. 51-85, 1910.
Sibbald, Robert. Scotia illustrata. Part 2, i. De Plantis Scotiae, etc.
Edinburgh, 1684.
Sibthorp, J. Flora Oxoniensis, etc. Oxford, 1794.
Sievers, F. Ueber die Wasserversorgung der Flechten. Wiss. Beil. 38
Jahresber. Ber. Landw. Schule Marienberg, 52 pp., 1908. (Bot.
Centralbl. cxiii. p. 22, 1910.)
Sloane, Hans. Catalogus Plantarum quae in Insula Jamaica sponte
proveniunt. London, 1696.
—— A voyage to ... Jamaica with the Natural History of Herbs, Trees,
etc. London, 1707.
Smith, A. Lorrain. British Coenogoniaceae. Journ. Bot. xliv. pp.
266-268, 1906.
—— Fungal parasites of Lichens. Trans. Brit. Mycol. Soc. iii. pp. 174-
178, 1910.
—— Monograph of British Lichens, Part ii. London, 1911. Part i.,
1918.
Smith, J. E. English Botany. London, 1790-1814.
—— Linnaeus’ Lachesis Lapponica or a Tour in Lappland. 2 Vols.
London, 1811.
Sorby, H. C. Comparative Vegetable Chromatology. Proc. Roy. Soc.
xxi. pp. 442-483 (1873).

Speerschneider, J. Zur Entwickelungsgeschichte der Hagenia

ciliaris. Bot. Zeit. xi. pp. 705, etc., 1853.
—— Zur Anatomie und Entwickelungsgeschichte der Usnea barbata
dasypoga Fr. Bot. Zeit. xii. pp. 193, etc. (1 pl.), 1854.
Spiegel, A. Ueber die Vulpinsäure. Ber. Deutsch. Chem. Ges. xiii.
pp. 1629-1635, 1880; tom. cit. pp. 2219-2221; op. cit. xiv. pp.
1686-1696, 1881.
Sprengel, K. Einleitung in das Studium der kryptogamischen
Gewächse, 1804. Eng. ed. London (Letter xxv.), 1807.
Stahel, Gerold. Stickstoffbildung durch Pilze bei gleichzeitiger
Ernährung mit gebundenem Stickstoff. Jahrb. Wiss. Bot. xlix. pp.
579-615, 1911.
Stahl, E. Beiträge zur Entwickelungsgeschichte der Flechten. Heft i.
and ii. 55, and 32 pp. (4 pls. 2 col.). Leipzig, 1877.
—— Die Schutzmittel der Flechten gegen Tierfrass. Festschrift zum
siebzigsten Geburtstage von Ernst Haeckel. Jena, pp. 357-375,
1904.
Stahlecker, Eugen. Untersuchungen über Thallusbau in ihren
Beziehungen zum Substrat bei siliciseden Krustenflechten.
Fünfstück’s Beitr. Wiss. Bot. v. pp. 405-451 (10 figs.), 1906.
Steiner, J. Verrucaria calciseda, Petractis exanthematica, ein Beitrag
zur Kenntniss des Baues und der Entwickelung der
Krustenflechten. Programm K.K. Staatsobergymn. Klagenfurt,
xxxi. 50 pp. (1 pl.), 1881.

—— Ein Beitrag zur Flechtenflora der Sahara. Sitzungsb. K. Akad.

Wiss. Wien, Math.-Nat. Cl. civ. pp. 384-393, 1895.
Steiner, J. Beitrag zur Flechtenflora Sudpersiens. Sitzungsb. K.
Akad. Wiss. Wien, Math.-Nat. Cl. cv. Abth. i. pp. 436-446, 1896.
—— Ueber die Function und den systematischen Wert der
Pycnoconidien der Flechten. Festschr. zur Feier des zweihundert
Jahr. Best. K.K. Staatsgymn. im viii. Bezirke Wiens, pp. 119-154,
1901.
—— Flechten auf Madeira und den Kanaren, etc. Oesterr. Bot.
Zeitschr. liv. pp. 333-336, 1904.
—— Flechten aus Transkaukasien. Ann. Mycol. xvii. pp. 1-32, 1919.
Stenberg, Sten. Om användandet af Lafvar rason material för
framställning af Drufsocker och Alkohol. Oefv. K. Vetensk. Akad.
Förh. pp. 17-28, 1868.
—— Om Tillverkning af Lafbränvin. Stockholm, 52 pp., 1868.
—— See also Flora lii. pp. 517-522, 1869.
Stenhouse, J. and Groves, C. E. Picroroccellin. Proc. Roy. Soc. xxv.
pp. 60-68, 1877.
Stirton, J. Additions to the Lichen-Flora of New Zealand. Journ.
Linn. Soc. xiv. pp. 458-474, 1875.
—— Description of recently discovered foreign Lichens. Proc. Phil.
Soc. Glasgow, x. pp. 156-164, 1874.