Full download Pro Serverless Data Handling with Microsoft Azure: Architecting ETL and Data-Driven Applications in the Cloud 1st Edition Benjamin Kettner pdf docx
Full download Pro Serverless Data Handling with Microsoft Azure: Architecting ETL and Data-Driven Applications in the Cloud 1st Edition Benjamin Kettner pdf docx
com
https://ebookmeta.com/product/pro-serverless-data-handling-
with-microsoft-azure-architecting-etl-and-data-driven-
applications-in-the-cloud-1st-edition-benjamin-kettner/
OR CLICK BUTTON
DOWNLOAD NOW
https://ebookmeta.com/product/data-science-in-the-cloud-with-
microsoft-azure-machine-learning-and-python-stephen-f-elston/
ebookmeta.com
https://ebookmeta.com/product/women-and-the-war-story-miriam-cooke/
ebookmeta.com
Building Bridges between Soft and Statistical
Methodologies for Data Science Luis A. García-Escudero
https://ebookmeta.com/product/building-bridges-between-soft-and-
statistical-methodologies-for-data-science-luis-a-garcia-escudero/
ebookmeta.com
Hulda Clark The Cure for All Diseases With Many Case
Histories 1st Edition Hulda Regehr Clark
https://ebookmeta.com/product/hulda-clark-the-cure-for-all-diseases-
with-many-case-histories-1st-edition-hulda-regehr-clark/
ebookmeta.com
https://ebookmeta.com/product/delightful-turkey-recipes-1st-edition-
julia-chiles/
ebookmeta.com
https://ebookmeta.com/product/identity-and-diversity-on-the-
international-bench-who-is-the-judge-1st-edition-freya-baetens/
ebookmeta.com
https://ebookmeta.com/product/talents-and-tyrants-laurence-dahners/
ebookmeta.com
Collaborative Performance Management for Public Health : A
Practical Guide 1st Edition Amanda E. Mccarty
https://ebookmeta.com/product/collaborative-performance-management-
for-public-health-a-practical-guide-1st-edition-amanda-e-mccarty/
ebookmeta.com
Pro Serverless Data
Handling with
Microsoft Azure
Architecting ETL and Data-Driven
Applications in the Cloud
—
Benjamin Kettner
Frank Geisler
Pro Serverless
Data Handling with
Microsoft Azure
Architecting ETL and Data-Driven
Applications in the Cloud
Benjamin Kettner
Frank Geisler
Pro Serverless Data Handling with Microsoft Azure: Architecting ETL and
Data-Driven Applications in the Cloud
Introduction�����������������������������������������������������������������������������������������������������������xvii
v
Table of Contents
vii
Table of Contents
viii
Table of Contents
ix
Table of Contents
Index��������������������������������������������������������������������������������������������������������������������� 309
x
About the Authors
Dr. Benjamin Kettner is co-founder and CTO of ML!PA
Consulting GmbH, a company that focuses on the end-to-end
delivery of Internet of Things (IoT) projects. Since 2020, he
has been a Microsoft Data Platform MVP and a Friend of
Red Gate. Together with Frank Geisler, he wrote the German
books Azure für Dummies and Docker für Dummies, before
they started the adventure of writing Pro Serverless Data
Handling with Microsoft Azure together. He received his
doctorate in applied mathematics at the Free University
of Berlin in 2012. At the time of earning his doctorate, he
was a member of the DFG Research Center Matheon-
Mathematics for Key Technologies, as well as a member of
the Computational Nano Optics group at the Zuse Institute Berlin. In his free time, Ben
likes to listen to (and play) metal music, make ham and bacon, and play Xbox games
with Frank, or spend time with his daughter, Pia.
xi
About the Technical Reviewer
Sascha Lorenz has worked with Microsoft SQL Server and
efficiently automated database-related tasks for several
decades. Still with a developer soul, he is now responsible
for developing the PSG tool stack, which his colleagues and
customers use to analyze and optimize database servers
worldwide. Furthermore, he shares his experience and
knowledge in numerous workshops and trainings and at
community events.
xiii
Acknowledgments
There are many people we have met along our way, many who have helped us grow,
and many who have taken part. Any listing of names will always have gaps, but
nevertheless…
Frank: The first and biggest thank you has to go to Ben, who not only brought me
aboard this project but who has also been a best friend and a very strong supporter
whatever came my way professionally or privately though all the years. I would like to
thank all my colleagues at GDS Business Intelligence GmbH, especially Melanie Vogel
and Timur Dudhasch, who supported me through the phase of writing this book. I would
also like to thank Aurelia, the mother of my wonderful little girl, Elisa, and of course Elisa
(4), who brightens up my days and helps me to discover all the known things in a new
light. Someday you will be able to read this. Your dad is very proud of you.
Ben: I would first like to express gratitude for the help and support of my colleagues
at ML!PA. When my private life was turned upside down, they stepped up and enabled
me to continue doing what I love, and supported me. Furthermore, I would like to thank
Freya, who finds the strength to keep fighting. And, most important, our daughter, Pia,
who is a constant source of strength and joy in my life and the best thing that has ever
happened to me. I would also like to thank my parents, who were always there for me
when I was struggling. Last but not least, I want to thank my special friend Frank, who
picked me up so many times when I was feeling down, who was always there for me
without hesitation, and who has helped me improve in so many areas.
xv
Introduction
Congratulations on picking up this book. That you started flipping the pages means
that you are interested in utilizing the power of cloud computing to meet your needs.
We should warn you that, even though we are aware of the marketing hype surrounding
serverless computing, this book is not a marketing book. It is more of a guide to utilizing
serverless services in Microsoft Azure to meet your needs regarding the scalability,
reliability, and simplicity of the design of your solution.
We are aware that serverless technology is not the means by which to solve all
problems in any given cloud architecture, and of course some of the examples in this
book will be overdoing the “serverless” aspect of the architectures, but the purpose here
is to give you an idea of where you could use serverless Azure services to solve certain
scenarios.
This book is aimed at you as an IT manager with technical interest who would like to
understand where serverless services might be an option for implementing a part of your
solution. And it is aimed at you as an IT developer who would like to write less code
for applications that scale well and are well behaved with respect to problems in the
infrastructure. It also is aimed at you as a solution architect if you would like to get some
ideas for how to incorporate new services and concepts into your solution. Finally, it is
aimed at you as an IT professional who would like to broaden your knowledge of cloud
computing.
This book will first give you a basic introduction to Microsoft Azure and serverless
computing and explain the basics that will be used throughout all other chapters of the
book (Chapters 1–3).
The second part of the book (Chapters 4–9) will introduce the most important
services in Microsoft Azure that offer a serverless tier. These chapters will focus on the
serverless tiers and introduce some of the services’ functionalities. You will also be
provided with examples of how to create each service.
The third part of this book (Chapters 10–13) will introduce several architectural
concepts and discuss how using serverless services can contribute to each of these
concepts. You will see some architectural drafts here—both as abstract concepts and
with actual Azure services—that you can use as a basis when building or enhancing
xvii
Introduction
your own architecture. These chapters are primarily aimed at explaining the interaction
between services and how to bring the pieces together into concise and working
examples.
In the last part of the book (Chapters 14–17), we will give you a head start for
implementing the concepts learned so far. We will introduce some tools and helpers
that you can use to interact with the services when implementing a solution, some
more-detailed patterns to highlight questions you should answer when designing your
solution, and finally an architectural blueprint for a theoretical solution that brings
together all the topics learned thoughout the book.
When reading this book, you will find many examples to explain what is happening.
The code for all examples will be available on our GitHub page at https://github.
com/Serverless-Data-Handling/. You can download it to save on all the editing. As
the Azure CLI is available on Linux, Mac, and Windows, you should be able to run all
examples on the hardware of your choice. If any examples do not work, we would like to
encourage you to add a comment to the GitHub repository so that we can help you find
the issue.
We would now like to encourage you to dive into the world of serverless computing.
We hope that you will find this book a good companion when designing your next
solution, enhancing your current solutions, or coming up with new ideas that even we
did not think of yet.
xviii
Other documents randomly have
different content
Item alia antiquissima
Passionale Octobrii et Decembrii mensis
Vita Sanctae Katerinae in uno codice
et Sancti Martini
Sermones Yvonis carnotensis[291]
Leviticus glosatus[292]
Anselmus, Cur Deus Homo
Item Anselmus, de processione Spiritus Sancti
Rodbertus, de Corpore et Sanguine Christi[293]
Compotus[294]
Gaufridi Abbatis[295]
Interpretationes Hebraicorum nominum[296]
Quidam liber de Titulis Psalterii
Vita Sanctae Werburge
Vita Sancti Edwardi
Vita Sancti Basilii
Vita Sancti Blasii
Vita Sancti Nicholai
Vita Sancti Johannis eleymonis[297]
et liber qui vocatur Dominus vobiscum
et Vita Sancti Dunstani
Vita Sancti Leonardi
Passio Sanctae Agathae et aliorum, in magno quaternione[298]
Vita Sanctae Martae[299] Egyptiacae versibus insignita
Arator, super Acta Apostolorum[300]
Sinonima Ysidori in parvo libro[301]
Sex libri Sententiarum qui fuerant Bernardi Abbatis[302]
Duo capitularia[303] vetusta
Ymnarium cum aureis litteris
Epistolae Apostolorum Canonicae
Omeliarium vetustissimum
Sermones Paschales Sancti Cesarii[304]
Ernaldus, de Villico iniquitatis[305]
Martirologia duo vetera
et unum novum
Regula duo vetusta
Omeliarium anglicum
INDEX
CHIEFLY OF PERSONS AND PLACES
Bachaker, 112
Bache, 204
Bacon, Richard, 10
Bageley, Robert, 190, 239, 242
Bagford, 103
—— Thomas, 204
Bagley, William, 117, 204
Bagnall, William, 169
Bagot, John, 88, 89
—— Thomas, 77, 116
Bagott, Stephen, 170, 257
Baguley, Thomas, 172, 190, 232
Baker, Hugh, 117, 204
—— Robert, 204
Bannebury, Thomas de, 80
Bannockburn, 96
Bar, Magna and Parva, 23
Barkley, 123
Barleston, 68, 123, 124
Barley, Hugh, 90
Barnes, Randall, 190
Bassett, Francis, 127, 158, 159, 160, 169, 176, 255
—— William, 36, 54, 55, 110, 158, 168, 264, 265, 266
Beauchief, 205
Beaulieu, 13 n.
Bech, Beche, 204, 233
Beche, William, 168, 196, 222
Becket, Archbishop, 10, 39
Bednall, 116
Belfeld, John, 87
Benedictines, 12, 14, 87
Bennett, Henry, 190
Bentley Park, 77
Berkswick, 58, 68, 117, 120, 181
Berreston, 195
Beyne, Abbot of Burton, 17, 81, 89
Bible, 95, 201
Biddulph, 6, 210
Billington, 112, 113
Billysdon, John de, Abbot of Croxden, 95
Biscopham, 102
Bitterstone, 24
Black Death, 32, 72, 96, 109
Blackmore, 93
Blithburgh, 23 note
Blithbury, 23 note, 94
Blithfield, 69, 79, 111
Blore Park, 143
Blount or Blunt, Edward, 62, 105, 106
—— John, 98
—— George, 141
—— Walter, 54
Blurton, 122, 124
Blythe, Geoffrey, Bishop of Lichfield, 26, 27, 30, 35, 42, 112
Boleyn, Anne, 43, 44
Bolton, Edmond, 190
Bond, William, 168
Bonye, Peter, 197
Boston, William, Abbot of Burton and afterwards of Westminster,
43, 44, 45, 47, 48, 74, 83
Bothe, John, 157, 175
Boudon, William, 172, 190, 232
Boughey, George, 117, 233
Boyston, Thomas, 90
Brabazon, William, 24, 36, and note,, 37
Bradborne, 124
Bradley, 68, 93, 110, 111
Bradnop, 107, 108
Bradshawe, Robert, 177
Bradwall, or Bradwell, Laurence, 123
—— —— John, 193
—— —— Thomas, Prior of Trentham, 122, 193, 195
Brailsford, 127
Branstone, 77, 86, 90
—— William, Abbot of Burton, 81
Brazenose College, 20
Bredehurst, Henry, 123
Brenn’, Hugh, 117
Brewood, Cistercian Nunnery, 92, 141, 209
—— Benedictine Nunnery, 14, 18, 62, 64, 67, 71, 92–4, 203,
204;
Dissolution, 138, 162, 171, 172, 175, 176, 178, 179, 189,
198, 199. App. iii
See Prioress Isabel Launder
Bridgnorth, 108
Brocke, or Brooke, Dr., 177, 191
Brodsha, Thomas, 155
Broke, Mr., 130, 156
—— St. Mary, 138
Broley, Nicholas, 167
Brome, 92, 93
Bromley Hurst, 77, 82, 84, 86, 88, 90, 130
Browne, Robert, 117
Brucheford, 112, 114
Brugge, William del, 101
Brykylbake, John, 168
Buckinghamshire, 7
Buildwas Abbey, 205
Bulle, Roger, 191
Burbank, William, 23, 25
Burchard, 9
Burdeslyme, 108
Burgh, Hubert de, 39
—— Robert, 103, 242
Burgoyn(e) Robert, 145, 163, 165, 175
Burnet, Archbishop Gilbert, quoted, 2, 4
Burston, 120, 121
Burton-on-Trent, 69, 75, 79, 80, 81, 82, 84, 85, 87, 90, 177, 196
—— Abbey, 7, 8, 14, 17, 18, 30, 43, 47, 60, 74, 80, 81, 86, 95,
96, 98, 106, 129, 130, 131, 139, 149, 150, 157, 176, 201,
207
Annals, 9, 74 and note, 200
Cook, 81
Library, 200. App. xiv
Manor Court, 84
In Valor Ecclesiasticus, 59, 60, 61, 62, 63, 64, 65, 67, 69, 70,
71, 76, 77, 79, 86, 129, 179
Dissolution, 160, 177, 203
College, 177, 191. App. xii, xiii
Pensions, 190, 191
See Abbots Abingdon, Beyne, Boston, Branstone, Edie, Felde,
Geoffrey, Nicholas, Packington, Richard, and Sudbury
—— Grammar School, 81, 177
Burton Overy, 98
Burwey, Nicholas, 177
Bushbury, 58, 68, 116, 117, 120
Butler, Thomas, 102
Byddel, 68, 108
Bykerton, John, 190
Byssheton, 116
Byveley, 103
Dalbury, 124
Damport (or Davenport) William, 103, 173, 194 and note, 195,
242, 243
Darlastone, 77, 119, 120, 121
Daun, Richard, 103
Dave, George, 168
Dawley, 93
Day, Richard, 196
Dayne, John, 168
Demesne, 77, 98, 102, 103, 105, 107, 108, 110, 111, 113, 114,
115, 119, 121, 122, 124, 127, 128, 142
Denstone, 100, 110, 111
Derby, 81, 84, 98, 111, 128, 130
—— Lord Edward, 103, 162, 170, 174, 193, 203, 204, 205, 237,
241, 242
Derbyshire, 7
Dieulacres Abbey, 14, 15, 16, 17, 18, 30, 60, 62, 64, 65, 67, 68,
71, 95, 107, 131, 139, 148, 180, 183, 184, 185, 186, 197,
201, 207
in Valor Ecclesiasticus, 102, 103, 179, 204
Dissolution, 170, 171, 172, 173, 174 and note, 175, 187, 193,
199, 203, 204, App. ix
Pensions, 190, 195, 196
See Abbots Goodfellow, Whitmore, and Whitney
Dijon, 94
Doddington, 114
Domesday Book, 75
Dorynton, Dorrington Robert, 165, 201, 246, 247, 249
Dove, River, 167
Dover, Bishop of. See Ingworth
Doveridge, 68, 98, 127, 128
Doveridge Holt, 127
Draycott, 130
—— Edmund de, 101
—— or Dreycote, Philip, 107, 203, 204, 264, 265, 266
Drayngton, 116
Drayton, 24, 115, 117
—— Edmund de, 101
Duddlestone, 105
Dudley, 23, 59, 105, 106
—— Prebendary Arthur, 159
—— Lord Edward, 25
—— Priory, 6, 11, 18, 30, 58, 59, 62, 64, 67, 70, 71, 92, 139,
202
in Valor Ecclesiasticus, 104–6, 179
Dissolution, 194, 199, 203
See Prior John Webley
Dudley, Sir John, 6, 105, 116, 194
Duffield, 127
Dulverne, 113
—— Richard de, Prior of Trentham, 122
Duranstrope, 116
Durham (County), 7
Dutton, Sir Piers, 46 and note
Gaddesby, 123
Gairdner, Dr., quoted 2, 139 note
Gallows, 100
Gasquet, Dr., quoted 2, 139 note
Gaunt, Robert, 128
Geoffrey, Abbot of Burton, 200
Geyton, 68, 117
Giffard, Mr., 175
Gifford (or Gyfford), John, 6, 25, 36, 54, 55, 93, 113
——, —— Thomas, 54, 55, 116, 225, 227
Glaston = Ellaston, q.v.
Glebe, 67, 68, 79, 102, 117, 124
Gloucester College, Oxford, 87
Gnosall, 112, 113
Goodcole, John, 191
Goodfellow, John, Abbot of Dieulacres, 101
Goodrich, Richard, 177, App. xii
Gordon, John, 103
—— Richard, 190
Gorton, Dan Richard, 83
Gostree, 104
Gostwick, John, Treasurer of First Fruits, 40
Grafton, George, 168
—— William, Abbot of Rocester, 109, 168, 193, 195
Great Gate, 100, 195
—— Meadow, 110
Green, J. R., quoted, 2
Grenburgh, 68, 113, 114
Grene, Alexander, 151
Gresley, George, 54, 55, 116
—— Nicholas, 35
—— Thomas, 149
—— Thomas de, 87
Greswike, Sampson, 147
Grindley, 116
Grindon, 69, 79
Grosvenor, John, 54, 55
—— Richard, 103, 242
Gynne, Richard, 123
Hadford, 103
Halghton, 112
Halywell, 109
Hampton, 94
—— Court, 28
Hamstall Ridware, 69, 79
Hanchurch, 122, 124
Hanyate, 116
Harborne, 23
Harcourt, Harecourt, John, 113, 203
——, —— Robert, 195
——, —— Richard, 39
——, —— Simon, 140, 141, 142, 144
Hargreaves, Henry, 197
—— Laurence, 197
Harmon, Bishop of Exeter, 26
Harvey Richard, 172, 190, 232
—— William, 117
Hartshorne, 98
Hastings, Lord, 142, 160
Hatton, 128
Haughmond Abbey, 10, 112, 113
Heathhouse Grange, 112, 114
Heath Mill, 197
Heith, Richard, 158
Heithcott, Robert, 191
Hendon, Thomas, 168, 222
Hennege, Thomas, 171
Henry I, 13
—— II, 13
—— III, 14, 94, 109, 118
—— IV, 87, 88, 115, 125
—— V, 19
—— VI, 17, 109
—— VIII, 16, 19, 21, 26, 39, 42, 43, 44, 48, 50, 55, 80, 99,
122, 130, 134
Henyngton, 94
Herefordshire, 7
Heron, John, 191
Heth, Roland, 127, 195
Hether, William, 191
Hevedale, 112, 114
Hevehall, 112, 113
Heyton, 103, 104
Higdon, John, Dean of Cardinal’s College, 24, 25
Hilderstone, 120, 121
Hilton, Hylton, Roger, 167, 195
Hodgetts, 159
Hoggson, John, 113
Hognaston, 110
Holcroft, Mr., 149
Hollington, Holington, 127, 128
Holond, Holland, Otto, 116, 117
Holte, Thomas, 54
Hopton, 116
Hornington, 77
Hospitality, 1, 16, 118
Horsbrook, 92 and note
Horton, 103
Howton, Abbot of Croxden, 94
Hulme, 104
Hulton, 130
Hulton Abbey, 6, 14, 18, 30, 59, 62, 64, 65, 67, 68, 70, 71, 95,
98, 106–9, 124, 130, 131, 196
in Valor Ecclesiasticus, 107, 108, 179, 204
Dissolution, 138, 145, 163, 169, 171, 186, 199, 203. App. xi
Pensions, 195
See Abbots Allen, John, and Wilkyns
Hulton Manor, 107, 108
Hunchedial, 100
Hundred Years’ War, 72, 96, 124
Huntingdon, George, Earl of, 90, 193, 203
—— Francis, Earl of, 193
Hyll, William, 127
Hyns, 24
Katherine of Aragon, 43
Keele, 15, 19
Kelyng, John, 112, 113
—— Thomas, 168, 222
Kenilworth Abbey, 10, 30, 32, 40, 118, 119, 120
Kent (County), 7, 57
Keydr (or Cade), Robert, 168, 196, 222
Kidderminster, 93
Kirk Broughton. See Church Broughton
Knighton, 112, 113
Knutsford, 103
Kybbulston, 122, 123, 124
Kyngeley, 111
Kynston, 68, 110
Packington, 24
—— Thomas, Abbot of Burton, 85
Paget, Sir William, afterwards Baron Paget of Beaudesert, 177,
263 and note, 264 and note
Paganel, Gervase, Baron of Dudley, 11
“Palfrey Money,” 127
Paper Surveys, 110, 113
Parliament, “Reformation,” 30, 44, 47, 137
Parry, William, 117
Particulars for Grants, 5
Peche, Bishop of Lichfield, 10
Peckham, Archbishop, 16
Penford, 115, 116, 117
Penford, John, 93
Penkridge, 113
Pensions to Religious, 26, 79, 178, 189–91, 198
—— — Lay Inmates, 193, 194
Penulton, 115, 116
Peter-sur-Dive, St., 9, 124, 125
Picto, Thomas, 164, 165, 166, 251
Pigs as Rent, 128
Pilgrimage of Grace, 146, 211
Pillatonhall, 77
Pipstoke (or Pykstoke), William, 172, 190, 232
Pitt, Thomas, 93
Plante, William, 5
Pole, Dr., 33, 39, 45, 46, 189, 212 note
—— Henry, 111, 127
—— John, 191
—— Reginald (Cardinal), 22
Polesworth Abbey, 85
Pope, Sir Thomas, 140
Pothlac, 86, 90
Pottery Works, 131
Præmunire, 42, 53, 55
Pratye, John, 197
Prince, John, 127
Prowdluffe, William, 190
Pulford, 103
Pulton, Poulton, 100, 103, 104, 173, 174 and note
Puttels, 98, 100
Radford, 14
Radmore, 12
Ralf, Baron of Stafford, 14
Ratclyffe, Alexander, 116, 117
—— Laurence, 107
Rathbone, Hugh, 147
Rede, William, 107
Reformator of Cistercians, 50, 62, 99, 192
Revival of Learning. See New Learning
Renez (or Raynard), Thomas, 167, 191
Repton Priory, 84
Rheims, 9, 118
Riche, Sir Richard, Solicitor-General, Chancellor of
Augmentations, 140, 163, 165
Richard, Abbot of Burton, 81
Richard II, 16, 96
Richmond, Archdeaconry, 53
—— Duke of, 16, 21
Ridding, 100
Ridel, Justice Geoffrey, his widow, 11
Robynson, Robert, 191
Rocester, 68, 94, 109, 110, 130, 193
—— “Abbey,” 5, 10, 11, 15, 17, 18, 30, 34, 36, 58, 59, 60, 62,
64, 65, 67, 69, 70, 71, 98, 102, 109–12, 130, 202, 207
in Valor Ecclesiasticus, 110–11, 179
Dissolution, 138, 145, 163, 167, 169 and note, 171, 186, 193,
199, 203. App. x.
Pensions, 190, 195, 196
See Abbot William Grafton
Rogers, Thorold, quoted 4, 5
Rolleston, 87
—— Thomas, 168, 222
Ronton, 112, 113, 114, 130
—— Priory, 10, 18, 26, 30, 62, 64, 65, 67, 68, 70, 71, 107, 112–
14, 116, 131, 195, 201
in Valor Ecclesiasticus, 112–13, 179
Dissolution, 138, 140, 144, 145, 203
Pensions, 195
See Prior Thomas Alton
Roses, Wars of, 72, 97
Rokyn, Roland, 23
Rossall, 103, 104
Rothwell, Henry, 168, 222
Rowley, 153
Rudde, John, 191
Rudheth, 103
Rugeley, 14
Rushton Grange, 6, 108, 210
Russell, William, 117
—— Thomas, 153
Rutland, 7, 138
Rycerdysctote, 116
Ryve, Robert, 166, 252