Upgrading OpenStack? Avoid these 3 Common Pitfalls

Upgrading OpenStack? Avoid these 3 Common Pitfalls

• 1.
  UPGRADING OPENSTACK? AVOID THESE 3COMMON PITFALLS KEN HUI DIRECTOR OF TECHNICAL MARKETING @hui_kenneth HARRISON PAGE SOFTWARE ENGINEER @harrisonpage
• 2.
  P R OL O G U E "Upgrade from one OpenStack release to the next is a daunting task. Experienced OpenStack operators usually only do so reluctantly." - Drew Fisher, Oracle "It's a process that strikes fear into the hearts of Sysadmins everywhere." - Chris Cowley “Backbreaking” OpenStack migrations hinder enterprise upgrades - Barb Darrow, Gagaom "Over the course of a month, what became obvious was that a huge amount of the documentation I was consuming was either outdated or fully inaccurate." - David Paube, Packet
• 3.
  W H YA R E U P G R A D E S S O D I F F I C U LT ? 1 . U N I N T E N D E D C O N S E Q U E N C E S : N E W F E AT U R E S B R I N G N E W B U G S 2 . F E AT U R E S G E T D E P R E C AT E D O R A R E O T H E R W I S E N O T B A C K WA R D S C O M PAT I B L E 3 . N E W R E Q U I R E M E N T S : FA S T E R C P U , M O R E D I S K S PA C E 4 . D ATA B A S E S C H E M A C H A N G E S 5 . C U S T O M C O N F I G U R AT I O N S T O B E P R E S E R V E D : F I R E WA L L R U L E S , U S E R S E T T I N G S
• 4.
  S O WH Y U P G R A D E ? 1 . P L AT F O R M S TA B I L I T Y B U G S H A P P E N 2 . N E W F E AT U R E S O P E N S TA C K A D D S N E W P R O J E C T S A N D N E W F E AT U R E S T O E X I S T I N G P R O J E C T S 3 . O N G O I N G S U P P O RT V E N D O R S C A N ' T S U P P O RT E V E RY T H I N G F O R E V E R 4 . S E C U R I T Y U P D AT E S A LWAY S W I T H T H E PAT C H E S
• 5.
  3 M OS T C O M M O N P I T FA L L S 1 . N O T I M P L E M E N T I N G A U T O M AT I O N 2 . N O T E N O U G H T E S T I N G 3 . N O R O L L B A C K C A PA B I L I T I E S
• 6.
  B U IL D I N G B L O C K P R I N C I P L E S I T S TA RT S W I T H T H E R I G H T D E S I G N PAT T E R N S • P I O N E E R S I N T H E C L O U D C O M P U T I N G S PA C E • A M A Z O N • N E T F L I X ( S I M I A N A R M Y ) 
 • Y O U C A N B U I L D S Y S T E M S W I T H H I G H AVA I L A B I L I T Y A N D S E R V I C E U P T I M E , E V E N I F T H E U N D E R LY I N G I N F R A S T R U C T U R E I S F R A G I L E MORE AUTOMATION MORE TESTING ROLLBACK CAPABILITIES
• 7.
  B U IL D I N G B L O C K P R I N C I P L E 1 : T H E B I G G E S T R I S K F O R FA I L U R E O C C U R S W H E N A H U M A N I S R E Q U I R E D T O M A N U A L LY C O M P L E T E R E P E T I T I V E TA S K S MORE AUTOMATION MORE TESTING ROLLBACK CAPABILITIES
• 8.
  B U IL D I N G B L O C K P R I N C I P L E 2 : C L O U D M A N A G E M E N T TA K E S O N N E W M E A N I N G W H E N Y O U F O C U S O N O V E R A L L S E R V I C E U P T I M E I N S T E A D O F I N D I V I D U A L C O M P O N E N T U P T I M E MORE AUTOMATION MORE TESTING ROLLBACK CAPABILITIES
• 9.
  B U IL D I N G B L O C K P R I N C I P L E 3 : • M A K E U S E O F I M M U TA B L E I N F R A S T R U C T U R E • T R E AT Y O U R I N S TA N C E S A S D I S P O S A B L E U N I T S • D O N ’ T U P G R A D E Y O U R I N F R A S T R U C T U R E , R E P L A C E I T “ O T H E R W I S E T H E R E S U LT I S A U N I Q U E S N O W F L A K E - G O O D F O R A S K I R E S O RT, B A D F O R A D ATA C E N T E R . " - - M A RT I N F O W L E R MORE AUTOMATION MORE TESTING ROLLBACK CAPABILITIES
• 10.
  P L ATF O R M 9 M A N A G E D O P E N S TA C K • C L O U D M A N A G E M E N T- A S - A - S E R V I C E • Y O U R S E R V E R S H O S T Y O U R D ATA • P L AT F O R M 9 H O S T S O P E N S TA C K C O N T R O L L E R S W I T H 2 4 / 7 M O N I T O R I N G , S U P P O RT , A N D S L A • W O R K S W I T H Y O U R E X I S T I N G V M WA R E A N D K V M E N V I R O N M E N T S • I N S TA L L S I N M I N U T E S , N O T M O N T H S
• 11.
  T H EP L AT F O R M 9 A R C H I T E C T U R E
• 12.
  A U TO M AT I O N W E ’ V E A U T O M AT E D C O N F I G U R AT I O N M A N A G E M E N T AT P L AT F O R M 9 U S I N G A N O P E N S O U R C E T O O L C A L L E D A N S I B L E W I T H “ S N A P E " S N A P E : • C R E AT E S A M I - B A S E D I N S TA N C E S T H AT M A K E U P A C U S T O M E R D U ( " D E P L O Y M E N T U N I T ” ) • A P P L I E S N E T W O R K C O N F I G U R AT I O N • C R E AT E S D ATA B A S E I N S TA N C E F O R E A C H D U • A P P LY C U S T O M E R C O N F I G U R AT I O N : PA S S W O R D S , S S H K E Y S , S S L C E RT I F I C AT E S • D E P L O Y S M O N I T O R I N G , L O G G I N G A N D A N A LY T I C S T O O L S MORE AUTOMATION MORE TESTING ROLLBACK CAPABILITIES
• 13.
  ROLLBACK CAPABILITIES MORE AUTOMATION MORE TESTING T E ST I N G W E H AV E A B O U T 1 0 0 L O N G - F O R M T E S T S , 1 0 0 0 S O F U N I T T E S T S T H AT W E C A N R U N O N E A C H B U I L D T O V E R I F Y A N U P G R A D E I S VA L I D
• 14.
  T H EB L U E / G R E E N D E P L O Y M E N T M O D E L : • S TA N D U P T W O P R O D U C T I O N E N V I R O N M E N T S • B L U E I S L I V E ( C U R R E N T R E L E A S E ) • G R E E N I S S TA N D B Y ( N E W R E L E A S E ) • I F A L L L O O K S G O O D , P R O M O T E T H E G R E E N I N S TA N C E T O P R O D U C T I O N A N D S E T B L U E A S I D E S O W E C A N R E V E RT T H E R E I F S O M E T H I N G G O E S W R O N G MORE TESTING MORE AUTOMATION ROLLBACK CAPABILITIES
• 15.
  U P GR A D E P R O C E S S W E R E C E N T LY U P G R A D E D F R O M H AVA N A T O J U N O P L AT F O R M 9 C U S T O M E R S A R E " O F T E N G E N U I N E LY A N D H A P P I LY S U R P R I S E D B Y O U R PA I N L E S S , Z E R O - T O U C H O P E N S TA C K U P G R A D E " U P G R A D E S A R E S C H E D U L E D 1 - 2 W E E K S I N A D VA N C E : • S O M E O R G A N I Z AT I O N S P R E F E R A L O N G E R W I N D O W • O T H E R S W H O A R E H E L P I N G U S T E S T O R WA I T I N G O N N E W F E AT U R E S D O N ' T M I N D M O R E F R E Q U E N T U P D AT E S
• 16.
  B E FO R E U P G R A D I N G P L AT F O R M 9 : • B A C K U P A L L L O G S A N D I N T E R E S T I N G F I L E S • D U M P A L L D ATA B A S E TA B L E S • G I V E E V E RY B O D Y I N T H E C O M PA N Y V I S I B I L I T Y I N T O T H E P R O C E S S MORE TESTING MORE AUTOMATION ROLLBACK CAPABILITIES
• 17.
  S E RV I C E O R I E N TAT I O N C U S T O M E R D U D O E S N O T S T O R E C O N F I G U R AT I O N D ATA L O C A L LY: • E V E RY T H I N G I S S T O R E D I N A R E M O T E D ATA B A S E • A L L C O N F I G U R AT I O N B I T S A R E E N C RY P T E D A N D C H E C K E D I N T O S O U R C E C O D E C O N T R O L N E W I N S TA N C E S C A N B E D E P L O Y E D A S U S A G E I N C R E A S E S MORE TESTING MORE AUTOMATION ROLLBACK CAPABILITIES
• 18.
  R O UT E R W E B S E R V E R A P P S E R V E R D B MORE TESTING MORE AUTOMATION ROLLBACK CAPABILITIES
• 19.
  P L ATF O R M 9 P R A C T I C E S " C H AT O P S " W E H AV E A S L A C K B O T T H AT C A N S C H E D U L E A N D K I C K O F F C U S T O M E R U P G R A D E S • T H E S A M E B O T W I L L I N S TA L L O R R E C O V E R A C U S T O M E R I N S TA N C E W E H AV E A # D E B U G C H A N N E L T H AT S H O W S W H AT ' S H A P P E N I N G U N D E R T H E H O O D • C H AT- R O O M - A S - S H A R E D - S H E L L G I V E S I N S I G H T T O A L L PA RT I E S MORE TESTING MORE AUTOMATION ROLLBACK CAPABILITIES
• 20.
  S U MM A RY 1 . U P G R A D E S A R E D I F F I C U LT B U T N E C E S S A RY 2 . WAT C H O U T F O R C O M M O N P I T FA L L S 3 . A D O P T C L O U D - N AT I V E P R I N C I P L E S 4 . C O N S I D E R L E T T I N G U P G R A D E S B E S O M E O N E E L S E ’ S P R O B L E M