Testing Cloud Services
185 Pages
English

Testing Cloud Services

-

Description

Everybody is confronted with cloud computing. Whether you are a user, designer, programmer, project manager, or tester, sooner or later the cloud affects your work. If you are involved in selecting or implementing services from the cloud, or in keeping them up and running, this book will prove to be an invaluable resource.

Testing Cloud Services covers an extensive list of risks that arise when implementing cloud computing, including some traditional risks and some completely new ones, and provides strategies for avoiding these risks and solving problems. Every risk is connected to existing, updated, and new test measures. It is necessary to start testing during the selection of cloud services, and continue end-to-end testing even after going live, as continuity risks arise all the time.

With this book in hand, you will save a lot of time and discover an effective approach to testing that can be applied in practice immediately!


Subjects

Informations

Published by
Published 19 September 2013
Reads 25
EAN13 9781492000044
Language English
Document size 10 MB

Legal information: rental price per page €. This information is given for information only in accordance with current legislation.

Testing Cloud Services
Kees Bloklandhas worked for Polteq as a senior test consultant since 2003 and has over twenty years experience in the testing profession. As the R&D manager, he has always been closely involved in testing innovations at Polteq. Kees is the first-line contact on cloud issues for customers and colleagues. He teaches many practical and theoretical courses in the field of testing and he is an experienced speaker on the national and international test stage.
Jeroen Mengerinkworked for Polteq since 2008 and is a has test consultant. In addition to his work for customers, he is involved in various Polteq testing innovations. Jeroen is the first-line contact on Agile issues for colleagues and customers. He is a trainer for a diverse assortment of testing trainings, including the subjects of Agile, SOA and Cloud. He is also inter-ested in the field of test automation.
Martin Polhas played a significant role in helping to raise the awareness and improve testing in Europe, Asia and the Ameri-cas, since 1983. He has gained experience by managing testing processes and implementing adequate testing in different branches of many organizations. He was responsible for the creation of international testing standards and models for test process improvement. Martin’s extensive experience and knowledge formed the unique architectural foundation for the approach in this fine book.
Polteqan independent provider of international software testing services based in is The Netherlands and Belgium. Polteq testing professionals are requested to execute test assignments or to help solve testing issues worldwide. Polteq offers consultancy and training for testing cloud services under the commercial label Cloutest®.
Kees Blokland, Jeroen Mengerink, Martin Pol
Testing Cloud Services
How to Test SaaS, PaaS & IaaS
Kees Blokland, Jeroen Mengerink, Martin Pol
Editor: Dr. Michael Barabas/Maggie Yates Copyeditor: Judy Flynn Proofreader: Carey Hobart Project Manager: Matthias Rossmanith Layout: Josef Hegele Cover Design: Helmut Kraus, www.exclam.de Printer: Edwards Brothers Malloy Printed in the USA
ISBN 978-1-937538-38-5
1st Edition © 2013 by Rocky Nook Inc. Rocky Nook Inc. 802 East Cota St., 3rd Floor Santa Barbara, CA 93103
www.rockynook.com
 Library of Congress Cataloging-in-Publication Data
Blokland, Kees, 1962-Testing cloud services : how to test SaaS, PaaS & IaaS / Kees Blokland, Jeroen Mengerink, Martin Pol. -- 1st edition.  pages cm ISBN 978-1-937538-38-5 (pbk.) 1. Cloud computing. 2. Application software--Testing. I. Mengerink, Jeroen. II. Pol, Martin, 1947- III. Title. QA76.585.B56 2013 004.67'82--dc23  2013022943
TOGA®and Cloutesare registered trademarks of Polteq.
Distributed by O'Reilly Media 1005 Gravenstein Highway North Sebastopol, CA 95472
All rights reserved. No part of the material protected by this copyright notice may be reproduced or utilized in any form, electronic or mechanical, including photocopying, recording, or by any information storage and retrieval system, without written permission of the publisher.
Many of the designations in this book used by manufacturers and sellers to distinguish their products are claimed as trademarks of their respective companies. Where those designations appear in this book, and Rocky Nook was aware of a trademark claim, the designations have been printed in caps or initial caps. All product names and services identified throughout this book are used in editorial fashion only and for the benefit of such companies with no intention of infringement of the trademark. They are not intended to convey endorsement or other affiliation with this book.
While reasonable care has been exercised in the preparation of this book, the publisher and author(s) assume no responsibility for errors or omissions, or for damages resulting from the use of the information contained herein or from the use of the discs or programs that may accompany it.
This book is printed on acid-free paper.
Contents
Introduction from the CEOvii. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Prefaceix. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  .
Acknowledgements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi
1 Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
2 What is Cloud Computing?. . . . . . . . . . . . 5. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2.1 Essential characteristics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 2.2 Service models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 2.3 Implementation models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
3 Role of the Test Manager. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 3.1 In general . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 3.2 Tasks during selection, implementation, and production . . . . . . . . . . . . . . . 25 3.3 Testing with the help of the cloud . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
4 From Risk to Test. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33 4.1 Performance risks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36 4.2 Security risks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39 4.3 Availability and continuity risks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41 4.4 Functionality risks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43 4.5 Maintainability risks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45 4.6 Legislation and regulations risks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47 4.7 Suppliers and outsourcing risks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
v
vi
 Contents
5
6
Test Measures. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 5.1 Testing during selection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 5.2 Testing performance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65 5.3 Testing security . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 82 5.4 Testing for manageability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92 5.5 Availability/continuity testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104 5.6 Functionality testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119 5.7 Testing migration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 137 5.8 Testing due to legislation and regulations . . . . . . . . . . . . . . . . . . . . . . . . . . . . 146 5.9 Testing in production . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 152
Completion. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 161
Glossary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 163. . . . . . . . . . . . . . . . .
Index. . . . . . . . . . . . . . . . 167. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Introduction from the CEO
I consider myself very lucky to be the executive lead of Polteq. The foundation of this company is a mix of experienced and young IT workers; the combination of doing, learning, improving and appreciating makes the cooperation a blast for the Polteq employees as well as for the customers. Since it was founded in 2000, Polteq has always paid a lot of attention to the development of the test profession. A renowned test company like Polteq can-not, therefore, ignore the cloud. In 2008, the first steps were made to develop an approach for testing cloud services. Studies, experience, perseverance and a hefty R&D budget have resulted in a unique and, most of all, practical approach for testing applications in the uncertain digital cloud. No one needs to invent the cloud-testing wheel anymore, since Kees Blokland, Jeroen Mengerink and Martin Pol have done that already, together with many colleagues. This book will enable you to start right away and help you navigate the process of testing in the cloud. It is probably clear that we at Polteq, and me in particular, are thrilled to have reached this milestone. It may not surprise you that Polteq offers consultancy and training for testing cloud services. For that we chose the commercial label Cloutest®.
Alain Bultink CEO Polteq Test Services BV
vii
Preface
We all have heard about the cloud, even without knowing it. When you receive a link to download a file online for instance, you probably are already in the cloud. As a user you don’t stop and think about the risks. What if, for instance, thousands of people simultaneously download this file? Can you accept the fact that this process will be extremely slow? Or when you send an email with your online client application, you very much would like it to be sent with the appro-priate privacy. The entire world, of course, is able to access the cloud. The termcloudcomes from the fact that data packages no longer travel along a defined path. One doesn’t know any longer by which path they reach their end point. We can no longer say for certain which route has been taken. This explanation contains a number of aspects that, as a tester, makes you think. “No defined path” and “no longer say for certain” are aspects that we as testers actually are not really looking for—quite the opposite. How can we make a statement about quality without having these certainties? Cloud computing has proven its use over the past years, and nobody doubts that anymore. But it quickly becomes clear that cloud computing brings a certain number of specific risks. As testers, we often say, “We can test everything!” But is this true? Are we really ready to test cloud computing applications? And then I was asked by Kees, Jeroen, and Martin to write this preface. My first thought was, “Finally, a book on testing applications developed for the purpose of cloud computing.” During conferences we gradually gained some information, but it still was a puzzle to create a complete approach. But we did, and that is exactly what you can find in this book. This book even goes further than the questions I originally had. It is also about how we can use cloud com-puting to execute our tests. It provides a very structured overview of what cloud computing actually is and how as a test manager you need to position your tasks.
ix
)