Rajesh Math

2018-19 Cloud Computing BY Rajesh Math 1


 Resource person

1. Research Scholar / Adjunct Faculty in Cloud Analytics and Big Data

with SPPU, Pune.
2. Mentor for Start-ups. Corporate Trainer/Consultant.
3. Academic Qualification MS(Boston University, USA), MBA Pune
University, BS(Computers) (Pune University)
4. 18 Years International Business Experience US(14) Australia(2) and
Europe(2 years)
5. 6 years Academic experience as Professor , Resource Person for IGI,
SPPU and CSI Author of Book in Internet Technology & Big Data
6. International/National Publications
7. Google Scholar Profile : Rajesh Math

2018-19 Cloud Computing BY Rajesh Math 2


 Cloud
Computing

2018-19 Cloud Computing BY Rajesh Math 3


 Cloud Computing

Introduction
What Is Cloud Computing?
History of Cloud Computing
Advantages of Cloud Computing
Disadvantages of Cloud Computing
Components of Cloud Computing
Architecture of Cloud Computing
Types of Cloud Computing
Recent Development’s of Cloud Computing
Conclusion Cloud Computing

2018-19 Cloud Computing BY Rajesh Math 4


 Introduction

Cloud computing is Internet-based computing, whereby shared resources,

software, and information are provided to computers and other devices on
demand, like the electricity grid.
Cloud computing is a paradigm shift following the shift from mainframe
to client–server in the early 1980s. Details are abstracted from the users,
who no longer have need for expertise in, or control over, the technology
infrastructure "in the cloud" that supports them.

2018-19 Cloud Computing BY Rajesh Math 5


 What is Cloud Computing?

 Cloud computing is Internet based computing where virtual shared servers

provide software, infrastructure, platform, devices and other resources and
hosting to customers on a pay-as-you-use basis.
 All information that a digitized system has to offer is provided as a service
in the cloud computing model. Users can access these services available
on the "Internet cloud" without having any previous know-how on
managing the resources involved.

2018-19 Cloud Computing BY Rajesh Math 6


 History

 Concept originated from telecommunication companies changing to VPN

 1999:Salesforce. com ‐ Delivery of applications via web
 2002: Amazon launches Amazon Web Services (AWS)
 2006: Google Docs, Amazon Elastic Compute Cloud (EC2)
 2008: Eucalyptus
 2009: Microsoft Azure

2018-19 Cloud Computing BY Rajesh Math 7


 Architecture

Cloud architecture, the systems architecture of the software systems

involved in the delivery of cloud computing, typically involves multiple
cloud components communicating with each other over application
programming interfaces, usually web services.

2018-19 Cloud Computing BY Rajesh Math 8


 Cloud computing sample architecture

This resembles the UNIX philosophy of having multiple programs

each doing one thing well and working together over universal
interfaces. Complexity is controlled and the resulting systems are
more manageable than their monolithic counterparts.
The two most significant components of cloud computing
architecture are known as the front end and the back end.
The front end is the part seen by the client, i.e. the computer user.
This includes the client‟s network (or computer) and the
applications used to access the cloud via a user interface such as a
web browser.
The back end of the cloud computing architecture is the „cloud‟
itself, comprising various computers, servers and data storage
devices.

2018-19 Cloud Computing BY Rajesh Math 9


 Types of Cloud Computing

2018-19 Cloud Computing BY Rajesh Math 10


 Public cloud

Public clouds are made available to the general public

by a service provider who hosts the cloud
infrastructure. Generally, public cloud providers like
Amazon AWS, Microsoft and Google own and operate
the infrastructure and offer access over the Internet.
With this model, customers have no visibility or control
over where the infrastructure is located. It is important
to note that all customers on public clouds share the
same infrastructure pool with limited configuration,
security protections and availability variances.

2018-19 Cloud Computing BY Rajesh Math 11


 Private cloud

Private cloud is cloud infrastructure dedicated to a particular

organization. Private clouds allow businesses to host applications in the
cloud, while addressing concerns regarding data security and control,
which is often lacking in a public cloud environment. It is not shared
with other organizations, whether managed internally or by a third-
party, and it can be hosted internally or externally.

2018-19 Cloud Computing BY Rajesh Math 12


 Hybrid cloud

Hybrid Clouds are a composition of two or more

clouds (private, community or public) that remain
unique entities but are bound together offering the
advantages of multiple deployment models. In a
hybrid cloud, you can leverage third party cloud
providers in either a full or partial manner; increasing
the flexibility of computing. Augmenting a traditional
private cloud with the resources of a public cloud can
be used to manage any unexpected surges in
workload.

2018-19 Cloud Computing BY Rajesh Math 13


 Components
SaaS (software as a service): SaaS refers to software that‟s made
available as a web-based service.

Utility computing: The predecessor of cloud computing, utility

computing provides the ability to access storage and virtual servers on
demand.

Cloud-based web services: Similar to Saas, web services in the cloud

allow you to offer services online, such as credit card processing services,
employee payroll processing or viewing an interactive map.

MSP (managed service providers): The grandfather of cloud computing,

an MSP delivers applications to IT instead of end-users.

IaaS (infrastructure as a service): IaaS refers to computer infrastructure

(e.g., virtualization) that‟s delivered as a service.

2018-19 Cloud Computing BY Rajesh Math 14


 Recent Development’s

In 2007, Google, IBM, and a number of universities embarked on a

large scale cloud computing research project. In early 2008,
Eucalyptus became the first open source AWS API compatible
platform for deploying private clouds.

2018-19 Cloud Computing BY Rajesh Math 15


 Advantages of Cloud Computing

Flexibility: There is a high rate of flexibility.

Low Cost: Companies can save big by employing cloud computing as
it eliminates cost for hardware and software.
Speed & Scales: Traditional methods to buy and configure hardware
and software are time consuming.
Easier Management of Data and Information: Since all data are
located on a centralized location, data are more organized making it
easy to manage.
Device Diversity: We can access our applications and data anywhere
in the world, on any system.

2018-19 Cloud Computing BY Rajesh Math 16


 Advantages of Cloud Computing

Increased Storage Capacity: Increased Storage Capacity is another

benefit of the cloud computing, as it can store more data as compared
to a personal computer.
Easy to Learn and Understand: Since people are quiet used to cloud
applications like GMail, Google Docs, so anything related to the same
is most likely to be understood by the users.
Automatic Updating: It saves companies time and effort to update
multiples server.
Customize Setting: Cloud computing also allows you to customize
your business applications.

2018-19 Cloud Computing BY Rajesh Math 17


 Disadvantages of Cloud Computing

Dependency: One major disadvantages of cloud computing is user‟s

dependency on the provider.
Risk: Cloud computing services means taking services from remote
servers.
Requires a Constant internet connection: The most obvious
disadvantage is that Cloud computing completely relies on network
connections.
Security: Security and privacy are the biggest concerns about cloud
computing.
Migration Issue: Migration problem is also a big concern about cloud
computing.

2018-19 Cloud Computing BY Rajesh Math 18


 Conclusion

So, while cloud computing is really great and you‟re probably

already using it, either for business of for personal means, here‟s
what we‟ve learned from taking a look at the pros and cons:
Cloud computing is a really cheap way for companies to have all
the resources they need in once place.
It‟s a much better way to spread your resources, and it
becomes easier to access things from longer distances.

2018-19 Cloud Computing BY Rajesh Math 19


 Reference

www.google.com
www.wikipedia.com
www.studymafia.org

2018-19 Cloud Computing BY Rajesh Math 20


 Cloud Computing
&
Grid Vs cloud

2018-19 Cloud Computing BY Rajesh Math 21


 Definitions

“A pool of abstracted, highly scalable, and managed computer

infrastructure capable of hosting end-customer applications and
billed by consumption1”

“Cloud computing is an emerging approach to shared

infrastructure in which large pools of systems are linked
together to provide IT services.”

2018-19 Cloud Computing BY Rajesh Math 22


 Defining the Segments

SaaS
Software as a Service
Storage as a Service
PaaS – Platform as a Service
IaaS – Infrastructure as a Service

2018-19 Cloud Computing BY Rajesh Math 23


 Cloud “Applications”

In SaaS no need to buy expensive licensed applications

Examples: Sales Force, Gmail, Yahoo! Mail, Quicken Online
Instead of selling you a copy of Microsoft Word for $300, a cloud
computing model would "rent" word processing software to you
through the Internet for perhaps 5 dollars a month.
Advantages: Free, Easy, repair a single central copy of the product
online
Disadvantages: Limited functionality, no control or access to
underlying technology, you have to trust into the online software
vendors.

2018-19 Cloud Computing BY Rajesh Math 24


 Cloud “Platforms”

“Containers”
“Closed” environments
Examples: Google App Engine(support only java & python),
,Force.com(support 16 languages)[5] ,Windows Azure(.Net,java,Php),
Mosso, Engine Yard, Joyent
Advantages: Good for developers, more control than “Application”
Clouds, tightly configured
Disadvantages: Restricted to what is available, other dependencies

2018-19 Cloud Computing BY Rajesh Math 25


 Cloud “Infrastructure”

Provide “Compute” and “Storage” clouds

Virtualization layers (hardware/software)
Examples: Amazon EC2, GoGrid, Amazon S3, Nirvanix, Linode
Advantages: Full control of environments and infrastructure
Disadvantages: Premium price point, limited competition

2018-19 Cloud Computing BY Rajesh Math 26


 Summary

 Infrastructure as a Service (IaaS) provides the user with virtual

infrastructure, such as servers and data storage space. This is
where virtualization fits into the cloud.
 Platform as a Service (PaaS) provides the user with development
environment services where the user can create and run home-grown
applications.
 Software as a Service (SaaS) provides the user with access to
already created applications that are operating in the cloud.

2018-19 Cloud Computing BY Rajesh Math 27


 The “Cloud Pyramid”

Layers equate structure

Building blocks: Infrastructure, Platforms, Applications

2018-19 Cloud Computing BY Rajesh Math 28


 The “Cloud Pyramid” Inversed

1000’s of Cloud Applications currently

Handful of Cloud Platforms
Elite group of Cloud Infrastructure providers

2018-19 Cloud Computing BY Rajesh Math 29


 Cloud “Extenders”

Provides extension to Cloud Infrastructure and Platforms with basic

functionality
Examples: Amazon SimpleDB, Amazon SQS, Google BigTable
Advantages: Extends functionality of Compute & Storage Clouds to
integrate with other clouds
Disadvantages: Sometimes requires use of specific Platforms or
Infrastructure

2018-19 Cloud Computing BY Rajesh Math 30


 Cloud “Aggregators”

Sits on top of various Cloud Infrastructures for management

Examples: RightScale, Appistry
Advantages: Provides more options for Cloud environments
Disadvantages: Dependent on Cloud Providers

2018-19 Cloud Computing BY Rajesh Math 31


 The NEW “Cloud Pyramid”

2018-19 Cloud Computing BY Rajesh Math 32


 Colo vs. Managed vs. Cloud Hosting

Colocation Managed Cloud

Time Weeks to Months Days to Weeks Minutes

Scalability Slowest, Rigid & Slower, somewhat Instant, Flexible,

Costly flexible, Costly Pay-per-usage
Cost High Costly, sometimes No contracts, usage
month/year contracts based, no upfront
costs
“Green” Low Low High - virtualized
Pricing model Buy Servers & Colo Rent Servers & Rent based on usage
costs whether used Hosting costs whether only
or not used or not

2018-19 Cloud Computing BY Rajesh Math 33


 Hosting Industry needs Change

Technology has evolved

People demand more control
Instant gratification
Managed is not dynamic enough

Cloud Computing - “Enabling Technology” to move from

Traditional Hosting to Cloud Hosting

2018-19 Cloud Computing BY Rajesh Math 34


 The “Cloud” = 10X Improvements

Ease of Use
Scalability
Risk
Reliability
Cost

2018-19 Cloud Computing BY Rajesh Math 35


 Ease of Use

Deploy infrastructure with a mouse or API

No cabling, screwdrivers, racking, unboxing, buying
Middle of the night
Do it yourself remotely from anywhere anytime

2018-19 Cloud Computing BY Rajesh Math 36


 Scalability

1. Control your infrastructure with your application demands.

2. No need to purchase expensive hardware's for scalability.

2018-19 Cloud Computing BY Rajesh Math 37


 Risk

1. Nothing to buy
2. Cancel immediately
3. Change instantly, even operating systems
4. Throw it out
5. Rebuild it instantly after testing

RISK

2018-19 Cloud Computing BY Rajesh Math 38


 Reliability

1. Based on High quality hardware

2. Design for failures:
 Automatically spin up replacements
 Use multiple clouds

2018-19 Cloud Computing BY Rajesh Math 39


 Cost

1. Pay for only what you use

2. No need to buy in advance
3. Zero Capital Outlay
4. No contracts

2018-19 Cloud Computing BY Rajesh Math 40


 Grid Computing

Grid computing is the ability to process information by utilizing a

collection of networked heterogeneous information-processing
components (hardware and software), all of which are
provisioned from various geographical locations and across
organizational boundaries. [5]

2018-19 Cloud Computing BY Rajesh Math 41


 Cont…

 In grid computing the concept of Virtual Organizations (VOs) rises.

Which means that all resources were owned by a single organization.
 Two key outcomes exist in grids:
1. The Open Grid Service Architecture (OGSA)
2. The Globus Toolkit.
 OGSA means how grids are created and maintained.

2018-19 Cloud Computing BY Rajesh Math 42


 Cont…

The Globus Toolkit is a software middleware package. All that is

required is to install and configure Globus and then create all required
resources and services.
grid security approach is the Grid Security Infrastructure (GSI) which
has been implemented in
the Globus Toolkit

2018-19 Cloud Computing BY Rajesh Math 43


 Grid Projects

 NAREGI ( National Research Grid Initiative) is a grid project that

focuses on the research and development of grid middleware.
 The test contains almost 3000 CPUs and is capable of 17 teraflops of
processing power, offered from various research institutions throughout
Japan.

 BOINC is an Open-source software for volunteer computing and grid

computing.
 BOINC is supported by the National Science Foundation(SETI@home,
Climateprediction.net)

2018-19 Cloud Computing BY Rajesh Math 44


 Grid vs Cloud

1. Neither grids nor clouds have a commonly accepted definition.

2. Grids are publicly funded and operated, whereas clouds are
privately funded and operated.
3. Grids and clouds are instantiations of distributed systems, which is a
common feature of them.
4. Grids evolve slowly and clouds evolve fast, and The level of
expertise to use a cloud is significantly lower than that of a grids.

2018-19 Cloud Computing BY Rajesh Math 45


 References

1. Paul Lancaster Business Development Manager, GoGrid Site:

http://www.GoGrid.com
2. http://www. amazon.com
3. http://wikipedia.org
4. http://saasevolution.blogspot.com
5. Grids vs. Clouds, Michael Brock and Andrzej Goscinski ,School of
Information Technology , Deakin University ,Australia
6. http://boinc.berkeley.edu/

2018-19 Cloud Computing BY Rajesh Math 46


 Cloud Computing

2018-19 Cloud Computing BY Rajesh Math 47


 What is Cloud Computing?

 Cloud Computing is a general term used to describe a new class of

network based computing that takes place over the Internet,
 basically a step on from Utility Computing
 a collection/group of integrated and networked hardware, software
and Internet infrastructure (called a platform).
 Using the Internet for communication and transport provides
hardware, software and networking services to clients
 These platforms hide the complexity and details of the underlying
infrastructure from users and applications by providing very simple
graphical interface or API (Applications Programming Interface).

2018-19 Cloud Computing BY Rajesh Math 48


 What is Cloud Computing?

In addition, the platform provides on demand services, that are

always on, anywhere, anytime and any place.
Pay for use and as needed, elastic
 scale up and down in capacity and functionalities
The hardware and software services are available to
 general public, enterprises, corporations and businesses markets

2018-19 Cloud Computing BY Rajesh Math 49


 Cloud Summary

Cloud computing is an umbrella term used to refer to Internet

based development and services

A number of characteristics define cloud data, applications

services and infrastructure:
 Remotely hosted: Services or data are hosted on remote
infrastructure.
 Ubiquitous: Services or data are available from anywhere.
 Commodified: The result is a utility computing model similar to
traditional that of traditional utilities, like gas and electricity - you
pay for what you would want!

2018-19 Cloud Computing BY Rajesh Math 50


 Cloud Architecture

2018-19 Cloud Computing BY Rajesh Math 51


 What is Cloud Computing

 Shared pool of configurable computing resources

 On-demand network access
 Provisioned by the Service Provider
2018-19 Cloud Computing BY Rajesh Math 52

 Cloud Computing Characteristics

Common Characteristics:
Massive Scale Resilient Computing

Homogeneity Geographic Distribution

Virtualization Service Orientation

Low Cost Software Advanced Security

Essential Characteristics:
On Demand Self-Service
Broad Network Access Rapid Elasticity
Resource Pooling Measured Service

2018-19 Cloud Computing BY Rajesh Math 53


 Cloud Service Models

Software as a Service Platform as a Infrastructure as a

(SaaS) Service (PaaS) Service (IaaS)

SalesForce CRM
LotusLive

Google App
Engine

2018-19 Cloud Computing BY Rajesh Math 54

Adopted from: Effectively and Securely Using the Cloud Computing Paradigm by peter Mell, Tim Grance

 SaaS Maturity Model

Level 1: Ad-Hoc/Custom –
One Instance per customer

Level 2: Configurable per

customer

Level 3: configurable &

Multi-Tenant-Efficient

Level 4: Scalable, Configurable

& Multi-Tenant-Efficient

2018-19 Cloud Computing BY Rajesh Math 55


 Different Cloud Computing Layers

Application Service MS Live/ExchangeLabs, IBM,

(SaaS) Google Apps; Salesforce.com
Quicken Online, Zoho, Cisco

Application Platform Google App Engine, Mosso,

Force.com, Engine Yard,
Facebook, Heroku, AWS

Server Platform 3Tera, EC2, SliceHost, GoGrid,

RightScale, Linode

Storage Platform Amazon S3, Dell, Apple, ...

2018-19 Cloud Computing BY Rajesh Math 56


 Cloud Computing Service Layers

Services Description
Services – Complete business services such as
Services PayPal, OpenID, OAuth, Google Maps, Alexa

Application – Cloud based software that eliminates

Application the need for local installation such as Google Apps,
Application Microsoft Online
Focused
Development – Software development platforms
Development used to build custom cloud based applications
(PAAS & SAAS) such as SalesForce
Platform – Cloud based platforms, typically
Platform provided using virtualization, such as Amazon
ECC, Sun Grid
Storage – Data storage or cloud based NAS such as
Infrastructure Storage CTERA, iDisk, CloudNAS
Focused
Hosting – Physical data centers such as those run
Hosting by IBM, HP, NaviSite, etc.

2018-19 Cloud Computing BY Rajesh Math 57


 Basic Cloud Characteristics

The “no-need-to-know” in terms of the underlying details of

infrastructure, applications interface with the infrastructure via the
APIs.
The “flexibility and elasticity” allows these systems to scale up
and down at will
 utilising the resources of all kinds
 CPU, storage, server capacity, load balancing, and databases
The “pay as much as used and needed” type of utility computing
and the “always on!, anywhere and any place” type of network-
based computing.

2018-19 Cloud Computing BY Rajesh Math 58


 Basic Cloud Characteristics

Cloud are transparent to users and applications, they can be built in

multiple ways
 branded products, proprietary open source, hardware or software, or
just off-the-shelf PCs.
In general, they are built on clusters of PC servers and off-the-shelf
components plus Open Source software combined with in-house
applications and/or system software.

2018-19 Cloud Computing BY Rajesh Math 59


 Software as a Service (SaaS)

SaaS is a model of software deployment where an application is

hosted as a service provided to customers across the Internet.
Saas alleviates the burden of software maintenance/support
 but users relinquish control over software versions and requirements.
Terms that are used in this sphere include
 Platform as a Service (PaaS) and
 Infrastructure as a Service (IaaS)

2018-19 Cloud Computing BY Rajesh Math 60


 Virtualization

Virtual workspaces:
 An abstraction of an execution environment that can be made
dynamically available to authorized clients by using well-defined
protocols,
 Resource quota (e.g. CPU, memory share),
 Software configuration (e.g. O/S, provided services).
Implement on Virtual Machines (VMs):
App App App
 Abstraction of a physical host machine,
OS OS OS
 Hypervisor intercepts and emulates instructions
Hypervisor
from VMs, and allows management of VMs,
 VMWare, Xen, etc. Hardware

Virtualized Stack
Provide infrastructure API:
 Plug-ins to hardware/support structures
2018-19 Cloud Computing BY Rajesh Math 61

 Virtual Machines

 VM technology allows multiple virtual machines to run on a single

physical machine.

App App App App App

Xen
Guest OS Guest OS Guest OS
(Linux) (NetBSD) (Windows)
VMWare
VM VM VM
UML
Virtual Machine Monitor (VMM) / Hypervisor

Denali
Hardware
etc.

Performance: Para-virtualization (e.g. Xen) is very close to raw physical performance!

2018-19 Cloud Computing BY Rajesh Math 62

 Virtualization in General

Advantages of virtual machines:

 Run operating systems where the physical hardware is unavailable,
 Easier to create new machines, backup machines, etc.,
 Software testing using “clean” installs of operating systems and
software,
 Emulate more machines than are physically available,
 Timeshare lightly loaded systems on one host,
 Debug problems (suspend and resume the problem machine),
 Easy migration of virtual machines (shutdown needed or not).
 Run legacy systems!

2018-19 Cloud Computing BY Rajesh Math 63


 What is the purpose and benefits?

Cloud computing enables companies and applications, which are

system infrastructure dependent, to be infrastructure-less.
By using the Cloud infrastructure on “pay as used and on demand”,
all of us can save in capital and operational investment!
Clients can:
 Put their data on the platform instead of on their own desktop PCs
and/or on their own servers.
 They can put their applications on the cloud and use the servers within
the cloud to do processing and data manipulations etc.

2018-19 Cloud Computing BY Rajesh Math 64


 Cloud-Sourcing

Why is it becoming a Big Deal:

Using high-scale/low-cost providers,
Any time/place access via web browser,
Rapid scalability; incremental cost and load sharing,
Can forget need to focus on local IT.
Concerns:
Performance, reliability, and SLAs,
Control of data, and service parameters,
Application features and choices,
Interaction between Cloud providers,
No standard API – mix of SOAP and REST!
Privacy, security, compliance, trust…

2018-19 Cloud Computing BY Rajesh Math 65


 Some Commercial Cloud Offerings

2018-19 Cloud Computing BY Rajesh Math 66


 Cloud Taxonomy

2018-19 Cloud Computing BY Rajesh Math 67


 Cloud Storage

Several large Web companies are now exploiting the fact that they
have data storage capacity that can be hired out to others.
allows data stored remotely to be temporarily cached on desktop
computers, mobile phones or other Internet-linked devices.

Amazon‟s Elastic Compute Cloud (EC2) and Simple Storage

Solution (S3) are well known examples
Mechanical Turk

2018-19 Cloud Computing BY Rajesh Math 68


 Amazon Simple Storage Service (S3)
 Unlimited Storage.
 Pay for what you use:
 $0.20 per GByte of data transferred,
 $0.15 per GByte-Month for storage used,
 Second Life Update:
• 1TBytes, 40,000 downloads in 24 hours - $200,

2018-19 Cloud Computing BY Rajesh Math 69


 Utility Computing – EC2

Amazon Elastic Compute Cloud (EC2):

 Elastic, marshal 1 to 100+ PCs via WS,
 Machine Specs…,
 Fairly cheap!
Powered by Xen – a Virtual Machine:
 Different from Vmware and VPC as uses “para-virtualization” where the
guest OS is modified to use special hyper-calls:
 Hardware contributions by Intel (VT-x/Vanderpool) and AMD (AMD-V).
 Supports “Live Migration” of a virtual machine between hosts.
Linux, Windows, OpenSolaris
Management Console/AP

2018-19 Cloud Computing BY Rajesh Math 70


 EC2 – The Basics

Load your image onto S3 and register it.

Boot your image from the Web Service.
Open up required ports for your image.
Connect to your image through SSH.
Execute you application…

2018-19 Cloud Computing BY Rajesh Math 71


 Opportunities and Challenges

 The use of the cloud provides a number of opportunities:

 It enables services to be used without any understanding of their
infrastructure.
 Cloud computing works using economies of scale:
 It potentially lowers the outlay expense for start up companies,
as they would no longer need to buy their own software or
servers.
 Cost would be by on-demand pricing.
 Vendors and Service providers claim costs by establishing an
ongoing revenue stream.
 Data and services are stored remotely but accessible from
“anywhere”.

2018-19 Cloud Computing BY Rajesh Math 72


 Opportunities and Challenges

In parallel there has been backlash against cloud computing:

Use of cloud computing means dependence on others and that could possibly limit
flexibility and innovation:
 The others are likely become the bigger Internet companies like Google and IBM,
who may monopolise the market.
 Some argue that this use of supercomputers is a return to the time of mainframe
computing that the PC was a reaction against.
Security could prove to be a big issue:
 It is still unclear how safe out-sourced data is and when using these services
ownership of data is not always clear.
There are also issues relating to policy and access:
 If your data is stored abroad whose policy do you adhere to?
 What happens if the remote server goes down?
 How will you then access files?
 There have been cases of users being locked out of accounts and losing access to data.

2018-19 Cloud Computing BY Rajesh Math 73


 Advantages of Cloud Computing

 Lower computer costs:

 You do not need a high-powered and high-priced computer to run
cloud computing's web-based applications.
 Since applications run in the cloud, not on the desktop PC, your
desktop PC does not need the processing power or hard disk space
demanded by traditional desktop software.
 When you are using web-based applications, your PC can be less
expensive, with a smaller hard disk, less memory, more efficient
processor...
 In fact, your PC in this scenario does not even need a CD or DVD
drive, as no software programs have to be loaded and no
document files need to be saved.

2018-19 Cloud Computing BY Rajesh Math 74


 Advantages of Cloud Computing

 Improved performance:
 With few large programs hogging your computer's memory, you will
see better performance from your PC.
 Computers in a cloud computing system boot and run faster because
they have fewer programs and processes loaded into memory…
 Reduced software costs:
 Instead of purchasing expensive software applications, you can get
most of what you need for free-ish!
 most cloud computing applications today, such as the Google Docs suite.
 better than paying for similar commercial software
 which alone may be justification for switching to cloud applications.

2018-19 Cloud Computing BY Rajesh Math 75


 Advantages of Cloud Computing

 Instant software updates:

 Another advantage to cloud computing is that you are no longer faced
with choosing between obsolete software and high upgrade costs.
 When the application is web-based, updates happen automatically
 available the next time you log into the cloud.
 When you access a web-based application, you get the latest version
 without needing to pay for or download an upgrade.

 Improved document format compatibility.

 You do not have to worry about the documents you create on your
machine being compatible with other users' applications or OSes
 There are potentially no format incompatibilities when everyone is
sharing documents and applications in the cloud.

2018-19 Cloud Computing BY Rajesh Math 76


 Advantages of Cloud Computing

Unlimited storage capacity:

 Cloud computing offers virtually limitless storage.
 Your computer's current 1 Tbyte hard drive is small compared to the
hundreds of Pbytes available in the cloud.
Increased data reliability:
 Unlike desktop computing, in which if a hard disk crashes and destroy
all your valuable data, a computer crashing in the cloud should not
affect the storage of your data.
 if your personal computer crashes, all your data is still out there in the cloud,
still accessible
 In a world where few individual desktop PC users back up their data on
a regular basis, cloud computing is a data-safe computing platform!

2018-19 Cloud Computing BY Rajesh Math 77


 Advantages of Cloud Computing

 Universal document access:

 That is not a problem with cloud computing, because you do not take
your documents with you.
 Instead, they stay in the cloud, and you can access them whenever
you have a computer and an Internet connection
 Documents are instantly available from wherever you are
 Latest version availability:
 When you edit a document at home, that edited version is what you
see when you access the document at work.
 The cloud always hosts the latest version of your documents
 as long as you are connected, you are not in danger of having an
outdated version

2018-19 Cloud Computing BY Rajesh Math 78


 Advantages of Cloud Computing

 Easier group collaboration:

 Sharing documents leads directly to better collaboration.
 Many users do this as it is an important advantages of cloud
computing
 multiple users can collaborate easily on documents and projects
 Device independence.
 You are no longer tethered to a single computer or network.
 Changes to computers, applications and documents follow you
through the cloud.
 Move to a portable device, and your applications and documents are
still available.

2018-19 Cloud Computing BY Rajesh Math 79


 Disadvantages of Cloud Computing

 Requires a constant Internet connection:

 Cloud computing is impossible if you cannot connect to the Internet.
 Since you use the Internet to connect to both your applications and
documents, if you do not have an Internet connection you cannot
access anything, even your own documents.
 A dead Internet connection means no work and in areas where
Internet connections are few or inherently unreliable, this could be a
deal-breaker.

2018-19 Cloud Computing BY Rajesh Math 80


 Disadvantages of Cloud Computing

 Does not work well with low-speed connections:

 Similarly, a low-speed Internet connection, such as that found with
dial-up services, makes cloud computing painful at best and often
impossible.
 Web-based applications require a lot of bandwidth to download, as
do large documents.
 Features might be limited:
 This situation is bound to change, but today many web-based
applications simply are not as full-featured as their desktop-based
applications.
 For example, you can do a lot more with Microsoft PowerPoint than
with Google Presentation's web-based offering

2018-19 Cloud Computing BY Rajesh Math 81


 Disadvantages of Cloud Computing

 Can be slow:
 Even with a fast connection, web-based applications can sometimes
be slower than accessing a similar software program on your desktop
PC.
 Everything about the program, from the interface to the current
document, has to be sent back and forth from your computer to the
computers in the cloud.
 If the cloud servers happen to be backed up at that moment, or if the
Internet is having a slow day, you would not get the instantaneous
access you might expect from desktop applications.

2018-19 Cloud Computing BY Rajesh Math 82


 Disadvantages of Cloud Computing

 Stored data might not be secure:

 With cloud computing, all your data is stored on the cloud.
 The questions is How secure is the cloud?
 Can unauthorised users gain access to your confidential data?
 Stored data can be lost:
 Theoretically, data stored in the cloud is safe, replicated across
multiple machines.
 But on the off chance that your data goes missing, you have no
physical or local backup.
 Put simply, relying on the cloud puts you at risk if the cloud lets you
down.

2018-19 Cloud Computing BY Rajesh Math 83


 Disadvantages of Cloud Computing

 HPC Systems:
 Not clear that you can run compute-intensive HPC applications that
use MPI/OpenMP!
 Scheduling is important with this type of application
 as you want all the VM to be co-located to minimize communication
latency!
 General Concerns:
 Each cloud systems uses different protocols and different APIs
 may not be possible to run applications between cloud based systems
 Amazon has created its own DB system (not SQL 92), and workflow
system (many popular workflow systems out there)
 so your normal applications will have to be adapted to execute on these
platforms.

2018-19 Cloud Computing BY Rajesh Math 84


 The Future

Many of the activities loosely grouped together under cloud

computing have already been happening and centralised
computing activity is not a new phenomena
Grid Computing was the last research-led centralised approach
However there are concerns that the mainstream adoption of cloud
computing could cause many problems for users
Many new open source systems appearing that you can install and
run on your local cluster
should be able to run a variety of applications on these systems

2018-19 Cloud Computing BY Rajesh Math 85


 CHAPTER 3

2018-19 Cloud Computing BY Rajesh Math 86


 Lucid Software

Online Diagram Software

Online Print & Digital Publishing

Large Documents

Real-time Collaboration

All Changes Tracked

Vector Graphics

High Quality Images

2018-19 Cloud Computing BY Rajesh Math 87


 Tech at Lucid

Google Closure SOA

Javascript Scala
PHP Play!
Sharded MongoDB Chef
Sharded MySQL Zabbix, Graphite
NodeJS AWS

2018-19 Cloud Computing BY Rajesh Math 88


 Lucid on AWS

Elastic Compute Cloud Relational Database Service

Virtual Private Cloud Route53
Elastic Block Store Simple Notification Service
Auto Scaling Simple Email Service
Elastic Load Balancing Availability Zones
Simple Storage Service Regions
CloudFront
Export/Import

2018-19 Cloud Computing BY Rajesh Math 89


 Why Lucid Chose Amazon VPC

Pricing
Interoperability
Enhanced Features
Security

2018-19 Cloud Computing BY Rajesh Math 90


 Other Benefits

ELB security groups

Network ACLs
Elastic IP associations
VPN support
Reserved instance transfers

2018-19 Cloud Computing BY Rajesh Math 91


 Drawbacks

NAT cost and maintenance

Setup time
New terminology
Private subnet accessibility
Internal DNS names defaults

2018-19 Cloud Computing BY Rajesh Math 92


 Things You Should Know

EIPs or Public IPs in public subnets

NAT
Not special
Public subnet
Subnets
Route tables
Network ACLs
DHCP

2018-19 Cloud Computing BY Rajesh Math 93


2018-19 Cloud Computing BY Rajesh Math 94

 Migration Constraints

EC2 & VPC communication Shared:

NAT traffic Instance Limit
Not Shared: EBS volumes
Security groups Snapshots
Load balancers Instance Sizes
Auto Scale groups Zones
Elastic IPs Regions
EIP Limits

2018-19 Cloud Computing BY Rajesh Math 95


 Migration Plan

Move top layer first

Move one layer at a time
Meticulously manage security groups
Move monitoring/utility servers last

http://nineofclouds.blogspot.com/search/label/VPC

2018-19 Cloud Computing BY Rajesh Math 96


 Starting Layout

2018-19 Cloud Computing BY Rajesh Math 97


 Move Web servers First

2018-19 Cloud Computing BY Rajesh Math 98


 Move Services Next

2018-19 Cloud Computing BY Rajesh Math 99


 Move Databases Last

2018-19 Cloud Computing BY Rajesh Math 100


2018-19 Cloud Computing BY Rajesh Math 101

 5. Setup & Terminology

Subnets
DHCP
Network ACLs
Routes
Internet Gateway
Unavoidable

2018-19 Cloud Computing BY Rajesh Math 102


 4. Security Groups

Groups Not Shared

EC2 open to NAT
Use Scripts
Avoidable using public subnets

2018-19 Cloud Computing BY Rajesh Math 103


 3. Access Private Subnets

Open VPN
High Availability
SSH Tunnels
Unavoidable

2018-19 Cloud Computing BY Rajesh Math 104


 2. Mongo DB Migration

Election Algorithm
Intermediate Move to Public Subnet
15 min Downtime

2018-19 Cloud Computing BY Rajesh Math 105


 1. NAT Bandwidth

NAT was t1.micro

Databases in EC2
Applications in VPC
Not enough bandwidth through NAT
Avoidable

2018-19 Cloud Computing BY Rajesh Math 106


2018-19 Cloud Computing BY Rajesh Math 107

 Three Major Trends to Chang the World

Cloud Computing

Big Data Mobile

2018-19 Cloud Computing BY Rajesh Math 108


 什麼是雲端運算？

美國國家標準技術研究所 (NIST)的定義:
Essential
Characteristics

Service Models

Deployment Models

以服務(as-a-service)的商業模式，透過Internet技術，提供具有擴充性
(scalable)和彈性(elastic)的IT相關功能給使用者
2018-19 Cloud Computing BY Rajesh Math 109

 It’s About the Ecosystem

Structured, Semi-
structured
Cloud
Computing
SaaS
Enterprise Data Warehouse
PaaS

IaaS

Generate

Big Data

Lead

Business Insights

create

Competition, Innovation,
Productivity

2018-19 Cloud Computing BY Rajesh Math 110


 What is BigData?

A set of files A database A single file

2018-19 Cloud Computing BY Rajesh Math 111

 What is the problem

Getting the data to the processors

becomes the bottleneck

Quick calculation
Typical disk data transfer rate:
 75MB/sec
Time taken to transfer 100GB of
data to the processor:
 approx. 22 minutes!

2018-19 Cloud Computing BY Rajesh Math 112


 The Era of Big Data – Are You Ready

Businesses are driving the growth of big data. The capable data
storage, efficient management, and capturing values to business values
of huge size of data are enterprise big challenges.
Overwhelming quantities of big data will challenge enterprise storage
infrastructure and data center architecture which will cause chain
reactions in database storage, data mining, business intelligence, cloud
computing, and computing application.

Data for business commercial analysis

• 2011: multi-terabyte (TB)
• 2020: 35.2 ZB (1 ZB = 1 billion TB)

2018-19 Cloud Computing BY Rajesh Math 113


 Who Needs It?

Enterprise Database Hadoop

When to use? When to use?

• Ad-hoc Reporting (<1sec) • Affordable Storage/Computer
• Multi-step Transactions • Unstructured or Semi-structured
• Lots of Inserts/Updates/Deletes • Resilient Auto Scalability

2018-19 Cloud Computing BY Rajesh Math 114


2018-19 Cloud Computing BY Rajesh Math 115

 – inspired by

Apache Hadoop project

inspired by Google's MapReduce and Google File System papers.
Open sourced, flexible and available architecture for large scale
computation and data processing on a network of commodity
hardware
Open Source Software + Hardware Commodity
IT Costs Reduction

2018-19 Cloud Computing BY Rajesh Math 116


 HDFS

Hadoop Distributed File System

Redundancy
Fault Tolerant
Scalable
Self Healing
Write Once, Read Many Times
Java API
Command Line Tool

2018-19 Cloud Computing BY Rajesh Math 117


 MapReduce

Two Phases of Functional Programming

Redundancy
Fault Tolerant
Scalable
Self Healing
Java API

2018-19 Cloud Computing BY Rajesh Math 118


 Facebook Messages

2018-19 Cloud Computing BY Rajesh Math 119


 Facebook Open Source Stack

Memcached --> App Server Cache

ZooKeeper --> Small Data Coordination Service
HBase --> Database Storage Engine
HDFS --> Distributed FileSystem
Hadoop --> Asynchronous Map-Reduce Jobs

2018-19 Cloud Computing BY Rajesh Math 120


2018-19 Cloud Computing BY Rajesh Math 121

2018-19 Cloud Computing BY Rajesh Math 122
