CloudSleuth service benchmarks IaaS and PaaS worldwide clouds

Posted by virtualization.info Staff   |   Thursday, July 8th, 2010   |  

In the attempt to provide more transparency to those customers that are approaching cloud computing, a number of brave firms is building methodologies and infrastructures to benchmark the performance of several Infrastructure-as-a-Service (IaaS) and Platform-as-a-Service (PaaS) public clouds.

A little more than one month ago, CloudHarmony published its first performance analysis on the most popular IaaS public clouds.
This week Compuware goes beyond that, launching a public tracking service that measures the performance of IaaS and PaaS public clouds: CloudSleuth.

CloudSleuth_Dashboard

The CloudSleuth methodology is simple: Compuware deploys an identical target application to each cloud platform. The Gomez Performance Network (GPN) is used to run test transactions on the deployed target applications and monitor the response time and availability from various points around the globe. Hundreds of data points from each successive test run are collected and aggregated into a cloud performance database. The results are exposed online, for free, through the nifty Flash-based dashboard above.

What Compuware is trying to do here is rather odd: comparing the performance of different public clouds that are based on completely different architectures: while Amazon EC2 or The Rackspace Cloud are IaaS clouds, Microsoft Azure and Google App Engine (GAE) are PaaS clouds.
The company claims that its target application, a two web pages retail shopping site with 41 items, stay unchanged on all tested clouds, but it’s quite evident that everything below it is different, from the application server to the optional presence of a virtualization layer.

How’s the faster platform anyway? Right now the top three are:

  1. OpSource (IaaS)
  2. Google App Engine (PaaS)
  3. The Rackspace Cloud (IaaS)


blog comments powered by Disqus


cloudcomputing.info Newest articles
Release: Microsoft Assessment and Planning Toolkit 6.5

December 6th, 2011

In November Microsoft released a public beta of the Microsoft Assessment and Planning Toolkit (MAP) version 6.5. Today Microsoft announced its release, which is the follow-up of version 6.0 which…

Release: VMware vCloud Connector 1.5

November 21st, 2011

VMware has released the vCloud Connector, its Software as a Service (SaaS) management tool for VMware environments residing on- or off premise offering Infrastructure as a Service (IaaS). vCloud connector…

Microsoft releases beta of Microsoft Assessment and Planning Toolkit 6.5

November 7th, 2011

Microsoft has released a beta of the next version of its capacity planning tool the Microsoft Assessment and Planning Toolkit version 6.5. This version will be the follow up of…

Microsoft releases beta of System Center App Controller

October 28th, 2011

Microsoft has released a public beta of System Center App Controller, its management portal for public and private clouds codenamed Concero which it announced in January this year. App Controller…

Papers: vCloud Architecture ToolKit 2.0

September 5th, 2011

In June this year, cloudcomputing.info reported that VMware released a set of papers, dubbed the vCloud Architecture Toolkit (vCAT) providing guidance for customers planning to implement their own cloud infrastructure….

Citrix announces new version of CloudStack

August 30th, 2011

In July this year Citrix acquired Cloud.com a company providing an orchestration tool for managing Infrastructure as a Service (IaaS) called CloudStack. Now Citrix has announced a new upcoming release…

VMware announces vCloud Connector 1.5 and Global Connect

August 30th, 2011

During VMWorld in Las Vegas, VMware announced version 1.5 of vCloud connector, a management platform for Infrastructure-as-a-Service (IaaS) clouds powered by VMware vSphere. vCloud Connector is capable of viewing, managing…

VMware releases beta of Micro Cloud solution for Cloud Foundry

August 25th, 2011

When VMware announced its Platform as a Service (PaaS) solution Cloud Foundry in April this year it detailed that Cloud Foundry would be able to run on several types of…

Release: Nimbula Director 1.5

August 22nd, 2011

In April this year, Nimbula launched the first version of its product Director, a tool assisting the creation of Private, Public and Hybrid cloud solutions running on top of a…

Release: Microsoft Assessment and Planning Toolkit 6.0

July 20th, 2011

After releasing a public beta in May this year, Microsoft has now released version 6.0 of its capacity planning tool, the Assessment and Planning Toolkit (MAP), which is the follow…

Citrix acquires Cloud.com

July 20th, 2011

In May this year cloudcomputing.info reported about Citrix which announced Project Olympus, a cloud infrastructure under development based on the OpenStack project. Last week though Citrix announced that it acquired…

CoreVault launches VMware vCloud based hosting service

June 20th, 2011

CoreVault has announced a new cloud based hosting service called Cloud Hosting, developed in partnership with VMware to provide, and targeted both for small medium business (SMB) and enterprise customers….

VMware to acquire Digital Fuel

June 16th, 2011

VMware announced a few days ago its intention to acquire Digital Fuel, which provides solutions to plan, bill and optimize IT cost and value.
Following the recent acquisitions of SlideRocket and SocialCast, this…

Fujitsu delivers its Azure on-premises Appliance

June 9th, 2011

In July last year, cloudcomputing.info reported about the fact that Microsoft was planning on launching a version of Azure, codenamed Talisker which could run on-premises. At that time, Microsoft confirmed…

 
Monthly Archive