CloudSleuth service benchmarks IaaS and PaaS worldwide clouds

Posted by virtualization.info Staff   |   Thursday, July 8th, 2010   |  

In the attempt to provide more transparency to those customers that are approaching cloud computing, a number of brave firms is building methodologies and infrastructures to benchmark the performance of several Infrastructure-as-a-Service (IaaS) and Platform-as-a-Service (PaaS) public clouds.

A little more than one month ago, CloudHarmony published its first performance analysis on the most popular IaaS public clouds.
This week Compuware goes beyond that, launching a public tracking service that measures the performance of IaaS and PaaS public clouds: CloudSleuth.

CloudSleuth_Dashboard

The CloudSleuth methodology is simple: Compuware deploys an identical target application to each cloud platform. The Gomez Performance Network (GPN) is used to run test transactions on the deployed target applications and monitor the response time and availability from various points around the globe. Hundreds of data points from each successive test run are collected and aggregated into a cloud performance database. The results are exposed online, for free, through the nifty Flash-based dashboard above.

What Compuware is trying to do here is rather odd: comparing the performance of different public clouds that are based on completely different architectures: while Amazon EC2 or The Rackspace Cloud are IaaS clouds, Microsoft Azure and Google App Engine (GAE) are PaaS clouds.
The company claims that its target application, a two web pages retail shopping site with 41 items, stay unchanged on all tested clouds, but it’s quite evident that everything below it is different, from the application server to the optional presence of a virtualization layer.

How’s the faster platform anyway? Right now the top three are:

  1. OpSource (IaaS)
  2. Google App Engine (PaaS)
  3. The Rackspace Cloud (IaaS)


blog comments powered by Disqus


cloudcomputing.info Newest articles
VMTurbo appoints Dennis Hoffman to Board of Directors

June 1st, 2012

Yesterday VMTurbo announced that Dennis Hoffman, currently Senior Vice President, Service Provider at EMC Corporation, has joined the company’s Board of Directors.
With more than 20 years of industry experience…

Amazon announces VM Export for EC2

May 30th, 2012

Today Amazon announced the availability, with no additional charge, of VM Export, the counterpart of VM Import, that allows the export EC2 instances to costumers on-premise infrastructures.
This new features…

Release: Fedora 17

May 30th, 2012

Yesterday the Fedora Project announced the general availability of Fedora 17, the latest version of Red Hat sponsored free open source operating system distribution.
In the rich set of new…

Brian Gammage puts some order in VMware’s strategy

May 24th, 2012

Today Milan hosted the VMware Forum 2012, during the opening keynote Brian Gammage, VMware’s Chief Market Technologist, tried to collect all the news and declarations we heard in the last…

VMware acquires Wanova

May 23rd, 2012

Yesterday VMware announced the acquisition of Wanova Inc. a company whose main product is called Mirage.
Mirage is a centralized management and recovery solution for physical desktop images over the…

Paper: VMware vSphere Metro Storage Cluster Case Study

May 23rd, 2012

Yesterday VMware published a paper focused on VMware vMSC (vSphere Metro Storage Cluster), a new configuration within the VMware Hardware Compatibility List intended for environments where disaster/downtime avoidance is a…

Release: Flexiant Cloud Orchestrator v2.0

May 22nd, 2012

Last week Flexiant announced release 2.0 of its Cloud Orchestrator software previously called Extility.
Flexiant Cloud Orchestrator 2.0 enables service providers to build a multi-level reseller model, the key…

EMC acquires Syncplicity

May 22nd, 2012

Yesterday, during its annual conference in Las Vegas, EMC announced the acquisition of Syncplicity, a cloud-storage privately held startup founded in 2008 and based in Menlo Park, California.
Terms…

Release: Oracle VM Server for x86 3.1

May 21st, 2012

On May 18th Oracle announced the general availability of version 3.1 of its x86 enterprise virtualization solution VM Server.
This release follows 3.0 announced on August 24th 2011.
All the new…

VMware shows View 5.1 performance improvements

May 21st, 2012

In this post, published on May 18 in VROOM! Blog, the VMware’s Performance Team presented some of the most significant enhancements and optimizations brought to Teradici‘s PCoIP protocol in the…

NVIDIA introduces World’s Firs Virtualized GPU

May 17th, 2012

On May 15th NVIDIA unveiled the NVIDIA® VGX™ platform that will be available later this year through NVIDIA’s hardware OEM and VDI partners.
This new platform promises to deliver…

Microsoft announces Assessment and Planning Toolkit 7.0 Beta Program

May 17th, 2012

Microsoft announced this week the new Beta version of its capacity planning tool Microsoft Assessment and Planning (MAP) 7.0 Beta.
The Beta program opened on May 15th and the review…

VMware announces vFabric Suite 5.1

May 15th, 2012

Today VMware announced VMware vFabric Suite 5.1, expected to be generally available in Q2 2012.
vFabric Suite 5.1 includes vFabric Application Director, to automate the deployment and management of vFabric…

VMware CTO talks about R&D plans for the future

May 15th, 2012

On April 4 Stephen Herrod, VMware’s CTO, has attended, as guest speaker, at a VMUG meeting in Italy.
One of the key point of the speech, documented in one hour-long…

 
Monthly Archive