CloudSleuth service benchmarks IaaS and PaaS worldwide clouds

Posted by virtualization.info Staff   |   Thursday, July 8th, 2010   |  

In the attempt to provide more transparency to those customers that are approaching cloud computing, a number of brave firms is building methodologies and infrastructures to benchmark the performance of several Infrastructure-as-a-Service (IaaS) and Platform-as-a-Service (PaaS) public clouds.

A little more than one month ago, CloudHarmony published its first performance analysis on the most popular IaaS public clouds.
This week Compuware goes beyond that, launching a public tracking service that measures the performance of IaaS and PaaS public clouds: CloudSleuth.

CloudSleuth_Dashboard

The CloudSleuth methodology is simple: Compuware deploys an identical target application to each cloud platform. The Gomez Performance Network (GPN) is used to run test transactions on the deployed target applications and monitor the response time and availability from various points around the globe. Hundreds of data points from each successive test run are collected and aggregated into a cloud performance database. The results are exposed online, for free, through the nifty Flash-based dashboard above.

What Compuware is trying to do here is rather odd: comparing the performance of different public clouds that are based on completely different architectures: while Amazon EC2 or The Rackspace Cloud are IaaS clouds, Microsoft Azure and Google App Engine (GAE) are PaaS clouds.
The company claims that its target application, a two web pages retail shopping site with 41 items, stay unchanged on all tested clouds, but it’s quite evident that everything below it is different, from the application server to the optional presence of a virtualization layer.

How’s the faster platform anyway? Right now the top three are:

  1. OpSource (IaaS)
  2. Google App Engine (PaaS)
  3. The Rackspace Cloud (IaaS)


blog comments powered by Disqus


cloudcomputing.info Newest articles
Release: MadeiraCloud Pysa Alpha

June 17th, 2013

We’ve already mentioned MadeiraCloud, a Beijing-based cloud startup focused on “IDE” for AWS, as a company with an interesting new approach to common problems related to configuration and management…

Gartner Contextual Research about cloud orchestration

June 13th, 2013

During first quarter of 2013 a team of Gartner for Technical Professionals (GTP) analysts which included Alessandro Perilli (former Editor in Chief of Virtualization.info & Cloudcomputing.info), interviewed 15 end user cloud…

VMware Technical Journal – Summer 2013

June 12th, 2013

VMware started VMware Technical Journal back in March 2012, as a new online publication with the purpose of raising the awareness among its customer and prospects about the new R&D…

AWS adds Red Hat Enterprise to its Free Usage Tier

June 12th, 2013

Yesterday Amazon announced, through a post on its official blog, the support for RHEL as a part of the 750 hours of monthly Linux usage provided from the AWS Free…

Open Beta: VMware vCenter Log Insight v1.0

June 11th, 2013

We just noticed, thanks to a tweet by Eric Sloof, that VMware’s new product for log management and analysis, VMware vCenter Log Insight, is now available in an Open Beta program….

NetApp announces Tech Preview of project Shift, allowing switching between virtualization platforms without migrating data

June 6th, 2013

NetApp, provider of storage solutions has released a Tech Preview of its Project Shift as announced by Vaughn Steward, Director and Cloud Computing Evangelist at NetApp. Shift allows customers to…

Paper: Infrastructure-as-a-Service Product Line Architecture Deployment Guide

June 5th, 2013

Microsoft has released a paper titled: "Infrastructure-as-a-Service Product Line Architecture Deployment Guide". The paper which has a total of 343 pages provides guidance for deploying a Microsoft private cloud infrastructure…

Microsoft announces Windows Server 2012 R2, System Center 2012 R2 and Windows Azure Pack

June 3rd, 2013

During its annual TechEd North America conference held in New Orleans this week Microsoft announced the next versions of Windows Server and System Center until now codenamed "Blue". Both products…

Release: Skytap Automation Pack for IBM Rational Team Concert

June 3rd, 2013

On May 30, Skytap has released Skytap Automation Pack for IBM Rational Team Concert, a solution that enables IT operations and development teams to provision IBM build machines on-demand in…

Release: VMware vCloud Automation Center 5.2

May 31st, 2013

VMware has released vCloud Automation Center (vCAC) 5.2 based on DynamicOps Cloud Automation Center 4.5 that VMware acquired in July 2012.
The product offers automated virtual machines and physical server…

Paper: VMware View with FlexPod – Deployment Guide

May 30th, 2013

FlexPod is a CISCO Systems base data center solution built upon Cisco Unified Computing System, Cisco Nexus switches and NetApp Fabric-Attached Storage (FAS) components.
The advantage of using pre-designed and…

Citrix boosts VDI with Nvidia GRID vGPU technology

May 29th, 2013

In recent times Nvidia has been investing in the enterprise market rather than its usual HPC environments.
In March the company unveiled its NVIDIA GRID-based server solutions announcing that was…

VMware announces more information about vCloud Hybrid Services

May 21st, 2013

In March this year cloudcomputing.info reported that VMware was set to announce the vCloud Hybrid Service. vCloud Hybrid Service provides Infrastructure as a Service (IaaS) from the cloud providing a…

MadeiraCloud raises $1.5M in Series A funding

May 14th, 2013

From China a new wind of changes came to stay, Beijing-based cloud startup focusing on “IDE” for Amazon Web Services MadeiraCloud developer of a graphical monitoring and management product,…

 
Monthly Archive