Thursday, October 27, 2011

Testing Tools Comparison



(Author:Dhivya Seethapathy)
Testing Tools are the tools which are used to validate and verify software programs or Applications or Products. There are different kinds of testing tools for different purposes. Some of the most common testing tools features are compared here.

Apache JMeter

    Apache JMeter is open source software.
    100% pure Java desktop application designed to load test functional behaviour and measure performance.
  • It’s a Graphical server performance testing tool, for both static and dynamic resources (files or CGI, Servlets, Perl scripts).  
  • It can be used to simulate a heavy load on a server, network or object to test its strength or to analyze overall performance under different load types.
  • It can be used to make a graphical analysis of performance or to test the server/script/object behaviour under heavy concurrent load.
  • It can load and performance test many different server types:  

      1. Web - HTTP, HTTPS SOAP
      2. Database via JDBC
      3. LDAP
      4. JMS
      5. Mail - POP3(S) and IMAP(S)

OpenSTA

  • OpenSTA stands for Open System Testing Architecture.
  • Open STA is to tests HTTP and HTTPS heavy load with performance measurements from Win32 platforms.
  • Web Load and stress testing for no cost; open source and General Public License.
  • The test result can be viewed, graphed, filtered and exported for use by more sophisticated report generation software.
  • It has the monitoring functionality.
  • OpenSTA is capable of running at least 1000 virtual users from one users from one machine which cannot be achieved by commercial load testing tools.

HP QTP (Quick Test Professional)

  • HP QuickTest Professional performs functional and regression testing through a user interface such as a native GUI or web interface.
  • It works by identifying the objects in the application user interface or a web page and performing desired operations
  • HP QuickTest Professional uses a VBScript scripting language to specify the test procedure and to manipulate the objects and controls of the application under test.
  • Although HP QuickTest Professional is usually used for "UI Based" Test Case Automation, it also can automate some "Non-UI" based Test Cases such as file system operations and database testing.
  • HP QuickTest Professional cannot be used by a plug-in in non-Windows environments. It fetches objects like ActiveX from the Windows environment but not from other operating systems. QTP cannot be used to test with all browser types and versions
Test Complete
  • Test Complete is an automated testing environment for Win32, .NET and Windows Presentation Foundation (WPF) applications.
  • Test Complete has a built-in code editor with a set of special plug-ins that helps testers write scripts manually.
  • Test Complete records the key actions necessary to replay the test and discards all unneeded actions.
  • Test Complete provides extended support for testing Web Pages, Web Servers, Web Services and Projects created in the following development tools:   

      1. Microsoft Visual C++/Borland C++ Builder
      2. VB
      3. Delphi
      4. Java
      5. .NET
      6. WPF


Grinder - A Java Load Testing Framework

  • Generic Approach Load tests anything that has a Java API. This includes common cases such as HTTP web servers, SOAP and REST web services, and application servers (CORBA, RMI, JMS, EJBs), as well as custom protocols.
  • Flexible Scripting Tests are written in the powerful Jython scripting language.
  • Distributed Framework A graphical console allows multiple load injectors to be monitored and controlled, and provides centralized script editing and distribution.
  • Mature HTTP Support Automatic management of client connections and cookies. SSL. Proxy aware. Connection throttling. Sophisticated record and replay of the interaction between a browser and a web site.
Selenium-RC
Selenium Remote Control (RC) is a test tool that allows you to write automated web application UI tests in any programming language against any HTTP website using any mainstream JavaScript-enabled browser. It is great for testing complex AJAX-based web user interfaces under a Continuous Integration system.
Selenium RC comes in two parts. 
  • A server which automatically launches and kills browsers, and acts as a HTTP proxy for web requests from them.
  • Client libraries for your favorite computer language.

Tools Comparison
Key Features
Test Complete
QTP
Grinder
Jmeter
OpenSTA
Selenium-RC
Cost
License
License
Open source
Open source
Open source
Open source
Automation
Record and Playback
Record and Playback
Record and Playback
Record and Playback
Record and Playback
Record and Playback
Multilingual
Yes
Yes
NO
No
No
NO
Scripting language
1.VBScript 
2.JScript 
3.C++Script 
4.C#Script 
5.DelphiScript
1.VBScript 
2.JavaScript 
3.VC++
Python scripting language.
JavaScript
Script Control Language
1.Java 
2.Perl 
3.Python 4.C# 
5.Ruby 
6.HTML 
7.PHP
Supported techno-logies
1.Web
2.Java 
3..Net 
4.WPF 
5.SAP
6.Oracle 
7.Siebel 
8.PeopleSoft 
9.Delphi 
10.PowerBuilder 
11.Stingray1 
12.Terminal Emulator 
13.Flex 
14.Webservices 
15.Windows Mobile 
16.Visual Edge 
17.SOAP 
18.Mainframe terminal
1.Web 
2.VB 
3.VC++ 
4.Java 
5.Power Builder 
6.Delphi 
7.Dot Net 
8.SAP 
9.Siebel 
10.Flash 
11.Oracle Apps 
12.People Soft 
13.Terminal Emulator 
14.HTML 
15.XML
Java
Java



It record http request.

record http request.

Testing Type
1.Functional (GUI) testing
 
2.Unit testing
 
3.Regression testing
 
4.White-box testing
 
5.Data-driven testing
 
6.Keyword-driven testing 
7.Load, stress and scalability testing
 
8.Distributed testing
 
9.Coverage testing
 
10.Manual testing
1.Functional testing 

2.Regression testing

1.Load testing 

2.Capacity testing 
3.Stress testing

1.Loadtesting 

2.Performance testing

1.Load testing 

2.Performance testing 

3.Stress testing

1.Functional testing 

2.Regression testing

Supported Browser
1.Internet Explorer 

2.Firefox 

3.Netscape Navigator

It support to recording the test only on Internet Explorer and It supports running tests on the other browsers 

1.Internet Explorer 

2.Netscape Navigator 

3.AOL 
8.0,9.0 

4.Firefox

1.Internet Explorer 

2.Firefox 

3.Netscape

1.Internet Explorer 

2.Firefox 

3.Netscape

For HTTPS recording 

1.Internet Explorer 4
 
2. Internet Explorer 5
 
3. Netscape 4.7

1.Firefox5
 
2.Firefox4 

3.Forefox3 

4.IE9 

5.IE8 

6.IE7 

7.Safari3 

8.Safari2 

9.Opera9 

10.Opera8

Supported os


1.Micosoft Windows 2000 

2.Micosoft Windows XP 

3.Microsoft Windows Server 2003 

4.Microsoft Windows Server 2008 

5.Micosoft Windows Vista 

6.Microsoft Windows 7

1.Micosoft Windows 2000 

2.Micosoft Windows XP 

3.Windows NT 

4.Windows 95/98.ME 

5.Windows 7 

6.Windows Vista 

7.Windows Server 2008 R2

Os Independent

1.Unix (Solaris,Linux,etc) 

2.Windows(98,NT,XP) 

3.OpenVMS Alpha 7.3+

1.windows 2000 NT4 and XP 

2.Win2K 

3.WinNT 

4.Microsoft Windows Server 2003 

5.WinXP

1.Windows
 
2.OS X
 
3.Linux
 
4.Solaris



167 comments: