Tuesday, January 14, 2014

10 best open source web testing tools


JMeter – Load and Performance tester
JMeter is a pure Java desktop application designed to load test functional behavior and measure performance. It may be used to test performance both on static and dynamic resources (files, Servlets, Perl scripts, Java Objects, Data Bases and Queries, FTP Servers and more). It can be used to simulate a heavy load on a server, network or object to test its strength or to analyze overall performance under different load types.
Grinder – Java Load Testing Framework
The Grinder is a Java load testing framework that makes it easy to run a distributed test using many load injector machines. Load test anything that has a Java API. This includes common cases such as HTTP web servers, SOAP and REST web services, and application servers (CORBA, RMI, JMS, EJBs), as well as custom protocols.
Multi-Mechanize – web performance and load testing framework
Multi-Mechanize is an framework for web performance and load testing. It allows you to run simultaneous python scripts to generate load (synthetic transactions) against a web site or web service. You programmatically create test scripts to simulate virtual user activity. Your scripts will then generate HTTP requests to intelligently navigate a web site or send requests to a web service.
Selenium – Web app testing tool
Selenium is a suite of tools such as Selenium IDE, Selenium Remote Control and Selenium Grid to test the web application. Selenium IDE is an integrated development environment for Selenium scripts. It is implemented as a Firefox extension, and allows you to record, edit, and debug tests. It supports record and playback.
Capybara – Acceptance test framework for web applications
Capybara aims to simplify the process of integration testing Rack applications such as Rails, Sinatra or Merb. Capybara simulates how a real user would interact with a web application. It is agnostic about the driver running your tests and currently comes with Rack::Test and Selenium support built in. HtmlUnit and env.js are supported through external gems.
OpenSTA – Open Systems Testing Architecture
OpenSTA is a distributed software testing architecture designed around CORBA. The current toolset has the capability of performing scripted HTTP and HTTPS heavy load tests with performance measurements from Win32 platforms. Results and statistics are collected during test runs by a variety of automatic and user controlled mechanisms. These can include scripted timers, SNMP data, Windows Performance Monitor stats and HTTP results & timings.
Pylot – Performance & Scalability Testing of Web Services
Pylot is a free open source tool for testing performance and scalability of web services. It runs HTTP load tests, which are useful for capacity planning, benchmarking, analysis, and system tuning. Pylot generates concurrent load (HTTP Requests), verifies server responses, and produces reports with metrics. Tests suites are executed and monitored from a GUI or shell/console.
It supports HTTP and HTTPS. It is multi-threaded and generates real time stats. Response is verified with regular expressions. GUI and Console mode support available.
WebLoad – The best LoadRunner Alternative
The WebLOAD Open Source Load Generation Engine is an open source project sponsored by RadView Software. This project is intended for ISVs, SIs and software developers who need to integrate a professional load generation engine into their applications.
Webrat – Ruby Acceptance Testing for Web applications
Webrat helps to write expressive and robust acceptance tests for a Ruby web application. It supports multiple Ruby web frameworks like Rails, Merb and Sinatra. It also supports popular test frameworks like RSpec, Cucumber, Test::Unit and Shoulda.
Windmill – Web Testing Tool
Windmill is a web testing tool designed to automate and debug your web application. It provides cross-browser test recorder. It has built-in shell to interact with WIndmill server. Write and run tests from Python, Ruby and Javascript.

Automated Testing – How to Choose the Best Automation Testing Tool

What is Automation Testing?
A series of software programs to validate test output against specified test conditions. It’s the best way of executing repetitive test cases using some software/tool which controls the test execution.
In simple words – Test automation is getting rid of repetitive manual tests and replacing those with systematic programs using automation tools.

Is Automated Testing a Solution for You?

I’ve worked on many projects in my career. When you work on same project for more than one year you strongly start feeling need of automating some tasks. You start thinking to introduce automation testing on the project if it’s not been considered till now by project management.
One year is enough time for anyone to know the ins and outs of any project. Once you know the project functionality in detail it becomes easier to decide which repetitive tasks need to be automated.
Some testers also get bored doing same repetitive tasks again and again and they strongly start feeling the need of test automation.
Does that mean you should jump into automation testing right away? Definitely not! There are many criteria you need to work on before deciding whether automation is a solution for you.
Automated Testing

When Does Test Automation Make Sense?

  • When there are many repetitive tests
  • When there are frequent regression testing iterations
  • When you need to simulate large number of users who are using the application resources
  • When AUT is having comparatively stable UI
  • When you have large set of BVT cases
  • When you can’t rely solely on manual test execution for critical functionality
Further readingWhen should you go for automation?
Once you know that it is the right time to invest your time and money in a good automation tool you can start looking for the best automation tool that suite your needs.
Further readingTips you read should before starting automated testing

How to Select Automation Tool for Your Project?

Automation testing success largely depends on the selection of right testing tools. It takes lot of time to evaluate relevant automation tools available in the market. But this is a must one time exercise that will benefit your project in long run.
There were few situations where I got chance to review and select automation tool for my projects. The task was difficult as we had to manage our testing needs and cost restrictions but it was a worth experience.
Here are the criteria you need to consider before selecting any testing tool:
1) Do you have necessary skilled resource to allocate for automation tasks?
2) What is your budget?
3) Does the tool satisfy your testing needs? Is it suitable for the project environment and technology you are using? Does it support all tools and objects used in the code? Sometime you may get stuck for small tests due to inabilities of the tool to identify the objects used in the application.
I consider above three factors as most important for selecting any tool.
4) Does the tool provide you the free trial version so that you can evaluate it before making a decision? Also does the tool have all features available in trial version?
5) Is the current tool version stable? Is the vendor company established with good customer support as well as online help resources and user manual?
6) How is the tool learning curve? Is the learning time acceptable for your goals?

7) Do you want automation tool for only your project needs or you are looking for a common tool for all projects in your company? It would be a good choice if you select a tool that supports most of the coding languages on your projects.
8 ) Which testing types does it support? Tool which supports maximum testing types (Unit, functional, regression etc.) is always a better choice. Warning – Don’t go for a tool just because it is supporting all testing types. It’s also important that the tool should be powerful enough to automate your complex requirements.


9) Does the tool support easy interface to create and maintain test scripts? Record and playback tool with abilities to edit recorded scripts could be a good solution.
10)  Does it provide simple interface yet powerful features to accomplish complex tasks?
11)  How easy it is to provide input test data for complex or load tests? Tool supporting test data input from various data files such as Excel, XML, text file etc. would be a big relief for the automation the testers.
12)  Does it provide the powerful reporting with graphical interface? Clear and concise reports will always help you to conclude the test results quickly.
13)  Does it integrate well with your other testing tools like project planning and test management tools?
You may also want to consider other criteria like:
14)  Tool vendor refund policy
15)  Existing customer reviews for the tool
16)  Is the vendor providing initial training?
Tips: Requirement gathering is by far the most important step for selecting the right tool. Make sure to categorize your requirements in must have, nice to have, and not required feature categories. This will help you to evaluate the tool quickly. Remember you won’t find a tool already available in the market which will support all your automation needs!
Best Automation Tools:
HP QTP and Selenium are the two most popular functional testing options available currently. QTP is a best functional testing tool supported on wide range of coding languages and platforms whereas Selenium is the best open source functional web testing tool.

Testing Tools - MOBILE Testing list


Cucumber

Behavior driven development with elegance and joy.
Tool Review Summary
Tool Scope Testing Tool, Testing Framework.
Application Rights Free Use, Opensource.
Maturity (since) 2008.
See more tools from GitHub project.
Support Tool Support link HERE.
Download Download HERE.

eggPlant

QA automation for productive testing
Tool Review Summary
Tool Scope Testing Tool, Monitoring Tool.
Application Rights Commercial, Trial.
Maturity (since) 2009.
See more tools from TestPlant.
Support Tool Support link HERE.
Download Download HERE.

Ranorex Test Automation

The Ranorex Automation Framework is used to automate all kind of desktop, web and mobile applications.

Tool Review Summary
Ranorex Tool Scope Testing Tool, Testing Utility, Testing Framework.
Application Rights Commercial, Demo, Floating license, Static license, Trial.
Maturity (since) 2007.
See more tools from Ranorex.
Support Tool Support link HERE.
Download Download HERE.

Tosca

Optimized Test Processes in TOSCA Testsuite

Tool Review Summary
Tool Scope Test Management, Testing Tool.
Application Rights Commercial, Demo, Trial.
Maturity (since) .
See more tools from TRICENTIS.
Support Tool Support link HERE.
Download Download HERE.

Googletest

Google C++ Testing Framework

Tool Review Summary
Tool Scope Testing Framework.
Application Rights Opensource.
Maturity (since) 2008.
See more tools from Google Code Projects.
Support Tool Support link HERE.
Download Download HERE.

M-eux Test

The M-eux Test software allows you to automate, monitor and maintain your mobile test cases.

Tool Review Summary
Jamosolutions in QATestingTools.com Tool Scope Testing Tool, Tool Extension.
Application Rights Commercial, Demo, Trial.
Maturity (since) 2008.
See more tools from Jamo Solutions.
Support Tool Support link HERE.
Download .

MonkeyTalk


Tool Review Summary
MonkeyTalk at QATestingTools.com Tool Scope
Application Rights
Maturity (since) Active Since 0
See more tools from Gorilla Logic
Support onsite support-services
Download onsite download

Android GUITAR

Android GUITAR is a project intended to simplify the testing process of GUIs on the Android platform by invoking GUITAR
Tool Review Summary
Android GUITAR Tool Scope Testing Tool, Testing Framework.
Application Rights Free Use, Opensource.
Maturity (since) 2011.
See more tools from Sourceforge.
Support .
Download Download HERE.

Robotium

User scenario testing for Android

Tool Review Summary
Robotium in QATestingTools.com Tool Scope Testing Framework, Testing Tool.
Application Rights Free Use, Opensource.
Maturity (since) 2010.
See more tools from Google Code Projects.
Support Tool Support link HERE.
Download Download HERE.

Android SDK

ADT (Android Developer Tools) to streamline your Android app development.
Tool Review Summary
Tool Scope Testing Tool, Emulator, Simulator, Testing Framework.
Application Rights Free Use, Opensource.
Maturity (since) 2009.
See more tools from Android.
Support Tool Support link HERE.
Download Download HERE.

NeoLoad

Make sure it works! 

Twist

Evolve Test Suites and Reduce Effort
Tool Review Summary
TWIST Agile Testing Tool Scope Testing Tool, Testing Framework.
Application Rights Commercial, Demo.
Maturity (since) 2007.
See more tools from Thoughtworks.
Support Tool Support link HERE.
Download Download HERE.

Load Tester PRO


Tool Review Summary
Tool in QATestingTools Tool Scope
Cloud Service
Application Rights
Commercial, Demo, Periodic license, Free Use
Static license, Trial, User license
Maturity (since) 1999
See more tools from
Support Get Support Here
Download Download HERE

SandStorm

Affordable load testing solution for your web and mobile apps.
Tool Review Summary
Tool Scope Testing Tool, Emulator, Cloud Service, Monitoring Tool.
Application Rights Commercial, Demo, Periodic license, SAAS, Subscription, Trial, User license.
Maturity (since) 2011.
See more tools from Impetus.
Support .
Download .

Test Studio

One easy solution for all your software testing needs

Tool Review Summary
Telerik Test Studio Tool Scope Testing Tool, Testing Framework, Test Management.
Application Rights Commercial, Floating license, Trial.
Maturity (since) 2002.
See more tools from Telerik.
Support Tool Support link HERE.
Download Download HERE.

T-PLAN ROBOT

A human-like approach to software testing

Tool Review Summary
T-Plan Robbot Tool Scope Testing Tool, Testing Framework.
Application Rights Commercial.
Maturity (since) .
See more tools from T-Plan.
Support Tool Support link HERE.
Download Download HERE.

UISpec

Behavior Driven Development framework for the iPhone
Tool Review Summary
UISpec Tool Scope Testing Framework.
Application Rights Free Use, Opensource.
Maturity (since) 2010.
See more tools from Google Code Projects.
Support Tool Support link HERE.
Download Download HERE.

Silk Performer

Performance testing tool - Test your performance during peak load times
Tool Review Summary
 Silk Performer Tool Scope Testing Tool.
Application Rights Commercial, Trial.
Maturity (since) 1994.
See more tools from Micro Focus.
Support Tool Support link HERE.
Download Download HERE.

TestQuest CountDown


Tool Review Summary
testquest CountDown at QATestingTools Tool Scope
Test Management
Quality Management
Application Rights Commercial
Maturity (since)  
See more tools from BSQUARE
Support  
Download  

Frank


Tool Review Summary
Tool in QATestingTools Tool Scope
Testing Framework
Testing Unit
Application Rights
Free Use
Opensource
Maturity (since) 2011
See more tools from GitHub project
Support  
Download http://github.com/moredip/Frank

mAutomate


Tool Review Summary
mAutomate at QATestingTools.com Tool Scope
Cloud Service
Testing Unit
Application Rights Commercial
Maturity (since) 2011
See more tools from Impetus
Support  
Download  

AppPerfect Web Test

AppPerfect Web Test is a fully Automated Web Functional testing and Regression testing software.
Tool Review Summary
AppPerfect Web Test Tool Scope Testing Tool, Testing Framework.
Application Rights Commercial.
Maturity (since) 2003.
See more tools from AppPerfect.
Support Tool Support link HERE.
Download Download HERE.

RealMobile

Conflair has a solution - RealMobileTM, our unique patent-pending method

Tool Review Summary
Tool Scope Testing Tool.
Application Rights Commercial.
Maturity (since) 2006.
See more tools from Conflair.
Support .
Download .

ZAP-fix

ZAP-fiX is the ultimate tool for cross-browser test automation

Tool Review Summary
ZAP-fix in QATestingTools.com Tool Scope Testing Framework, Testing Tool, Tool Extension.
Application Rights Commercial, Trial.
Maturity (since) .
See more tools from ZAP technologies.
Support .
Download .

App Test

AppPerfect App Test has been designed to assist users meet such testing challenges.
Tool Review Summary
AppPerfect App Test Tool Scope Testing Tool, Testing Framework.
Application Rights Commercial.
Maturity (since) 2003.
See more tools from AppPerfect.
Support Tool Support link HERE.
Download Download HERE.

StressTester

Assuring Application Performance
Tool Review Summary
Tool Scope Emulator, Simulator, Cloud Service, Reporting Tool, Defect Reporting tool, Quality Management, Project Management, Agile Management.
Application Rights Commercial, Demo, Floating license, Periodic license, SAAS, Subscription, Trial, User license.
Maturity (since) 2003.
See more tools from Reflective Solutions.
Support .
Download .

Squish

Squish is the leading cross-platform/cross-technology GUI test automation tool for functional GUI regression tests.

Tool Review Summary
Squish - GUI Testing Tool Scope Testing Tool, Testing Framework.
Application Rights Commercial, Demo, Trial.
Maturity (since) 2003.
See more tools from Froglogic.
Support Tool Support link HERE.
Download Download HERE.

MyVoIPSpeed PC


Tool Review Summary
Tool Scope Simulator, Testing Tool.
Application Rights Commercial, Trial.
Maturity (since) 2007.
See more tools from Try Out VoIP.
Support .
Download Download HERE.

SeeTestAutomation

Test automation tool for iOS, Android, Blackberry and WindowsPhone
Tool Review Summary
SeeTest Automation by Experitest Tool Scope Testing Framework.
Application Rights Commercial.
Maturity (since) 2008.
See more tools from Experitest.
Support .
Download Download HERE.

MobileCloud

The MobileCloud is a 100% web-based Software-as-a-Service (SaaS) platform
Tool Review Summary
MobileCloud by Perfectomobile Tool Scope Testing Tool, Testing Framework, Cloud Service.
Application Rights Commercial, Demo, SAAS.
Maturity (since) 2006.
See more tools from Perfecto Mobile.
Support .
Download .

OpKey

Smartest test framework
Tool Review Summary
OPKey, Automation Framework Tool Scope Testing Framework.
Application Rights Commercial, Free Use.
Maturity (since) .
See more tools from CresTech Software Systems.
Support Tool Support link HERE.
Download Download HERE.

Trust

Mobile Application Testing. Accelerated.
Tool Review Summary
Mobile Labs, Trust Tool Scope Testing Tool.
Application Rights Commercial, Trial.
Maturity (since) 2011.
See more tools from Mobile Labs.
Support .
Download .

Continuous

Test your Android & Web-App and find bugs before the users do.
Tool Review Summary
Continuous by TestObject Tool Scope Testing Tool.
Application Rights Commercial.
Maturity (since) 2011.
See more tools from Test Object.
Support .
Download .

Ubertesters Platform

monitor and manage your mobile beta testing process
Tool Review Summary
Ubertesters Platform Tool Scope Test Management, Cloud Service.
Application Rights Commercial.
Maturity (since) 2012.
See more tools from Ubertesters.
Support .
Download Download HERE.