Home

Belgium Testing Days (BTD) 2011 How To Automate Tests Using Testlink And Hudson

kinow @ Feb 14, 2011 22:18:03 ()

How To Automate Tests Using Testlink And Hudson

Event
Belgium Testing Days 2011
Where ?
Brussels, Belgium
When ?
2011-02-14

Code coverage helps, but it's not enough

kinow @ Jan 25, 2011 19:41:59 ()

Today I talked to two QA Engineers about code coverage and we all agreed that code coverage helps, but is not enough. And by coincidence today I had to fix a bug in tap4j that reminded me the same thing. My cobertura (the coverage tool that I was using at moment) report said that my code was covered by my tests. However there was a bug in the covered code.

Cobertura code coverage

If you are curious about the code you can see this issue here. However if you really would like to know more about code coverage, I suggest you to read this fantastic article written by Brian Marick in 99 with the title “How to misuse code coverage”.

I will finish this post now quoting him:

“they (code coverage tools) are only helpful if they’re used to enhance thought, not to replace it”.

Cheers :-)

Article about TestLink and Hudson integration published

kinow @ Dec 10, 2010 10:52:22 ()

Since September I’ve been working on a project to integrate TestLink and Hudson. The project consists basically in a Hudson Plug-in that uses TestLink Java API to retrieve information of Automated Test Cases created in TestLink. You can read more about the plug-in in the following address: http://wiki.hudson-ci.org/display/HUDSON/TestLink+Plugin.

I wrote an article in conjunction with Anderson dos Santos about this Plug-in. The article was published by Testing Experience in its December issue. The issue’s topic is Open Source Tools. You can download the whole magazine from Testing Experience website (I highly recommend downloading the magazine, there are some great articles there!).

Since we wrote the article we changed only the way we parsed the test reports. Instead of parsing only TAP report files, we decided implement TAP, JUnit and TestNG parsers. In the future we plan adding more parsers to others *nits and Selenium report files.

The plug-in is being used to automate acceptance tests in a CRM system that was developed by Sysmap Solutions. I will write about the automation process, experiences learned and mistakes to be avoided in future projects as soon as we finish writing the automated tests and setting up the Selenium Farm.

In the following days I’ll be writing more tutorials, guides and recording some video tutorials. In February of the next year this automation solution will be presented in the Belgium Testing Days event.

Cheers

Automating tests with Hudson and TestLink (pt-BR only)

kinow @ Nov 28, 2010 13:35:19 ()

Slides used at Encontro Ágil 2010. As soon as I finish the plug-in 2.0 version I’ll upload a video with a sample demo too.

Automatizando Testes Com Hudson e TestLink by brunodepaulak

Cheers

Encontro Ágil 2010 - Lighting talk about Test Automation with TestLink and Hudson

kinow @ Nov 02, 2010 11:45:09 ()

On November 6th (next Saturday) Anderson Santos and I will present a Test Automation solution built on TestLink and Hudson at Encontro Ágil 2010. This meeting is for intended for the Agile community and will be hold at IME-USP (Instituto de Matemática e Estatística - Universidade de Sáo Paulo).


In our demonstration we will be using TestLink 1.9 HEAD version, Hudson 1.366 and TestLink Hudson Plug-in 2.0-SNAPSHOT. This TestLink Hudson Plug-in version is still not released as we are finishing to code the integration between the plug-in and TAP through tap4j, an implementation of TAP - Test Anything Protocol.

What is nice about this solution is that we aren’t trying to use TestLink as an Automation Tool. But yes, as a Test Management Tool (what TestLink is by nature). And the choice of the Test Execution Tool is up to you, as long as you generate TAP Stream (basically, files containing a log of tests executed). We only enable you to have these tests updated on your TestLink installation, this way you can plan a Test Cycle with both Manual and Automated Tests in one single tool.

And lastly but not less important, this week Testing Experience Magazine accepted a proposal of article for the next issue on Open Source Tools about this solution. So we are working very hard to release TestLink Hudson Plug-in new version and spread this Test Automation Solution through the Testing/Quality community.

Cheers