RSS feed [root] /software_engineering /testing /weblog




login:

password:

title search:




 


Tue Jan 31 00:14:47 HKT 2012

testing



(google search) (amazon search)
second
download zip of files only

Tue Jan 31 00:14:39 HKT 2012 From /weblog/software_engineering/testing

antipattern


The evil test:

1. Evil tests create a lock on how the code is implemented.
2. Cause duplication.
3. Builds uncertainty on the tests (red is meaningless).
4. Decrease productivity.
5. Discourage change.

http://www.makinggoodsoftware.com/2012/01/27/the-evil-unit-test

use thread in junit - http://softwareintegrityblog.com[..]blog/2007/11/05/false-positives-in-junit

Don't try to test everything - http://www.nearinfinity.com[..]ay?entry=unit_testing_avoiding_extremism

Why TDD fail? Because test is too complicate to write - http://agile.dzone.com/news/why-you-fail-tdd ( I agree it a lot )

Hard to test something? Unreadable tests? Slow running tests? It takes too long to write a test? Some solution suggested - http://www.stephenchu.com[..]/last-d-in-tdd-means-more-than-just.html

Comment out test so that the code compile - http://martinfowler.com/bliki/TestCancer.html

A list of TDD antipattern - http://blog.james-carr.org/?p=44 http://www.exubero.com/junit/antipatterns.html

And the long discussion using random in unittest - http://tech.groups.yahoo.com[..]rivendevelopment/message/20458?var=1&l=1
Here is an example of using random in unittest, it actually same for every new instance! - http://www.skizz.biz/archives/000568.html

Test abstraction smells - http://agileinaflash.blogspot.com[..]com/2011/11/test-abstraction-smells.html

(google search) (amazon search)


Tue Jan 10 23:34:47 HKT 2012 From /weblog/software_engineering/testing

LoadTest


Experience of using load testing tool - http://www.netatlantis.com/?p=3320 , in his opinions, look like http://www.loadui.org/ is the best

(google search) (amazon search)


Wed Dec 21 22:08:06 HKT 2011 From /weblog/software_engineering/testing

best practices


Testing Patterns - http://c2.com/cgi/wiki?TestingPatterns

Continuously to break thing so that we know our system is solid - http://www.codinghorror.com[..]11/04/working-with-the-chaos-monkey.html

First rule - http://fishbowl.pastiche.org[..]08/10/01/nothing_is_too_trivial_to_test/

Test first/last is not important? Unit test either? What do you think? http://beust.com/weblog/archives/000477.html

* The name of the test should describe the requirement of the code
* There should be at least one test for each requirement of the code. Each possible path through of the code is a different requirement#
* Test the goal of the code, not the implementation

http://xprogramming.com/xpmag/testFirstGuidelines.htm http://www.theserverside.com[..]AppQuality&asrc=EM_NLN_761453&uid=703565 http://www.coopercode.net[..]og/2007/08/how-not-to-run-beta-test.html

The teaser: Fast, Isolated, Repeatable, Self-validating, and Timely. - http://blog.objectmentor.com[..]es/2007/08/02/not-a-task-but-an-approach http://blog.objectmentor.com/articles/2007/08/02/which-came-first

Corner cases - http://testobsessed.com[..]s/2007/02/testheuristicscheatsheetv1.pdf

One of the targets of TDD coding - http://haacked.com[..]e-code-is-about-managing-complexity.aspx

Design for unit test - http://www.theserverside.com[..]es/content/DesigntoUnitTest/article.html

Push and Pull approach -
http://www.richarddurnall.com/?p=10
http://www.richarddurnall.com/?p=15
http://www.richarddurnall.com/?p=31

When not to test - http://www.junitmax.com/blog/?p=187

http://www.infoq.com/news/2009/06/love_agile_testing

Test the story, rather than the implementation - http://www.davesquared.net[..]ving-to-scenario-based-unit-testing.html

Test the configuration - http://searchsoftwarequality.techtarget.com[..]TSS10ctqa&asrc=EM_NLN_8746433&uid=703565

Feel the deep synergy of design and test constraint - http://michaelfeathers.typepad.com[..]athers_blog/2007/09/the-deep-synerg.html

Another set of principles for automated testing - http://a-sisyphean-task.blogspot.com[..]of-principles-for-automated-testing.html

Priority for tester - http://googletesting.blogspot.com[..]t.com/2011/01/new-years-resolutions.html

A lot of links - http://it-techexperts.com/tutorials/tutorials.asp http://testingspot.net/ http://www.exampler.com[..]-links-biased-toward-exploratory-testing

http://www.makinggoodsoftware.com[..]nit-tests-5-principles-for-unit-testing/

(google search) (amazon search)


Fri Nov 04 01:41:15 HKT 2011 From /weblog/software_engineering/testing

exploring test


Using mindmap as testing tool - http://lisacrispin.com[..]02/28/using-mind-maps-for-test-planning/

Chat about exploring test - http://www.developsense.com[..]g-or-scripted-testing-which-comes-first/

How to effective use notebook with exploratory-testing - http://www.developsense.com[..]4/exploratory-testing-recording-and.html


(google search) (amazon search)


Sun Oct 30 02:10:07 HKT 2011 From /weblog/software_engineering/testing

TDD


If you write the test after you've written the code, it's much more likely that you'll write the tests that will pass what you've written.

That's just how our brains work.

If you determine the criteria for whether a decision is good after you've already made the decision, it's much more likely that you'll create criteria that justifies the decision that was just made.

That's just how our brains work.

Determine how to assess whether something is good before you implement it and/or before you make a decision. Otherwise, you will tend to be emotionally attached to what you just did, what you just decided.

http://jchyip.blogspot.com/2011/09/criteria-first.html

My Top 5 ways to reproduce a "Hard to Reproduce" Bug! - http://software-testing-zone.blogspot.com[..]/my-top-5-ways-to-reproduce-hard-to.html

Common TDD issue and suggested solution - http://www.agileadvisor.com[..]utomated-test-problems-address-root.html

http://biblio.gdinwiddie.com[..]om/biblio/StudiesOfTestDrivenDevelopment

http://www.notesfromatooluser.com[..]ptions-with-test-driven-development.html

(google search) (amazon search)


Tue Oct 04 00:22:03 HKT 2011 From /weblog/software_engineering/testing

performance


By far the biggest reason I have seen for the performance discrepancy above is not due to a faulty test but due to the stress test being executed on wildly different data sets than what is in production. - http://saasinterrupted.com[..]on-flaw-in-software-performance-testing/

http://www.jayphilips.com[..]0-open-source-performance-testing-tools/

Discuss about performance management, a process to monitor and control performance details - http://blog.dynatrace.com[..]1/09/15/why-do-you-do-apm-in-production/

(google search) (amazon search)


Sun Sep 25 00:13:48 HKT 2011 From /weblog/software_engineering/testing

attitude


Customer attitude will affect how the software engineering workflow a lot: http://groups.yahoo.com[..]gprog/message/7420?threaded=1&var=1&p=24

Do you think this piece of code are too simple to have test case to cover? read this - http://gojko.net[..]t-the-software-craftsmanship-conference/

Related blog, finding the common between taking photo and software testing - http://andreas-simon.blogspot.com[..]hotographic-testing-lessons-learned.html . However, there is one big difference, it is harder to define a good photo than bug feel software

If it is good to put developer as tester? - http://janetgregory.blogspot.com[..].com/2011/03/programmers-as-testers.html

In fact I am kind of agree about this article, but maybe I just not TDD hard enough - http://beust.com[..]ectural-meltdown-around-iteration-three/

Tooling, Insight and Humility - http://www.developsense.com[..]reasons-for-testers-to-learn-to-program/

(google search) (amazon search)


Tue Jun 21 00:16:16 HKT 2011 From /weblog/software_engineering/testing

Release Checklist


Various discussion about the checklist: http://discuss.joelonsoftware.com/default.asp?joel.3.111480 . But I think practice CI is more important: http://www.martinfowler.com/articles/continuousIntegration.html

Joey discuss on beta testing... I feel he requirement is too high for small team - http://www.joelonsoftware.com/articles/BetaTest.html

More discussion - http://www.infoq.com/news/2007/12/agile-checklists and a checklist for SCRUM http://www.infoq.com/minibooks/scrum-checklists

Integraton test concern - http://www.makinggoodsoftware.com[..]integration-points-4-main-considerations

http://blog.anandvishwanath.in[..]h.in/2011/06/release-plan-checklist.html

(google search) (amazon search)


Thu Apr 28 00:36:26 HKT 2011 From /weblog/software_engineering/testing

refactoring unit test


Idea of how to refactoring test cases, summary :

Refactor production code with the tests passing. This helps you determine that the production code still does what it is meant to.
Refactor test code with the tests failing. This helps you determine that the test code still does what it is meant to.

http://googletesting.blogspot.com[..]07/04/tott-refactoring-tests-in-red.html

Collections of idea of testing private methods - http://www.infoq.com/news/2008/01/private-methods-tdd-design , may be it is a signal of refactoring?

The other way of testing private , via compare with difference implementation - http://manversusvirtualmachine.blogspot.com[..]1/unit-testing-private-methods-like.html

Explain the problem of non-Determinism in testing, common reason of why tests becoming non-Deterministic, and common solution - http://martinfowler.com/articles/nonDeterminism.html

(google search) (amazon search)


Sun Apr 10 08:58:20 HKT 2011 From /weblog/software_engineering/testing

case study


How google doing test - http://googletesting.blogspot.com[..]/how-google-tests-software-part-two.html http://www.infoq.com/news/2011/03/Ensuring-Product-Quality-Google http://googletesting.blogspot.com/2
011/03/how-google-tests-software-part-five.html

How facebook doing test? - http://www.quora.com[..]nd-of-automated-testing-does-Facebook-do

How to test map-reduce application - http://cornercases.wordpress.com[..]ting-mapreduce-with-the-adapter-pattern/

(google search) (amazon search)


Tue Mar 01 08:17:05 HKT 2011 From /weblog/software_engineering/testing

test data


Suggestion of how to manage the test datas - http://jchyip.blogspot.com[..]citcon-melbourne-2008-managing-test.html

Difference Pattern of managing test datas - http://adrianmowat.blogspot.com[..]damentals-of-data-testing-setup-and.html

How to get the data feed and design automated test trading system - http://howtohft.wordpress.com[..]m/2011/02/16/trading-system-testability/

(google search) (amazon search)


Wed Jan 12 22:27:11 HKT 2011 From /weblog/software_engineering/testing

reference


A lot of links - http://www.staqs.com/software_testing.html

Mindmap like testing diagram - http://www.mindmeister.com/maps/show_public/3957006

Video and Slides for GTAC - http://googletesting.blogspot.com[..]posted-by-lydia-ash-gtac-conference.html http://googletesting.blogspot.com[..]0/12/gtac-5-videos-slides-abstracts.html

(google search) (amazon search)


Mon Jan 03 09:13:15 HKT 2011 From /weblog/software_engineering/testing

javascript tester


An simple example of doing javascript unit test - http://jroller.com[..]ray?entry=testing_javascript_with_groovy However this approach is too fake for me and easy to miss many thing, IMHO putting test a real environment is better

A site for javascript testing http://www.testdrivenjavascript.com

Test time in javascript - http://googletesting.blogspot.com[..]avascript-simulating-time-in-jsunit.html

And this is an example of using JDK6 scripting framework for testing javascript, pretty interesting , but probably not reflecting IE/MOZ behaviour - http://technology.amis.nl/blog/?p=1869

Use a scripting engine to test javascript - http://labnotes.org[..]nsanely-fast-full-stack-headless-testing

(google search) (amazon search)


Wed Nov 17 00:48:42 HKT 2010 From /weblog/software_engineering/testing

acceptance



Here is a more complicated framework, not looking good but still keep it here as the concept is interesting - http://sourceforge.net/projects/cubictest

The most excellent implementation for my need - http://www.concordion.org/

http://www.jamesshore.com/Blog/Five-Ways-to-Misuse-Fit.html - Don't use it as junit, "The whole point of Fit is to use HTML to speak the customer's language and fixtures to translate that language to code. "

http://jroller.com/njain/entry/is_fitnesse_ready_for_enterprise - Version control is #1 issue at that article

When use Fit/Fitness - http://madcoderspeak.blogspot.com[..]-do-i-use-for-acceptance-tests-atdd.html

(google search) (amazon search)


Sun Feb 14 21:57:11 HKT 2010 From /weblog/software_engineering/testing

junit


A nice example of convert dbunit from using junit to testng - http://www.realsolve.co.uk[..]h/blog.php?name=philzoio&mydate=20050826

redirect junit output to a file - http://www.diotalevi.com/weblog/?p=43

invokeNCopiesWithTimeout, run a test ( in runnable() ) for n times and see if it ok for multi-thread likely or not - http://binkley.blogspot.com[..]/running-n-foreground-tasks-in-java.html

Use theories to execute test with a lot difference input, probably possible for all cases - http://blog.schauderhaft.de[..]010/01/31/new-feature-of-junit-theories/ http://bloritsch.d-haven.net[..]using-junit-4-theories-to-test-contracts http://blog.schauderhaft.de/2010/02/07/junit-theories/

The other features, rule, perform some rule on test cases - http://blog.schauderhaft.de/2009/10/04/junit-rules/

(google search) (amazon search)


Fri Jan 22 23:10:32 HKT 2010 From /weblog/software_engineering/testing

concurrency


Create a thread-pool to execution concurrency - http://www.planetgeek.ch[..]how-to-find-a-concurrency-bug-with-java/

http://legalizeadulthood.wordpress.com[..]com/2009/10/14/unit-testing-concurrency/

http://merereflections.wordpress.com[..]sting-multi-threaded-code-with-easymock/

(google search) (amazon search)



Thu Dec 03 11:46:29 HKT 2009 From /weblog/software_engineering/testing

deployment


Automated deployment test on VM - http://code.dblock.org/ShowPost.aspx?id=62

(google search) (amazon search)


Thu Nov 26 00:56:14 HKT 2009 From /weblog/software_engineering/testing

debugger


Various discussion about debugger

Debuggers are a wasteful Timesink - http://www.artima.com/weblogs/viewpost.jsp?thread=23476
The Power of Debuggers - http://beust.com/weblog/archives/000055.html

And a lot of links - http://www.infoq.com/news/2007/10/are-ruby-debuggers-harmful

I feel the same, most of the time rely on debugger is not that nice - http://iancartwright.com/blog/2009/11/ban-debugger.html

(google search) (amazon search)


Fri Oct 30 16:42:36 HKT 2009 From /weblog/software_engineering/testing

mock


Yet other discussion of Stubs, Fakes, and Mock Objects - http://vladimirlevin.blogspot.com/2007/11/stubs-fakes-mocks.html

While reviewing this article, Marty Andrews pointed out an important insight: there are two ways to use a mock object, either as a testing technique or as a design technique, and the intended use helps shape the available choices.

http://www.onjava.com/lpt/a/4526

Someone post some arguement that using mock probably a bad idea , which look like a endless arguement... - http://jroller.com[..]xRuiz?entry=mocks_for_concrete_class_can

Alberto Savoia on Testing the Untestable, raise a point that mocking make testing more portable, it probably true, but database setup may be not that difficult to port. - http://www.artima.com/forums/flat.jsp?forum=276&thread=213402

http://gojko.net[..]ut-isolation-but-about-responsibilities/

http://blog.objectmentor.com[..]ing-the-invasion-of-dots-and-parentheses

(google search) (amazon search)


Thu Sep 24 01:39:55 HKT 2009 From /weblog/software_engineering/testing

tester


Being proactive! - http://xndev.blogspot.com[..]to-be-first-class-citizen-as-tester.html

(google search) (amazon search)


Wed Sep 02 01:53:05 HKT 2009 From /weblog/software_engineering/testing

classification


There is a lot of discussion about this blog - http://www.artima.com/weblogs/viewpost.jsp?thread=126923

Which talk about classification of functional test and unit test. Nice to read. You can also refer to the following article:

http://beust.com/weblog/archives/000319.html
http://www.magpiebrain.com/archives/2005/09/18/unit_tests

Checking vs. testing - http://www.developsense.com/2009/08/testing-vs-checking.html

(google search) (amazon search)


Mon Jul 06 00:35:08 HKT 2009 From /weblog/software_engineering/testing

automatic test presentation


A presentation bascially say: "any start is a good start" - http://perl.plover.com/yak/testing/samples/

Short presentation illustrate many important concept of unit test - http://www.agitar.com/downloads/TheWayOfTestivus.pdf http://en.wikipedia.org/wiki/Testivus

Argument of not doing TDD will cost more - http://blog.objectmentor.com[..]ave-time-for-tdd-but-may-not-know-it-yet

Automated test or Test automated? - http://googletesting.blogspot.com[..]automating-tests-vs-test-automation.html

IT adventures: Creating a QA process from out of thin air - http://crazy-it-adventures.blogspot.com/2009/06/createing.html

(google search) (amazon search)


Mon Apr 06 01:25:04 HKT 2009 From /weblog/software_engineering/testing

Testometer Triangle Test


This is probably one of the most common question in software testing interview. This problem was first introduced by Myers, who was one of the first person to treat Software Testing as a different subject all together. This test check your ability to think about generating test data in a given condition.
Suppose your program accepts input as three sides of a triangle and gives output on what type of triangle is this i.e. Scalene (no sides are same), Isosceles (any two sides are same) or Equilateral (All the three sides are same). You have to come up with different test cases to test this program.
You can write your test cases here, by giving side of the triangles and evaluate your test data. Once you are done with all the test cases you can think of, check your performance. If you want to restart your test anytime, just click on the restart test button. I have not covered all the possible test cases here as idea is to give you sufficient information to get started.

http://www.testinggeek.com[..]er/154-triangle-test-in-software-testing

(google search) (amazon search)


Thu Feb 26 01:06:56 HKT 2009 From /weblog/software_engineering/testing

functional


Selenium - Here is a video show how to record script using a firefox plugin: http://wiki.openqa.org/display/SIDE/Recording+a+Test (BTW, the plugin link: http://www.openqa.org/selenium-ide/), and here is a blog mentioned how to setup a test server to run batch of script altogather: http://agiletesting.blogspot.com[..]/web-app-testing-with-python-part-2.html

WatiN, alternative of selenium - http://blog.benhall.me.uk[..]2/how-to-unit-test-watin-mbunit-and.html another person saying this is better - http://jchyip.blogspot.com/2008/03/watij-vs-selenium-rc.html

And someone work hard on make FITness and Selenium work togather, more information can be found at http://www.cornetdesign.com[..]m/2006/09/fitnesse-selenium-wrapper.html http://gojko.net[..]ng-web-tests-with-fitnesse-and-selenium/

A story of how to overcome various issues of applying selenium in acceptance testing -http://blogs.atlassian.com[..]07/08/selenium_is_the_pain_worth_it.html

http://mguillem.wordpress.com[..]9/webtest-vs-selenium-webtest-wins-13-5/

http://www.jamesshore.com/Blog/Does-It-Work-Are-We-Done.html Why functional test is important

How much resource should put in functional test? http://c2.com/cgi/wiki?TestFoodPyramid

Kent discuss about how to balance low level unit test and high level functional test - http://www.threeriversinstitute.org/WhereToTest.html

(google search) (amazon search)