CHANGES.txt revision 119
119N/A
119N/ATODO
119N/A :Introduce ITestFactory, deprecate @Factory
119N/A :Introduce Annotation Transformers
119N/A
119N/A===========================================================================
119N/A5.1
119N/A
119N/AAdded: @Test(sequential = true)
119N/AFixed: TESTNG-102 (Incorrect ordering of @BeforeMethod calls when a dependency is specified)
119N/AFixed: TESTNG-101 (HTML output contains nested <P> tags and a missing <tr> tag)
119N/AAdded: support for specifying test-only classpath (http://forums.opensymphony.com/thread.jspa?messageID=78048&tstart=0)
119N/AFixed: TESTNG-93 (method selectors filtering @BeforeMethod)
119N/AFixed: TESTNG-81 (Assert.assertFalse() displays wrong expected, actual value)
119N/AFixed: TESTNG-59 (multiple method selectors usage results in no tests run)
119N/AFixed: TESTNG-56 (invocation of @Before/AfterClass methods in parallel/sequential scenarios)
119N/AFixed: TESTNG-40 (failures suite does not contain @Before/After Suite/Test methods)
119N/AFixed: TESTNG-37 (allow passing null parameter value from testng.xml)
119N/AFixed: TESTNG-7 (display classname when hovering method)
119N/A
119N/A
119N/AEclipse plug-in
119N/A
119N/AAdded: run contextual test classes with parameters from suite definition files
119N/AAdded: TESTNG-100 (Show HTML reports after running tests)
119N/AAdded: TESTNG-97 (Double click top stack to raise comparison)
119N/AAdded: TESTNG-84 (plug-in UI for suite option should support absolute path)
119N/AAdded: TESTNG-20 (copy stack trace)
119N/A
119N/AFixed: TESTNG-72 (display groups with non-array values)
119N/AFixed: TESTNG-64 (Eclipse plug-in applies added groups to all launch configurations)
119N/AFixed: TESTNG-28 (Cannot select groups from dependent eclipse projects)
119N/AFixed: TESTNG-25 (do not display fully qualified method name when running contextual test class)
119N/A
119N/AImproved behavior:
119N/A TESTNG-98 (temporary files have guaranteed fixed names)
119N/A TESTNG-95 (Assertion failed comparison trims trailing ">")
119N/A TESTNG-70 (TestNG prevents eclipse from opening an older CVS version of a java class)
119N/A display of test hierarchy information (TESTNG-29)
119N/A
119N/A===========================================================================
119N/A
119N/A5.0.1
119N/A
119N/AEclipse plug-in
119N/A
119N/AAdded: Output directory for the tests
119N/AAdded: Can now specify listener classes
119N/A
119N/A===========================================================================
119N/A5.0.1
119N/A
119N/AFixed: reports generated by SuiteHTMLReporter do not work with JDK1.4
119N/A
119N/A===========================================================================
119N/A
119N/A5.0
119N/A
119N/AAdded: Ant task: support for JVM, workingDir, timeout
119N/AAdded: Stack traces can be interactively shown in the HTML reports
119N/AAdded: Link to testng.xml in the reports
119N/AAdded: New structure for reports, suites go in their individual directory
119N/AAdded: @Test(suiteName) and @Test(testName)
119N/AAdded: The stack traces in reports do not include TestNG frames (system property testng.exception)
119N/A (see: http://groups.google.com/group/testng-dev/browse_thread/thread/9f4d46ade10b0fda)
119N/AFixed: Exit with error when no methods are run
119N/A (see: http://groups.google.com/group/testng-dev/browse_thread/thread/3c26e8a5658f22ac)
119N/AAdded: List of methods in alphabetical order
119N/AFixed: Class-scoped annotations were not recognized when inherited
119N/AAdded: Deprecated @Configuration and introduced @BeforeSuite/Test/Class/TestMethod
119N/AAdded: Deprecated @ExpectedExceptions and moved it into @Test
119N/AAdded: expectedExceptions to @Test, deprecated @ExpectedExceptions
119N/AAdded: New annotations: @BeforeSuite, @BeforeTest, etc...
119N/AFixed: Was returning an exit code of 0 if a cyclic graph was detected
119N/AAdded: Interface org.testng.ITest so that tests can declare a name
119N/AFixed: The Text reporter was reporting the square of the actual number of methods
119N/AFixed: Bug reported by Eran about dependencies with an afterClass method
119N/AAdded: IHookCallBack now receives the ITestResult in its run() method
119N/AAdded: Name of suite for command line can be set with -Dtestng.suite.name=xxx
119N/AFixed: TestNGAntTask was hardcoding m_haltOnFSP to true
119N/AFixed: Passing a null parameter caused an NPE in the reports
119N/AAdded: "listener" to the ant task (and documentation)
119N/AAdded: if patch-testng-sourcedir.properties is found in the classpath
119N/A with a property "sourcedir" containing a ; separated list of
119N/A directories, this list will override -sourcedir.
119N/A
119N/A===========================================================================
119N/A
119N/A
119N/A4.7
119N/A
119N/AAdded: Maven 2 plug-in
119N/AFixed: Message formattings in TestNG assertion utility class
119N/AFixed: @Factory methods were counted as @Test as well
119N/A http://jira.opensymphony.com/browse/TESTNG-51
119N/AFixed: All DataProvider parameters were shown in the HTML report
119N/AFixed: Bug in testng-failed.xml generation
119N/AFixed: <packages> bug when using a jar file to load the test classes
119N/AAdded: alwaysRun for before @Configuration methods
119N/A http://jira.opensymphony.com/browse/TESTNG-35
119N/AFixed: groupless @Configurations were not invoked if a method depends on a group
119N/A http://jira.opensymphony.com/browse/TESTNG-45
119N/AAdded: beforeGroups/afterGroups to @Configuration
119N/A
119N/AEclipse plugin:
119N/A
119N/AAdded: last contextual launch is available in Eclipse launcher lists
119N/AFixed: 3.2M5 integration (removed dependency on non-existing class)
119N/AFixed: testng-failures.xml generation
119N/A
119N/A===========================================================================
119N/A
119N/A4.6
119N/A
119N/AAdded: Documentation contains the new reports
119N/AAdded: TestNG.setUseDefaultListeners(boolean)
119N/AAdded: Descriptions now appear in TextReporter (verbose>=2) and the HTML reports
119N/AAdded: description attribute to @Test and @Configuration
119N/AAdded: combined Reporter output in the reports
119N/AAdded: methods not run in the reports
119N/AAdded: org.testng.IReporter
119N/AAdded: threadPoolSize to @Test
119N/AAdded: Reports now show relative timings (start at 0)
119N/AAdded: Reports now show different colors depending on the methods' classes
119N/AAdded: Reports now show all parameters used to invoke the test method
119N/AAdded: org.testng.Reporter
119N/AAdded: DataProviders can accept a Method as first parameter
119N/AFixed: Extraneous implicit inclusion of a method
119N/A
119N/AEclipse plugin:
119N/A
119N/AAdded: Run/Debug as TestNG test from the editor contextual menu
119N/AFixed: TESTNG-24: 'Run as testng test' does not appear of the Test annotation does not have a group
119N/AFixed: TESTNG-18: Eclipse plugin ignores Factory annotation
119N/AFixed: TESTNG-21: Show differences when double clicking assertion exceptions
119N/AAdded: UI allows setting orientation (even more space)
119N/A http://forums.opensymphony.com/thread.jspa?threadID=17225&messageID=33805#33805
119N/A
119N/A===========================================================================
119N/A
119N/A4.5
119N/A
119N/ACore:
119N/A
119N/AFixed: Methods were not implicitly included, only groups
119N/AFixed: Bug with failed parent @Configuration don't skip child @Configuration/@Test invocations
119N/AFixed: Bug with overridding @Configuration methods (both parent and child were run)
119N/AFixed: Bug when overriding beforeClass methods in base class (cyclic graph)
119N/AAdded: Support for JAAS (see org.testng.IHookable)
119N/AFixed: Problem with nested classes inside <package name="foo.*"
119N/AFixed: If a group is not found, mark the method as a skip instead of aborting
119N/AFixed: testng-failed.xml was not respecting dependencies
119N/AFixed: class/include method in testng.xml didn't work on default package
119N/AFixed: DTD only allowed one <define>
119N/AFixed: ArrayIndexOutOfBoundsException for jMock
119N/AAdded: dependsOnMethods can contain methods from another class
119N/AFixed: JUnitConverter required -restore, not any more (option is now a no-op)
119N/AFixed: JUnit mode wasn't invoking setName() on test classes
119N/AAdded: Regular expressions for classes in <package>
119N/AAdded: Distributed TestNG
119N/AFixed: Command line parameters and testng.xml are now cumulative
119N/AFixed: Reports now work for multiple suites
119N/AFixed: Was ignoring abstract classes even if they have non-abstract instances
119N/AFixed: If setUp() failed, methods were not skipped
119N/AFixed: Was not clearly indicating when beforeSuite fails
119N/AAdded: @Configuration.inheritGroups
119N/AFixed: inconsistency between testng.xml and objects regarding method selectors
119N/A
119N/AEclipse plug-in:
119N/A
119N/ANew look for the progress view.
119N/A
119N/A===========================================================================
119N/A
119N/A4.4
119N/A
119N/ACore:
119N/A
119N/AFixed: testng-failures.xml was not excluding methods from base classes
119N/AFixed: Bug in suites of suites for JUnit mode
119N/A
119N/A===========================================================================
119N/A
119N/A4.3
119N/A
119N/ACore:
119N/A
119N/AFixed: testng-failures.xml was not excluding methods from base classes
119N/AFixed: Bug in suites of suites for JUnit mode
119N/AAdded: Excluded groups on command line and ant task
119N/AFixed: When including a group, implicitly include groups depended upon
119N/AFixed: When depending on several groups, wasn't skipped if one of them failed
119N/AFixed: Failures weren't reported accurately in the JUnitReports report
119N/AFixed: Wasn't throwing an exception if depending on a non-existing group
119N/A
119N/A===========================================================================
119N/A
119N/A4.2
119N/A
119N/ACore:
119N/A
119N/AFixed: wasn't excluding methods in base classes
119N/AAdded: alwaysRun for tests (soft dependencies)
119N/AFixed: Class-level enabled=false were not honored
119N/AFixed: Bug with multiple dataproviders on same class
119N/AFixed: Bug with dataprovider defined in the parent class
119N/AFixed: Bug with dataprovider defined in a subclass
119N/AFixed: Bug with dataprovider defined in an abstract class
119N/AFixed: testng-failures generation was excluding the methods even if a failed test depended on it
119N/A
119N/A===========================================================================
119N/A
119N/A4.1
119N/A
119N/ACore:
119N/A
119N/AAdded: @DataProviders can return Iterable<Object[]>
119N/AFixed: Superclass test methods were not called in the presence of a class @Test
119N/AAdded: Reporter class to log messages in the HTML reports
119N/A
119N/A===========================================================================
119N/A
119N/A4.0
119N/A
119N/ACore:
119N/A
119N/AFixed: suite methods now invoked only once in a hierarchy
119N/AAdded: @DataProvider and @testng.data-provider
119N/AFixed: Interleave order now respected for before/afterClass methods
119N/AAdded: Can now invoke java -jar testng-2.6.jar <...>
119N/AAdded: Support for BeanShell
119N/AAdded: Method Selectors (IMethodSelector)
119N/AFixed: In the absence of dependencies, @Configuration methods respect inheritance
119N/AFixed: Bug in multithreaded dependencies on methods
119N/AFixed: dependsOnGroups wasn't working on regular expressions
119N/AFixed: Bug in <package> when directories contain spaces in their names
119N/AFixed: Introduced a JDK5 dependency in the JDK1.4 build (getEnclosingClass())
119N/AFixed: Output directory in ant task was not honored if it didn't exist
119N/AFixed: Problem with timeout according to
119N/A http://forums.opensymphony.com/thread.jspa?threadID=6707
119N/A
119N/AEclipse plug-in:
119N/A
119N/AFixed: Wasn't handling linked directories correctly
119N/AFixed: Bug in QuickFix implementation
119N/AAdded: Quick Fix for JUnit conversion (Annotations and JavaDoc)
119N/AFixed: Methods Run as TestNG test
119N/AAdded: Package level Run as TestNG test
119N/AFixed: Resources from the linked directories are using a wrong path when
119N/A passed to command line TestNG
119N/A
119N/AIDEA plug-in:
119N/A
119N/AAdded: Support for JDK 1.4 (both projects and IDEA itself)
119N/AFixed: Classes that contained only configuration were ignored
119N/A
119N/A===========================================================================
119N/A
119N/A2.5
119N/A
119N/AAdded: ITestListener.onTestStart(ITestResult)
119N/AAdded: Support for <packages>
119N/AAdded: Resource files for easier ant taskdefs
119N/AFixed: @Configuration methods were not invoked with individual test methods
119N/AFixed: Bug with ExpectedExceptions
119N/AFixed: Didn't support nested factory classes
119N/AFixed: NPE if -target is omitted with JDK 1.4
119N/AFixed: @Configuration failures in a class would cause other classes to fail
119N/AAdded: alwaysRun
119N/AFixed: beforeTestClass/afterTestClass were broken for a pathological case
119N/AAdded: @Configuration(alwaysRun)
119N/AAdded: JUnitConverter task
119N/AFixed: < and > characters in reports were not escaped
119N/A
119N/AEclipse plug-in:
119N/A
119N/AFixed: Class dialog wasn't showing @Factory classes
119N/A
119N/AIDEA plug-in:
119N/A
119N/AFirst release!
119N/A
119N/ADocumentation:
119N/A
119N/AAdded: Brand new look!!!
119N/AAdded: Section on testng.xml
119N/AFixed: Numbering of sections
119N/A
119N/A===========================================================================
119N/A
119N/A2.4
119N/AChanged: New package: testng.org
119N/AFixed: Bug with @ExpectedException occuring the parallel mode
119N/AFixed: Bug with parameters and beforeTest
119N/AAdded: IInstanceInfo support
119N/AFixed: methods were not excluded when included by groups
119N/AFixed: testng-failures.xml is now including also the beforeSuite/afterSuite methods
119N/AFixed: generating the testng-failures.xml is now working as expected
119N/AFixed: Factories call all the tests even if some of them fail along the way
119N/AFixed: Better JUnit support (wasn't creating individual instances)
119N/AFixed: dependsOnGroups didn't work across different classes
119N/AAdded: command line (and Ant) -groups option
119N/AAdded: @Parameters (and made parameters attribute deprecated)
119N/AAdded: Parameters for constructors
119N/AFixed: Better interleaving of before/afterTestMethods
119N/AFixed: Ant task
119N/AFixed: TestNGException thrown when TestNG conditions are not fulfilled
119N/A
119N/ADocumentation:
119N/A- New assert classes
119N/A- New ways to launch
119N/A- JUnitConverter documentation
119N/A- new beforeSuite/afterSuite
119N/A
119N/A===========================================================================
119N/A
119N/A2.3
119N/A
119N/AFixed: Spaces are now legal in JavaDoc comments
119N/AAdded: documentation for @Factory
119N/AFixed: factories were called multiple times
119N/AAdded: beforeSuite and afterSuite
119N/AFixed: inheritance and scope now working properly for annotations
119N/AFixed: dependsOnMethods wasn't working for 1.4
119N/AAdded: Better stack traces
119N/AAdded: Better syntax for included/excluded methods
119N/AFixed: Better verbose support
119N/AFixed: Various fixes for the Eclipse plug-in
119N/AAdded: Can specify a class name on the command line
119N/AFixed: Default package bug in JUnitConverter
119N/AAdded: Regression tests for JUnitConverter
119N/AAdded: -quiet option to JUnitConverter
119N/A
119N/A===========================================================================
119N/A
119N/A2.2
119N/A
119N/AFixed: Wasn't handling several testng.xml files correctly
119N/AFixed: Renamed -src to -sourcedir
119N/AFixed: Complains if no sourcedir is specified in 1.4
119N/AAdded: In 1.4, don't require annotations="javadoc"
119N/AFixed: If setUp fails, complain and mark test methods as skips
119N/AFixed: Dependent methods weren't working for 1.4
119N/A
119N/A===========================================================================
119N/A
119N/A2.1
119N/A
119N/AAdded: Parser can accept an InputStream for testng.xml
119N/AFixed: expected-exceptions now fails if test passes
119N/AFixed: reports now use the suite name in HTML
119N/AAdded: invocationCount and successPercentage
119N/AAdded: dependsOnMethods
119N/AAdded: timeOut works in non-parallel mode
119N/A
119N/A===========================================================================
119N/A
119N/A2.0
119N/A
119N/AAdded: port on JDK 1.4
119N/A
119N/A===========================================================================
119N/A
119N/A1.3
119N/A
119N/AAdded: new view: classes (still experimental)
119N/AAdded: timeout on methods
119N/AAdded: thread-count
119N/AAdded: TestNG is now multithread, see "parallel" in <suite>
119N/A
119N/A===========================================================================
119N/A
119N/A1.2
119N/A
119N/AAdded: JUnitConverter
119N/AFixed: Bug with afterClasses (test: AfterClassCalledAtTheEnd)
119N/A
119N/A===========================================================================
119N/A
119N/A1.1
119N/A
119N/AAdded: new links for methods and groups in the HTML report
119N/AAdded: <methods>
119N/AAdded: <fileset> to <testng>
119N/A
119N/A===========================================================================
119N/A
119N/A1.0
119N/A
119N/AFixed: Updated to the new DTD
119N/AFixed: Suite table of contents displays failures first
119N/AFixed: Bug in afterTestClass
119N/AAdded: Validating testng.xml
119N/AAdded: Scoped parameters
119N/AAdded: testng.xml
119N/ARemoved: Property quiet
119N/AChanged: Verbose is now an integer
119N/AAdded: Dependent methods
119N/A
119N/A===========================================================================
119N/A
119N/A0.9
119N/A
119N/AAdded: Groups of groups
119N/AAdded: Groups for Configuration methods
119N/AAdded: Parameters
119N/A
119N/A===========================================================================
119N/A
119N/A0.2
119N/A
119N/AFixed: Merged TestMethod and TestClass into Test
119N/AAdded: HTML report
119N/AAdded: Regexps for groups
119N/AFixed: Inheritance of methods
119N/AFixed: ExpectedException is now called ExpectedExceptions