Known bug in testset

Documentation not stable yet.

A extension may be tested and contain definition collection of testsets. The test is Same only if all Definition extension testset belonging to that extension are tested and are Same.

Contents 1 Testresult of a extension 1.1 Example 2 Not allways desired 3 Known bug 4 Result of testing the extension 4.1 Example

Testresult of a extension

Example

1. If there are 10 testsets for a extension and all testsets are Same then the extension is tested Same
2. If there are 10 testsets for a extension and 9 testsets are Same and 1 testset does Differ then the collection of testsets does Differ.

Not allways desired

But it may happen that a specific testset does not work as expected and Differ. For the extension user it may be annoying but acceptable. The only way to make this extension runs Same for all testset is remove this testset. This is a pitty because valuable information get lost.

Known bug

When a testset fails, but this is acceptable by the extension user it may be marked Known bug in testset". When using wikipages as testsets this will be a category.

Result of testing the extension

Example

1. If there are 10 testsets for a extension and 9 testsets are Same and 1 testset does Differ then the collection of testsets does span style="color:red">Differ.
2. If there are 10 testsets for a extension and 9 testsets are Same and 1 testset does Differ but have the mark Known bug then the result of the collection of testsets is :

Overall : <span style="color:green">Same</span>
1 <span style="color:red">Differ</span> with know bug in :
testset XXX

1. If there are 10 testsets for a extension and 10 testsets are Same and 1 testset does the mark Known bug in testset but does not differ anymore then the result of the collection of testsets is :

Overall : <span style="color:green">Same</span>
1 <span style="color:green">Same</span> but still marked as know bug in :
testset XXX