[Report]Automated testing of Samba with Windows Protocol Test Suites

[joeg at catalyst.net.nz]

Hi Andreas:

About the tests count, my first result(total 85) is for the KDC category
in Kerberos test suite,

the second result(total 168) is for the whole Kerberos test suite, which
contains a list  of categories including KDC.

So the first one is a subset of the second one.


You can refer to the source code to find out how Microsoft organise them.

Here is the list of test suites:

https://github.com/Microsoft/WindowsProtocolTestSuites/tree/staging/TestSuites

Here is the definition of categories in Kerberos:

https://github.com/Microsoft/WindowsProtocolTestSuites/blob/staging/TestSuites/Kerberos/src/Adapter/TestCategories.cs

And, for each test, it can be grouped into multiple categories, here is
an example:

https://github.com/Microsoft/WindowsProtocolTestSuites/blob/staging/TestSuites/Kerberos/src/TestSuite/KILE/KileCrossRealmTest.cs#L37

Hope this answers your question.


On 05/01/18 00:18, Andreas Schneider wrote:
> On Wednesday, 3 January 2018 21:33:05 CET joeg--- via samba-technical wrote:
>> Hi Andreas:
>>
>> This is the result for Kerberos test suite:
> Hi Joe,
>
> so we have MIT Kerberos:
>  
>> total: 168
>>
>> inconclusive: 5
>>
>> passed: 37
>>
>> failed: 126
> Heimdal Kerberos:
>
>>>> This is the current KDC test result:
>>>>
>>>> total: 85
>>>>
>>>> inconclusive: 3
>>>>
>>>> passed: 32
>>>>
>>>> failed: 50
> Looks like with MIT Kerberos five tests more are passing. Also do you know why 
> with MIT Kerberos it has 168 tests scheduled and with Heimdal just 85?
>
>
>
> 	Andreas
>
>
>
>

-- 
Joe Guo
joeg at catalyst.net.nz
Catalyst IT