[REPORT] Performance Test Samba vs Windows
joeg at catalyst.net.nz
joeg at catalyst.net.nz
Mon May 14 03:45:58 UTC 2018
Oops, get wrapped. Attach the table in a text file this time.
On 14/05/18 15:38, joeg--- via samba-technical wrote:
> It seems like some people have trouble to receive my original email
> because of the images.
>
> This is the text version:
>
>
> ubuntu at wpts-s1-traffic-runner:~/samba$ python summary.py
> r\S 1 2 3 4 5 6
> 7 8 9 10 11 12
> 1 0 0 0 0 0 0
> 0 0 0 0 0 0
> 2 0 0 0 0 0 0
> 0 0 0 0 0 0
> 3 0 0 0 0 0 0
> 0 0 0 0 0 0
> 4 0 0 0 41.119 56.732 66.447 72.572
> 76.956 95.436 102.396 110.454 0
> 5 0 0 0 49.145 70.014 74.849 84.013
> 89.707 107.108 116.287 103.106 0
> 6 0 0 0 68.731 78.698 93.159 95.705
> 115.973 114.349 112.678 130.282 0
> 7 0 0 0 71.490 85.902 108.542 108.586
> 113.590 126.788 119.140 101.968 0
> 8 0 0 0 84.228 103.297 112.420 108.141
> 112.146 125.492 109.455 101.155 0
> 9 0 0 0 88.669 111.279 121.480 121.692
> 138.248 115.464 131.850 98.632 0
> 10 0 0 0 107.833 115.134 126.926 132.568
> 116.088 136.371 97.090 126.787 0
> 11 0 0 0 114.108 111.883 126.213 139.040
> 141.352 106.134 124.904 118.583 0
> 12 0 0 0 109.988 120.804 142.387 133.999
> 124.241 131.333 107.382 111.447 0
> 13 0 0 0 133.787 115.635 135.760 144.311
> 113.029 109.257 124.848 135.680 0
> 14 0 0 0 142.868 118.900 139.201 131.333
> 132.071 113.330 116.351 118.728 0
> 15 0 0 0 124.355 132.024 146.237 130.092
> 107.181 125.418 121.196 126.104 0
> 16 0 0 0 123.211 140.214 135.858 109.205
> 146.865 137.027 111.136 121.051 0
> 17 0 0 0 120.864 149.945 116.799 147.768
> 119.295 126.733 119.915 107.164 0
> 18 0 0 0 140.311 138.099 108.622 126.043
> 127.352 143.128 134.762 93.017 0
> 19 0 0 0 145.346 133.715 120.586 139.703
> 120.015 118.425 83.349 106.214 0
> 20 0 0 0 144.652 130.634 110.613 123.414
> 151.610 135.753 93.042 85.515 0
> 21 0 0 0 131.350 122.082 121.926 146.542
> 132.719 126.720 120.016 91.363 0
> 22 0 0 0 140.259 146.325 129.648 142.637
> 142.712 132.569 124.193 84.189 0
> 23 0 0 0 *169.764 139.553 91.046 137.663
> 159.753 138.276 102.191 110.595 0
> 24 0 0 0 148.510 142.059 141.010 137.082
> 98.231 96.259 109.009 69.462 0
> 25 0 0 0 0 0 0
> 0 0 0 0 0 0
>
> max: 169.764
>
>
> ubuntu at wpts-s1-traffic-runner-win1:~/samba$ python summary.py
> r\S 1 2 3 4 5 6
> 7 8 9 10 11 12
> 1 0 0 0 0 0 0
> 0 0 0 0 0 0
> 2 0 0 0 0 0 0
> 0 0 0 0 0 0
> 3 0 0 0 0 0 0
> 0 0 0 0 0 0
> 4 0 0 0 37.499 51.081 47.946 78.658
> 73.416 92.505 95.842 100.820 0
> 5 0 0 0 55.603 57.470 74.442 86.191
> 113.089 111.861 115.396 142.818 0
> 6 0 0 0 58.732 85.243 92.833 102.397
> 108.455 136.802 134.110 136.791 0
> 7 0 0 0 66.669 91.372 100.347 132.541
> 159.121 137.524 166.432 131.660 0
> 8 0 0 0 76.959 113.768 130.787 148.635
> 140.318 155.053 185.398 172.079 0
> 9 0 0 0 104.442 124.219 135.548 156.073
> 159.233 161.505 165.132 111.609 0
> 10 0 0 0 121.444 128.814 170.306 172.741
> 173.592 155.078 137.541 160.373 0
> 11 0 0 0 119.806 147.530 171.919 175.189
> 156.816 189.379 176.344 155.873 0
> 12 0 0 0 103.682 145.108 174.202 172.044
> 206.165 129.995 157.405 150.218 0
> 13 0 0 0 151.011 151.274 172.072 189.949
> 161.779 176.042 137.990 140.948 0
> 14 0 0 0 146.589 166.755 213.144 189.248
> 166.505 145.031 138.344 150.909 0
> 15 0 0 0 149.442 190.469 200.051 160.482
> 143.324 151.437 141.908 130.576 0
> 16 0 0 0 173.891 202.137 204.066 172.500
> 176.371 166.698 127.024 141.724 0
> 17 0 0 0 170.829 180.184 196.766 181.791
> 147.663 155.474 99.551 127.230 0
> 18 0 0 0 188.009 191.858 155.009 172.549
> 147.957 152.508 124.296 129.689 0
> 19 0 0 0 201.694 225.261 190.230 157.619
> 152.969 136.545 130.671 125.775 0
> 20 0 0 0 203.151 209.354 165.844 166.927
> 141.296 140.057 139.265 125.006 0
> 21 0 0 0 212.496 217.526 171.679 168.568
> 168.101 145.787 111.281 106.252 0
> 22 0 0 0 184.216 *235.421 180.842 156.551
> 158.798 149.434 115.148 113.642 0
> 23 0 0 0 201.699 210.266 191.049 153.199
> 153.461 110.562 110.072 112.646 0
> 24 0 0 0 222.205 150.690 155.598 176.060
> 137.402 123.665 115.973 106.362 0
> 25 0 0 0 0 0 0
> 0 0 0 0 0 0
>
> max: 235.421
>
>
> And I should mention that Samba is running in prefork mode in this test:
>
> sudo bin/samba -M prefork --option='prefork children = 4'
>
>
> On 14/05/18 15:16, Garming Sam via samba-technical wrote:
>> There's some interesting observations that you can make about the
>> overall traffic, without looking at too much detail of the actual runs.
>>
>> 1) In terms of maximum traffic (which in our examples has been quite
>> LDAP based), Windows is at most 50% faster. This number likely shrinks
>> depending on whether or not the service levels (e.g. 99% success) at
>> such high load are acceptable or not.
>>
>> 2) Looking at median packet response times, we generally spend twice as
>> long on processing a packet. However, the difference between our 95
>> percentile values is often much smaller than this and some of the mean
>> values are actually at parity.
>>
>> 3) With small to moderate loads, Samba handles a similar amount of
>> operations per second to Windows. For the values shown, it actually
>> seems to get more throughput (although not incredibly so) for a good
>> chunk of the table shown.
>>
>> It's actually kind of surprising that Samba doesn't perform all that
>> much worse than Windows does. It's certainly not off by an order of
>> magnitude (or two), although this testing has been run in the prefork
>> mode. Our previous analyses showed much smaller numbers and that's
>> likely due to the limitations of being stuck with a single-process.
>>
>>
>> Cheers,
>>
>> Garming
>>
>> On 14/05/18 14:45, joeg at catalyst.net.nz wrote:
>>> Hi Team,
>>>
>>> I've been trying to make the Samba performance test tool work against
>>> Windows.
>>>
>>> After a lot of effort, Garming and I fixed all the errors for
>>> different packets, and finally it's working(fixes are merged into master).
>>>
>>> Base on that, we can send traffic to Samba and Windows, get the
>>> maximum load, and compare the performance.
>>>
>>> An example of the command I was using:
>>>
>>>
>>> script/traffic_replay -U Administrator%PASSWORD --realm
>>> krb.samba.site --workgroup KRB --fixed-password FIXED-PASSWORD -r 4 -S
>>> 4 traffic-sample-1-model.txt dc1.krb.samba.site 2>&1 >
>>> traffic_replay_stats/dc1_r4_S4.txt
>>>
>>>
>>> By changing the combination of different -r and -S, we can get test
>>> results and save to files, then parse files to get summary tables as
>>> below.
>>>
>>> The number displayed is "*Successful operations per s**econd*", the 0
>>> ones are combinations we think not important and skipped.
>>>
>>>
>>> Test Result for Samba (master code on 2018.05.11):
>>>
>>>
>>>
>>> Test Result for Windows Server 2012r2:
>>>
>>>
>>>
>>>
>>> I am running the test with 4 servers in Catalyst Cloud which is Openstack:
>>>
>>>
>>>
>>> All data are attached, hope this can help the team to understand how
>>> is Samba performing with compare to Windows.
>>> --
>>> Joe Guo
>>> joeg at catalyst.net.nz
>>> Catalyst IT
--
Joe Guo
joeg at catalyst.net.nz
Catalyst IT
-------------- next part --------------
Samba:
ubuntu at wpts-s1-traffic-runner:~/samba$ python summary.py
r\S 1 2 3 4 5 6 7 8 9 10 11 12
1 0 0 0 0 0 0 0 0 0 0 0 0
2 0 0 0 0 0 0 0 0 0 0 0 0
3 0 0 0 0 0 0 0 0 0 0 0 0
4 0 0 0 41.119 56.732 66.447 72.572 76.956 95.436 102.396 110.454 0
5 0 0 0 49.145 70.014 74.849 84.013 89.707 107.108 116.287 103.106 0
6 0 0 0 68.731 78.698 93.159 95.705 115.973 114.349 112.678 130.282 0
7 0 0 0 71.490 85.902 108.542 108.586 113.590 126.788 119.140 101.968 0
8 0 0 0 84.228 103.297 112.420 108.141 112.146 125.492 109.455 101.155 0
9 0 0 0 88.669 111.279 121.480 121.692 138.248 115.464 131.850 98.632 0
10 0 0 0 107.833 115.134 126.926 132.568 116.088 136.371 97.090 126.787 0
11 0 0 0 114.108 111.883 126.213 139.040 141.352 106.134 124.904 118.583 0
12 0 0 0 109.988 120.804 142.387 133.999 124.241 131.333 107.382 111.447 0
13 0 0 0 133.787 115.635 135.760 144.311 113.029 109.257 124.848 135.680 0
14 0 0 0 142.868 118.900 139.201 131.333 132.071 113.330 116.351 118.728 0
15 0 0 0 124.355 132.024 146.237 130.092 107.181 125.418 121.196 126.104 0
16 0 0 0 123.211 140.214 135.858 109.205 146.865 137.027 111.136 121.051 0
17 0 0 0 120.864 149.945 116.799 147.768 119.295 126.733 119.915 107.164 0
18 0 0 0 140.311 138.099 108.622 126.043 127.352 143.128 134.762 93.017 0
19 0 0 0 145.346 133.715 120.586 139.703 120.015 118.425 83.349 106.214 0
20 0 0 0 144.652 130.634 110.613 123.414 151.610 135.753 93.042 85.515 0
21 0 0 0 131.350 122.082 121.926 146.542 132.719 126.720 120.016 91.363 0
22 0 0 0 140.259 146.325 129.648 142.637 142.712 132.569 124.193 84.189 0
23 0 0 0 *169.764 139.553 91.046 137.663 159.753 138.276 102.191 110.595 0
24 0 0 0 148.510 142.059 141.010 137.082 98.231 96.259 109.009 69.462 0
25 0 0 0 0 0 0 0 0 0 0 0 0
max: 169.764
Windows:
ubuntu at wpts-s1-traffic-runner-win1:~/samba$ python summary.py
r\S 1 2 3 4 5 6 7 8 9 10 11 12
1 0 0 0 0 0 0 0 0 0 0 0 0
2 0 0 0 0 0 0 0 0 0 0 0 0
3 0 0 0 0 0 0 0 0 0 0 0 0
4 0 0 0 37.499 51.081 47.946 78.658 73.416 92.505 95.842 100.820 0
5 0 0 0 55.603 57.470 74.442 86.191 113.089 111.861 115.396 142.818 0
6 0 0 0 58.732 85.243 92.833 102.397 108.455 136.802 134.110 136.791 0
7 0 0 0 66.669 91.372 100.347 132.541 159.121 137.524 166.432 131.660 0
8 0 0 0 76.959 113.768 130.787 148.635 140.318 155.053 185.398 172.079 0
9 0 0 0 104.442 124.219 135.548 156.073 159.233 161.505 165.132 111.609 0
10 0 0 0 121.444 128.814 170.306 172.741 173.592 155.078 137.541 160.373 0
11 0 0 0 119.806 147.530 171.919 175.189 156.816 189.379 176.344 155.873 0
12 0 0 0 103.682 145.108 174.202 172.044 206.165 129.995 157.405 150.218 0
13 0 0 0 151.011 151.274 172.072 189.949 161.779 176.042 137.990 140.948 0
14 0 0 0 146.589 166.755 213.144 189.248 166.505 145.031 138.344 150.909 0
15 0 0 0 149.442 190.469 200.051 160.482 143.324 151.437 141.908 130.576 0
16 0 0 0 173.891 202.137 204.066 172.500 176.371 166.698 127.024 141.724 0
17 0 0 0 170.829 180.184 196.766 181.791 147.663 155.474 99.551 127.230 0
18 0 0 0 188.009 191.858 155.009 172.549 147.957 152.508 124.296 129.689 0
19 0 0 0 201.694 225.261 190.230 157.619 152.969 136.545 130.671 125.775 0
20 0 0 0 203.151 209.354 165.844 166.927 141.296 140.057 139.265 125.006 0
21 0 0 0 212.496 217.526 171.679 168.568 168.101 145.787 111.281 106.252 0
22 0 0 0 184.216 *235.421 180.842 156.551 158.798 149.434 115.148 113.642 0
23 0 0 0 201.699 210.266 191.049 153.199 153.461 110.562 110.072 112.646 0
24 0 0 0 222.205 150.690 155.598 176.060 137.402 123.665 115.973 106.362 0
25 0 0 0 0 0 0 0 0 0 0 0 0
max: 235.421
More information about the samba-technical
mailing list