- Graviton3-test-report - lists.linaro.org

Linux Kernel v6.10 vs v6.9 Performance Testing Results

by konstantin.belov＠linaro.org

Hello, Performance evaluation of Linux Kernel v6.10 is finished. Comparison is done to baseline Linux Kernel version: v6.9. The following configuration was used for all targets: - Instance CPU: graviton3 - Number of cores: 2 - RAM size, GB: 7.6 - OS: Debian Linux 12 (bookworm) Regressions by test Benchmark/Test/Metric, units | Baseline Mean | Current Mean | Diff, % | SD | Confidence interval ------------------------------------------------------------------------------------------------------------------------------------------------------ aim9/brk_test/System Memory Allocations, OPS | 2024031.020 | 1971348.765 | 2.642 | 15981.304 | 2025399.286 / 2031124.707 aim9/disk_cp/Disk Copies, OPS | 702706.835 | 671075.747 | 4.366 | 19063.338 | 698285.885 / 705092.986 aim9/disk_rr/Read operations, OPS | 596150.100 | 564453.565 | 5.137 | 16197.472 | 592002.596 / 597703.321 aim9/disk_rw/Write operations, OPS | 570349.455 | 541951.825 | 4.909 | 13784.275 | 567411.007 / 572259.048 aim9/disk_src/Directory Searches, OPS | 138168.938 | 135014.312 | 2.261 | 894.343 | 138010.228 / 138326.856 aim9/disk_wrt/Sequential Disk Writes, OPS | 1118581.885 | 1034308.093 | 7.889 | 33193.254 | 1116935.783 / 1128865.426 aim9/page_test/System Allocations & Pages, OPS | 572948.228 | 514986.665 | 10.291 | 14810.463 | 570258.256 / 575523.875 stressng/af-alg/Crypto Operations, OPS - af-alg-1 | 5164.675 | 4950.320 | 4.088 | 132.075 | 5133.983 / 5195.494 - af-alg-2 | 9686.665 | 9485.945 | 2.180 | 351.044 | 9622.321 / 9786.543 - af-alg-4 | 10236.295 | 9939.305 | 2.699 | 228.442 | 10179.286 / 10284.837 - af-alg-8 | 10366.020 | 10040.460 | 2.973 | 278.439 | 10294.060 / 10422.874 - af-alg-16 | 10606.775 | 10187.315 | 3.785 | 220.383 | 10529.211 / 10629.636 - af-alg-32 | 11204.950 | 10653.275 | 4.869 | 276.255 | 11135.362 / 11263.346 - af-alg-64 | 12125.135 | 11624.545 | 4.003 | 301.317 | 12047.239 / 12188.945 - af-alg-128 | 12970.840 | 12550.495 | 3.173 | 349.765 | 12884.449 / 13048.155 stressng/bad-altstack/Error Rate, errors/s - bad-altstack-1 | 3762.400 | 3806.550 | 1.240 | 81.798 | 3739.397 / 3777.322 - bad-altstack-4 | 6587.710 | 6687.025 | 1.584 | 192.744 | 6540.752 / 6630.084 - bad-altstack-32 | 6420.985 | 6519.595 | 1.634 | 217.020 | 6364.417 / 6464.764 - bad-altstack-64 | 6302.420 | 6384.260 | 1.407 | 247.458 | 6238.005 / 6352.318 - bad-altstack-128 | 6085.475 | 6216.385 | 2.147 | 235.878 | 6027.545 / 6136.103 stressng/context/Context Switches, switches/s - context-1 | 2413.745 | 2263.620 | 6.226 | 5.545 | 2411.896 / 2416.531 - context-2 | 4841.600 | 4533.660 | 6.330 | 8.553 | 4836.248 / 4843.247 - context-4 | 4752.505 | 4476.875 | 5.562 | 56.213 | 4716.018 / 4762.479 - context-8 | 4753.285 | 4491.420 | 5.388 | 42.188 | 4727.050 / 4762.047 - context-16 | 4753.605 | 4489.815 | 5.580 | 26.756 | 4739.978 / 4762.315 - context-32 | 4756.705 | 4499.645 | 5.255 | 42.255 | 4729.208 / 4764.696 - context-64 | 4759.445 | 4504.835 | 5.227 | 46.395 | 4731.720 / 4770.681 - context-128 | 4814.425 | 4541.760 | 5.477 | 43.430 | 4784.792 / 4820.034 stressng/get/Read Throughput, MB/s - get-1 | 2828.900 | 2794.095 | 1.069 | 41.018 | 2814.349 / 2833.252 - get-4 | 2878.250 | 2832.150 | 1.505 | 83.756 | 2853.293 / 2892.078 - get-8 | 3096.580 | 3053.180 | 1.523 | 66.413 | 3074.655 / 3105.807 - get-16 | 3045.695 | 3005.570 | 1.186 | 87.911 | 3018.373 / 3058.932 - get-32 | 2978.230 | 2945.090 | 1.150 | 86.859 | 2951.986 / 2992.572 - get-64 | 2948.340 | 2901.570 | 1.516 | 78.343 | 2928.063 / 2964.172 - get-128 | 2937.790 | 2900.980 | 1.314 | 78.724 | 2914.902 / 2951.766 stressng/getdent/Read Throughput, MB/s - getdent-1 | 87967.663 | 84103.515 | 4.357 | 1127.153 | 87720.446 / 88154.951 - getdent-2 | 152377.763 | 146399.800 | 3.916 | 1206.968 | 152098.458 / 152568.043 - getdent-4 | 148489.635 | 143262.375 | 3.494 | 1578.436 | 148114.610 / 148737.820 - getdent-8 | 147962.622 | 143254.745 | 3.185 | 1514.188 | 147638.878 / 148227.931 - getdent-16 | 147484.495 | 143078.785 | 2.998 | 1671.056 | 147139.074 / 147788.277 - getdent-32 | 147146.335 | 142453.715 | 3.192 | 1706.258 | 146754.026 / 147420.476 - getdent-64 | 146121.867 | 141403.570 | 3.231 | 1415.987 | 145805.917 / 146358.295 - getdent-128 | 145466.773 | 140410.075 | 3.500 | 1348.685 | 145195.427 / 145723.931 stressng/madvise/Access calls, OPS - madvise-1 | 39.925 | 37.470 | 6.318 | 0.901 | 39.713 / 40.058 - madvise-2 | 77.400 | 73.310 | 5.292 | 2.653 | 76.827 / 77.837 - madvise-4 | 87.550 | 82.705 | 5.689 | 1.662 | 87.284 / 87.913 - madvise-8 | 88.070 | 82.650 | 8.804 | 1.859 | 87.747 / 88.448 - madvise-16 | 87.235 | 81.845 | 6.242 | 1.978 | 86.897 / 87.657 - madvise-32 | 86.300 | 80.725 | 6.852 | 1.805 | 86.000 / 86.681 - madvise-64 | 85.615 | 80.340 | 6.384 | 1.923 | 85.292 / 86.019 - madvise-128 | 84.730 | 78.940 | 6.878 | 1.741 | 84.431 / 85.105 stressng/vm-splice/Transfer Rate, MB/s - vm-splice-1 | 393962.125 | 360630.090 | 8.450 | 1375.412 | 393558.782 / 394196.428 - vm-splice-2 | 985842.100 | 921596.990 | 6.512 | 3171.138 | 984969.357 / 986440.978 - vm-splice-4 | 1112662.825 | 1065436.700 | 4.321 | 4974.978 | 1111706.780 / 1114036.447 - vm-splice-8 | 1196704.405 | 1155576.555 | 3.424 | 5363.710 | 1195216.144 / 1197690.108 - vm-splice-16 | 1241430.610 | 1203981.285 | 3.003 | 5841.721 | 1239878.679 / 1242620.163 - vm-splice-32 | 1243408.735 | 1205273.090 | 3.080 | 5133.764 | 1242249.597 / 1244636.200 - vm-splice-64 | 1241989.475 | 1205714.570 | 4.921 | 5385.394 | 1240624.117 / 1243141.203 - vm-splice-128 | 1248649.105 | 1211778.420 | 2.994 | 6197.063 | 1247253.689 / 1250174.078 wis/context_switch1-threads/Mutex Ops, OPS | 1043198.500 | 1033264.000 | 0.983 | 15769.853 | 1037771.710 / 1047614.205 wis/eventfd1-threads/Eventfd, OPS - eventfd1-threads-2 | 3691094.500 | 3611879.500 | 2.135 | 4620.901 | 3688821.053 / 3691604.814 - eventfd1-threads-5 | 3696887.250 | 3618277.000 | 2.135 | 7956.267 | 3694490.667 / 3699338.543 - eventfd1-threads-8 | 3695939.000 | 3619874.500 | 2.060 | 9501.408 | 3692775.004 / 3698644.467 - eventfd1-threads-12 | 3699411.250 | 3624443.500 | 2.089 | 5301.489 | 3698395.896 / 3701576.532 - eventfd1-threads-21 | 3702116.500 | 3620887.500 | 2.189 | 7321.327 | 3699159.098 / 3703668.078 - eventfd1-threads-30 | 3701632.750 | 3623844.000 | 2.104 | 4649.785 | 3700169.216 / 3703039.233 - eventfd1-threads-48 | 3704471.000 | 3625261.500 | 2.160 | 5273.453 | 3702099.157 / 3705296.741 - eventfd1-threads-79 | 3699755.000 | 3623403.500 | 2.084 | 6352.434 | 3697209.069 / 3701058.307 - eventfd1-threads-110 | 3697941.250 | 3621659.000 | 2.053 | 5922.402 | 3696141.769 / 3699759.580 - eventfd1-threads-128 | 3759892.250 | 3679477.500 | 2.119 | 15690.578 | 3754286.792 / 3763928.994 wis/futex1-threads/Futex, OPS - futex1-threads-2 | 7331384.000 | 6826139.000 | 6.857 | 19642.783 | 7320746.815 / 7332575.805 - futex1-threads-5 | 7345486.500 | 6834169.500 | 6.944 | 18849.538 | 7338437.798 / 7350165.390 - futex1-threads-8 | 7345137.750 | 6842295.000 | 6.765 | 37983.921 | 7324505.779 / 7347552.519 - futex1-threads-12 | 7355575.500 | 6839910.000 | 7.011 | 11125.573 | 7351157.894 / 7358024.775 - futex1-threads-21 | 7361320.500 | 6843891.000 | 7.024 | 9466.763 | 7356603.803 / 7362371.236 - futex1-threads-30 | 7359961.000 | 6850677.000 | 6.917 | 7729.312 | 7356992.792 / 7361746.928 - futex1-threads-48 | 7351592.500 | 6850642.500 | 6.867 | 6461.848 | 7351363.838 / 7355325.955 - futex1-threads-79 | 7358242.000 | 6849112.500 | 6.928 | 11973.766 | 7353991.141 / 7361341.412 - futex1-threads-110 | 7354987.000 | 6843735.000 | 6.961 | 7643.182 | 7351877.969 / 7356511.297 - futex1-threads-128 | 7488506.000 | 6967984.000 | 6.962 | 27867.865 | 7475166.954 / 7492136.886 wis/futex2-threads/Futex, OPS - futex2-threads-2 | 6439415.000 | 6069072.500 | 5.720 | 14991.436 | 6430748.186 / 6440079.601 - futex2-threads-5 | 6449443.750 | 6080318.500 | 5.364 | 74947.282 | 6400971.050 / 6446224.400 - futex2-threads-8 | 6460301.750 | 6087438.000 | 5.766 | 12960.529 | 6455203.441 / 6463071.691 - futex2-threads-12 | 6461225.500 | 6090392.000 | 5.722 | 16174.516 | 6452916.826 / 6462717.041 - futex2-threads-21 | 6460055.250 | 6092776.500 | 5.704 | 8811.087 | 6457086.681 / 6462442.051 - futex2-threads-30 | 6466882.250 | 6090484.500 | 5.856 | 5501.198 | 6464483.709 / 6467871.564 - futex2-threads-48 | 6467698.500 | 6091584.000 | 5.915 | 10942.337 | 6460849.920 / 6467543.504 - futex2-threads-79 | 6464392.750 | 6088131.500 | 5.794 | 10348.639 | 6459012.148 / 6465347.706 - futex2-threads-110 | 6462639.750 | 6088138.000 | 5.792 | 6179.592 | 6460489.131 / 6464307.372 - futex2-threads-128 | 6569593.000 | 6190756.500 | 5.766 | 29951.831 | 6556913.671 / 6575176.689 wis/futex3-threads/Futex, OPS - futex3-threads-2 | 9382908.500 | 8984432.000 | 4.219 | 14419.002 | 9376245.645 / 9385091.062 - futex3-threads-5 | 9393108.500 | 9007226.500 | 4.086 | 24800.732 | 9384118.746 / 9399148.277 - futex3-threads-8 | 9410893.750 | 9011010.000 | 4.250 | 19601.712 | 9403034.945 / 9414886.634 - futex3-threads-12 | 9412522.250 | 9020257.000 | 4.251 | 22854.990 | 9400484.240 / 9414496.146 - futex3-threads-21 | 9415376.500 | 9024097.500 | 4.208 | 11577.181 | 9411172.535 / 9418189.545 - futex3-threads-30 | 9408300.500 | 9021776.000 | 4.100 | 16189.516 | 9402341.044 / 9412289.579 - futex3-threads-48 | 9369011.750 | 8976510.500 | 4.041 | 119035.789 | 9308324.969 / 9380702.737 - futex3-threads-79 | 9419871.250 | 9024055.000 | 4.332 | 9673.762 | 9417345.869 / 9423435.956 - futex3-threads-110 | 9421860.250 | 9025995.500 | 4.183 | 9375.712 | 9416954.271 / 9422770.027 - futex3-threads-128 | 9585034.750 | 9153532.000 | 4.497 | 35227.549 | 9567322.246 / 9588839.044 wis/futex4-threads/Futex, OPS - futex4-threads-2 | 7893564.750 | 7677390.500 | 2.713 | 12639.586 | 7886731.607 / 7894370.553 - futex4-threads-5 | 7901604.500 | 7696649.500 | 2.577 | 16861.605 | 7896655.449 / 7906873.973 - futex4-threads-8 | 7904723.500 | 7692989.500 | 3.742 | 23607.962 | 7893452.338 / 7908060.245 - futex4-threads-12 | 7921845.000 | 7707831.000 | 2.716 | 10639.182 | 7917309.814 / 7923749.233 - futex4-threads-21 | 7916875.750 | 7704176.000 | 2.745 | 8378.886 | 7914439.335 / 7919572.859 - futex4-threads-30 | 7916309.250 | 7707303.500 | 2.638 | 11055.392 | 7912316.315 / 7919098.152 - futex4-threads-48 | 7918489.250 | 7703435.500 | 2.765 | 14478.658 | 7911478.668 / 7920348.046 - futex4-threads-79 | 7907508.250 | 7704413.000 | 2.552 | 13801.388 | 7901134.967 / 7909552.184 - futex4-threads-110 | 7921016.500 | 7706606.000 | 2.709 | 7548.079 | 7918937.241 / 7923524.734 - futex4-threads-128 | 8050113.500 | 7828337.500 | 2.766 | 30601.526 | 8038553.358 / 8057145.229 wis/getppid1-threads/getppid Calls, OPS - getppid1-threads-2 | 10375945.250 | 9814233.500 | 5.386 | 18753.455 | 10367320.952 / 10378673.163 - getppid1-threads-5 | 10390054.250 | 9828461.500 | 5.390 | 23406.663 | 10380959.166 / 10395253.390 - getppid1-threads-8 | 10396742.000 | 9859442.500 | 5.170 | 24886.144 | 10387208.621 / 10402331.140 - getppid1-threads-12 | 10414925.750 | 9852053.000 | 5.436 | 14847.800 | 10408246.921 / 10417248.382 - getppid1-threads-21 | 10412924.250 | 9846726.000 | 5.438 | 12270.329 | 10408172.414 / 10415666.353 - getppid1-threads-30 | 10414844.250 | 9851879.500 | 5.392 | 13281.828 | 10408733.765 / 10416798.373 - getppid1-threads-48 | 10412120.500 | 9851284.500 | 5.376 | 24083.090 | 10400557.956 / 10414904.304 - getppid1-threads-79 | 10418012.250 | 9854536.000 | 5.410 | 10337.716 | 10414308.921 / 10420688.545 - getppid1-threads-110 | 10409186.250 | 9853279.500 | 5.139 | 53431.670 | 10369783.901 / 10402366.473 - getppid1-threads-128 | 10596017.750 | 10014438.000 | 5.481 | 39978.839 | 10577778.959 / 10602346.265 wis/pipe1-threads/Pipe, OPS - pipe1-threads-2 | 2953808.000 | 2840522.500 | 3.951 | 32265.170 | 2947407.479 / 2967321.314 - pipe1-threads-5 | 2902003.750 | 2836582.000 | 2.325 | 35961.675 | 2891530.044 / 2913285.006 - pipe1-threads-8 | 2902555.250 | 2827880.500 | 2.624 | 38328.801 | 2891034.446 / 2914572.513 - pipe1-threads-12 | 2893482.250 | 2835518.500 | 2.185 | 37131.352 | 2884534.266 / 2907027.406 - pipe1-threads-21 | 2898269.500 | 2806138.000 | 3.225 | 38567.680 | 2888080.935 / 2911830.839 - pipe1-threads-30 | 2893691.750 | 2808611.000 | 3.447 | 37063.065 | 2886480.201 / 2909074.341 - pipe1-threads-48 | 2897777.250 | 2805968.000 | 3.197 | 36639.153 | 2887361.032 / 2909684.424 - pipe1-threads-79 | 2899279.250 | 2819372.000 | 2.756 | 36845.516 | 2888030.768 / 2910695.763 - pipe1-threads-110 | 2884872.250 | 2798108.000 | 2.933 | 51646.569 | 2866460.306 / 2897588.144 - pipe1-threads-128 | 2910726.750 | 2824520.000 | 2.964 | 42884.068 | 2897061.333 / 2923366.245 wis/pthread_mutex1-threads/Mutex, OPS | 14964128.250 | 14084219.000 | 4.497 | 967263.602 | 14420416.666 / 15012074.144 wis/sched_yield-threads/Context Switches, OPS - sched_yield-threads-2 | 5376383.250 | 4841080.000 | 9.945 | 8528.420 | 5371868.174 / 5377040.460 - sched_yield-threads-5 | 2803251.000 | 2643919.500 | 5.934 | 44282.527 | 2789631.074 / 2816289.989 - sched_yield-threads-8 | 2676167.750 | 2454554.000 | 8.158 | 24688.255 | 2670356.337 / 2685397.471 - sched_yield-threads-12 | 2537788.750 | 2418764.500 | 4.672 | 45024.342 | 2522006.371 / 2549437.333 - sched_yield-threads-21 | 2471273.250 | 2357514.000 | 4.172 | 42739.709 | 2447382.125 / 2473416.342 - sched_yield-threads-30 | 2379894.500 | 2298642.500 | 3.100 | 25939.719 | 2366502.588 / 2382444.250 - sched_yield-threads-48 | 2304837.500 | 2192008.500 | 4.858 | 37808.218 | 2294448.102 / 2317365.790 - sched_yield-threads-79 | 2202153.500 | 2171771.500 | 1.896 | 20013.488 | 2195498.597 / 2207786.474 - sched_yield-threads-110 | 2143881.500 | 2069554.500 | 3.282 | 21334.701 | 2137062.709 / 2150027.178 - sched_yield-threads-128 | 2102815.500 | 2030478.500 | 3.547 | 27519.539 | 2097349.642 / 2114001.021 wis/signal1-threads/Signals, OPS - signal1-threads-2 | 1032419.750 | 925490.500 | 10.374 | 39861.529 | 1018095.401 / 1042158.878 - signal1-threads-5 | 1040060.750 | 890765.500 | 14.489 | 29931.169 | 1030202.776 / 1048525.521 - signal1-threads-8 | 1035393.500 | 924303.500 | 10.584 | 23590.606 | 1026143.651 / 1040566.724 - signal1-threads-12 | 1033586.750 | 926311.000 | 9.195 | 33248.929 | 1023053.494 / 1043328.833 - signal1-threads-21 | 1037118.250 | 951275.000 | 8.426 | 20657.264 | 1032056.801 / 1044588.583 - signal1-threads-30 | 1025704.500 | 900407.000 | 11.826 | 31987.654 | 1015538.281 / 1035204.584 - signal1-threads-48 | 1027878.250 | 931808.500 | 9.364 | 29338.353 | 1024327.779 / 1042024.542 - signal1-threads-79 | 1030575.250 | 910514.500 | 11.579 | 38482.082 | 1019979.996 / 1043515.216 - signal1-threads-110 | 1034733.750 | 947147.500 | 8.418 | 19589.115 | 1028251.652 / 1040949.242 - signal1-threads-128 | 1037267.000 | 931585.000 | 9.994 | 24313.801 | 1027799.854 / 1043593.311 * index after test name indicate number of threads or processes used for the test. Detailed test results and raw data can be found here: https://artifacts.codelinaro.org/artifactory/linaro-373-reports/aws-gravito… Best regards.

7 months, 4 weeks

2
1
0 0

Linux Kernel v6.10-rc7 vs v6.9 Performance Testing Results

by konstantin.belov＠linaro.org

Hello, Performance evaluation of Linux Kernel v6.10-rc7 is finished. Comparison is done to baseline Linux Kernel version: v6.9. The following configuration was used for all targets: - Instance CPU: graviton3 - Number of cores: 2 - RAM size, GB: 7.6 - OS: Debian Linux 12 (bookworm) Regressions by test Benchmark/Test/Metric, units | Baseline Mean | Current Mean | Diff, % | SD | Confidence interval ------------------------------------------------------------------------------------------------------------------------------------------------------ aim9/brk_test/System Memory Allocations, OPS | 2024031.020 | 1977565.865 | 2.352 | 15981.304 | 2025374.888 / 2031023.961 aim9/disk_cp/Disk Copies, OPS | 702706.835 | 664727.042 | 5.208 | 19063.338 | 698294.525 / 705031.096 aim9/disk_rr/Read operations, OPS | 596150.100 | 556820.742 | 6.480 | 16197.472 | 592009.077 / 597681.765 aim9/disk_rw/Write operations, OPS | 570349.455 | 534813.385 | 6.227 | 13784.275 | 567347.046 / 572273.069 aim9/disk_src/Directory Searches, OPS | 138168.938 | 136271.125 | 1.359 | 894.343 | 138008.843 / 138327.957 aim9/disk_wrt/Sequential Disk Writes, OPS | 1118581.885 | 1023842.095 | 8.787 | 33193.254 | 1116941.210 / 1128868.798 aim9/page_test/System Allocations & Pages, OPS | 572948.228 | 509716.688 | 11.645 | 14810.463 | 570248.641 / 575445.324 stressng/af-alg/Crypto Operations, OPS - af-alg-1 | 5164.675 | 4880.005 | 5.558 | 132.075 | 5133.686 / 5195.471 - af-alg-2 | 9686.665 | 9207.275 | 5.123 | 351.044 | 9622.286 / 9787.429 - af-alg-4 | 10236.295 | 9705.220 | 5.196 | 228.442 | 10179.290 / 10285.385 - af-alg-8 | 10366.020 | 9827.025 | 5.557 | 278.439 | 10293.759 / 10422.581 - af-alg-16 | 10606.775 | 9979.150 | 5.876 | 220.383 | 10525.798 / 10629.687 - af-alg-32 | 11204.950 | 10562.215 | 5.681 | 276.255 | 11134.828 / 11264.693 - af-alg-64 | 12125.135 | 11421.200 | 5.778 | 301.317 | 12047.567 / 12190.076 - af-alg-128 | 12970.840 | 12296.635 | 5.230 | 349.765 | 12885.485 / 13048.595 stressng/context/Context Switches, switches/s - context-1 | 2413.745 | 2312.915 | 4.252 | 5.545 | 2411.890 / 2416.488 - context-2 | 4841.600 | 4626.430 | 4.419 | 8.553 | 4836.114 / 4843.269 - context-4 | 4752.505 | 4553.725 | 4.143 | 56.213 | 4715.802 / 4762.156 - context-8 | 4753.285 | 4559.315 | 4.147 | 42.188 | 4727.522 / 4762.316 - context-16 | 4753.605 | 4556.805 | 4.261 | 26.756 | 4739.990 / 4762.417 - context-32 | 4756.705 | 4568.215 | 3.886 | 42.255 | 4729.264 / 4764.563 - context-64 | 4759.445 | 4576.455 | 3.768 | 46.395 | 4732.501 / 4770.995 - context-128 | 4814.425 | 4610.795 | 4.042 | 43.430 | 4784.460 / 4820.215 stressng/getdent/Read Throughput, MB/s - getdent-1 | 87967.663 | 83852.200 | 4.652 | 1127.153 | 87713.927 / 88154.936 - getdent-2 | 152377.763 | 145743.055 | 4.320 | 1206.968 | 152091.623 / 152568.638 - getdent-4 | 148489.635 | 142459.415 | 4.005 | 1578.436 | 148119.902 / 148726.095 - getdent-8 | 147962.622 | 141963.980 | 4.068 | 1514.188 | 147642.149 / 148228.467 - getdent-16 | 147484.495 | 141707.015 | 3.914 | 1671.056 | 147139.333 / 147794.107 - getdent-32 | 147146.335 | 141225.905 | 4.017 | 1706.258 | 146750.090 / 147416.790 - getdent-64 | 146121.867 | 140589.265 | 3.756 | 1415.987 | 145810.542 / 146350.109 - getdent-128 | 145466.773 | 139579.320 | 4.025 | 1348.685 | 145196.715 / 145721.155 stressng/madvise/Access calls, OPS - madvise-1 | 39.925 | 37.535 | 6.029 | 0.901 | 39.712 / 40.056 - madvise-2 | 77.400 | 73.370 | 5.181 | 2.653 | 76.835 / 77.859 - madvise-4 | 87.550 | 82.910 | 5.414 | 1.662 | 87.284 / 87.918 - madvise-8 | 88.070 | 83.465 | 5.389 | 1.859 | 87.730 / 88.441 - madvise-16 | 87.235 | 82.610 | 5.382 | 1.978 | 86.894 / 87.645 - madvise-32 | 86.300 | 81.505 | 5.789 | 1.805 | 85.991 / 86.682 - madvise-64 | 85.615 | 80.940 | 5.640 | 1.923 | 85.289 / 86.013 - madvise-128 | 84.730 | 79.780 | 5.964 | 1.741 | 84.440 / 85.095 stressng/vm-splice/Transfer Rate, MB/s - vm-splice-1 | 393962.125 | 363364.965 | 7.784 | 1375.412 | 393561.990 / 394188.639 - vm-splice-2 | 985842.100 | 926730.095 | 5.994 | 3171.138 | 984967.489 / 986455.171 - vm-splice-4 | 1112662.825 | 1063485.470 | 4.447 | 4974.978 | 1111703.150 / 1114042.634 - vm-splice-8 | 1196704.405 | 1153685.555 | 3.595 | 5363.710 | 1195216.807 / 1197711.869 - vm-splice-16 | 1241430.610 | 1201355.460 | 3.216 | 5841.721 | 1239892.857 / 1242574.198 - vm-splice-32 | 1243408.735 | 1203818.015 | 3.199 | 5133.764 | 1242270.041 / 1244645.885 - vm-splice-64 | 1241989.475 | 1204833.700 | 2.992 | 5385.394 | 1240599.977 / 1243111.956 - vm-splice-128 | 1248649.105 | 1212029.230 | 2.938 | 6197.063 | 1247244.615 / 1250167.405 sysbench/thread/Events, OPS | 716.375 | 666.590 | 7.608 | 83.161 | 693.885 / 736.559 wis/context_switch1-threads/Mutex Ops, OPS - context_switch1-threads-2 | 1043198.500 | 1032579.000 | 1.025 | 15769.853 | 1038064.094 / 1047657.730 - context_switch1-threads-48 | 880147.500 | 875809.000 | 0.510 | 7073.159 | 878033.185 / 882357.976 wis/eventfd1-threads/Eventfd, OPS - eventfd1-threads-2 | 3691094.500 | 3616663.500 | 1.983 | 4620.901 | 3688767.203 / 3691599.066 - eventfd1-threads-5 | 3696887.250 | 3624564.500 | 1.954 | 7956.267 | 3694444.546 / 3699271.317 - eventfd1-threads-8 | 3695939.000 | 3624944.500 | 1.943 | 9501.408 | 3692778.364 / 3698659.086 - eventfd1-threads-12 | 3699411.250 | 3630306.000 | 1.918 | 5301.489 | 3698377.409 / 3701624.781 - eventfd1-threads-21 | 3702116.500 | 3629874.000 | 1.941 | 7321.327 | 3699202.365 / 3703624.491 - eventfd1-threads-30 | 3701632.750 | 3629186.500 | 1.967 | 4649.785 | 3700178.568 / 3703039.120 - eventfd1-threads-48 | 3704471.000 | 3627763.500 | 2.052 | 5273.453 | 3702086.620 / 3705355.450 - eventfd1-threads-79 | 3699755.000 | 3629602.500 | 1.882 | 6352.434 | 3697160.938 / 3701062.317 - eventfd1-threads-110 | 3697941.250 | 3628737.000 | 1.867 | 5922.402 | 3696152.422 / 3699778.071 - eventfd1-threads-128 | 3759892.250 | 3690786.500 | 1.869 | 15690.578 | 3754481.564 / 3763941.355 wis/futex1-threads/Futex, OPS - futex1-threads-2 | 7331384.000 | 6883248.000 | 6.081 | 19642.783 | 7320794.605 / 7332716.219 - futex1-threads-5 | 7345486.500 | 6890270.000 | 6.184 | 18849.538 | 7338570.284 / 7350049.859 - futex1-threads-8 | 7345137.750 | 6900552.500 | 5.991 | 37983.921 | 7324309.996 / 7347553.352 - futex1-threads-12 | 7355575.500 | 6902726.000 | 6.191 | 11125.573 | 7351224.342 / 7357989.719 - futex1-threads-21 | 7361320.500 | 6904192.000 | 6.200 | 9466.763 | 7356644.107 / 7362363.796 - futex1-threads-30 | 7359961.000 | 6904044.500 | 6.195 | 7729.312 | 7356981.896 / 7361725.577 - futex1-threads-48 | 7351592.500 | 6899884.500 | 6.212 | 6461.848 | 7351383.142 / 7355276.354 - futex1-threads-79 | 7358242.000 | 6903142.000 | 6.182 | 11973.766 | 7354010.197 / 7361383.763 - futex1-threads-110 | 7354987.000 | 6902757.500 | 6.136 | 7643.182 | 7351888.164 / 7356551.226 - futex1-threads-128 | 7488506.000 | 7012330.500 | 6.309 | 27867.865 | 7475259.002 / 7492163.192 wis/futex2-threads/Futex, OPS - futex2-threads-2 | 6439415.000 | 6149848.000 | 4.444 | 14991.436 | 6430975.179 / 6440065.329 - futex2-threads-5 | 6449443.750 | 6161752.500 | 4.089 | 74947.282 | 6400030.183 / 6446066.601 - futex2-threads-8 | 6460301.750 | 6163526.000 | 4.603 | 12960.529 | 6455149.411 / 6462972.281 - futex2-threads-12 | 6461225.500 | 6170457.500 | 4.465 | 16174.516 | 6452825.353 / 6462687.543 - futex2-threads-21 | 6460055.250 | 6170144.000 | 4.521 | 8811.087 | 6457117.594 / 6462465.690 - futex2-threads-30 | 6466882.250 | 6171848.000 | 4.593 | 5501.198 | 6464431.897 / 6467841.079 - futex2-threads-48 | 6467698.500 | 6171119.000 | 4.549 | 10942.337 | 6460871.839 / 6467607.359 - futex2-threads-79 | 6464392.750 | 6171063.000 | 4.515 | 10348.639 | 6458980.874 / 6465340.407 - futex2-threads-110 | 6462639.750 | 6169682.000 | 4.549 | 6179.592 | 6460519.129 / 6464273.842 - futex2-threads-128 | 6569593.000 | 6268854.500 | 4.564 | 29951.831 | 6556867.009 / 6575076.095 wis/futex3-threads/Futex, OPS - futex3-threads-2 | 9382908.500 | 9037800.500 | 3.658 | 14419.002 | 9376207.961 / 9384954.973 - futex3-threads-5 | 9393108.500 | 9053605.000 | 3.664 | 24800.732 | 9384096.016 / 9399169.784 - futex3-threads-8 | 9410893.750 | 9069903.000 | 3.623 | 19601.712 | 9402976.534 / 9415122.887 - futex3-threads-12 | 9412522.250 | 9076284.000 | 3.552 | 22854.990 | 9400688.445 / 9414391.509 - futex3-threads-21 | 9415376.500 | 9069406.000 | 3.702 | 11577.181 | 9411074.473 / 9418127.891 - futex3-threads-30 | 9408300.500 | 9063350.000 | 3.668 | 16189.516 | 9402333.763 / 9412373.368 - futex3-threads-48 | 9369011.750 | 9043498.500 | 3.442 | 119035.789 | 9308732.579 / 9381623.114 - futex3-threads-79 | 9419871.250 | 9072635.000 | 3.755 | 9673.762 | 9417386.876 / 9423311.751 - futex3-threads-110 | 9421860.250 | 9070475.500 | 3.733 | 9375.712 | 9417018.946 / 9422765.596 - futex3-threads-128 | 9585034.750 | 9221111.500 | 3.748 | 35227.549 | 9567337.461 / 9588916.089 wis/futex4-threads/Futex, OPS - futex4-threads-2 | 7893564.750 | 7721498.000 | 2.143 | 12639.586 | 7886811.269 / 7894367.252 - futex4-threads-5 | 7901604.500 | 7732460.000 | 2.154 | 16861.605 | 7896694.639 / 7906894.681 - futex4-threads-8 | 7904723.500 | 7739545.500 | 2.038 | 23607.962 | 7893734.971 / 7907869.379 - futex4-threads-12 | 7921845.000 | 7749749.000 | 2.210 | 10639.182 | 7917295.694 / 7923848.691 - futex4-threads-21 | 7916875.750 | 7748597.000 | 2.146 | 8378.886 | 7914467.376 / 7919593.269 - futex4-threads-30 | 7916309.250 | 7749966.500 | 2.100 | 11055.392 | 7912379.824 / 7919108.074 - futex4-threads-48 | 7918489.250 | 7747947.500 | 2.137 | 14478.658 | 7911576.226 / 7920429.777 - futex4-threads-79 | 7907508.250 | 7748515.000 | 2.001 | 13801.388 | 7901235.728 / 7909555.540 - futex4-threads-110 | 7921016.500 | 7747755.000 | 2.198 | 7548.079 | 7918981.411 / 7923523.896 - futex4-threads-128 | 8050113.500 | 7880477.000 | 2.107 | 30601.526 | 8038555.835 / 8057352.197 wis/getppid1-threads/getppid Calls, OPS - getppid1-threads-2 | 10375945.250 | 9813354.000 | 5.399 | 18753.455 | 10367349.139 / 10378692.356 - getppid1-threads-5 | 10390054.250 | 9835972.500 | 5.330 | 23406.663 | 10380889.967 / 10395127.799 - getppid1-threads-8 | 10396742.000 | 9846406.500 | 5.290 | 24886.144 | 10387085.300 / 10402060.881 - getppid1-threads-12 | 10414925.750 | 9856911.000 | 5.361 | 14847.800 | 10408212.359 / 10417304.574 - getppid1-threads-21 | 10412924.250 | 9852442.500 | 5.377 | 12270.329 | 10408245.041 / 10415619.922 - getppid1-threads-30 | 10414844.250 | 9858418.500 | 5.341 | 13281.828 | 10408622.217 / 10416860.653 - getppid1-threads-48 | 10412120.500 | 9860432.500 | 5.271 | 24083.090 | 10400380.918 / 10414940.192 - getppid1-threads-79 | 10418012.250 | 9855990.500 | 5.413 | 10337.716 | 10414375.443 / 10420735.453 - getppid1-threads-110 | 10409186.250 | 9859469.000 | 5.082 | 53431.670 | 10369411.491 / 10401891.145 - getppid1-threads-128 | 10596017.750 | 10019019.000 | 5.405 | 39978.839 | 10577937.198 / 10602482.227 wis/pipe1-threads/Pipe, OPS - pipe1-threads-2 | 2953808.000 | 2825556.500 | 4.435 | 32265.170 | 2947508.459 / 2967410.641 - pipe1-threads-5 | 2902003.750 | 2814897.500 | 3.015 | 35961.675 | 2891632.491 / 2913524.917 - pipe1-threads-8 | 2902555.250 | 2814502.000 | 2.988 | 38328.801 | 2890678.412 / 2914496.674 - pipe1-threads-12 | 2893482.250 | 2813077.500 | 2.853 | 37131.352 | 2884526.789 / 2907229.827 - pipe1-threads-21 | 2898269.500 | 2810387.000 | 3.052 | 38567.680 | 2888073.649 / 2911800.905 - pipe1-threads-30 | 2893691.750 | 2810363.000 | 2.975 | 37063.065 | 2886646.805 / 2909268.202 - pipe1-threads-48 | 2897777.250 | 2795953.000 | 3.484 | 36639.153 | 2887270.304 / 2909571.047 - pipe1-threads-79 | 2899279.250 | 2801835.000 | 3.328 | 36845.516 | 2888248.850 / 2910888.323 - pipe1-threads-110 | 2884872.250 | 2787005.000 | 3.339 | 51646.569 | 2866643.583 / 2897914.354 - pipe1-threads-128 | 2910726.750 | 2836406.500 | 2.563 | 42884.068 | 2897163.614 / 2923366.264 wis/sched_yield-threads/Context Switches, OPS - sched_yield-threads-2 | 5376383.250 | 4828295.000 | 10.223 | 8528.420 | 5371839.052 / 5377023.071 - sched_yield-threads-5 | 2803251.000 | 2652031.500 | 5.402 | 44282.527 | 2789550.220 / 2816197.259 - sched_yield-threads-8 | 2676167.750 | 2497411.500 | 6.737 | 24688.255 | 2670342.896 / 2685403.914 - sched_yield-threads-12 | 2537788.750 | 2467843.500 | 2.745 | 45024.342 | 2521980.461 / 2549240.323 - sched_yield-threads-21 | 2471273.250 | 2355632.000 | 4.331 | 42739.709 | 2447018.216 / 2473327.458 - sched_yield-threads-30 | 2379894.500 | 2268452.500 | 4.297 | 25939.719 | 2366481.249 / 2382356.959 - sched_yield-threads-48 | 2304837.500 | 2215921.000 | 3.969 | 37808.218 | 2294065.377 / 2317562.381 - sched_yield-threads-79 | 2202153.500 | 2118637.000 | 3.738 | 20013.488 | 2195676.071 / 2207817.684 - sched_yield-threads-110 | 2143881.500 | 2068694.500 | 3.688 | 21334.701 | 2136885.958 / 2150121.350 - sched_yield-threads-128 | 2102815.500 | 2058940.000 | 2.259 | 27519.539 | 2097329.351 / 2114073.109 wis/signal1-threads/Signals, OPS - signal1-threads-2 | 1032419.750 | 935450.000 | 9.909 | 39861.529 | 1017749.954 / 1042401.714 - signal1-threads-5 | 1040060.750 | 938070.500 | 9.719 | 29931.169 | 1030290.221 / 1048550.307 - signal1-threads-8 | 1035393.500 | 943227.500 | 9.299 | 23590.606 | 1026068.740 / 1040746.521 - signal1-threads-12 | 1033586.750 | 946046.500 | 8.512 | 33248.929 | 1023018.170 / 1043372.011 - signal1-threads-21 | 1037118.250 | 932406.000 | 10.286 | 20657.264 | 1031912.448 / 1044681.119 - signal1-threads-30 | 1025704.500 | 941233.000 | 8.014 | 31987.654 | 1015683.896 / 1034931.138 - signal1-threads-48 | 1027878.250 | 930092.000 | 9.786 | 29338.353 | 1024223.213 / 1042257.056 - signal1-threads-79 | 1030575.250 | 960248.500 | 7.081 | 38482.082 | 1020039.997 / 1043903.479 - signal1-threads-110 | 1034733.750 | 921364.500 | 11.114 | 19589.115 | 1028186.181 / 1040985.147 - signal1-threads-128 | 1037267.000 | 956130.750 | 7.854 | 24313.801 | 1027829.378 / 1043573.977 * index after test name indicate number of threads or processes used for the test. Detailed test results and raw data can be found here: https://artifacts.codelinaro.org/artifactory/linaro-373-reports/aws-gravito… Best regards.

8 months

1
0
0 0

Linux Kernel v6.10-rc5 vs v6.9 Performance Testing Results

by konstantin.belov＠linaro.org

Hello, Performance evaluation of Linux Kernel v6.10-rc5 is finished. Comparison is done to baseline Linux Kernel version: v6.9. The following configuration was used for all targets: - Instance CPU: graviton3 - Number of cores: 2 - RAM size, GB: 7.6 - OS: Debian Linux 12 (bookworm) Regressions by test Benchmark/Test/Metric, Units | Baseline Mean | Current Mean | Diff, % | SD | Samples | Confidence interval ------------------------------------------------------------------------------------------------------------------------------------------------------ aim9/brk_test/System Memory Allocations, OPS | 2024031.020 | 2008833.335 | 0.841 | 15981.304 | 120 | 2025343.934 / 2031098.615 fio/writer/writer-write, OPS | 97798.885 | 67325.199 | 25.764 | 72300.888 | 60 | 85492.996 / 122116.078 stressng/context/Context Switches, switches/s - context-1 | 2413.745 | 2366.265 | 1.974 | 5.545 | 21 | 2411.869 / 2416.544 - context-2 | 4841.600 | 4757.130 | 1.716 | 8.553 | 21 | 4836.322 / 4843.231 - context-4 | 4752.505 | 4712.375 | 0.646 | 56.213 | 21 | 4715.545 / 4762.271 - context-8 | 4753.285 | 4713.330 | 0.725 | 42.188 | 21 | 4727.178 / 4762.383 - context-16 | 4753.605 | 4711.875 | 0.861 | 26.756 | 21 | 4740.353 / 4762.158 - context-32 | 4756.705 | 4721.310 | 0.628 | 42.255 | 21 | 4729.786 / 4764.480 - context-64 | 4759.445 | 4728.605 | 0.505 | 46.395 | 21 | 4732.590 / 4770.716 - context-128 | 4814.425 | 4759.170 | 0.936 | 43.430 | 21 | 4784.785 / 4820.130 stressng/fork/Forks, OPS - fork-4 | 6922.335 | 6846.845 | 0.595 | 181.515 | 105 | 6905.004 / 6973.439 - fork-8 | 6751.675 | 6645.580 | 1.540 | 175.721 | 105 | 6733.361 / 6800.310 - fork-16 | 6639.680 | 6536.265 | 1.157 | 230.738 | 105 | 6605.904 / 6691.617 - fork-32 | 6469.605 | 6351.585 | 1.843 | 199.299 | 105 | 6435.213 / 6512.344 - fork-64 | 6226.470 | 6050.965 | 3.055 | 229.732 | 105 | 6202.757 / 6290.235 - fork-128 | 5938.430 | 5824.840 | 2.447 | 260.748 | 105 | 5922.094 / 6020.485 stressng/get/Read Throughput, MB/s - get-1 | 2828.900 | 2793.915 | 1.113 | 41.018 | 70 | 2814.521 / 2833.488 - get-4 | 2878.250 | 2848.490 | 1.126 | 83.756 | 70 | 2853.543 / 2892.408 stressng/madvise/Access calls, OPS - madvise-1 | 39.925 | 38.445 | 3.726 | 0.901 | 105 | 39.717 / 40.055 - madvise-2 | 77.400 | 74.895 | 3.051 | 2.653 | 105 | 76.821 / 77.835 - madvise-4 | 87.550 | 85.125 | 2.941 | 1.662 | 105 | 87.288 / 87.916 - madvise-8 | 88.070 | 85.405 | 3.131 | 1.859 | 105 | 87.739 / 88.446 - madvise-16 | 87.235 | 84.830 | 3.080 | 1.978 | 105 | 86.901 / 87.640 - madvise-32 | 86.300 | 83.885 | 3.077 | 1.805 | 105 | 85.999 / 86.684 - madvise-64 | 85.615 | 83.190 | 3.066 | 1.923 | 105 | 85.282 / 86.023 - madvise-128 | 84.730 | 81.780 | 3.566 | 1.741 | 105 | 84.442 / 85.099 stressng/vm-splice/Transfer Rate, MB/s - vm-splice-1 | 393962.125 | 380884.680 | 3.338 | 1375.412 | 70 | 393557.679 / 394193.506 - vm-splice-2 | 985842.100 | 955996.310 | 3.014 | 3171.138 | 70 | 984987.661 / 986448.773 - vm-splice-4 | 1112662.825 | 1085601.655 | 2.410 | 4974.978 | 70 | 1111703.539 / 1114047.566 - vm-splice-8 | 1196704.405 | 1167308.690 | 2.471 | 5363.710 | 70 | 1195240.562 / 1197725.298 - vm-splice-16 | 1241430.610 | 1206691.725 | 2.798 | 5841.721 | 70 | 1239884.083 / 1242606.569 - vm-splice-32 | 1243408.735 | 1205210.870 | 3.071 | 5133.764 | 70 | 1242267.819 / 1244628.719 - vm-splice-64 | 1241989.475 | 1210209.025 | 2.556 | 5385.394 | 70 | 1240609.336 / 1243102.559 - vm-splice-128 | 1248649.105 | 1212717.895 | 2.864 | 6197.063 | 70 | 1247271.017 / 1250112.895 sysbench/mutex/Events, OPS | 9991.017 | 9599.048 | 4.210 | 1446.210 | 56 | 9434.313 / 10169.427 wis/futex1-threads/Futex, OPS - futex1-threads-2 | 7331384.000 | 7284264.500 | 0.590 | 19642.783 | 40 | 7320680.786 / 7332620.586 - futex1-threads-5 | 7345486.500 | 7292154.000 | 0.730 | 18849.538 | 40 | 7338685.872 / 7350282.645 - futex1-threads-8 | 7345137.750 | 7298011.000 | 0.514 | 37983.921 | 40 | 7324579.433 / 7347620.029 - futex1-threads-12 | 7355575.500 | 7303781.500 | 0.719 | 11125.573 | 40 | 7351143.157 / 7358021.168 - futex1-threads-21 | 7361320.500 | 7305515.000 | 0.751 | 9466.763 | 40 | 7356681.171 / 7362429.214 - futex1-threads-30 | 7359961.000 | 7300230.500 | 0.807 | 7729.312 | 40 | 7357069.488 / 7361786.599 - futex1-threads-48 | 7351592.500 | 7309618.000 | 0.591 | 6461.848 | 40 | 7351385.098 / 7355354.709 - futex1-threads-79 | 7358242.000 | 7308607.500 | 0.692 | 11973.766 | 40 | 7353975.894 / 7361353.356 - futex1-threads-110 | 7354987.000 | 7304531.000 | 0.673 | 7643.182 | 40 | 7351888.976 / 7356472.944 - futex1-threads-128 | 7488506.000 | 7428399.500 | 0.746 | 27867.865 | 40 | 7475077.688 / 7492044.614 wis/futex3-threads/Futex, OPS - futex3-threads-30 | 9408300.500 | 9380256.000 | 0.639 | 16189.516 | 40 | 9402458.322 / 9412406.551 - futex3-threads-79 | 9419871.250 | 9379065.000 | 0.643 | 9673.762 | 40 | 9417409.600 / 9423269.750 wis/pipe1-threads/Pipe, OPS - pipe1-threads-2 | 2953808.000 | 2836051.000 | 4.096 | 32265.170 | 40 | 2947591.564 / 2967304.694 - pipe1-threads-5 | 2902003.750 | 2808807.500 | 3.244 | 35961.675 | 40 | 2891343.652 / 2913314.310 - pipe1-threads-8 | 2902555.250 | 2797466.500 | 3.955 | 38328.801 | 40 | 2890867.899 / 2914501.971 - pipe1-threads-12 | 2893482.250 | 2798925.000 | 3.338 | 37131.352 | 40 | 2884542.474 / 2907327.818 - pipe1-threads-21 | 2898269.500 | 2781471.000 | 4.220 | 38567.680 | 40 | 2888091.931 / 2911775.462 - pipe1-threads-30 | 2893691.750 | 2772565.000 | 4.414 | 37063.065 | 40 | 2886426.264 / 2908849.549 - pipe1-threads-48 | 2897777.250 | 2785544.000 | 3.849 | 36639.153 | 40 | 2887350.688 / 2909847.167 - pipe1-threads-79 | 2899279.250 | 2768002.500 | 4.559 | 36845.516 | 40 | 2888371.391 / 2910716.188 - pipe1-threads-110 | 2884872.250 | 2770956.000 | 4.240 | 51646.569 | 40 | 2866295.525 / 2897785.042 - pipe1-threads-128 | 2910726.750 | 2831037.000 | 2.793 | 42884.068 | 40 | 2897187.420 / 2923784.775 wis/pthread_mutex1-threads/Mutex, OPS - pthread_mutex1-threads-5 | 14964128.250 | 14225412.000 | 3.902 | 967263.602 | 40 | 14413067.341 / 15008825.215 - pthread_mutex1-threads-21 | 15001573.500 | 13764075.500 | 6.863 | 695259.838 | 40 | 14691176.210 / 15112893.191 wis/sched_yield-threads/Context Switches, OPS - sched_yield-threads-5 | 2803251.000 | 2739170.000 | 1.637 | 44282.527 | 40 | 2789015.746 / 2816083.465 - sched_yield-threads-8 | 2676167.750 | 2621844.500 | 2.074 | 24688.255 | 40 | 2670476.766 / 2685268.877 - sched_yield-threads-12 | 2537788.750 | 2510135.500 | 1.227 | 45024.342 | 40 | 2521879.751 / 2549589.639 - sched_yield-threads-21 | 2471273.250 | 2442379.500 | 0.778 | 42739.709 | 40 | 2447357.476 / 2473133.006 - sched_yield-threads-30 | 2379894.500 | 2311476.000 | 2.301 | 25939.719 | 40 | 2366828.438 / 2382368.296 - sched_yield-threads-79 | 2202153.500 | 2149404.500 | 2.836 | 20013.488 | 40 | 2195495.042 / 2207819.754 - sched_yield-threads-110 | 2143881.500 | 2059775.500 | 4.010 | 21334.701 | 40 | 2137079.910 / 2150291.032 - sched_yield-threads-128 | 2102815.500 | 2026696.000 | 3.346 | 27519.539 | 40 | 2097120.591 / 2114175.826 wis/signal1-threads/Signals, OPS - signal1-threads-2 | 1032419.750 | 967942.500 | 5.658 | 39861.529 | 40 | 1017668.801 / 1042203.932 - signal1-threads-5 | 1040060.750 | 1017754.500 | 2.443 | 29931.169 | 40 | 1030378.573 / 1048564.717 - signal1-threads-12 | 1033586.750 | 984592.500 | 4.575 | 33248.929 | 40 | 1022808.441 / 1043256.098 - signal1-threads-21 | 1037118.250 | 979339.000 | 3.928 | 20657.264 | 40 | 1032019.797 / 1044798.986 - signal1-threads-30 | 1025704.500 | 983937.000 | 4.030 | 31987.654 | 40 | 1015466.709 / 1034958.376 - signal1-threads-48 | 1027878.250 | 975944.000 | 5.507 | 29338.353 | 40 | 1024320.523 / 1042120.100 - signal1-threads-79 | 1030575.250 | 992948.250 | 3.856 | 38482.082 | 40 | 1020043.830 / 1043527.170 - signal1-threads-110 | 1034733.750 | 1005838.500 | 2.806 | 19589.115 | 35 | 1028380.922 / 1041184.536 - signal1-threads-128 | 1037267.000 | 988638.000 | 4.543 | 24313.801 | 35 | 1027944.596 / 1043670.576 * index after test name indicate number of threads or processes used for the test. Detailed test results and raw data can be found here: https://artifacts.codelinaro.org/artifactory/linaro-373-reports/aws-gravito… Best regards.

8 months, 2 weeks

1
0
0 0

Re: Linux Kernel v6.10-rc3 vs v6.9 Performance Testing Results

by Konstantin Belov

Hello James, I can say from statistical point of view the following: 1. madvise results: All madvise test scenarios show a performance degradation 4.4% - 6.6% compared to the baseline (v6.9). It's clear from the numbers and chart (see aws-graviton3-2024-06-17/stressng/stressng.html). Given the consistency of the regression across different 'madvise' settings (number of threads 1-128), this tells of a potentially major issue introduced in Linux Kernel v6.10-rc3 that impacts the 'madvise' system call. This observation also can be strengthened with individual threads cases (madvise-1, .., -128) observation across previous versions starting from 6.8 (aws-graviton3-2024-06-17stressng/madvise-1/comparison.html, for example). Moreover, from git log it's clear that some active work was done in windows v6.8-v6.9, v6.9-v6.10-rc1, etc. This could be a reason for such degradations. With implemented bisection procedures it will be possible to tell which commits have made what contribution to such degradations. 2. fork results: The 'fork' tests with 32, 64 and 128 processes show performance regressions ranging 3.7% - 4.85%. While not as severe as the madvise results, these still indicate a measurable degradation in the fork system call performance. The madvise results are more significant for a the following reasons: - The regressions are larger in magnitude (up to 6.6% vs 4.85% for fork) - The regressions are consistent across all tested 'madvise' settings and versions, while 'fork' only shows notable regressions at higher counts. So in summary, based on this data, the 'madvise' performance issues introduced in Linux Kernel v6.10-rc3 appear to be the more significant and require further investigation and optimization efforts. Best regards, Konstantin. On Fri, 14 Jun 2024 at 22:16, James Greenhalgh <James.Greenhalgh(a)arm.com> wrote: > Should I read this as identifying new issues with madvise and fork > performance, with the madvise result likely to be more significant? > > > > Thanks for the effort to make the report public – it is now much easier to > access and click through to see the detailed stats. > > > > Thanks, > > James > > > > *From: *konstantin.belov(a)linaro.org <konstantin.belov(a)linaro.org> > *Date: *Friday, June 14, 2024 at 15:03 > *To: *graviton3-test-report(a)lists.linaro.org < > graviton3-test-report(a)lists.linaro.org> > *Subject: *[Graviton3-test-report] Linux Kernel v6.10-rc3 vs v6.9 > Performance Testing Results > > > Hello, > Performance evaluation of Linux Kernel v6.10-rc3 is finished. > Comparison is done to baseline Linux Kernel version: v6.9. > The following configuration was used for all targets: > - Instance CPU: graviton3 > - Number of cores: 2 > - RAM size, GB: 7.6 > - OS: Debian Linux 12 (bookworm) > > > Regressions by test > > Benchmark/Test/Metric, Units | Baseline Median | > Current Median | Diff, % | SD | Samples | Confidence interval > > ------------------------------------------------------------------------------------------------------------------------------------------------------ > aim9/brk_test/System Memory Allocations, OPS | 2024133.335 | > 2013262.470 | 0.537 | 16053.459 | 60 | 2024467.853 / > 2032591.875 > aim9/exec_test/Program Loads, OPS | 2019.665 | > 2005.835 | 0.685 | 17.517 | 60 | 2015.828 / 2024.693 > aim9/page_test/System Allocations & Pages, OPS | 570520.000 | > 550091.667 | 3.581 | 8356.271 | 60 | 568085.990 / > 572314.769 > stressng/context/Context Switches, switches/s > - context-1 | 2413.745 | > 2376.445 | 1.545 | 5.545 | 21 | 2411.760 / 2416.503 > - context-2 | 4841.600 | > 4769.580 | 1.488 | 8.553 | 21 | 4836.387 / 4843.704 > - context-4 | 4752.505 | > 4712.600 | 0.840 | 56.213 | 21 | 4716.312 / 4764.397 > - context-8 | 4753.285 | > 4724.605 | 0.603 | 42.188 | 21 | 4728.812 / 4764.899 > - context-16 | 4753.605 | > 4726.140 | 0.578 | 26.756 | 21 | 4740.173 / 4763.060 > - context-128 | 4814.425 | > 4774.555 | 0.828 | 43.430 | 21 | 4786.041 / 4823.191 > stressng/fork/Forks, OPS > - fork-32 | 6659.030 | > 6412.310 | 3.705 | 174.515 | 21 | 6588.293 / 6737.573 > - fork-64 | 6516.635 | > 6200.470 | 4.852 | 266.061 | 21 | 6394.023 / 6621.612 > - fork-128 | 6128.850 | > 5843.435 | 4.657 | 353.797 | 21 | 6005.178 / 6307.815 > stressng/get/Read Throughput, MB/s > - get-1 | 2835.125 | > 2785.405 | 1.754 | 25.632 | 21 | 2823.417 / 2845.342 > - get-2 | 3295.495 | > 3250.850 | 1.355 | 50.308 | 21 | 3271.035 / 3314.069 > - get-16 | 3097.905 | > 3062.850 | 1.132 | 36.459 | 21 | 3081.725 / 3112.912 > stressng/madvise/Access calls, OPS > - madvise-1 | 39.845 | > 37.240 | 6.538 | 0.864 | 21 | 39.425 / 40.164 > - madvise-2 | 76.950 | > 72.480 | 5.809 | 2.384 | 21 | 76.016 / 78.055 > - madvise-4 | 86.900 | > 83.080 | 4.396 | 1.283 | 21 | 86.317 / 87.414 > - madvise-8 | 87.615 | > 82.920 | 5.359 | 1.634 | 21 | 86.943 / 88.341 > - madvise-16 | 87.230 | > 82.345 | 5.600 | 1.879 | 21 | 86.472 / 88.079 > - madvise-32 | 85.895 | > 80.780 | 5.955 | 1.543 | 21 | 85.294 / 86.614 > - madvise-64 | 85.955 | > 80.625 | 6.201 | 2.257 | 21 | 84.615 / 86.546 > - madvise-128 | 85.005 | > 79.375 | 6.623 | 1.706 | 21 | 84.143 / 85.603 > stressng/vm-splice/Transfer Rate, MB/s > - vm-splice-1 | 393825.950 | > 384976.075 | 2.247 | 1326.151 | 21 | 393146.946 / > 394281.333 > - vm-splice-2 | 985022.850 | > 970009.675 | 1.524 | 3305.843 | 21 | 983522.945 / > 986350.758 > - vm-splice-4 | 1111278.105 | > 1098156.625 | 1.181 | 5058.131 | 21 | 1108947.236 / > 1113273.953 > - vm-splice-8 | 1195749.630 | > 1183949.325 | 0.987 | 5994.316 | 21 | 1192658.405 / > 1197785.934 > - vm-splice-16 | 1238939.755 | > 1226909.580 | 0.971 | 7273.147 | 21 | 1235968.212 / > 1242189.651 > - vm-splice-32 | 1241984.390 | > 1227662.560 | 1.153 | 5226.860 | 21 | 1239895.031 / > 1244366.079 > - vm-splice-64 | 1241623.855 | > 1227060.990 | 1.173 | 5099.827 | 21 | 1239863.809 / > 1244226.193 > - vm-splice-128 | 1248609.720 | > 1233938.390 | 1.175 | 7083.372 | 21 | 1245315.449 / > 1251374.554 > > * index after test name indicate number of threads or processes used for > the test. > > Detailed test results and raw data can be found here: > https://artifacts.codelinaro.org/artifactory/linaro-373-reports/aws-gravito… > > Best regards. > _______________________________________________ > Graviton3-test-report mailing list -- > graviton3-test-report(a)lists.linaro.org > To unsubscribe send an email to > graviton3-test-report-leave(a)lists.linaro.org > IMPORTANT NOTICE: The contents of this email and any attachments are > confidential and may also be privileged. If you are not the intended > recipient, please notify the sender immediately and do not disclose the > contents to any other person, use it for any purpose, or store or copy the > information in any medium. Thank you. >

8 months, 4 weeks

1
0
0 0

Linux Kernel v6.10-rc3 vs v6.9 Performance Testing Results

by konstantin.belov＠linaro.org

Hello, Performance evaluation of Linux Kernel v6.10-rc3 is finished. Comparison is done to baseline Linux Kernel version: v6.9. The following configuration was used for all targets: - Instance CPU: graviton3 - Number of cores: 2 - RAM size, GB: 7.6 - OS: Debian Linux 12 (bookworm) Regressions by test Benchmark/Test/Metric, Units | Baseline Median | Current Median | Diff, % | SD | Samples | Confidence interval ------------------------------------------------------------------------------------------------------------------------------------------------------ aim9/brk_test/System Memory Allocations, OPS | 2024133.335 | 2013262.470 | 0.537 | 16053.459 | 60 | 2024467.853 / 2032591.875 aim9/exec_test/Program Loads, OPS | 2019.665 | 2005.835 | 0.685 | 17.517 | 60 | 2015.828 / 2024.693 aim9/page_test/System Allocations & Pages, OPS | 570520.000 | 550091.667 | 3.581 | 8356.271 | 60 | 568085.990 / 572314.769 stressng/context/Context Switches, switches/s - context-1 | 2413.745 | 2376.445 | 1.545 | 5.545 | 21 | 2411.760 / 2416.503 - context-2 | 4841.600 | 4769.580 | 1.488 | 8.553 | 21 | 4836.387 / 4843.704 - context-4 | 4752.505 | 4712.600 | 0.840 | 56.213 | 21 | 4716.312 / 4764.397 - context-8 | 4753.285 | 4724.605 | 0.603 | 42.188 | 21 | 4728.812 / 4764.899 - context-16 | 4753.605 | 4726.140 | 0.578 | 26.756 | 21 | 4740.173 / 4763.060 - context-128 | 4814.425 | 4774.555 | 0.828 | 43.430 | 21 | 4786.041 / 4823.191 stressng/fork/Forks, OPS - fork-32 | 6659.030 | 6412.310 | 3.705 | 174.515 | 21 | 6588.293 / 6737.573 - fork-64 | 6516.635 | 6200.470 | 4.852 | 266.061 | 21 | 6394.023 / 6621.612 - fork-128 | 6128.850 | 5843.435 | 4.657 | 353.797 | 21 | 6005.178 / 6307.815 stressng/get/Read Throughput, MB/s - get-1 | 2835.125 | 2785.405 | 1.754 | 25.632 | 21 | 2823.417 / 2845.342 - get-2 | 3295.495 | 3250.850 | 1.355 | 50.308 | 21 | 3271.035 / 3314.069 - get-16 | 3097.905 | 3062.850 | 1.132 | 36.459 | 21 | 3081.725 / 3112.912 stressng/madvise/Access calls, OPS - madvise-1 | 39.845 | 37.240 | 6.538 | 0.864 | 21 | 39.425 / 40.164 - madvise-2 | 76.950 | 72.480 | 5.809 | 2.384 | 21 | 76.016 / 78.055 - madvise-4 | 86.900 | 83.080 | 4.396 | 1.283 | 21 | 86.317 / 87.414 - madvise-8 | 87.615 | 82.920 | 5.359 | 1.634 | 21 | 86.943 / 88.341 - madvise-16 | 87.230 | 82.345 | 5.600 | 1.879 | 21 | 86.472 / 88.079 - madvise-32 | 85.895 | 80.780 | 5.955 | 1.543 | 21 | 85.294 / 86.614 - madvise-64 | 85.955 | 80.625 | 6.201 | 2.257 | 21 | 84.615 / 86.546 - madvise-128 | 85.005 | 79.375 | 6.623 | 1.706 | 21 | 84.143 / 85.603 stressng/vm-splice/Transfer Rate, MB/s - vm-splice-1 | 393825.950 | 384976.075 | 2.247 | 1326.151 | 21 | 393146.946 / 394281.333 - vm-splice-2 | 985022.850 | 970009.675 | 1.524 | 3305.843 | 21 | 983522.945 / 986350.758 - vm-splice-4 | 1111278.105 | 1098156.625 | 1.181 | 5058.131 | 21 | 1108947.236 / 1113273.953 - vm-splice-8 | 1195749.630 | 1183949.325 | 0.987 | 5994.316 | 21 | 1192658.405 / 1197785.934 - vm-splice-16 | 1238939.755 | 1226909.580 | 0.971 | 7273.147 | 21 | 1235968.212 / 1242189.651 - vm-splice-32 | 1241984.390 | 1227662.560 | 1.153 | 5226.860 | 21 | 1239895.031 / 1244366.079 - vm-splice-64 | 1241623.855 | 1227060.990 | 1.173 | 5099.827 | 21 | 1239863.809 / 1244226.193 - vm-splice-128 | 1248609.720 | 1233938.390 | 1.175 | 7083.372 | 21 | 1245315.449 / 1251374.554 * index after test name indicate number of threads or processes used for the test. Detailed test results and raw data can be found here: https://artifacts.codelinaro.org/artifactory/linaro-373-reports/aws-gravito… Best regards.

9 months

1
0
0 0

Linux Kernel v6.9 vs v6.8 Performance Testing Results

by konstantin.belov＠linaro.org

Hello, Performance testing of Linux Kernel v6.9 on aws m7g.large (graviton3, arm64 CPU) is finished. Comparison is done to baseline Linux Kernel version: v6.8. Regressions by test - fio/writer: 98.73% - wis/getppid1-threads: 13.13% - aim9/exec_test: 13.06% - aim9/fork_test: 13.03% - wis/eventfd1-threads: 12.83% - wis/sched_yield-threads: 12.61% - stressng/context: 12.27% - wis/futex4-threads: 11.87% - wis/futex3-threads: 11.15% - wis/pipe1-threads: 9.86% - aim9/disk_rd: 9.52% - aim9/disk_wrt: 9.48% - wis/futex1-threads: 8.61% - wis/futex2-threads: 8.43% - stressng/vm-splice: 8.07% - aim9/disk_rr: 7.56% - wis/context_switch1-threads: 6.32% - stressng/get: 3.44% - aim9/disk_src: 1.99% - wis/signal1-threads: 1.50% - redis/MSET_10: 1.42% - stressng/fork: 1.37% - redis/LRANGE_300: 1.03% - redis/INCR: 0.99% - stressng/af-alg: 0.90% - redis/GET: 0.86% - redis/LRANGE_600: 0.72% Detailed test results and raw data can be found here: https://artifacts.codelinaro.org/artifactory/linaro-351-reports/aws-gravito… Best regards.

9 months, 3 weeks

1
0
0 0

Linux Kernel v6.9-rc6 vs v6.8 Performance Testing Results

by konstantin.belov＠linaro.org

Hello, Performance testing of Linux Kernel v6.9-rc6 on aws m7g.large (graviton3, arm64 CPU) is finished. Comparison is done to baseline Linux Kernel version: v6.8. Improvements by test - fio/writer: 25.14% - stressng/madvise: 2.19% - wis/pthread_mutex1-threads: 4.31% Regressions by test - fio/reader: 27.65% - redis/LRANGE_600: 0.53% - aim9/disk_rr: 6.72% - aim9/disk_cp: 6.39% - aim9/disk_src: 2.10% - aim9/disk_wrt: 6.70% - aim9/disk_rw: 6.47% - aim9/disk_rd: 5.32% - aim9/page_test: 4.77% - aim9/fork_test: 7.43% - aim9/exec_test: 8.31% - stressng/af-alg: 2.97% - stressng/bad-altstack: 6.50% - stressng/context: 8.90% - stressng/fork: 6.44% - stressng/get: 4.92% - stressng/getdent: 3.45% - stressng/vm-splice: 5.36% - wis/eventfd1-threads: 12.05% - wis/futex2-threads: 7.79% - wis/futex1-threads: 7.71% - wis/futex4-threads: 10.52% - wis/futex3-threads: 10.94% - wis/getppid1-threads: 13.24% - wis/context_switch1-threads: 6.39% - wis/pipe1-threads: 9.71% - wis/sched_yield-threads: 12.11% - wis/signal1-threads: 5.47% Detailed test results and raw data can be found here: https://artifacts.codelinaro.org/artifactory/linaro-351-reports/aws-gravito… Best regards.

10 months, 2 weeks

1
0
0 0

Linux Kernel v6.9-rc5 vs v6.8 Performance Testing Results

by konstantin.belov＠linaro.org

Hello, Performance testing of Linux Kernel v6.9-rc5 on aws m7g.large (graviton3, arm64 CPU) is finished. Comparison is done to baseline Linux Kernel version: v6.8. Improvements by test - aim9/disk_rr: 3.19% - aim9/disk_rw: 2.46% - aim9/disk_src: 2.61% - aim9/disk_rd: 5.38% - aim9/page_test: 4.04% - aim9/brk_test: 4.55% - aim9/exec_test: 7.90% - aim9/fork_test: 6.83% - stressng/af-alg: 3.38% - stressng/bad-altstack: 6.91% - stressng/context: 8.43% - stressng/fork: 7.68% - stressng/get: 4.48% - stressng/getdent: 1.11% - stressng/madvise: 8.15% - wis/futex3-threads: 0.75% - wis/futex2-threads: 0.73% - wis/futex1-threads: 2.04% - wis/pthread_mutex1-threads: 1.97% - wis/pipe1-threads: 0.97% Regressions by test - wis/sched_yield-threads: 6.68% - wis/eventfd1-threads: 0.65% Detailed test results and raw data can be found here: https://artifacts.codelinaro.org/artifactory/linaro-351-reports/aws-gravito… Best regards.

10 months, 3 weeks

1
0
0 0

Linux Kernel v6.9-rc3 vs v6.8 Performance Testing Results

by konstantin.belov＠linaro.org

Hello, Performance testing of Linux Kernel v6.9-rc3 on aws m7g.large (graviton3, arm64 CPU) is finished. Comparison is done to baseline Linux Kernel version: v6.8. Here is the summary of the results: - The following areas have been affected most by the changes in this release: File System, Disk I/O Performance, CPU, Memory, CPU Cache - Improvements observed in File System, Disk I/O Performance, CPU, Memory, CPU Cache, Storage, File System, IPC, Memory, Processes, Cryptography, Processes, Scheduler - Regressions observed in Improvements by test - scimarkc/FFT: 0.00% - scimarkc/LU: 0.03% - scimarkc/MonteCarlo: 0.06% - scimarkc/SOR: 0.01% - sysbench/cpu: 0.00% - aim9/brk_test: 0.05% - aim9/disk_cp: 0.50% - aim9/disk_rd: 0.30% - aim9/disk_rr: 0.09% - aim9/disk_rw: 0.54% - aim9/disk_src: 0.16% - aim9/disk_wrt: 0.87% - aim9/exec_test: 0.10% - aim9/fork_test: 0.99% - aim9/page_test: 0.43% - coremark/Score: 0.05% - stressng/context: 1.23% - stressng/madvise: 0.57% - stressng/vm-splice: 0.09% - stressng/fork: 0.07% - stressng/bad-altstack: 1.17% - stressng/get: 0.18% - stressng/getdent: 0.75% - stressng/af-alg: 0.20% Detailed test results and raw data can be found here: https://artifacts.codelinaro.org/artifactory/linaro-351-reports/aws-gravito… Best regards.

11 months

2
1
0 0

2025

2024

Graviton3-test-report ----- 2025 ----- March 2025 February 2025 January 2025 ----- 2024 ----- December 2024 November 2024 October 2024 September 2024 August 2024 July 2024 June 2024 May 2024 April 2024

Graviton3-test-report