If we repeat this test are the numbers stable and reproduceable? This would say we lost 2-5% pretty consistently everywhere
Ali
On 7/15/24, 09:12, "konstantin.belov@linaro.org mailto:konstantin.belov@linaro.org" <konstantin.belov@linaro.org mailto:konstantin.belov@linaro.org> wrote:
CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe.
Hello, Performance evaluation of Linux Kernel v6.10 is finished. Comparison is done to baseline Linux Kernel version: v6.9. The following configuration was used for all targets: - Instance CPU: graviton3 - Number of cores: 2 - RAM size, GB: 7.6 - OS: Debian Linux 12 (bookworm)
Regressions by test
Benchmark/Test/Metric, units | Baseline Mean | Current Mean | Diff, % | SD | Confidence interval ------------------------------------------------------------------------------------------------------------------------------------------------------ aim9/brk_test/System Memory Allocations, OPS | 2024031.020 | 1971348.765 | 2.642 | 15981.304 | 2025399.286 / 2031124.707 aim9/disk_cp/Disk Copies, OPS | 702706.835 | 671075.747 | 4.366 | 19063.338 | 698285.885 / 705092.986 aim9/disk_rr/Read operations, OPS | 596150.100 | 564453.565 | 5.137 | 16197.472 | 592002.596 / 597703.321 aim9/disk_rw/Write operations, OPS | 570349.455 | 541951.825 | 4.909 | 13784.275 | 567411.007 / 572259.048 aim9/disk_src/Directory Searches, OPS | 138168.938 | 135014.312 | 2.261 | 894.343 | 138010.228 / 138326.856 aim9/disk_wrt/Sequential Disk Writes, OPS | 1118581.885 | 1034308.093 | 7.889 | 33193.254 | 1116935.783 / 1128865.426 aim9/page_test/System Allocations & Pages, OPS | 572948.228 | 514986.665 | 10.291 | 14810.463 | 570258.256 / 575523.875 stressng/af-alg/Crypto Operations, OPS - af-alg-1 | 5164.675 | 4950.320 | 4.088 | 132.075 | 5133.983 / 5195.494 - af-alg-2 | 9686.665 | 9485.945 | 2.180 | 351.044 | 9622.321 / 9786.543 - af-alg-4 | 10236.295 | 9939.305 | 2.699 | 228.442 | 10179.286 / 10284.837 - af-alg-8 | 10366.020 | 10040.460 | 2.973 | 278.439 | 10294.060 / 10422.874 - af-alg-16 | 10606.775 | 10187.315 | 3.785 | 220.383 | 10529.211 / 10629.636 - af-alg-32 | 11204.950 | 10653.275 | 4.869 | 276.255 | 11135.362 / 11263.346 - af-alg-64 | 12125.135 | 11624.545 | 4.003 | 301.317 | 12047.239 / 12188.945 - af-alg-128 | 12970.840 | 12550.495 | 3.173 | 349.765 | 12884.449 / 13048.155 stressng/bad-altstack/Error Rate, errors/s - bad-altstack-1 | 3762.400 | 3806.550 | 1.240 | 81.798 | 3739.397 / 3777.322 - bad-altstack-4 | 6587.710 | 6687.025 | 1.584 | 192.744 | 6540.752 / 6630.084 - bad-altstack-32 | 6420.985 | 6519.595 | 1.634 | 217.020 | 6364.417 / 6464.764 - bad-altstack-64 | 6302.420 | 6384.260 | 1.407 | 247.458 | 6238.005 / 6352.318 - bad-altstack-128 | 6085.475 | 6216.385 | 2.147 | 235.878 | 6027.545 / 6136.103 stressng/context/Context Switches, switches/s - context-1 | 2413.745 | 2263.620 | 6.226 | 5.545 | 2411.896 / 2416.531 - context-2 | 4841.600 | 4533.660 | 6.330 | 8.553 | 4836.248 / 4843.247 - context-4 | 4752.505 | 4476.875 | 5.562 | 56.213 | 4716.018 / 4762.479 - context-8 | 4753.285 | 4491.420 | 5.388 | 42.188 | 4727.050 / 4762.047 - context-16 | 4753.605 | 4489.815 | 5.580 | 26.756 | 4739.978 / 4762.315 - context-32 | 4756.705 | 4499.645 | 5.255 | 42.255 | 4729.208 / 4764.696 - context-64 | 4759.445 | 4504.835 | 5.227 | 46.395 | 4731.720 / 4770.681 - context-128 | 4814.425 | 4541.760 | 5.477 | 43.430 | 4784.792 / 4820.034 stressng/get/Read Throughput, MB/s - get-1 | 2828.900 | 2794.095 | 1.069 | 41.018 | 2814.349 / 2833.252 - get-4 | 2878.250 | 2832.150 | 1.505 | 83.756 | 2853.293 / 2892.078 - get-8 | 3096.580 | 3053.180 | 1.523 | 66.413 | 3074.655 / 3105.807 - get-16 | 3045.695 | 3005.570 | 1.186 | 87.911 | 3018.373 / 3058.932 - get-32 | 2978.230 | 2945.090 | 1.150 | 86.859 | 2951.986 / 2992.572 - get-64 | 2948.340 | 2901.570 | 1.516 | 78.343 | 2928.063 / 2964.172 - get-128 | 2937.790 | 2900.980 | 1.314 | 78.724 | 2914.902 / 2951.766 stressng/getdent/Read Throughput, MB/s - getdent-1 | 87967.663 | 84103.515 | 4.357 | 1127.153 | 87720.446 / 88154.951 - getdent-2 | 152377.763 | 146399.800 | 3.916 | 1206.968 | 152098.458 / 152568.043 - getdent-4 | 148489.635 | 143262.375 | 3.494 | 1578.436 | 148114.610 / 148737.820 - getdent-8 | 147962.622 | 143254.745 | 3.185 | 1514.188 | 147638.878 / 148227.931 - getdent-16 | 147484.495 | 143078.785 | 2.998 | 1671.056 | 147139.074 / 147788.277 - getdent-32 | 147146.335 | 142453.715 | 3.192 | 1706.258 | 146754.026 / 147420.476 - getdent-64 | 146121.867 | 141403.570 | 3.231 | 1415.987 | 145805.917 / 146358.295 - getdent-128 | 145466.773 | 140410.075 | 3.500 | 1348.685 | 145195.427 / 145723.931 stressng/madvise/Access calls, OPS - madvise-1 | 39.925 | 37.470 | 6.318 | 0.901 | 39.713 / 40.058 - madvise-2 | 77.400 | 73.310 | 5.292 | 2.653 | 76.827 / 77.837 - madvise-4 | 87.550 | 82.705 | 5.689 | 1.662 | 87.284 / 87.913 - madvise-8 | 88.070 | 82.650 | 8.804 | 1.859 | 87.747 / 88.448 - madvise-16 | 87.235 | 81.845 | 6.242 | 1.978 | 86.897 / 87.657 - madvise-32 | 86.300 | 80.725 | 6.852 | 1.805 | 86.000 / 86.681 - madvise-64 | 85.615 | 80.340 | 6.384 | 1.923 | 85.292 / 86.019 - madvise-128 | 84.730 | 78.940 | 6.878 | 1.741 | 84.431 / 85.105 stressng/vm-splice/Transfer Rate, MB/s - vm-splice-1 | 393962.125 | 360630.090 | 8.450 | 1375.412 | 393558.782 / 394196.428 - vm-splice-2 | 985842.100 | 921596.990 | 6.512 | 3171.138 | 984969.357 / 986440.978 - vm-splice-4 | 1112662.825 | 1065436.700 | 4.321 | 4974.978 | 1111706.780 / 1114036.447 - vm-splice-8 | 1196704.405 | 1155576.555 | 3.424 | 5363.710 | 1195216.144 / 1197690.108 - vm-splice-16 | 1241430.610 | 1203981.285 | 3.003 | 5841.721 | 1239878.679 / 1242620.163 - vm-splice-32 | 1243408.735 | 1205273.090 | 3.080 | 5133.764 | 1242249.597 / 1244636.200 - vm-splice-64 | 1241989.475 | 1205714.570 | 4.921 | 5385.394 | 1240624.117 / 1243141.203 - vm-splice-128 | 1248649.105 | 1211778.420 | 2.994 | 6197.063 | 1247253.689 / 1250174.078 wis/context_switch1-threads/Mutex Ops, OPS | 1043198.500 | 1033264.000 | 0.983 | 15769.853 | 1037771.710 / 1047614.205 wis/eventfd1-threads/Eventfd, OPS - eventfd1-threads-2 | 3691094.500 | 3611879.500 | 2.135 | 4620.901 | 3688821.053 / 3691604.814 - eventfd1-threads-5 | 3696887.250 | 3618277.000 | 2.135 | 7956.267 | 3694490.667 / 3699338.543 - eventfd1-threads-8 | 3695939.000 | 3619874.500 | 2.060 | 9501.408 | 3692775.004 / 3698644.467 - eventfd1-threads-12 | 3699411.250 | 3624443.500 | 2.089 | 5301.489 | 3698395.896 / 3701576.532 - eventfd1-threads-21 | 3702116.500 | 3620887.500 | 2.189 | 7321.327 | 3699159.098 / 3703668.078 - eventfd1-threads-30 | 3701632.750 | 3623844.000 | 2.104 | 4649.785 | 3700169.216 / 3703039.233 - eventfd1-threads-48 | 3704471.000 | 3625261.500 | 2.160 | 5273.453 | 3702099.157 / 3705296.741 - eventfd1-threads-79 | 3699755.000 | 3623403.500 | 2.084 | 6352.434 | 3697209.069 / 3701058.307 - eventfd1-threads-110 | 3697941.250 | 3621659.000 | 2.053 | 5922.402 | 3696141.769 / 3699759.580 - eventfd1-threads-128 | 3759892.250 | 3679477.500 | 2.119 | 15690.578 | 3754286.792 / 3763928.994 wis/futex1-threads/Futex, OPS - futex1-threads-2 | 7331384.000 | 6826139.000 | 6.857 | 19642.783 | 7320746.815 / 7332575.805 - futex1-threads-5 | 7345486.500 | 6834169.500 | 6.944 | 18849.538 | 7338437.798 / 7350165.390 - futex1-threads-8 | 7345137.750 | 6842295.000 | 6.765 | 37983.921 | 7324505.779 / 7347552.519 - futex1-threads-12 | 7355575.500 | 6839910.000 | 7.011 | 11125.573 | 7351157.894 / 7358024.775 - futex1-threads-21 | 7361320.500 | 6843891.000 | 7.024 | 9466.763 | 7356603.803 / 7362371.236 - futex1-threads-30 | 7359961.000 | 6850677.000 | 6.917 | 7729.312 | 7356992.792 / 7361746.928 - futex1-threads-48 | 7351592.500 | 6850642.500 | 6.867 | 6461.848 | 7351363.838 / 7355325.955 - futex1-threads-79 | 7358242.000 | 6849112.500 | 6.928 | 11973.766 | 7353991.141 / 7361341.412 - futex1-threads-110 | 7354987.000 | 6843735.000 | 6.961 | 7643.182 | 7351877.969 / 7356511.297 - futex1-threads-128 | 7488506.000 | 6967984.000 | 6.962 | 27867.865 | 7475166.954 / 7492136.886 wis/futex2-threads/Futex, OPS - futex2-threads-2 | 6439415.000 | 6069072.500 | 5.720 | 14991.436 | 6430748.186 / 6440079.601 - futex2-threads-5 | 6449443.750 | 6080318.500 | 5.364 | 74947.282 | 6400971.050 / 6446224.400 - futex2-threads-8 | 6460301.750 | 6087438.000 | 5.766 | 12960.529 | 6455203.441 / 6463071.691 - futex2-threads-12 | 6461225.500 | 6090392.000 | 5.722 | 16174.516 | 6452916.826 / 6462717.041 - futex2-threads-21 | 6460055.250 | 6092776.500 | 5.704 | 8811.087 | 6457086.681 / 6462442.051 - futex2-threads-30 | 6466882.250 | 6090484.500 | 5.856 | 5501.198 | 6464483.709 / 6467871.564 - futex2-threads-48 | 6467698.500 | 6091584.000 | 5.915 | 10942.337 | 6460849.920 / 6467543.504 - futex2-threads-79 | 6464392.750 | 6088131.500 | 5.794 | 10348.639 | 6459012.148 / 6465347.706 - futex2-threads-110 | 6462639.750 | 6088138.000 | 5.792 | 6179.592 | 6460489.131 / 6464307.372 - futex2-threads-128 | 6569593.000 | 6190756.500 | 5.766 | 29951.831 | 6556913.671 / 6575176.689 wis/futex3-threads/Futex, OPS - futex3-threads-2 | 9382908.500 | 8984432.000 | 4.219 | 14419.002 | 9376245.645 / 9385091.062 - futex3-threads-5 | 9393108.500 | 9007226.500 | 4.086 | 24800.732 | 9384118.746 / 9399148.277 - futex3-threads-8 | 9410893.750 | 9011010.000 | 4.250 | 19601.712 | 9403034.945 / 9414886.634 - futex3-threads-12 | 9412522.250 | 9020257.000 | 4.251 | 22854.990 | 9400484.240 / 9414496.146 - futex3-threads-21 | 9415376.500 | 9024097.500 | 4.208 | 11577.181 | 9411172.535 / 9418189.545 - futex3-threads-30 | 9408300.500 | 9021776.000 | 4.100 | 16189.516 | 9402341.044 / 9412289.579 - futex3-threads-48 | 9369011.750 | 8976510.500 | 4.041 | 119035.789 | 9308324.969 / 9380702.737 - futex3-threads-79 | 9419871.250 | 9024055.000 | 4.332 | 9673.762 | 9417345.869 / 9423435.956 - futex3-threads-110 | 9421860.250 | 9025995.500 | 4.183 | 9375.712 | 9416954.271 / 9422770.027 - futex3-threads-128 | 9585034.750 | 9153532.000 | 4.497 | 35227.549 | 9567322.246 / 9588839.044 wis/futex4-threads/Futex, OPS - futex4-threads-2 | 7893564.750 | 7677390.500 | 2.713 | 12639.586 | 7886731.607 / 7894370.553 - futex4-threads-5 | 7901604.500 | 7696649.500 | 2.577 | 16861.605 | 7896655.449 / 7906873.973 - futex4-threads-8 | 7904723.500 | 7692989.500 | 3.742 | 23607.962 | 7893452.338 / 7908060.245 - futex4-threads-12 | 7921845.000 | 7707831.000 | 2.716 | 10639.182 | 7917309.814 / 7923749.233 - futex4-threads-21 | 7916875.750 | 7704176.000 | 2.745 | 8378.886 | 7914439.335 / 7919572.859 - futex4-threads-30 | 7916309.250 | 7707303.500 | 2.638 | 11055.392 | 7912316.315 / 7919098.152 - futex4-threads-48 | 7918489.250 | 7703435.500 | 2.765 | 14478.658 | 7911478.668 / 7920348.046 - futex4-threads-79 | 7907508.250 | 7704413.000 | 2.552 | 13801.388 | 7901134.967 / 7909552.184 - futex4-threads-110 | 7921016.500 | 7706606.000 | 2.709 | 7548.079 | 7918937.241 / 7923524.734 - futex4-threads-128 | 8050113.500 | 7828337.500 | 2.766 | 30601.526 | 8038553.358 / 8057145.229 wis/getppid1-threads/getppid Calls, OPS - getppid1-threads-2 | 10375945.250 | 9814233.500 | 5.386 | 18753.455 | 10367320.952 / 10378673.163 - getppid1-threads-5 | 10390054.250 | 9828461.500 | 5.390 | 23406.663 | 10380959.166 / 10395253.390 - getppid1-threads-8 | 10396742.000 | 9859442.500 | 5.170 | 24886.144 | 10387208.621 / 10402331.140 - getppid1-threads-12 | 10414925.750 | 9852053.000 | 5.436 | 14847.800 | 10408246.921 / 10417248.382 - getppid1-threads-21 | 10412924.250 | 9846726.000 | 5.438 | 12270.329 | 10408172.414 / 10415666.353 - getppid1-threads-30 | 10414844.250 | 9851879.500 | 5.392 | 13281.828 | 10408733.765 / 10416798.373 - getppid1-threads-48 | 10412120.500 | 9851284.500 | 5.376 | 24083.090 | 10400557.956 / 10414904.304 - getppid1-threads-79 | 10418012.250 | 9854536.000 | 5.410 | 10337.716 | 10414308.921 / 10420688.545 - getppid1-threads-110 | 10409186.250 | 9853279.500 | 5.139 | 53431.670 | 10369783.901 / 10402366.473 - getppid1-threads-128 | 10596017.750 | 10014438.000 | 5.481 | 39978.839 | 10577778.959 / 10602346.265 wis/pipe1-threads/Pipe, OPS - pipe1-threads-2 | 2953808.000 | 2840522.500 | 3.951 | 32265.170 | 2947407.479 / 2967321.314 - pipe1-threads-5 | 2902003.750 | 2836582.000 | 2.325 | 35961.675 | 2891530.044 / 2913285.006 - pipe1-threads-8 | 2902555.250 | 2827880.500 | 2.624 | 38328.801 | 2891034.446 / 2914572.513 - pipe1-threads-12 | 2893482.250 | 2835518.500 | 2.185 | 37131.352 | 2884534.266 / 2907027.406 - pipe1-threads-21 | 2898269.500 | 2806138.000 | 3.225 | 38567.680 | 2888080.935 / 2911830.839 - pipe1-threads-30 | 2893691.750 | 2808611.000 | 3.447 | 37063.065 | 2886480.201 / 2909074.341 - pipe1-threads-48 | 2897777.250 | 2805968.000 | 3.197 | 36639.153 | 2887361.032 / 2909684.424 - pipe1-threads-79 | 2899279.250 | 2819372.000 | 2.756 | 36845.516 | 2888030.768 / 2910695.763 - pipe1-threads-110 | 2884872.250 | 2798108.000 | 2.933 | 51646.569 | 2866460.306 / 2897588.144 - pipe1-threads-128 | 2910726.750 | 2824520.000 | 2.964 | 42884.068 | 2897061.333 / 2923366.245 wis/pthread_mutex1-threads/Mutex, OPS | 14964128.250 | 14084219.000 | 4.497 | 967263.602 | 14420416.666 / 15012074.144 wis/sched_yield-threads/Context Switches, OPS - sched_yield-threads-2 | 5376383.250 | 4841080.000 | 9.945 | 8528.420 | 5371868.174 / 5377040.460 - sched_yield-threads-5 | 2803251.000 | 2643919.500 | 5.934 | 44282.527 | 2789631.074 / 2816289.989 - sched_yield-threads-8 | 2676167.750 | 2454554.000 | 8.158 | 24688.255 | 2670356.337 / 2685397.471 - sched_yield-threads-12 | 2537788.750 | 2418764.500 | 4.672 | 45024.342 | 2522006.371 / 2549437.333 - sched_yield-threads-21 | 2471273.250 | 2357514.000 | 4.172 | 42739.709 | 2447382.125 / 2473416.342 - sched_yield-threads-30 | 2379894.500 | 2298642.500 | 3.100 | 25939.719 | 2366502.588 / 2382444.250 - sched_yield-threads-48 | 2304837.500 | 2192008.500 | 4.858 | 37808.218 | 2294448.102 / 2317365.790 - sched_yield-threads-79 | 2202153.500 | 2171771.500 | 1.896 | 20013.488 | 2195498.597 / 2207786.474 - sched_yield-threads-110 | 2143881.500 | 2069554.500 | 3.282 | 21334.701 | 2137062.709 / 2150027.178 - sched_yield-threads-128 | 2102815.500 | 2030478.500 | 3.547 | 27519.539 | 2097349.642 / 2114001.021 wis/signal1-threads/Signals, OPS - signal1-threads-2 | 1032419.750 | 925490.500 | 10.374 | 39861.529 | 1018095.401 / 1042158.878 - signal1-threads-5 | 1040060.750 | 890765.500 | 14.489 | 29931.169 | 1030202.776 / 1048525.521 - signal1-threads-8 | 1035393.500 | 924303.500 | 10.584 | 23590.606 | 1026143.651 / 1040566.724 - signal1-threads-12 | 1033586.750 | 926311.000 | 9.195 | 33248.929 | 1023053.494 / 1043328.833 - signal1-threads-21 | 1037118.250 | 951275.000 | 8.426 | 20657.264 | 1032056.801 / 1044588.583 - signal1-threads-30 | 1025704.500 | 900407.000 | 11.826 | 31987.654 | 1015538.281 / 1035204.584 - signal1-threads-48 | 1027878.250 | 931808.500 | 9.364 | 29338.353 | 1024327.779 / 1042024.542 - signal1-threads-79 | 1030575.250 | 910514.500 | 11.579 | 38482.082 | 1019979.996 / 1043515.216 - signal1-threads-110 | 1034733.750 | 947147.500 | 8.418 | 19589.115 | 1028251.652 / 1040949.242 - signal1-threads-128 | 1037267.000 | 931585.000 | 9.994 | 24313.801 | 1027799.854 / 1043593.311
* index after test name indicate number of threads or processes used for the test.
Detailed test results and raw data can be found here: https://artifacts.codelinaro.org/artifactory/linaro-373-reports/aws-graviton... https://artifacts.codelinaro.org/artifactory/linaro-373-reports/aws-graviton3-2024-07-15-report.tar.xz
Best regards. _______________________________________________ Graviton3-test-report mailing list -- graviton3-test-report@lists.linaro.org mailto:graviton3-test-report@lists.linaro.org To unsubscribe send an email to graviton3-test-report-leave@lists.linaro.org mailto:graviton3-test-report-leave@lists.linaro.org