oilshell.org
OSH Runtime Performance
Source code: benchmarks/osh-runtime.sh
Raw files
Elapsed Time by Shell (milliseconds)
Some benchmarks call many external tools, while some exercise the shell
interpreter itself.
workload |
host name |
bash |
dash |
osh-cpython |
osh-native |
py bash ratio |
native bash ratio |
abuild-print-help |
no-host |
19 |
9 |
454 |
22 |
23.78 |
1.17 |
bin-true |
no-host |
679 |
544 |
2,262 |
807 |
3.33 |
1.19 |
configure.cpython |
no-host |
15,017 |
15,196 |
28,683 |
15,434 |
1.91 |
1.03 |
configure.ocaml |
no-host |
3,895 |
3,774 |
4,683 |
3,895 |
1.20 |
1.00 |
configure.tcc |
no-host |
48 |
42 |
194 |
49 |
4.08 |
1.04 |
configure.util-linux |
no-host |
14,277 |
14,949 |
31,445 |
14,527 |
2.20 |
1.02 |
configure.yash |
no-host |
1,840 |
1,791 |
2,474 |
1,873 |
1.34 |
1.02 |
hello-world |
no-host |
1 |
1 |
50 |
3 |
34.74 |
2.03 |
Minor Page Faults
workload |
host name |
bash |
dash |
osh-cpython |
osh-native |
py bash ratio |
native bash ratio |
abuild-print-help |
no-host |
2,542 |
1,080 |
22,924 |
3,159 |
9.02 |
1.24 |
bin-true |
no-host |
106,267 |
66,431 |
759,891 |
127,172 |
7.15 |
1.20 |
configure.cpython |
no-host |
2,222,097 |
2,246,234 |
6,186,171 |
2,225,508 |
2.78 |
1.00 |
configure.ocaml |
no-host |
411,019 |
390,845 |
640,533 |
413,734 |
1.56 |
1.01 |
configure.tcc |
no-host |
6,535 |
5,480 |
23,321 |
7,009 |
3.57 |
1.07 |
configure.util-linux |
no-host |
2,100,727 |
2,259,313 |
5,337,926 |
1,997,627 |
2.54 |
0.95 |
configure.yash |
no-host |
255,599 |
244,617 |
385,340 |
258,486 |
1.51 |
1.01 |
hello-world |
no-host |
152 |
85 |
3,698 |
346 |
24.33 |
2.28 |
Memory Usage (Max Resident Set Size in MB)
Memory usage is measured in MB (powers of 10), not MiB (powers of 2).
GC Stats
workload |
host name |
elapsed ms |
max gc millis |
total gc millis |
allocated MB |
max rss MB |
num allocated |
num live |
max survived |
num in heap |
num in pool 1 |
num in pool 2 |
num gc points |
num gc done |
gc threshold |
num growths |
hello-world |
no-host |
3 |
0 |
0 |
0.3 |
6.2 |
3,749 |
3,749 |
0 |
684 |
1,892 |
1,173 |
2 |
0 |
50,000 |
0 |
bin-true |
no-host |
807 |
1 |
2 |
2.6 |
8.0 |
154,714 |
13,066 |
2,818 |
9,734 |
78,361 |
66,619 |
3,008 |
3 |
50,000 |
0 |
configure.cpython |
no-host |
15,434 |
1 |
60 |
15.0 |
27.3 |
1,772,690 |
49,108 |
28,528 |
86,381 |
908,113 |
778,196 |
22,694 |
60 |
50,000 |
0 |
configure.util-linux |
no-host |
14,527 |
3 |
60 |
21.3 |
30.0 |
2,703,426 |
42,745 |
65,812 |
109,643 |
1,320,611 |
1,273,172 |
27,391 |
41 |
131,624 |
1 |
configure.ocaml |
no-host |
3,895 |
1 |
2 |
2.6 |
20.6 |
150,060 |
10,993 |
5,163 |
7,513 |
71,649 |
70,898 |
1,448 |
3 |
50,000 |
0 |
configure.tcc |
no-host |
49 |
0 |
0 |
1.3 |
19.3 |
30,549 |
30,549 |
0 |
1,504 |
14,816 |
14,229 |
226 |
0 |
50,000 |
0 |
configure.yash |
no-host |
1,873 |
1 |
2 |
2.6 |
24.2 |
139,717 |
7,961 |
6,620 |
6,320 |
70,321 |
63,076 |
1,803 |
3 |
50,000 |
0 |
abuild-print-help |
no-host |
22 |
1 |
2 |
2.8 |
8.8 |
116,292 |
64,471 |
42,681 |
4,555 |
54,561 |
57,176 |
270 |
3 |
85,362 |
1 |
rusage Details
task id |
host name |
workload |
elapsed ms |
user ms |
sys ms |
max rss MB |
shell label |
7 |
no-host |
abuild-print-help |
19 |
15 |
5 |
4.3 |
bash |
15 |
no-host |
abuild-print-help |
9 |
8 |
1 |
3.4 |
dash |
23 |
no-host |
abuild-print-help |
454 |
397 |
62 |
21.6 |
osh-cpython |
31 |
no-host |
abuild-print-help |
22 |
11 |
12 |
8.8 |
osh-native |
1 |
no-host |
bin-true |
679 |
518 |
192 |
3.0 |
bash |
9 |
no-host |
bin-true |
544 |
414 |
139 |
1.4 |
dash |
17 |
no-host |
bin-true |
2,262 |
1,499 |
1,029 |
17.6 |
osh-cpython |
25 |
no-host |
bin-true |
807 |
580 |
240 |
8.0 |
osh-native |
2 |
no-host |
configure.cpython |
15,017 |
8,909 |
6,506 |
27.5 |
bash |
10 |
no-host |
configure.cpython |
15,196 |
9,096 |
6,519 |
27.3 |
dash |
18 |
no-host |
configure.cpython |
28,683 |
17,197 |
13,345 |
27.4 |
osh-cpython |
26 |
no-host |
configure.cpython |
15,434 |
8,998 |
6,708 |
27.3 |
osh-native |
4 |
no-host |
configure.ocaml |
3,895 |
1,743 |
1,188 |
20.6 |
bash |
12 |
no-host |
configure.ocaml |
3,774 |
1,560 |
1,232 |
20.6 |
dash |
20 |
no-host |
configure.ocaml |
4,683 |
2,258 |
1,633 |
20.4 |
osh-cpython |
28 |
no-host |
configure.ocaml |
3,895 |
1,747 |
1,188 |
20.6 |
osh-native |
5 |
no-host |
configure.tcc |
48 |
19 |
29 |
19.4 |
bash |
13 |
no-host |
configure.tcc |
42 |
24 |
18 |
19.3 |
dash |
21 |
no-host |
configure.tcc |
194 |
133 |
65 |
19.3 |
osh-cpython |
29 |
no-host |
configure.tcc |
49 |
33 |
17 |
19.3 |
osh-native |
3 |
no-host |
configure.util-linux |
14,277 |
8,855 |
5,896 |
30.1 |
bash |
11 |
no-host |
configure.util-linux |
14,949 |
9,264 |
6,168 |
30.1 |
dash |
19 |
no-host |
configure.util-linux |
31,445 |
21,052 |
11,491 |
30.1 |
osh-cpython |
27 |
no-host |
configure.util-linux |
14,527 |
8,714 |
6,005 |
30.0 |
osh-native |
6 |
no-host |
configure.yash |
1,840 |
1,108 |
738 |
24.4 |
bash |
14 |
no-host |
configure.yash |
1,791 |
1,064 |
731 |
24.2 |
dash |
22 |
no-host |
configure.yash |
2,474 |
1,545 |
969 |
24.2 |
osh-cpython |
30 |
no-host |
configure.yash |
1,873 |
1,079 |
798 |
24.2 |
osh-native |
0 |
no-host |
hello-world |
1 |
1 |
0 |
2.9 |
bash |
8 |
no-host |
hello-world |
1 |
1 |
0 |
1.4 |
dash |
16 |
no-host |
hello-world |
50 |
29 |
20 |
17.3 |
osh-cpython |
24 |
no-host |
hello-world |
3 |
0 |
3 |
6.2 |
osh-native |
More Details
task id |
host name |
workload |
minor faults |
major faults |
swaps |
in block |
out block |
signals |
voluntary ctx |
involuntary ctx |
shell label |
7 |
no-host |
abuild-print-help |
2,542 |
0 |
0 |
0 |
16 |
0 |
41 |
0 |
bash |
15 |
no-host |
abuild-print-help |
1,080 |
0 |
0 |
0 |
8 |
0 |
39 |
1 |
dash |
23 |
no-host |
abuild-print-help |
22,924 |
0 |
0 |
0 |
8 |
0 |
45 |
11 |
osh-cpython |
31 |
no-host |
abuild-print-help |
3,159 |
0 |
0 |
0 |
16 |
0 |
39 |
2 |
osh-native |
1 |
no-host |
bin-true |
106,267 |
0 |
0 |
0 |
8 |
0 |
1,995 |
49 |
bash |
9 |
no-host |
bin-true |
66,431 |
0 |
0 |
0 |
8 |
0 |
1,990 |
50 |
dash |
17 |
no-host |
bin-true |
759,891 |
0 |
0 |
0 |
8 |
0 |
1,992 |
169 |
osh-cpython |
25 |
no-host |
bin-true |
127,172 |
0 |
0 |
0 |
16 |
0 |
1,987 |
68 |
osh-native |
2 |
no-host |
configure.cpython |
2,222,097 |
1 |
0 |
0 |
32,928 |
0 |
14,558 |
1,021 |
bash |
10 |
no-host |
configure.cpython |
2,246,234 |
0 |
0 |
0 |
32,992 |
0 |
14,595 |
1,144 |
dash |
18 |
no-host |
configure.cpython |
6,186,171 |
0 |
0 |
0 |
27,512 |
0 |
13,198 |
1,293 |
osh-cpython |
26 |
no-host |
configure.cpython |
2,225,508 |
0 |
0 |
0 |
27,520 |
0 |
13,250 |
1,060 |
osh-native |
4 |
no-host |
configure.ocaml |
411,019 |
0 |
0 |
0 |
5,120 |
0 |
1,963 |
169 |
bash |
12 |
no-host |
configure.ocaml |
390,845 |
0 |
0 |
0 |
5,112 |
0 |
1,881 |
162 |
dash |
20 |
no-host |
configure.ocaml |
640,533 |
1 |
0 |
0 |
5,112 |
0 |
1,847 |
208 |
osh-cpython |
28 |
no-host |
configure.ocaml |
413,734 |
0 |
0 |
0 |
5,120 |
0 |
1,923 |
151 |
osh-native |
5 |
no-host |
configure.tcc |
6,535 |
0 |
0 |
0 |
104 |
0 |
49 |
2 |
bash |
13 |
no-host |
configure.tcc |
5,480 |
0 |
0 |
0 |
96 |
0 |
47 |
2 |
dash |
21 |
no-host |
configure.tcc |
23,321 |
0 |
0 |
0 |
96 |
0 |
52 |
15 |
osh-cpython |
29 |
no-host |
configure.tcc |
7,009 |
0 |
0 |
0 |
104 |
0 |
47 |
3 |
osh-native |
3 |
no-host |
configure.util-linux |
2,100,727 |
0 |
0 |
0 |
42,400 |
0 |
18,523 |
1,169 |
bash |
11 |
no-host |
configure.util-linux |
2,259,313 |
2 |
0 |
0 |
42,584 |
0 |
17,485 |
1,201 |
dash |
19 |
no-host |
configure.util-linux |
5,337,926 |
10 |
0 |
0 |
39,112 |
0 |
16,975 |
1,309 |
osh-cpython |
27 |
no-host |
configure.util-linux |
1,997,627 |
5 |
0 |
0 |
39,128 |
0 |
16,968 |
987 |
osh-native |
6 |
no-host |
configure.yash |
255,599 |
0 |
0 |
0 |
4,120 |
0 |
873 |
91 |
bash |
14 |
no-host |
configure.yash |
244,617 |
0 |
0 |
0 |
3,720 |
0 |
870 |
87 |
dash |
22 |
no-host |
configure.yash |
385,340 |
0 |
0 |
0 |
3,728 |
0 |
855 |
97 |
osh-cpython |
30 |
no-host |
configure.yash |
258,486 |
0 |
0 |
0 |
3,736 |
0 |
850 |
74 |
osh-native |
0 |
no-host |
hello-world |
152 |
0 |
0 |
0 |
8 |
0 |
1 |
0 |
bash |
8 |
no-host |
hello-world |
85 |
0 |
0 |
0 |
8 |
0 |
1 |
0 |
dash |
16 |
no-host |
hello-world |
3,698 |
0 |
0 |
0 |
8 |
0 |
7 |
3 |
osh-cpython |
24 |
no-host |
hello-world |
346 |
0 |
0 |
0 |
16 |
0 |
1 |
0 |
osh-native |
Shell and Host