Metrics for Herbie run

Date:	Tuesday, April 16th, 2024
Commit:	7c422dd2 on artem-sharing-exponents
Hostname:	nightly with Racket 8.11.1
Seed:	2024107
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample20.9min (21.9%)

Results

10.4min	4229112×	0	valid
1.8min	232679×	1	valid
33.6s	193178×	0	invalid
49.7s	143988×	0	precondition
2.3min	63845×	5	exit
15.1s	63000×	0	unsamplable
12.9s	11862×	2	valid
2.1s	4356×	1	invalid
2.5s	1104×	3	valid
45.0ms	74×	2	invalid
41.0ms	52×	1	unsamplable
206.0ms	42×	4	valid
8.0ms	3×	5	valid
2.0ms	1×	3	unsamplable

Precisions

Click to see histograms. Total time spent on operations: 12.8min

ival-mult: 2.4min (19% of total)

ival-sin: 1.5min (12% of total)

ival-pow: 1.3min (9.9% of total)

ival-div: 1.2min (9% of total)

ival-add: 56.4s (7.3% of total)

ival-sub: 52.6s (6.8% of total)

ival-exp: 50.5s (6.6% of total)

ival-cos: 49.0s (6.4% of total)

backward-pass: 29.5s (3.8% of total)

ival-<=: 28.5s (3.7% of total)

ival-log: 23.9s (3.1% of total)

ival-tan: 22.5s (2.9% of total)

ival-sqrt: 20.1s (2.6% of total)

const: 11.8s (1.5% of total)

ival-neg: 6.3s (0.8% of total)

ival-fabs: 6.3s (0.8% of total)

ival-<: 4.5s (0.6% of total)

ival-and: 3.2s (0.4% of total)

ival-pi: 2.9s (0.4% of total)

ival-atan: 2.2s (0.3% of total)

ival->: 1.8s (0.2% of total)

ival-==: 1.6s (0.2% of total)

ival-asin: 1.6s (0.2% of total)

ival-atan2: 1.4s (0.2% of total)

ival-acos: 1.4s (0.2% of total)

ival-sinh: 1.2s (0.2% of total)

ival-fmod: 1.0s (0.1% of total)

ival-fmin: 759.0ms (0.1% of total)

ival-floor: 727.0ms (0.1% of total)

ival-if: 496.0ms (0.1% of total)

ival-cbrt: 485.0ms (0.1% of total)

ival-cosh: 455.0ms (0.1% of total)

ival->=: 388.0ms (0.1% of total)

ival-fmax: 363.0ms (0% of total)

ival-log2: 348.0ms (0% of total)

ival-hypot: 288.0ms (0% of total)

ival-acosh: 284.0ms (0% of total)

ival-asinh: 271.0ms (0% of total)

ival-atanh: 220.0ms (0% of total)

ival-fma: 151.0ms (0% of total)

ival-tanh: 136.0ms (0% of total)

ival-or: 53.0ms (0% of total)

Bogosity

localize18.1min (19%)

Results

5.0min	376613×	0	valid
3.3min	40165×	1	valid
38.1s	24041×	0	invalid
1.2min	10519×	2	valid
3.6min	9455×	5	exit
2.8s	2727×	0	unsamplable
41.1s	1141×	3	valid
5.0s	547×	1	invalid
1.8s	25×	4	valid
8.0ms	1×	5	valid

Compiler

Compiled 457327 to 212503 computations (53.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 12.2min

ival-mult: 2.6min (21.7% of total)

ival-pow: 2.0min (16.2% of total)

ival-sin: 1.2min (10.3% of total)

ival-div: 1.2min (10.2% of total)

backward-pass: 1.1min (8.9% of total)

ival-cos: 46.3s (6.4% of total)

ival-add: 41.0s (5.6% of total)

ival-sub: 28.7s (3.9% of total)

ival-fma: 20.6s (2.8% of total)

ival-sqrt: 17.1s (2.3% of total)

ival-log: 15.2s (2.1% of total)

const: 12.8s (1.7% of total)

ival-tan: 10.8s (1.5% of total)

ival-exp: 10.1s (1.4% of total)

ival-hypot: 6.6s (0.9% of total)

ival-asin: 6.5s (0.9% of total)

ival-cbrt: 5.5s (0.8% of total)

ival-log1p: 3.8s (0.5% of total)

ival-atan: 2.5s (0.3% of total)

ival-neg: 2.5s (0.3% of total)

ival-expm1: 2.3s (0.3% of total)

ival-acos: 1.3s (0.2% of total)

ival-atan2: 1.2s (0.2% of total)

ival-fmax: 796.0ms (0.1% of total)

ival-fmod: 712.0ms (0.1% of total)

ival-pi: 674.0ms (0.1% of total)

ival-fabs: 506.0ms (0.1% of total)

ival-sinh: 289.0ms (0% of total)

ival-if: 283.0ms (0% of total)

ival-floor: 199.0ms (0% of total)

ival->=: 163.0ms (0% of total)

ival-copysign: 163.0ms (0% of total)

ival-e: 139.0ms (0% of total)

ival->: 119.0ms (0% of total)

ival-log2: 104.0ms (0% of total)

ival-cosh: 75.0ms (0% of total)

ival-<: 22.0ms (0% of total)

ival-tanh: 10.0ms (0% of total)

simplify10.0min (10.5%)

Algorithm

2247×

egg-herbie

Rules

703130×	`fma-define`
503525×	`*-commutative`
502365×	`fma-neg`
495856×	`associate-r`
486635×	`distribute-lft-in`

Stop Event

543×	saturated
1682×	node limit
22×	unsound

Counts

796950 → 699388

soundness8.5min (8.9%)

Rules

647970×	`fma-define`
465639×	`fma-neg`
431582×	`log1p-expm1-u`
398733×	`associate-r`
361875×	`times-frac`

Stop Event

158×	saturated
337×	fuel
1765×	node limit
23×	unsound
203×	done

Compiler

Compiled 435873 to 236373 computations (45.8% saved)

eval8.3min (8.7%)

Compiler: Compiled 37415604 to 19796197 computations (47.1% saved)

rewrite6.1min (6.4%)

Algorithm

1707×

batch-egg-rewrite

Rules

1080153×	`log1p-expm1-u`
827835×	`expm1-log1p-u`
368916×	`pow1`
355884×	`add-exp-log`
343448×	`add-log-exp`

Stop Event

1688×	node limit
19×	unsound

Counts

13728 → 448861

prune5.4min (5.7%)

Counts: 1051155 → 35663
Compiler: Compiled 1659704 to 1107215 computations (33.3% saved)

regimes5.1min (5.3%)

Counts

91460 → 9592

Calls

1196 calls:

27.7s	y
26.8s	x
23.6s	z
21.7s	t
17.1s	a

Compiler

Compiled 91613 to 69099 computations (24.6% saved)

explain3.7min (3.9%)

Results

1.2min	234492×	0	valid
49.0s	33230×	1	valid
24.5s	8576×	2	valid
23.0s	974×	3	valid
870.0ms	198×	5	exit
1.0s	34×	4	valid

Compiler

Compiled 97157 to 47036 computations (51.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.2min

ival-mult: 27.5s (20.9% of total)

ival-sin: 18.0s (13.6% of total)

ival-div: 17.3s (13.2% of total)

ival-cos: 11.4s (8.7% of total)

ival-pow: 11.4s (8.7% of total)

ival-sub: 10.6s (8% of total)

ival-add: 10.2s (7.8% of total)

backward-pass: 9.6s (7.3% of total)

ival-log: 3.9s (3% of total)

ival-sqrt: 2.9s (2.2% of total)

ival-tan: 2.5s (1.9% of total)

const: 2.2s (1.7% of total)

ival-exp: 1.8s (1.3% of total)

ival-neg: 586.0ms (0.4% of total)

ival-atan: 535.0ms (0.4% of total)

ival-sinh: 154.0ms (0.1% of total)

ival-atan2: 146.0ms (0.1% of total)

ival-fabs: 139.0ms (0.1% of total)

ival-asin: 118.0ms (0.1% of total)

ival-pi: 109.0ms (0.1% of total)

ival-acos: 93.0ms (0.1% of total)

ival-if: 88.0ms (0.1% of total)

ival-hypot: 85.0ms (0.1% of total)

ival-cbrt: 62.0ms (0% of total)

ival-floor: 49.0ms (0% of total)

ival-fmod: 46.0ms (0% of total)

ival-fmax: 24.0ms (0% of total)

ival-log1p: 19.0ms (0% of total)

ival->=: 19.0ms (0% of total)

ival-copysign: 18.0ms (0% of total)

ival-fma: 16.0ms (0% of total)

ival-log2: 14.0ms (0% of total)

ival-tanh: 13.0ms (0% of total)

ival-cosh: 13.0ms (0% of total)

ival-<: 12.0ms (0% of total)

ival->: 5.0ms (0% of total)

bsearch2.9min (3%)

Algorithm

4937×	binary-search
571×	left-value

Stop Event

148×	predicate-same
4788×	narrow-enough
1×	predicate-failed

Results

1.7min	564666×	0	valid
17.6s	34044×	1	valid
3.6s	21847×	0	invalid
2.4s	4384×	2	valid
298.0ms	416×	3	valid
14.0ms	110×	0	unsamplable
29.0ms	101×	1	invalid
6.0ms	14×	2	invalid
85.0ms	10×	4	valid

Compiler

Compiled 1254660 to 931802 computations (25.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.4min

ival-mult: 31.4s (36.5% of total)

ival-sub: 13.2s (15.4% of total)

ival-add: 10.3s (12% of total)

ival-div: 9.0s (10.5% of total)

ival-pow: 4.2s (4.9% of total)

ival-sin: 3.9s (4.5% of total)

ival-cos: 2.8s (3.2% of total)

backward-pass: 2.3s (2.7% of total)

ival-log: 2.3s (2.7% of total)

ival-sqrt: 2.2s (2.6% of total)

const: 1.3s (1.5% of total)

ival-exp: 1.1s (1.2% of total)

ival-neg: 646.0ms (0.8% of total)

ival-tan: 511.0ms (0.6% of total)

ival-atan2: 318.0ms (0.4% of total)

ival-acos: 126.0ms (0.1% of total)

ival-atan: 100.0ms (0.1% of total)

ival-pi: 61.0ms (0.1% of total)

ival-fabs: 42.0ms (0% of total)

ival-asin: 25.0ms (0% of total)

ival-hypot: 20.0ms (0% of total)

ival-sinh: 16.0ms (0% of total)

ival-tanh: 9.0ms (0% of total)

ival->=: 8.0ms (0% of total)

ival-if: 7.0ms (0% of total)

ival-copysign: 7.0ms (0% of total)

ival-cosh: 5.0ms (0% of total)

ival-cbrt: 3.0ms (0% of total)

ival-fmod: 1.0ms (0% of total)

preprocess2.3min (2.4%)

Algorithm

542×	egg-herbie

Rules

254384×	`fma-define`
252110×	`fma-neg`
118944×	`unsub-neg`
101039×	`sub-neg`
94642×	`distribute-lft-in`

Stop Event

294×	saturated
248×	node limit

Compiler

Compiled 388928 to 210590 computations (45.9% saved)

series2.2min (2.3%)

Counts

13728 → 348089

Calls

85122 calls:

Time	Variable		Point	Expression
493.0ms	g	@	0	(cbrt (cbrt (* g (/ 1/2 a))))
455.0ms	x	@	inf	(* z (- t x))
377.0ms	t	@	-inf	(* x (+ (+ (+ y (* 2 z)) y) t))
376.0ms	x	@	-inf	(+ (log 2) (log x))
319.0ms	w	@	inf	(pow (fmax (pow (sqrt (+ (* (* (floor d) dX.w) (* (floor d) dX.w)) (* (sqrt (+ (* (* (floor w) dX.u) (* (floor w) dX.u)) (* (* (floor h) dX.v) (* (floor h) dX.v)))) (sqrt (+ (* (* (floor w) dX.u) (* (floor w) dX.u)) (* (* (floor h) dX.v) (* (floor h) dX.v))))))) 2) (+ (* (pow (floor w) 2) (pow dY.u 2)) (pow (* (floor d) dY.w) 2))) 1/4)

analyze1.8min (1.9%)

Algorithm

545×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	84.4%	15.6%	0%	0%	0%	0
39.4%	33.3%	51.2%	15.6%	0%	0%	0%	1
45.1%	37.7%	46%	15.6%	0%	0.7%	0%	2
54.3%	44.3%	37.3%	15.7%	0%	2.7%	0%	3
61%	49.2%	31.4%	15.8%	0%	3.6%	0%	4
67.2%	53.9%	26.3%	15.8%	0%	4%	0%	5
71.1%	56.7%	23%	15.8%	0%	4.3%	0%	6
75.1%	59.5%	19.7%	15.9%	0%	4.8%	0.1%	7
77.1%	60.8%	18.1%	15.9%	0%	5.2%	0.1%	8
79.7%	62.6%	15.9%	15.9%	0%	5.5%	0.1%	9
81.2%	63.5%	14.7%	16%	0%	5.7%	0.1%	10
83.5%	65.2%	12.9%	16%	0%	5.8%	0.1%	11
84.6%	65.8%	12%	16%	0%	6.1%	0.1%	12

Compiler

Compiled 13446 to 8689 computations (35.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.1min

ival-mult: 18.0s (27% of total)

ival-div: 8.1s (12.1% of total)

ival-pow: 6.6s (9.8% of total)

ival-add: 5.9s (8.7% of total)

ival-sub: 4.7s (7% of total)

ival-<=: 4.5s (6.7% of total)

ival-sqrt: 3.2s (4.8% of total)

ival-sin: 2.9s (4.3% of total)

ival-cos: 2.6s (3.9% of total)

ival-fabs: 1.8s (2.7% of total)

const: 1.2s (1.7% of total)

ival-log: 979.0ms (1.5% of total)

ival-floor: 741.0ms (1.1% of total)

ival-exp: 680.0ms (1% of total)

ival-and: 652.0ms (1% of total)

ival-<: 609.0ms (0.9% of total)

ival-neg: 569.0ms (0.9% of total)

ival-tan: 537.0ms (0.8% of total)

ival-if: 479.0ms (0.7% of total)

ival-fmax: 357.0ms (0.5% of total)

ival-==: 305.0ms (0.5% of total)

ival-atan2: 214.0ms (0.3% of total)

ival-log2: 194.0ms (0.3% of total)

ival-pi: 185.0ms (0.3% of total)

ival-acos: 185.0ms (0.3% of total)

backward-pass: 171.0ms (0.3% of total)

ival-atan: 150.0ms (0.2% of total)

ival->: 120.0ms (0.2% of total)

ival->=: 106.0ms (0.2% of total)

ival-asin: 97.0ms (0.1% of total)

ival-fmod: 52.0ms (0.1% of total)

ival-sinh: 43.0ms (0.1% of total)

ival-or: 23.0ms (0% of total)

ival-cbrt: 20.0ms (0% of total)

ival-cosh: 15.0ms (0% of total)

ival-tanh: 8.0ms (0% of total)

ival-fmin: 6.0ms (0% of total)

ival-atanh: 1.0ms (0% of total)

ival-asinh: 0.0ms (0% of total)

ival-hypot: 0.0ms (0% of total)

ival-fma: 0.0ms (0% of total)

ival-acosh: 0.0ms (0% of total)

end3.0ms (0%)

Precisions: Click to see histograms. Total time spent on operations: 1.4s
backward-pass: 1.4s (100% of total)

sample20.9min (21.9%)

localize18.1min (19%)

simplify10.0min (10.5%)

soundness8.5min (8.9%)

eval8.3min (8.7%)

rewrite6.1min (6.4%)

prune5.4min (5.7%)

regimes5.1min (5.3%)

explain3.7min (3.9%)

bsearch2.9min (3%)

preprocess2.3min (2.4%)

series2.2min (2.3%)

analyze1.8min (1.9%)

end3.0ms (0%)

Profiling