Metrics for Herbie run

Date:	Friday, January 26th, 2024
Commit:	906dabff on mix-histograms
Hostname:	nightly with Racket 8.11.1
Seed:	2024026
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample7.8min (18.7%)

Results

5.6min	1823098×	256	valid
1.1min	341153×	256	infinite
18.9s	64706×	256	invalid
18.4s	30463×	512	valid
12.0s	19199×	1024	valid
3.4s	5113×	2048	valid
2.4s	1564×	8192	exit
353.0ms	1091×	512	infinite
319.0ms	744×	1024	infinite
715.0ms	694×	1024	invalid
371.0ms	570×	512	invalid
2.0ms	3×	4096	valid

Precisions

Click to see histograms. Total time spent on operations: 2.7min

Operation ival-mult, time spent: 53.4s, 32.0% of total-time

Operation ival-add, time spent: 24.3s, 15.0% of total-time

Operation ival-sub, time spent: 24.0s, 15.0% of total-time

Operation ival-div, time spent: 21.8s, 13.0% of total-time

Operation ival-log, time spent: 14.1s, 9.0% of total-time

Operation ival-sqrt, time spent: 10.0s, 6.0% of total-time

Operation ival-sin, time spent: 4.8s, 3.0% of total-time

Operation ival-cos, time spent: 4.8s, 3.0% of total-time

Operation const, time spent: 4.5s, 3.0% of total-time

Operation ival-exp, time spent: 1.7s, 1.0% of total-time

Operation ival-tan, time spent: 501.0ms, 0.0% of total-time

Operation ival-acos, time spent: 376.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 257.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 198.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 183.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 169.0ms, 0.0% of total-time

Bogosity

soundness7.6min (18.2%)

Rules

1167386×	`fma-def`
626414×	`associate-r`
556880×	`times-frac`
502344×	`log-prod`
492676×	`fma-neg`

Stop Event

89×	saturated
1450×	node limit
7×	unsound

Compiler

Compiled 101794 to 56511 computations (44.5% saved)

regimes5.2min (12.6%)

Counts

32828 → 5655

Calls

485 calls:

50.1s	y
47.6s	z
44.2s	x
37.5s	t
24.2s	a

Compiler

Compiled 43990 to 34884 computations (20.7% saved)

localize4.4min (10.5%)

Compiler: Compiled 105693 to 46344 computations (56.2% saved)
Precisions: Click to see histograms. Total time spent on operations: 2.2min
Operation ival-mult, time spent: 29.3s, 23.0% of total-time
Operation ival-pow, time spent: 22.1s, 17.0% of total-time
Operation ival-div, time spent: 16.4s, 13.0% of total-time
Operation ival-add, time spent: 13.3s, 10.0% of total-time
Operation ival-sqrt, time spent: 9.7s, 7.0% of total-time
Operation ival-sub, time spent: 8.8s, 7.0% of total-time
Operation ival-log, time spent: 8.7s, 7.0% of total-time
Operation ival-fma, time spent: 6.1s, 5.0% of total-time
Operation const, time spent: 3.7s, 3.0% of total-time
Operation ival-cos, time spent: 2.6s, 2.0% of total-time
Operation ival-sin, time spent: 1.9s, 1.0% of total-time
Operation ival-exp, time spent: 1.8s, 1.0% of total-time
Operation ival-cbrt, time spent: 1.5s, 1.0% of total-time
Operation ival-log1p, time spent: 1.2s, 1.0% of total-time
Operation ival-neg, time spent: 813.0ms, 1.0% of total-time
Operation ival-expm1, time spent: 580.0ms, 0.0% of total-time
Operation ival-tan, time spent: 435.0ms, 0.0% of total-time
Operation ival-acos, time spent: 180.0ms, 0.0% of total-time
Operation ival-hypot, time spent: 179.0ms, 0.0% of total-time
Operation ival-e, time spent: 109.0ms, 0.0% of total-time
Operation ival-sinh, time spent: 16.0ms, 0.0% of total-time
Operation ival-cosh, time spent: 16.0ms, 0.0% of total-time
Operation ival-fabs, time spent: 15.0ms, 0.0% of total-time
Operation ival-tanh, time spent: 13.0ms, 0.0% of total-time

simplify3.6min (8.8%)

Algorithm

1073×

egg-herbie

Rules

572490×	`fma-def`
440242×	`log-prod`
401252×	`associate-r`
358688×	`times-frac`
349138×	`associate-l`

Stop Event

268×	saturated
801×	node limit
135×	fuel
4×	unsound
134×	done

Counts

353132 → 265785

Compiler

Compiled 65508 to 39941 computations (39% saved)

eval2.9min (6.9%)

Compiler: Compiled 8041094 to 4323219 computations (46.2% saved)

rewrite2.8min (6.8%)

Algorithm

804×	batch-egg-rewrite

Rules

492413×	`log1p-expm1-u`
380873×	`expm1-log1p-u`
291838×	`expm1-udef`
286246×	`prod-diff`
271272×	`log1p-udef`

Stop Event

803×	node limit
1×	unsound

Counts

5348 → 208133

bsearch2.5min (6%)

Algorithm

3401×	binary-search
258×	left-value

Stop Event

56×	predicate-same
3345×	narrow-enough

Results

1.4min	318623×	256	valid
48.4s	90105×	256	infinite
1.3s	8218×	256	invalid
3.8s	5490×	512	valid
1.8s	2470×	1024	valid
139.0ms	256×	2048	valid
24.0ms	51×	512	infinite
14.0ms	13×	1024	infinite

Compiler

Compiled 778480 to 587041 computations (24.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.1min

Operation ival-mult, time spent: 29.6s, 46.0% of total-time

Operation ival-sub, time spent: 13.1s, 20.0% of total-time

Operation ival-add, time spent: 9.3s, 15.0% of total-time

Operation ival-div, time spent: 4.4s, 7.0% of total-time

Operation ival-log, time spent: 2.5s, 4.0% of total-time

Operation ival-sqrt, time spent: 1.8s, 3.0% of total-time

Operation const, time spent: 1.6s, 2.0% of total-time

Operation ival-sin, time spent: 735.0ms, 1.0% of total-time

Operation ival-exp, time spent: 500.0ms, 1.0% of total-time

Operation ival-cos, time spent: 483.0ms, 1.0% of total-time

Operation ival-tanh, time spent: 32.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 16.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 2.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 2.0ms, 0.0% of total-time

preprocess2.2min (5.3%)

Algorithm

269×	egg-herbie

Rules

366494×	`fma-def`
126628×	`fma-neg`
120808×	`sub-neg`
110422×	`unsub-neg`
108590×	`div-sub`

Stop Event

123×	saturated
146×	node limit

Compiler

Compiled 191707 to 96040 computations (49.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 20.0s

Operation ival-mult, time spent: 6.0s, 30.0% of total-time

Operation ival-add, time spent: 3.0s, 15.0% of total-time

Operation ival-div, time spent: 2.8s, 14.0% of total-time

Operation ival-sub, time spent: 2.6s, 13.0% of total-time

Operation ival-log, time spent: 2.4s, 12.0% of total-time

Operation ival-sqrt, time spent: 1.3s, 7.0% of total-time

Operation const, time spent: 664.0ms, 3.0% of total-time

Operation ival-cos, time spent: 470.0ms, 2.0% of total-time

Operation ival-sin, time spent: 393.0ms, 2.0% of total-time

Operation ival-exp, time spent: 196.0ms, 1.0% of total-time

Operation ival-tan, time spent: 47.0ms, 0.0% of total-time

Operation ival-acos, time spent: 20.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 11.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 11.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 9.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 8.0ms, 0.0% of total-time

prune1.6min (3.9%)

Counts: 337397 → 12444
Compiler: Compiled 405910 to 276973 computations (31.8% saved)

series37.6s (1.5%)

Counts

5348 → 144999

Calls

38091 calls:

Time	Variable		Point	Expression
325.0ms	x	@	0	(*.f64 x (log.f64 y))
268.0ms	y	@	-inf	(/.f64 (hypot.f64 (pow.f64 y 3/2) (pow.f64 x 3/2)) y)
256.0ms	y	@	inf	(pow.f64 (*.f64 y (sqrt.f64 x)) 2)
253.0ms	z	@	inf	(+.f64 (-.f64 (-.f64 (*.f64 x (log.f64 y)) y) z) (log.f64 t))
222.0ms	y	@	inf	(.f64 (sqrt.f64 x) (.f64 3 (+.f64 (/.f64 1/9 x) (+.f64 y -1))))

analyze25.2s (1%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.3%	68.3%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.4%	22.9%	0.1%	0%	4.6%	0%	6
80%	75.7%	19%	0.1%	0%	5.1%	0%	7
81.8%	77.1%	17.1%	0.1%	0%	5.6%	0%	8
84.5%	79.4%	14.6%	0.1%	0%	5.9%	0%	9
86.1%	80.6%	13.1%	0.1%	0%	6.2%	0%	10
88.6%	83%	10.6%	0.1%	0%	6.2%	0%	11
89.7%	83.7%	9.6%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 11.0s

Operation ival-mult, time spent: 3.9s, 35.0% of total-time

Operation ival-add, time spent: 2.1s, 19.0% of total-time

Operation ival-sub, time spent: 1.8s, 16.0% of total-time

Operation ival-div, time spent: 1.4s, 12.0% of total-time

Operation ival-sqrt, time spent: 723.0ms, 7.0% of total-time

Operation ival-log, time spent: 446.0ms, 4.0% of total-time

Operation const, time spent: 277.0ms, 3.0% of total-time

Operation ival-exp, time spent: 163.0ms, 1.0% of total-time

Operation ival-cos, time spent: 133.0ms, 1.0% of total-time

Operation ival-sin, time spent: 123.0ms, 1.0% of total-time

Operation ival-acos, time spent: 43.0ms, 0.0% of total-time

Operation ival-tan, time spent: 35.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 16.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 10.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 5.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 3.0ms, 0.0% of total-time

Herbie run

sample7.8min (18.7%)

soundness7.6min (18.2%)

regimes5.2min (12.6%)

localize4.4min (10.5%)

simplify3.6min (8.8%)

eval2.9min (6.9%)

rewrite2.8min (6.8%)

bsearch2.5min (6%)

preprocess2.2min (5.3%)

prune1.6min (3.9%)

series37.6s (1.5%)

analyze25.2s (1%)

end234.0ms (0%)

Profiling