Metrics for Herbie run

Date:	Wednesday, January 31st, 2024
Commit:	84d7cf92 on artem-tuning-128start-20-128-512-1024-2048
Hostname:	nightly with Racket 8.11.1
Seed:	2024031
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.9min (23%)

Results

58.5s	256716×	0	valid
9.4s	30996×	0	infinite
9.0s	27694×	1	valid
16.0s	20664×	3	valid
5.1s	9176×	2	valid
579.0ms	2660×	0	invalid
749.0ms	1009×	4	valid
234.0ms	945×	0	unsamplable
4.4s	548×	5	exit
115.0ms	243×	1	infinite
191.0ms	204×	2	infinite
93.0ms	50×	3	infinite

Precisions

Click to see histograms. Total time spent on operations: 1.2min

Operation ival-add, time spent: 17.7s, 25.0% of total-time

Operation ival-sub, time spent: 12.5s, 18.0% of total-time

Operation ival-mult, time spent: 12.0s, 17.0% of total-time

Operation ival-div, time spent: 6.7s, 10.0% of total-time

Operation ival-pow, time spent: 6.5s, 9.0% of total-time

Operation ival-<=, time spent: 3.9s, 6.0% of total-time

Operation ival-sin, time spent: 2.3s, 3.0% of total-time

Operation const, time spent: 2.2s, 3.0% of total-time

Operation ival-sqrt, time spent: 1.0s, 1.0% of total-time

Operation ival-cos, time spent: 1.0s, 1.0% of total-time

Operation ival-exp, time spent: 958.0ms, 1.0% of total-time

Operation ival-and, time spent: 680.0ms, 1.0% of total-time

Operation ival-neg, time spent: 505.0ms, 1.0% of total-time

Operation ival-fma, time spent: 462.0ms, 1.0% of total-time

Operation ival-<, time spent: 393.0ms, 1.0% of total-time

Operation ival-==, time spent: 359.0ms, 1.0% of total-time

Operation ival-log, time spent: 307.0ms, 0.0% of total-time

Operation ival-tan, time spent: 305.0ms, 0.0% of total-time

Operation ival-atan, time spent: 112.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 46.0ms, 0.0% of total-time

Operation ival-pi, time spent: 43.0ms, 0.0% of total-time

Operation ival-if, time spent: 4.0ms, 0.0% of total-time

Bogosity

localize1.7min (20.2%)

Compiler: Compiled 28825 to 16834 computations (41.6% saved)
Precisions: Click to see histograms. Total time spent on operations: 1.3min
Operation ival-add, time spent: 20.8s, 26.0% of total-time
Operation ival-mult, time spent: 17.1s, 21.0% of total-time
Operation ival-sub, time spent: 12.5s, 16.0% of total-time
Operation ival-pow, time spent: 11.4s, 14.0% of total-time
Operation ival-div, time spent: 7.6s, 9.0% of total-time
Operation ival-fma, time spent: 4.6s, 6.0% of total-time
Operation const, time spent: 2.3s, 3.0% of total-time
Operation ival-sqrt, time spent: 1.0s, 1.0% of total-time
Operation ival-exp, time spent: 731.0ms, 1.0% of total-time
Operation ival-log, time spent: 560.0ms, 1.0% of total-time
Operation ival-expm1, time spent: 269.0ms, 0.0% of total-time
Operation ival-cbrt, time spent: 211.0ms, 0.0% of total-time
Operation ival-hypot, time spent: 147.0ms, 0.0% of total-time
Operation ival-log1p, time spent: 112.0ms, 0.0% of total-time
Operation ival-cos, time spent: 109.0ms, 0.0% of total-time
Operation ival-neg, time spent: 89.0ms, 0.0% of total-time
Operation ival-tan, time spent: 87.0ms, 0.0% of total-time
Operation ival-atan, time spent: 81.0ms, 0.0% of total-time
Operation ival-sin, time spent: 51.0ms, 0.0% of total-time
Operation ival-pi, time spent: 5.0ms, 0.0% of total-time

soundness1.0min (12%)

Rules

161304×	`fma-def`
87798×	`times-frac`
84832×	`associate-r`
74556×	`distribute-lft-in`
71480×	`log-prod`

Stop Event

4×	saturated
255×	node limit

Compiler

Compiled 22826 to 13770 computations (39.7% saved)

eval58.6s (11.6%)

Compiler: Compiled 2549541 to 1686149 computations (33.9% saved)

preprocess36.7s (7.3%)

Algorithm

42×	egg-herbie

Rules

48610×	`fma-def`
20956×	`sub-neg`
19818×	`fma-neg`
19082×	`div-sub`
18016×	`unsub-neg`

Stop Event

11×	saturated
31×	node limit

Compiler

Compiled 33787 to 20537 computations (39.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 18.3s

Operation ival-add, time spent: 4.9s, 27.0% of total-time

Operation ival-mult, time spent: 4.9s, 27.0% of total-time

Operation ival-sub, time spent: 3.7s, 20.0% of total-time

Operation ival-div, time spent: 2.2s, 12.0% of total-time

Operation ival-pow, time spent: 1.5s, 8.0% of total-time

Operation const, time spent: 568.0ms, 3.0% of total-time

Operation ival-exp, time spent: 114.0ms, 1.0% of total-time

Operation ival-sin, time spent: 109.0ms, 1.0% of total-time

Operation ival-sqrt, time spent: 102.0ms, 1.0% of total-time

Operation ival-neg, time spent: 74.0ms, 0.0% of total-time

Operation ival-cos, time spent: 58.0ms, 0.0% of total-time

Operation ival-fma, time spent: 25.0ms, 0.0% of total-time

Operation ival-tan, time spent: 24.0ms, 0.0% of total-time

Operation ival-log, time spent: 20.0ms, 0.0% of total-time

Operation ival-atan, time spent: 13.0ms, 0.0% of total-time

Operation ival-pi, time spent: 4.0ms, 0.0% of total-time

simplify32.9s (6.5%)

Algorithm

166×	egg-herbie

Rules

99112×	`fma-def`
57056×	`associate-r`
55244×	`distribute-lft-in`
52498×	`times-frac`
51730×	`log-prod`

Stop Event

42×	saturated
124×	node limit
23×	fuel
19×	done

Counts

52325 → 46969

Compiler

Compiled 9696 to 6229 computations (35.8% saved)

rewrite25.5s (5.1%)

Algorithm

124×	batch-egg-rewrite

Rules

65120×	`log1p-expm1-u`
58028×	`expm1-log1p-u`
42746×	`prod-diff`
41854×	`log-prod`
36156×	`fma-def`

Stop Event

124×	node limit

Counts

923 → 34915

prune20.5s (4.1%)

Counts: 75067 → 1976
Compiler: Compiled 76298 to 52156 computations (31.6% saved)

bsearch20.4s (4%)

Algorithm

301×	binary-search
26×	left-value

Stop Event

7×	predicate-same
294×	narrow-enough

Results

7.5s	21460×	0	valid
5.5s	7203×	0	infinite
606.0ms	3790×	0	invalid
1.5s	3777×	1	valid
1.0s	1932×	2	valid
1.4s	1092×	3	valid
63.0ms	161×	1	infinite
69.0ms	118×	2	infinite
231.0ms	47×	5	exit
0.0ms	2×	0	unsamplable
2.0ms	1×	4	valid

Compiler

Compiled 94953 to 65909 computations (30.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 12.9s

Operation ival-add, time spent: 3.8s, 30.0% of total-time

Operation ival-mult, time spent: 3.3s, 26.0% of total-time

Operation ival-sub, time spent: 2.9s, 23.0% of total-time

Operation ival-div, time spent: 1.2s, 9.0% of total-time

Operation ival-pow, time spent: 885.0ms, 7.0% of total-time

Operation const, time spent: 309.0ms, 2.0% of total-time

Operation ival-sqrt, time spent: 165.0ms, 1.0% of total-time

Operation ival-exp, time spent: 152.0ms, 1.0% of total-time

Operation ival-neg, time spent: 118.0ms, 1.0% of total-time

Operation ival-log, time spent: 5.0ms, 0.0% of total-time

regimes17.9s (3.6%)

Counts

4621 → 600

Calls

94 calls:

2.3s	c
1.8s	b
1.6s	x1
1.5s	x
1.4s	a

Compiler

Compiled 4030 to 2834 computations (29.7% saved)

analyze9.3s (1.8%)

Algorithm

43×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	54.5%	45.5%	0%	0%	0%	0
23.5%	12.8%	41.7%	45.5%	0%	0%	0%	1
37.4%	20.4%	34.1%	45.5%	0%	0%	0%	2
49.2%	26.2%	27.1%	45.5%	0%	1.2%	0%	3
58%	30.7%	22.3%	45.5%	0%	1.5%	0%	4
71.4%	37.7%	15.1%	45.6%	0%	1.7%	0%	5
73%	38.4%	14.2%	45.6%	0%	1.7%	0%	6
78%	40.7%	11.5%	45.6%	0%	2.2%	0%	7
81.6%	42.6%	9.6%	45.7%	0%	2.2%	0%	8
84.5%	43.8%	8%	45.7%	0%	2.5%	0%	9
86.6%	44.6%	6.9%	45.7%	0%	2.7%	0%	10
88.7%	45.6%	5.8%	45.7%	0%	2.8%	0.1%	11
89.7%	45.9%	5.3%	45.7%	0%	2.9%	0.1%	12

Compiler

Compiled 1441 to 1017 computations (29.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 7.6s

Operation ival-sqrt, time spent: 1.4s, 19.0% of total-time

Operation ival-sub, time spent: 1.4s, 18.0% of total-time

Operation ival-add, time spent: 1.3s, 17.0% of total-time

Operation ival-mult, time spent: 1.1s, 14.0% of total-time

Operation ival-div, time spent: 917.0ms, 12.0% of total-time

Operation ival-pow, time spent: 761.0ms, 10.0% of total-time

Operation ival-fabs, time spent: 277.0ms, 4.0% of total-time

Operation const, time spent: 164.0ms, 2.0% of total-time

Operation ival-exp, time spent: 105.0ms, 1.0% of total-time

Operation ival-<=, time spent: 86.0ms, 1.0% of total-time

Operation ival-==, time spent: 72.0ms, 1.0% of total-time

Operation ival-if, time spent: 26.0ms, 0.0% of total-time

Operation ival-<, time spent: 22.0ms, 0.0% of total-time

Operation ival-neg, time spent: 22.0ms, 0.0% of total-time

Operation ival-and, time spent: 18.0ms, 0.0% of total-time

Operation ival-pi, time spent: 4.0ms, 0.0% of total-time

Operation ival-atan, time spent: 1.0ms, 0.0% of total-time

Operation ival-log, time spent: 1.0ms, 0.0% of total-time

Operation ival-fma, time spent: 0.0ms, 0.0% of total-time

Operation ival-cos, time spent: 0.0ms, 0.0% of total-time

Operation ival-tan, time spent: 0.0ms, 0.0% of total-time

Operation ival-sin, time spent: 0.0ms, 0.0% of total-time

series4.4s (0.9%)

Counts

923 → 17410

Calls

4920 calls:

Time	Variable		Point	Expression
434.0ms	c	@	-inf	(sqrt.f64 (fma.f64 a (*.f64 c -4) (pow.f64 b 2)))
200.0ms	t	@	0	(pow.f64 (exp.f64 (sqrt.f64 (log.f64 (cbrt.f64 (fma.f64 t 170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 -170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000))))) (sqrt.f64 (log.f64 (cbrt.f64 (fma.f64 t 170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 -170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000)))))
111.0ms	x	@	-inf	(pow.f64 (sqrt.f64 (*.f64 x 238732414637843/250000000000000)) 2)
67.0ms	a	@	inf	(sqrt.f64 (+.f64 a b))
57.0ms	x	@	-inf	(/.f64 x 1/5)

Herbie run

sample1.9min (23%)

localize1.7min (20.2%)

soundness1.0min (12%)

eval58.6s (11.6%)

preprocess36.7s (7.3%)

simplify32.9s (6.5%)

rewrite25.5s (5.1%)

prune20.5s (4.1%)

bsearch20.4s (4%)

regimes17.9s (3.6%)

analyze9.3s (1.8%)

series4.4s (0.9%)

end21.0ms (0%)

Profiling