Metrics for Herbie run

Date:	Wednesday, December 13th, 2023
Commit:	665878db on main
Hostname:	nightly with Racket 8.6
Seed:	2023347
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.4min (17.5%)

Results

38.3s	179607×	body	256	valid
11.5s	66773×	body	256	invalid
8.1s	42342×	body	256	infinite
6.6s	10230×	body	2048	valid
6.2s	12216×	body	1024	valid
3.7s	5771×	body	1024	invalid
2.3s	2044×	body	4096	valid
2.3s	6686×	body	512	valid
2.0s	633×	body	4096	infinite
1.3s	663×	body	2048	infinite
1.3s	3017×	body	512	invalid
820.0ms	810×	body	8192	valid
220.0ms	432×	body	1024	infinite
90.0ms	273×	body	512	infinite
47.0ms	204×	body	256	unsamplable
6.0ms	9×	body	8192	exit
1.0ms	1×	body	2048	invalid

Bogosity

soundness1.4min (16.8%)

Rules

188288×	`fma-def`
155738×	`associate-r`
133058×	`times-frac`
116800×	`associate-l`
100690×	`log-prod`

Stop Event

1×	unsound
4×	saturated
368×	node limit

Compiler

Compiled 38302 to 24489 computations (36.1% saved)

localize1.3min (15.5%)

Compiler: Compiled 38214 to 20650 computations (46% saved)

regimes58.4s (11.9%)

Counts

9629 → 763

Calls

152 calls:

5.1s	l
3.1s	F
2.5s	t
2.3s	NaChar
1.9s	Vef

Compiler

Compiled 147909 to 85382 computations (42.3% saved)

eval57.7s (11.8%)

Compiler: Compiled 2683593 to 1739031 computations (35.2% saved)

simplify38.1s (7.8%)

Algorithm

151×	egg-herbie

Rules

100058×	`fma-def`
73870×	`associate-r`
66544×	`times-frac`
63250×	`associate-l`
55548×	`*-commutative`

Stop Event

1×	done
31×	saturated
30×	fuel
120×	node limit

Counts

66259 → 54669

Compiler

Compiled 12570 to 8289 computations (34.1% saved)

prune25.7s (5.2%)

Counts: 81318 → 3192
Compiler: Compiled 240564 to 174690 computations (27.4% saved)

rewrite19.0s (3.9%)

Algorithm

120×	batch-egg-rewrite

Rules

55544×	`log1p-expm1-u`
43260×	`expm1-log1p-u`
35228×	`expm1-udef`
33410×	`prod-diff`
32456×	`log1p-udef`

Stop Event

1×	unsound
119×	node limit

Counts

1297 → 36005

preprocess15.7s (3.2%)

Algorithm

31×	egg-herbie

Rules

40752×	`fma-def`
16580×	`fma-neg`
15360×	`div-sub`
14408×	`distribute-lft-neg-in`
13246×	`associate-/l*`

Stop Event

4×	saturated
27×	node limit

Compiler

Compiled 57510 to 34523 computations (40% saved)

bsearch12.2s (2.5%)

Algorithm

319×	binary-search
106×	left-value

Stop Event

315×	narrow-enough
4×	predicate-same

Results

8.3s	33899×	body	256	valid
1.0s	4690×	body	256	infinite
978.0ms	5247×	body	256	invalid
471.0ms	1050×	body	1024	valid
456.0ms	444×	body	2048	valid
48.0ms	72×	body	4096	valid
42.0ms	155×	body	512	valid
18.0ms	3×	body	4096	infinite
16.0ms	31×	body	1024	infinite
13.0ms	34×	body	1024	invalid
12.0ms	13×	body	2048	infinite
7.0ms	21×	body	512	infinite
5.0ms	6×	body	8192	valid
5.0ms	21×	body	512	invalid

Compiler

Compiled 93992 to 71180 computations (24.3% saved)

analyze9.7s (2%)

Algorithm

31×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	98.2%	1.8%	0%	0%	0%	0
23%	22.6%	75.6%	1.8%	0%	0%	0%	1
24.2%	23.3%	73.2%	1.8%	0%	1.6%	0%	2
29.6%	27.4%	65.2%	1.8%	0%	5.6%	0%	3
33.6%	30.4%	60.2%	1.8%	0%	7.3%	0.4%	4
35.9%	32.4%	57.9%	1.8%	0%	7.3%	0.6%	5
40.2%	36.2%	53.8%	1.8%	0%	7.5%	0.7%	6
45.3%	40.3%	48.7%	1.8%	0%	8.1%	1.1%	7
47.6%	41.8%	45.9%	1.8%	0%	9.4%	1.2%	8
50.6%	44.1%	43.1%	1.8%	0%	9.7%	1.2%	9
51.7%	44.9%	41.9%	1.8%	0%	10.1%	1.3%	10
53.4%	46%	40.1%	1.8%	0%	10.7%	1.3%	11
55.2%	47.2%	38.3%	1.8%	0%	11.3%	1.4%	12

Compiler

Compiled 845 to 604 computations (28.5% saved)

series9.1s (1.9%)

Counts

1297 → 30254

Calls

8646 calls:

Time	Variable		Point	Expression
241.0ms	t	@	0	(.f64 l (/.f64 2 (.f64 (*.f64 (sin.f64 k) (pow.f64 t 3)) (tan.f64 k))))
122.0ms	U	@	-inf	(log.f64 (.f64 -4 (.f64 U (*.f64 (pow.f64 l 2) n))))
112.0ms	d	@	0	(/.f64 (.f64 -1/4 (.f64 (pow.f64 (.f64 D M) 2) (.f64 h (pow.f64 w0 2)))) (*.f64 (pow.f64 d 2) l))
107.0ms	k	@	-inf	(exp.f64 (log.f64 (pow.f64 k -1/2)))
104.0ms	x	@	0	(*.f64 (pow.f64 (pow.f64 (+.f64 (/.f64 1 (+.f64 x -1)) (/.f64 1 x)) 3/2) 1/3) (/.f64 l t))

Herbie run

sample1.4min (17.5%)

soundness1.4min (16.8%)

localize1.3min (15.5%)

regimes58.4s (11.9%)

eval57.7s (11.8%)

simplify38.1s (7.8%)

prune25.7s (5.2%)

rewrite19.0s (3.9%)

preprocess15.7s (3.2%)

bsearch12.2s (2.5%)

analyze9.7s (2%)

series9.1s (1.9%)

end13.0ms (0%)

Profiling