Metrics for Herbie run

Date:	Thursday, September 14th, 2023
Commit:	4716b437 on main
Hostname:	nightly with Racket 8.6
Seed:	2023257
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample6.1min (19%)

Results

4.0min	1796885×	body	256	valid
50.7s	336197×	body	256	infinite
24.1s	144666×	body	256	invalid
23.7s	45482×	body	1024	valid
10.6s	32077×	body	512	valid
6.5s	9935×	body	2048	valid
1.7s	1512×	body	8192	exit
1.7s	4939×	body	1024	infinite
1.2s	3255×	body	512	infinite
478.0ms	350×	body	4096	valid
418.0ms	1253×	body	1024	invalid
189.0ms	913×	body	512	invalid
1.0ms	3×	body	2048	invalid

Bogosity

soundness5.5min (17.2%)

Rules

1213690×	`fma-def`
680666×	`associate-r`
580472×	`log-prod`
561778×	`associate-l`
559126×	`fma-neg`

Stop Event

139×	saturated
9×	unsound
1449×	node limit

Compiler

Compiled 111845 to 62448 computations (44.2% saved)

regimes5.3min (16.4%)

Counts

35285 → 5926

Calls

486 calls:

47.6s	x
44.6s	z
44.6s	y
32.6s	t
29.2s	a

Compiler

Compiled 423123 to 232010 computations (45.2% saved)

simplify3.1min (9.7%)

Algorithm

1358×

egg-herbie

Rules

914342×	`fma-def`
496300×	`associate-r`
482488×	`log-prod`
448632×	`fma-neg`
437418×	`associate-l`

Stop Event

4×	unsound
76×	done
436×	saturated
194×	fuel
918×	node limit

Counts

377224 → 277758

Compiler

Compiled 68447 to 40779 computations (40.4% saved)

localize2.9min (9.2%)

Compiler: Compiled 116352 to 47694 computations (59% saved)

eval2.5min (7.9%)

Compiler: Compiled 8302231 to 3915260 computations (52.8% saved)

prune1.7min (5.3%)

Counts: 349656 → 13952
Compiler: Compiled 720670 to 490873 computations (31.9% saved)

rewrite1.7min (5.2%)

Algorithm

818×	batch-egg-rewrite

Rules

508326×	`pow1`
479192×	`add-exp-log`
478954×	`log1p-expm1-u`
478900×	`expm1-log1p-u`
450706×	`add-log-exp`

Stop Event

2×	unsound
816×	node limit

Counts

5830 → 217361

bsearch1.5min (4.7%)

Algorithm

3521×	binary-search
346×	left-value

Stop Event

3466×	narrow-enough
55×	predicate-same

Results

50.4s	329256×	body	256	valid
26.2s	97327×	body	256	infinite
2.3s	4419×	body	1024	valid
1.6s	4765×	body	512	valid
1.4s	9717×	body	256	invalid
238.0ms	688×	body	1024	infinite
51.0ms	171×	body	2048	valid
27.0ms	110×	body	512	infinite
1.0ms	7×	body	512	invalid

Compiler

Compiled 803151 to 599182 computations (25.4% saved)

preprocess1.0min (3.2%)

Algorithm

270×	egg-herbie

Rules

380012×	`fma-def`
124642×	`fma-neg`
117048×	`sub-neg`
102858×	`unsub-neg`
98826×	`div-sub`

Stop Event

124×	saturated
146×	node limit

Compiler

Compiled 151935 to 72244 computations (52.5% saved)

series26.8s (1.4%)

Counts

5830 → 159593

Calls

41331 calls:

Time	Variable		Point	Expression
250.0ms	y	@	-inf	(.f64 (.f64 27 x) (pow.f64 (cbrt.f64 y) 2))
153.0ms	a	@	0	(/.f64 (/.f64 (/.f64 (pow.f64 a t) a) (/.f64 y (pow.f64 z y))) (exp.f64 b))
146.0ms	z	@	-inf	(log.f64 (.f64 z (.f64 y (pow.f64 t -1/2))))
135.0ms	a	@	-inf	(.f64 b (-.f64 (.f64 z c) (*.f64 a i)))
119.0ms	y	@	0	(+.f64 (-.f64 1 (.f64 (/.f64 y x) (.f64 -2 (/.f64 y x)))) (*.f64 -2 (/.f64 y x)))

analyze15.5s (0.8%)

Algorithm

270×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.7%	46.6%	53.2%	0.1%	0%	0%	0%	1
50.1%	49.9%	49.7%	0.1%	0%	0.2%	0%	2
58%	57.5%	41.6%	0.1%	0%	0.7%	0%	3
64.2%	63.3%	35.4%	0.1%	0%	1.2%	0%	4
69.9%	68.8%	29.6%	0.1%	0%	1.4%	0%	5
74.5%	72.8%	25%	0.1%	0%	2%	0%	6
78.6%	76.1%	20.7%	0.1%	0%	3%	0%	7
80.4%	77.4%	18.9%	0.1%	0%	3.5%	0%	8
83.2%	79.7%	16.1%	0.1%	0%	4%	0%	9
84.9%	80.8%	14.4%	0.1%	0%	4.6%	0%	10
87.7%	83.1%	11.6%	0.1%	0%	5.1%	0%	11
88.9%	83.9%	10.5%	0.1%	0%	5.5%	0%	12

Compiler

Compiled 4021 to 2770 computations (31.1% saved)

Herbie run

sample6.1min (19%)

soundness5.5min (17.2%)

regimes5.3min (16.4%)

simplify3.1min (9.7%)

localize2.9min (9.2%)

eval2.5min (7.9%)

prune1.7min (5.3%)

rewrite1.7min (5.2%)

bsearch1.5min (4.7%)

preprocess1.0min (3.2%)

series26.8s (1.4%)

analyze15.5s (0.8%)

end57.0ms (0%)

Profiling