Metrics for Herbie run

Date:	Monday, August 28th, 2023
Commit:	5f639494 on main
Hostname:	nightly with Racket 8.6
Seed:	2023240
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample22.1min (24.6%)

Results

8.3min	3328026×	body	256	valid
3.9min	47035×	body	8192	exit
2.8min	274396×	body	1024	valid
1.7min	97981×	body	2048	valid
1.3min	526509×	body	256	infinite
1.0min	14675×	body	4096	valid
50.8s	150447×	body	512	valid
43.9s	256949×	body	256	invalid
28.9s	2393×	body	8192	valid
14.7s	20424×	body	1024	infinite
8.7s	49779×	body	256	unsamplable
7.5s	16211×	body	1024	invalid
6.0s	1185×	body	4096	infinite
4.8s	11249×	body	512	infinite
4.6s	1599×	body	2048	infinite
2.5s	8669×	body	512	invalid
1.9s	5449×	body	2048	invalid
834.0ms	2958×	body	256	precondition
283.0ms	20×	body	8192	infinite
194.0ms	493×	body	1024	unsamplable
164.0ms	316×	body	2048	unsamplable
54.0ms	228×	body	512	unsamplable
4.0ms	12×	body	4096	invalid
2.0ms	1×	body	8192	invalid

Bogosity

localize18.2min (20.2%)

Results

Compiler

Compiled 387877 to 183915 computations (52.6% saved)

soundness11.7min (13%)

Rules

2739478×	`fma-def`
1635016×	`associate-r`
1394542×	`log-prod`
1302134×	`times-frac`
1301036×	`associate-l`

Stop Event

25×	unsound
208×	saturated
3647×	node limit

Compiler

Compiled 343237 to 198047 computations (42.3% saved)

eval8.4min (9.3%)

Compiler: Compiled 27627408 to 14986707 computations (45.8% saved)

regimes8.3min (9.2%)

Counts

87457 → 9975

Calls

1161 calls:

57.9s	x
46.4s	y
41.9s	z
31.9s	t
27.8s	a

Compiler

Compiled 1352580 to 707827 computations (47.7% saved)

simplify6.5min (7.2%)

Algorithm

2786×

egg-herbie

Rules

1894326×	`fma-def`
1064056×	`associate-r`
913514×	`associate-l`
911616×	`log-prod`
899322×	`times-frac`

Stop Event

13×	unsound
814×	saturated
124×	done
409×	fuel
1959×	node limit

Counts

750931 → 594328

Compiler

Compiled 129708 to 81036 computations (37.5% saved)

prune4.2min (4.6%)

Counts: 881956 → 36689
Compiler: Compiled 2430018 to 1654878 computations (31.9% saved)

rewrite3.3min (3.7%)

Algorithm

1717×

batch-egg-rewrite

Rules

1152548×	`pow1`
1088768×	`add-exp-log`
1087722×	`log1p-expm1-u`
1087526×	`expm1-log1p-u`
1040554×	`add-log-exp`

Stop Event

8×	unsound
1709×	node limit

Counts

13798 → 424419

bsearch2.5min (2.8%)

Algorithm

5149×	binary-search
659×	left-value

Stop Event

5037×	narrow-enough
112×	predicate-same

Results

1.3min	466258×	body	256	valid
24.8s	109568×	body	256	infinite
18.7s	25149×	body	1024	valid
6.8s	16736×	body	512	valid
3.4s	3533×	body	2048	valid
3.0s	4762×	body	1024	infinite
2.1s	14897×	body	256	invalid
1.2s	833×	body	4096	valid
906.0ms	2653×	body	512	infinite
530.0ms	268×	body	2048	infinite
322.0ms	78×	body	4096	infinite
176.0ms	439×	body	512	invalid
132.0ms	397×	body	1024	invalid
81.0ms	82×	body	8192	valid
15.0ms	102×	body	256	unsamplable
3.0ms	7×	body	1024	unsamplable

Compiler

Compiled 1190995 to 873947 computations (26.6% saved)

preprocess2.0min (2.2%)

Algorithm

536×	egg-herbie

Rules

704136×	`fma-def`
261454×	`fma-neg`
211808×	`sub-neg`
201670×	`div-sub`
191518×	`unsub-neg`

Stop Event

208×	saturated
328×	node limit

Compiler

Compiled 296557 to 153910 computations (48.1% saved)

analyze1.4min (1.6%)

Algorithm

540×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	86.8%	13.2%	0%	0%	0%	0
40.5%	35.1%	51.6%	13.2%	0%	0%	0%	1
46.5%	40.1%	46.1%	13.3%	0%	0.6%	0%	2
56.2%	47.7%	37.3%	13.3%	0%	1.8%	0%	3
62.2%	52.5%	31.9%	13.3%	0%	2.4%	0%	4
67.9%	57%	27%	13.3%	0%	2.7%	0%	5
71.6%	59.8%	23.7%	13.3%	0%	3.2%	0%	6
75.5%	62.4%	20.3%	13.3%	0%	4.1%	0%	7
77.3%	63.6%	18.7%	13.3%	0%	4.4%	0%	8
79.8%	65.3%	16.5%	13.3%	0%	4.9%	0.1%	9
81.4%	66.2%	15.1%	13.3%	0%	5.3%	0.1%	10
83.6%	67.7%	13.3%	13.3%	0%	5.7%	0.1%	11
84.7%	68.3%	12.3%	13.3%	0%	6%	0.1%	12

Compiler

Compiled 11868 to 8225 computations (30.7% saved)

series1.2min (1.4%)

Counts

13798 → 325976

Calls

84033 calls:

Time	Variable		Point	Expression
511.0ms	x	@	inf	(-.f64 (sqrt.f64 (cbrt.f64 (pow.f64 (+.f64 x 1) 2))) (cbrt.f64 x))
468.0ms	t	@	inf	(log.f64 (cbrt.f64 (pow.f64 (exp.f64 1/18) (*.f64 (/.f64 (sqrt.f64 t) z) (/.f64 x y)))))
283.0ms	f	@	-inf	(-.f64 (pow.f64 (exp.f64 (/.f64 (PI.f64) 4)) f) (pow.f64 (exp.f64 f) (*.f64 -1/4 (PI.f64))))
278.0ms	v	@	-inf	(pow.f64 (pow.f64 (cbrt.f64 (cbrt.f64 (asin.f64 (/.f64 (fma.f64 v (*.f64 v -5) 1) (fma.f64 v v -1))))) 3) 3)
267.0ms	V	@	inf	(*.f64 c0 (pow.f64 (/.f64 V (/.f64 A l)) -1/2))

Results

Herbie run

sample22.1min (24.6%)

localize18.2min (20.2%)

soundness11.7min (13%)

eval8.4min (9.3%)

regimes8.3min (9.2%)

simplify6.5min (7.2%)

prune4.2min (4.6%)

rewrite3.3min (3.7%)

bsearch2.5min (2.8%)

preprocess2.0min (2.2%)

analyze1.4min (1.6%)

series1.2min (1.4%)

end178.0ms (0%)

Profiling