Metrics for Herbie run

Date:	Saturday, October 28th, 2023
Commit:	f24e89ef on platforms
Hostname:	nightly with Racket 8.6
Seed:	2023301
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.8min (18.6%)

Results

32.1s	154997×	body	256	valid
20.3s	29404×	body	1024	valid
13.0s	67484×	body	256	invalid
8.4s	7769×	body	8192	exit
7.7s	39281×	body	256	infinite
6.7s	10343×	body	2048	valid
6.4s	13841×	body	512	valid
3.5s	5760×	body	1024	invalid
2.9s	685×	body	4096	infinite
2.4s	2055×	body	4096	valid
1.5s	7891×	body	256	unsamplable
1.3s	672×	body	2048	infinite
1.2s	2410×	body	1024	infinite
1.2s	2970×	body	512	invalid
825.0ms	759×	body	8192	valid
493.0ms	1489×	body	512	infinite
1.0ms	2×	body	2048	invalid

Bogosity

soundness1.8min (18.2%)

Rules

114664×	`associate-r`
96600×	`*-commutative`
87195×	`associate-*r/`
86951×	`associate-l`
86173×	`associate-/r*`

Stop Event

5×	saturated
5×	unsound
371×	node limit

Compiler

Compiled 39254 to 23503 computations (40.1% saved)

localize1.5min (14.6%)

Compiler: Compiled 39528 to 20652 computations (47.8% saved)

eval1.2min (12%)

Compiler: Compiled 3275336 to 2027950 computations (38.1% saved)

regimes57.4s (9.7%)

Counts

9478 → 806

Calls

152 calls:

4.6s	l
3.3s	d
3.1s	NdChar
2.6s	t
2.6s	F

Compiler

Compiled 143314 to 77173 computations (46.2% saved)

simplify47.2s (7.9%)

Algorithm

151×	egg-herbie

Rules

46424×	`*-commutative`
41222×	`associate-*r/`
40477×	`associate-/r*`
40401×	`associate-/l*`
38511×	`associate-r`

Stop Event

2×	done
31×	saturated
29×	fuel
120×	node limit

Counts

75159 → 65434

Compiler

Compiled 14666 to 9128 computations (37.8% saved)

prune33.9s (5.7%)

Counts: 99662 → 2941
Compiler: Compiled 217253 to 152592 computations (29.8% saved)

rewrite27.0s (4.5%)

Algorithm

120×	batch-egg-rewrite

Rules

32569×	`associate-r`
29618×	`*-un-lft-identity`
25779×	`add-sqr-sqrt`
23273×	`add-cube-cbrt`
21364×	`add-cbrt-cube`

Stop Event

3×	unsound
117×	node limit

Counts

1281 → 44798

bsearch17.6s (3%)

Algorithm

368×	binary-search
112×	left-value

Stop Event

362×	narrow-enough
6×	predicate-same

Results

5.7s	27634×	body	256	valid
4.7s	6567×	body	1024	valid
2.0s	6767×	body	256	infinite
1.7s	3497×	body	512	valid
1.6s	8005×	body	256	invalid
412.0ms	472×	body	2048	valid
183.0ms	103×	body	4096	valid
131.0ms	385×	body	1024	invalid
116.0ms	262×	body	1024	infinite
94.0ms	244×	body	512	infinite
28.0ms	35×	body	8192	valid
27.0ms	30×	body	2048	infinite
22.0ms	102×	body	512	invalid
7.0ms	5×	body	4096	infinite

Compiler

Compiled 119191 to 88945 computations (25.4% saved)

preprocess17.3s (2.9%)

Algorithm

31×	egg-herbie

Rules

10369×	`fma-def`
9749×	`distribute-lft-in`
9512×	`*-commutative`
7807×	`distribute-rgt-in`
7442×	`associate-/r*`

Stop Event

5×	saturated
26×	node limit

Compiler

Compiled 39556 to 20799 computations (47.4% saved)

analyze10.4s (1.7%)

Algorithm

31×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	98.2%	1.8%	0%	0%	0%	0
23%	22.6%	75.6%	1.8%	0%	0%	0%	1
24.2%	23.3%	73.2%	1.8%	0%	1.6%	0%	2
30.2%	28.2%	65.2%	1.8%	0%	4.8%	0%	3
34%	31.2%	60.6%	1.8%	0%	6.4%	0%	4
36.2%	33.2%	58.5%	1.8%	0%	6.4%	0%	5
40.4%	37%	54.5%	1.8%	0%	6.6%	0%	6
45.4%	41.1%	49.4%	1.8%	0%	7.3%	0.4%	7
47.7%	42.6%	46.7%	1.8%	0%	8.6%	0.4%	8
50.6%	44.9%	43.9%	1.8%	0%	8.9%	0.5%	9
51.7%	45.7%	42.7%	1.8%	0%	9.3%	0.5%	10
53.4%	46.8%	40.9%	1.8%	0%	9.9%	0.6%	11
55.1%	48%	39.1%	1.8%	0%	10.5%	0.6%	12

Compiler

Compiled 845 to 604 computations (28.5% saved)

series7.0s (1.2%)

Counts

1281 → 30361

Calls

8604 calls:

Time	Variable		Point	Expression
154.0ms	f	@	-inf	(*.f64 (/.f64 1 (/.f64 (PI.f64) 4)) (log.f64 (/.f64 (/.f64 4 (PI.f64)) f)))
143.0ms	B	@	-inf	(-.f64 (/.f64 1 (log.f64 (exp.f64 (sin.f64 B)))) (/.f64 x B))
91.0ms	Om	@	0	(/.f64 1 (sqrt.f64 (+.f64 1 (pow.f64 (.f64 (/.f64 (.f64 2 l) Om) (hypot.f64 (sin.f64 kx) (sin.f64 ky))) 2))))
69.0ms	v	@	inf	(/.f64 (/.f64 1 (.f64 t (PI.f64))) (sqrt.f64 (+.f64 2 (.f64 (*.f64 v v) -6))))
66.0ms	k	@	inf	(.f64 k (.f64 a -10))

Herbie run

sample1.8min (18.6%)

soundness1.8min (18.2%)

localize1.5min (14.6%)

eval1.2min (12%)

regimes57.4s (9.7%)

simplify47.2s (7.9%)

prune33.9s (5.7%)

rewrite27.0s (4.5%)

bsearch17.6s (3%)

preprocess17.3s (2.9%)

analyze10.4s (1.7%)

series7.0s (1.2%)

end14.0ms (0%)

Profiling