Metrics for Herbie run

Date:	Saturday, January 27th, 2024
Commit:	72aaa402 on sample-profiles-more
Hostname:	nightly with Racket 8.11.1
Seed:	2024027
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample7.1min (29%)

Results

1.2min	298359×	256	valid
42.1s	45854×	512	valid
5.1s	27630×	256	invalid
6.4s	27630×	256	infinite
6.3s	27289×	256	unsamplable
19.4s	25541×	1024	valid
2.7min	17191×	8192	exit
28.5s	11060×	2048	valid
49.3s	7327×	4096	valid
6.8s	6004×	512	infinite
1.5s	1653×	1024	invalid
794.0ms	1236×	512	invalid
19.9s	1140×	8192	valid
1.4s	1137×	2048	invalid
111.0ms	937×	256	precondition
2.5s	668×	2048	infinite
1.3s	500×	1024	infinite
2.1s	359×	4096	infinite
5.0ms	7×	512	unsamplable
8.0ms	5×	1024	unsamplable

Bogosity

localize6.3min (25.9%)

Results

Compiler

Compiled 84397 to 45942 computations (45.6% saved)

eval2.3min (9.3%)

Compiler: Compiled 6578973 to 3844861 computations (41.6% saved)

preprocess1.8min (7.4%)

Algorithm

51×	egg-herbie

Rules

76366×	`fma-def`
27106×	`div-sub`
26806×	`fma-neg`
24952×	`sub-neg`
22390×	`distribute-lft-in`

Stop Event

8×	saturated
43×	node limit

Compiler

Compiled 73784 to 44946 computations (39.1% saved)

soundness1.8min (7.4%)

Rules

264636×	`fma-def`
174904×	`associate-r`
138768×	`fma-neg`
137366×	`log-prod`
124112×	`times-frac`

Stop Event

5×	saturated
391×	node limit
8×	unsound

Compiler

Compiled 43154 to 25936 computations (39.9% saved)

regimes1.5min (6.1%)

Counts

17457 → 752

Calls

137 calls:

8.5s	lambda1
7.3s	lambda2
6.9s	phi2
6.9s	phi1
4.6s	b

Compiler

Compiled 11166 to 8225 computations (26.3% saved)

simplify1.0min (4.2%)

Algorithm

220×	egg-herbie

Rules

130688×	`fma-def`
100570×	`associate-r`
84390×	`associate-l`
82090×	`log-prod`
75186×	`times-frac`

Stop Event

49×	saturated
37×	fuel
170×	node limit
1×	unsound
11×	done

Counts

77446 → 63735

Compiler

Compiled 13757 to 9318 computations (32.3% saved)

prune48.5s (3.3%)

Counts: 145178 → 6243
Compiler: Compiled 408860 to 279727 computations (31.6% saved)

analyze43.8s (3%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
14.8%	11.8%	67.6%	20.6%	0%	0%	0%	1
22.6%	17.7%	60.4%	21%	0%	0.9%	0%	2
32.7%	24.7%	50.8%	21.2%	0%	3.3%	0%	3
39.8%	29.8%	45%	21.2%	0%	4%	0%	4
45.4%	33.8%	40.6%	21.2%	0%	4.5%	0%	5
48.4%	35.7%	38%	21.2%	0%	5.1%	0%	6
51.8%	37.8%	35.2%	21.2%	0%	5.7%	0.1%	7
53.5%	38.9%	33.8%	21.3%	0%	6%	0.1%	8
56.4%	40.6%	31.4%	21.3%	0%	6.6%	0.2%	9
57.7%	41.4%	30.3%	21.3%	0%	6.8%	0.2%	10
59.8%	42.7%	28.7%	21.3%	0%	7.1%	0.3%	11
61.3%	43.5%	27.5%	21.3%	0%	7.5%	0.3%	12

Compiler

Compiled 1919 to 1343 computations (30% saved)

rewrite34.9s (2.4%)

Algorithm

173×	batch-egg-rewrite

Rules

100825×	`log1p-expm1-u`
77787×	`expm1-log1p-u`
57642×	`expm1-udef`
54778×	`log1p-udef`
52934×	`log-prod`

Stop Event

169×	node limit
4×	unsound

Counts

1563 → 44948

Results

bsearch16.8s (1.1%)

Algorithm

272×	binary-search
51×	left-value

Stop Event

6×	predicate-same
266×	narrow-enough

Results

5.7s	24301×	256	valid
5.1s	5162×	512	valid
1.3s	4644×	256	invalid
1.3s	1471×	2048	valid
674.0ms	1230×	1024	valid
750.0ms	661×	4096	valid
108.0ms	572×	256	infinite
296.0ms	473×	1024	invalid
198.0ms	465×	512	invalid
263.0ms	311×	2048	invalid
75.0ms	171×	512	infinite

Compiler

Compiled 85269 to 64363 computations (24.5% saved)

series13.9s (0.9%)

Counts

1580 → 32890

Calls

9144 calls:

Time	Variable		Point	Expression
256.0ms	phi1	@	inf	(pow.f64 (cbrt.f64 (hypot.f64 (.f64 (cos.f64 (.f64 (+.f64 phi1 phi2) 1/2)) (-.f64 lambda1 lambda2)) (-.f64 phi1 phi2))) 3)
243.0ms	a	@	0	(/.f64 (.f64 a (.f64 -3/2 c)) b)
130.0ms	lambda2	@	-inf	(log1p.f64 (sin.f64 (-.f64 lambda1 lambda2)))
128.0ms	ew	@	-inf	(cos.f64 (atan.f64 (/.f64 (*.f64 (neg.f64 eh) (tan.f64 t)) ew)))
115.0ms	F	@	0	(pow.f64 (/.f64 (pow.f64 (.f64 2 (.f64 F (+.f64 C (hypot.f64 C B)))) 1/2) B) 3)

Herbie run

sample7.1min (29%)

localize6.3min (25.9%)

eval2.3min (9.3%)

preprocess1.8min (7.4%)

soundness1.8min (7.4%)

regimes1.5min (6.1%)

simplify1.0min (4.2%)

prune48.5s (3.3%)

analyze43.8s (3%)

rewrite34.9s (2.4%)

bsearch16.8s (1.1%)

series13.9s (0.9%)

end27.0ms (0%)

Profiling