Metrics for Herbie run

Date:	Friday, February 2nd, 2024
Commit:	e387a80b on zane-regimes-2
Hostname:	nightly with Racket 8.11.1
Seed:	2024033
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample7.1min (30.5%)

Results

2.7min	17237×	body	8192	exit
1.2min	298466×	body	256	valid
47.6s	7333×	body	4096	valid
42.2s	46238×	body	512	valid
28.0s	11148×	body	2048	valid
19.3s	1117×	body	8192	valid
17.9s	25497×	body	1024	valid
8.2s	5842×	body	512	infinite
6.7s	27320×	body	256	unsamplable
6.3s	27251×	body	256	infinite
5.3s	27946×	body	256	invalid
2.8s	695×	body	2048	infinite
2.7s	416×	body	4096	infinite
1.6s	525×	body	1024	infinite
1.5s	1191×	body	2048	invalid
1.3s	1670×	body	1024	invalid
794.0ms	1105×	body	512	invalid
103.0ms	878×	body	256	precondition
13.0ms	1×	body	4096	unsamplable
10.0ms	7×	body	1024	unsamplable
7.0ms	9×	body	512	unsamplable

Bogosity

localize6.8min (29.4%)

Results

Compiler

Compiled 81695 to 43378 computations (46.9% saved)

eval2.3min (9.7%)

Compiler: Compiled 6337108 to 3661462 computations (42.2% saved)

soundness1.4min (5.9%)

Rules

215216×	`fma-def`
139860×	`associate-r`
111686×	`associate-l`
106432×	`log-prod`
94810×	`fma-neg`

Stop Event

6×	saturated
317×	node limit
7×	unsound

Compiler

Compiled 37238 to 21977 computations (41% saved)

regimes1.3min (5.4%)

Counts

12959 → 330

Calls

135 calls:

5.3s	phi1
5.0s	phi2
4.9s	lambda1
4.5s	a
4.0s	b

Compiler

Compiled 302084 to 155884 computations (48.4% saved)

preprocess59.9s (4.3%)

Algorithm

51×	egg-herbie

Rules

76366×	`fma-def`
27106×	`div-sub`
26806×	`fma-neg`
24952×	`sub-neg`
22390×	`distribute-lft-in`

Stop Event

8×	saturated
43×	node limit

Compiler

Compiled 49202 to 32227 computations (34.5% saved)

simplify57.7s (4.1%)

Algorithm

219×	egg-herbie

Rules

140416×	`fma-def`
94984×	`associate-r`
83742×	`associate-l`
78320×	`*-commutative`
77280×	`times-frac`

Stop Event

48×	saturated
39×	fuel
170×	node limit
1×	unsound
9×	done

Counts

82855 → 66470

Results

Compiler

Compiled 6167 to 4419 computations (28.3% saved)

prune52.9s (3.8%)

Counts: 146786 → 6653
Compiler: Compiled 681770 to 480166 computations (29.6% saved)

analyze44.0s (3.2%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
14.8%	11.8%	67.6%	20.6%	0%	0%	0%	1
22.6%	17.7%	60.4%	21%	0%	0.9%	0%	2
32.7%	24.7%	50.8%	21.2%	0%	3.3%	0%	3
39.8%	29.8%	45%	21.2%	0%	4%	0%	4
45.4%	33.8%	40.6%	21.2%	0%	4.5%	0%	5
48.4%	35.7%	38%	21.2%	0%	5.1%	0%	6
51.8%	37.8%	35.2%	21.2%	0%	5.7%	0.1%	7
53.5%	38.9%	33.8%	21.3%	0%	6%	0.1%	8
56.4%	40.6%	31.4%	21.3%	0%	6.6%	0.2%	9
57.7%	41.4%	30.3%	21.3%	0%	6.8%	0.2%	10
59.8%	42.7%	28.7%	21.3%	0%	7.1%	0.3%	11
61.3%	43.5%	27.5%	21.3%	0%	7.5%	0.3%	12

Compiler

Compiled 1919 to 1343 computations (30% saved)

rewrite35.3s (2.5%)

Algorithm

171×	batch-egg-rewrite

Rules

90089×	`log1p-expm1-u`
70717×	`expm1-log1p-u`
54108×	`expm1-udef`
50478×	`log1p-udef`
47910×	`log-prod`

Stop Event

167×	node limit
4×	unsound

Counts

1614 → 49809

series16.9s (1.2%)

Counts

1614 → 33911

Calls

9249 calls:

Time	Variable		Point	Expression
408.0ms	B	@	-inf	(-.f64 (exp.f64 (log1p.f64 (/.f64 (atan.f64 (/.f64 (-.f64 (-.f64 C A) (hypot.f64 (-.f64 A C) B)) B)) (PI.f64)))) 1)
391.0ms	c	@	0	(log.f64 (+.f64 1 (expm1.f64 (*.f64 (/.f64 -1/2 b) c))))
343.0ms	B	@	-inf	(-.f64 C (+.f64 A (hypot.f64 B (-.f64 A C))))
322.0ms	x	@	inf	(log.f64 (sqrt.f64 (+.f64 1 (exp.f64 x))))
176.0ms	phi2	@	inf	(.f64 (fma.f64 (sin.f64 lambda1) (cos.f64 lambda2) (.f64 (neg.f64 (sin.f64 lambda2)) (cos.f64 lambda1))) (cos.f64 phi2))

Herbie run

sample7.1min (30.5%)

localize6.8min (29.4%)

eval2.3min (9.7%)

soundness1.4min (5.9%)

regimes1.3min (5.4%)

preprocess59.9s (4.3%)

simplify57.7s (4.1%)

prune52.9s (3.8%)

analyze44.0s (3.2%)

rewrite35.3s (2.5%)

series16.9s (1.2%)

end8.0ms (0%)

Profiling