Metrics for Herbie run

Date:	Wednesday, January 10th, 2024
Commit:	3465769b on main
Hostname:	nightly with Racket 8.6
Seed:	2024010
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

localize7.8min (30.8%)

Results

Compiler

Compiled 88082 to 48098 computations (45.4% saved)

sample7.1min (28.2%)

Results

2.7min	17093×	body	8192	exit
1.1min	299165×	body	256	valid
53.3s	7437×	body	4096	valid
44.4s	45767×	body	512	valid
28.3s	10861×	body	2048	valid
19.8s	1088×	body	8192	valid
18.6s	25420×	body	1024	valid
7.5s	5903×	body	512	infinite
6.8s	27365×	body	256	unsamplable
6.3s	27392×	body	256	infinite
5.0s	27779×	body	256	invalid
2.9s	384×	body	4096	infinite
2.8s	653×	body	2048	infinite
1.5s	521×	body	1024	infinite
1.3s	1666×	body	1024	invalid
1.3s	1187×	body	2048	invalid
573.0ms	1157×	body	512	invalid
100.0ms	921×	body	256	precondition
8.0ms	10×	body	512	unsamplable
6.0ms	4×	body	1024	unsamplable

Bogosity

eval2.5min (9.8%)

Compiler: Compiled 6707233 to 4015151 computations (40.1% saved)

regimes1.9min (7.4%)

Counts

22160 → 842

Calls

135 calls:

9.1s	phi2
9.0s	phi1
7.9s	lambda1
7.4s	lambda2
5.0s	(-.f64 lambda1 lambda2)

Results

Compiler

Compiled 603555 to 332385 computations (44.9% saved)

soundness1.6min (6.5%)

Rules

291394×	`fma-def`
167260×	`log-prod`
155028×	`associate-r`
129714×	`times-frac`
124568×	`fma-neg`

Stop Event

7×	unsound
6×	saturated
421×	node limit

Compiler

Compiled 47222 to 28294 computations (40.1% saved)

preprocess1.0min (4%)

Algorithm

51×	egg-herbie

Rules

76366×	`fma-def`
27180×	`div-sub`
26822×	`fma-neg`
24892×	`sub-neg`
22370×	`distribute-lft-in`

Stop Event

8×	saturated
43×	node limit

Compiler

Compiled 62456 to 37471 computations (40% saved)

prune53.4s (3.5%)

Counts: 151818 → 6508
Compiler: Compiled 705761 to 500398 computations (29.1% saved)

simplify51.7s (3.4%)

Algorithm

222×	egg-herbie

Rules

146512×	`fma-def`
92956×	`log-prod`
88078×	`associate-r`
79786×	`times-frac`
78424×	`*-commutative`

Stop Event

2×	unsound
47×	saturated
5×	done
42×	fuel
173×	node limit

Counts

81925 → 68039

Compiler

Compiled 13918 to 9252 computations (33.5% saved)

analyze41.3s (2.7%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
14.8%	11.8%	67.6%	20.6%	0%	0%	0%	1
22.6%	17.7%	60.4%	21%	0%	0.9%	0%	2
32.7%	24.7%	50.8%	21.2%	0%	3.3%	0%	3
39.8%	29.8%	45%	21.2%	0%	4%	0%	4
45.4%	33.8%	40.6%	21.2%	0%	4.5%	0%	5
48.4%	35.7%	38%	21.2%	0%	5.1%	0%	6
51.8%	37.8%	35.2%	21.2%	0%	5.7%	0.1%	7
53.5%	38.9%	33.8%	21.3%	0%	6%	0.1%	8
56.4%	40.6%	31.4%	21.3%	0%	6.6%	0.2%	9
57.7%	41.4%	30.3%	21.3%	0%	6.8%	0.2%	10
59.8%	42.7%	28.7%	21.3%	0%	7.1%	0.3%	11
61.3%	43.5%	27.5%	21.3%	0%	7.5%	0.3%	12

Compiler

Compiled 1919 to 1343 computations (30% saved)

rewrite27.3s (1.8%)

Algorithm

175×	batch-egg-rewrite

Rules

100717×	`log1p-expm1-u`
75379×	`expm1-log1p-u`
61096×	`expm1-udef`
58110×	`log1p-udef`
50408×	`prod-diff`

Stop Event

2×	unsound
173×	node limit

Counts

1645 → 47803

bsearch15.5s (1%)

Algorithm

298×	binary-search
64×	left-value

Stop Event

290×	narrow-enough
8×	predicate-same

Results

6.2s	26059×	body	256	valid
4.5s	6428×	body	512	valid
1.1s	1345×	body	2048	valid
836.0ms	1208×	body	1024	valid
792.0ms	777×	body	4096	valid
568.0ms	3055×	body	256	invalid
245.0ms	219×	body	1024	invalid
178.0ms	753×	body	256	infinite
160.0ms	326×	body	512	infinite
64.0ms	77×	body	2048	invalid
36.0ms	85×	body	512	invalid
2.0ms	26×	body	256	unsamplable

Compiler

Compiled 86009 to 63767 computations (25.9% saved)

series12.8s (0.8%)

Counts

1645 → 34122

Calls

9444 calls:

Time	Variable		Point	Expression
290.0ms	t	@	inf	(cbrt.f64 (*.f64 eh (sin.f64 t)))
172.0ms	delta	@	-inf	(log.f64 (+.f64 1 (sin.f64 delta)))
171.0ms	x-scale	@	-inf	(pow.f64 (sqrt.f64 (*.f64 x-scale y-scale)) -4)
90.0ms	c	@	0	(log.f64 (+.f64 1 (expm1.f64 (*.f64 -1/2 (/.f64 (/.f64 a (/.f64 b c)) a)))))
89.0ms	B	@	0	(log.f64 (cbrt.f64 (exp.f64 (.f64 -1/2 (/.f64 (-.f64 (fma.f64 B B (pow.f64 A 2)) (pow.f64 A 2)) (.f64 B C))))))

Herbie run

localize7.8min (30.8%)

sample7.1min (28.2%)

eval2.5min (9.8%)

regimes1.9min (7.4%)

soundness1.6min (6.5%)

preprocess1.0min (4%)

prune53.4s (3.5%)

simplify51.7s (3.4%)

analyze41.3s (2.7%)

rewrite27.3s (1.8%)

bsearch15.5s (1%)

series12.8s (0.8%)

end18.0ms (0%)

Profiling