Metrics for Herbie run

Date:	Friday, August 18th, 2023
Commit:	5f639494 on main
Hostname:	nightly with Racket 8.6
Seed:	2023230
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.7min (21.4%)

Results

29.8s	155130×	body	256	valid
17.9s	29547×	body	1024	valid
11.1s	66879×	body	256	invalid
8.0s	7768×	body	8192	exit
7.4s	39274×	body	256	infinite
5.9s	10083×	body	2048	valid
5.2s	13897×	body	512	valid
2.9s	5716×	body	1024	invalid
2.3s	644×	body	4096	infinite
2.1s	2017×	body	4096	valid
1.4s	8014×	body	256	unsamplable
1.2s	653×	body	2048	infinite
1.2s	2450×	body	1024	infinite
1.1s	3033×	body	512	invalid
693.0ms	789×	body	8192	valid
558.0ms	1452×	body	512	infinite
1.0ms	1×	body	2048	invalid

Bogosity

soundness1.3min (16.6%)

Rules

261370×	`fma-def`
185998×	`associate-r`
170252×	`times-frac`
148876×	`associate-l`
132904×	`log-prod`

Stop Event

2×	unsound
6×	saturated
419×	node limit

Compiler

Compiled 46956 to 27746 computations (40.9% saved)

localize1.1min (14.8%)

Compiler: Compiled 37663 to 16996 computations (54.9% saved)

regimes57.7s (12.4%)

Counts

11153 → 1017

Calls

152 calls:

5.4s	l
3.0s	EAccept
2.5s	d
2.4s	F
2.3s	t

Compiler

Compiled 166460 to 85757 computations (48.5% saved)

eval43.5s (9.4%)

Compiler: Compiled 2424046 to 1371400 computations (43.4% saved)

simplify33.8s (7.3%)

Algorithm

183×	egg-herbie

Rules

134478×	`fma-def`
86614×	`associate-r`
82900×	`times-frac`
73338×	`associate-l`
67954×	`*-commutative`

Stop Event

2×	done
37×	saturated
29×	fuel
146×	node limit

Counts

62975 → 48985

Compiler

Compiled 15753 to 9952 computations (36.8% saved)

prune21.1s (4.5%)

Counts: 74527 → 3148
Compiler: Compiled 220667 to 150578 computations (31.8% saved)

bsearch21.0s (4.5%)

Algorithm

541×	binary-search
89×	left-value

Stop Event

525×	narrow-enough
16×	predicate-same

Results

7.8s	41074×	body	256	valid
5.5s	7716×	body	1024	valid
2.0s	9384×	body	256	infinite
1.5s	3435×	body	512	valid
1.2s	6776×	body	256	invalid
556.0ms	851×	body	2048	valid
400.0ms	624×	body	4096	valid
270.0ms	639×	body	1024	infinite
212.0ms	263×	body	8192	valid
109.0ms	332×	body	1024	invalid
69.0ms	240×	body	512	infinite
20.0ms	85×	body	512	invalid
10.0ms	14×	body	2048	infinite
1.0ms	1×	body	8192	exit

Compiler

Compiled 150005 to 109417 computations (27.1% saved)

rewrite15.0s (3.2%)

Algorithm

121×	batch-egg-rewrite

Rules

89076×	`pow1`
84112×	`add-exp-log`
84028×	`log1p-expm1-u`
84010×	`expm1-log1p-u`
82358×	`add-log-exp`

Stop Event

1×	unsound
120×	node limit

Counts

1331 → 28409

analyze9.5s (2.1%)

Algorithm

31×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	98.2%	1.8%	0%	0%	0%	0
23%	22.6%	75.6%	1.8%	0%	0%	0%	1
24.2%	23.3%	73.2%	1.8%	0%	1.6%	0%	2
30.2%	28.2%	65.2%	1.8%	0%	4.8%	0%	3
34%	31.2%	60.6%	1.8%	0%	6.4%	0%	4
36.2%	33.2%	58.5%	1.8%	0%	6.4%	0%	5
40.4%	37%	54.5%	1.8%	0%	6.6%	0%	6
45.4%	41.1%	49.4%	1.8%	0%	7.3%	0.4%	7
47.7%	42.6%	46.7%	1.8%	0%	8.6%	0.4%	8
50.6%	44.9%	43.9%	1.8%	0%	8.9%	0.5%	9
51.7%	45.7%	42.7%	1.8%	0%	9.3%	0.5%	10
53.4%	46.8%	40.9%	1.8%	0%	9.9%	0.6%	11
55.1%	48%	39.1%	1.8%	0%	10.5%	0.6%	12

Compiler

Compiled 845 to 604 computations (28.5% saved)

preprocess9.3s (2%)

Algorithm

31×	egg-herbie

Rules

36464×	`fma-def`
16456×	`fma-neg`
13966×	`div-sub`
13472×	`distribute-lft-neg-in`
12750×	`distribute-lft-in`

Stop Event

5×	saturated
26×	node limit

Compiler

Compiled 36708 to 19610 computations (46.6% saved)

series7.6s (1.6%)

Counts

1331 → 34535

Calls

9318 calls:

Time	Variable		Point	Expression
129.0ms	v	@	inf	(pow.f64 (pow.f64 (cbrt.f64 (sqrt.f64 (acos.f64 (/.f64 (fma.f64 v (*.f64 v -5) 1) (fma.f64 v v -1))))) 3) 2)
98.0ms	M	@	-inf	(log1p.f64 (cos.f64 (-.f64 (.f64 (+.f64 m n) (.f64 K 1/2)) M)))
69.0ms	l	@	0	(cbrt.f64 (.f64 (sqrt.f64 (/.f64 A (.f64 V l))) c0))
68.0ms	n	@	0	(.f64 (.f64 (pow.f64 k -1/2) (pow.f64 (PI.f64) (-.f64 1/2 (.f64 k 1/2)))) (pow.f64 (.f64 2 n) (-.f64 1/2 (*.f64 k 1/2))))
67.0ms	B	@	inf	(fma.f64 (/.f64 F (sin.f64 B)) (pow.f64 (fma.f64 x 2 (fma.f64 F F 2)) -1/2) (/.f64 (neg.f64 x) (tan.f64 B)))

Herbie run

sample1.7min (21.4%)

soundness1.3min (16.6%)

localize1.1min (14.8%)

regimes57.7s (12.4%)

eval43.5s (9.4%)

simplify33.8s (7.3%)

prune21.1s (4.5%)

bsearch21.0s (4.5%)

rewrite15.0s (3.2%)

analyze9.5s (2.1%)

preprocess9.3s (2%)

series7.6s (1.6%)

end16.0ms (0%)

Profiling