Metrics for Herbie run

Date:	Wednesday, November 1st, 2023
Commit:	9364c08b on platforms
Hostname:	nightly with Racket 8.6
Seed:	2023305
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample7.8min (29.9%)

Results

2.7min	16981×	body	8192	exit
1.2min	64852×	body	1024	valid
59.4s	8073×	body	4096	valid
54.6s	269484×	body	256	valid
33.1s	13240×	body	2048	valid
29.1s	1550×	body	8192	valid
18.4s	32239×	body	512	valid
7.7s	4377×	body	1024	infinite
5.9s	27725×	body	256	unsamplable
5.7s	27256×	body	256	infinite
4.1s	602×	body	4096	infinite
3.8s	21359×	body	256	invalid
3.4s	851×	body	2048	infinite
2.2s	2175×	body	512	infinite
2.1s	5259×	body	2048	invalid
1.7s	3673×	body	1024	invalid
644.0ms	2208×	body	512	invalid
356.0ms	24×	body	8192	infinite
79.0ms	890×	body	256	precondition
1.0ms	6×	body	4096	invalid
1.0ms	1×	body	512	unsamplable

Bogosity

localize7.1min (27.2%)

Results

Compiler

Compiled 87840 to 47677 computations (45.7% saved)

eval2.6min (10.1%)

Compiler: Compiled 7538151 to 4443955 computations (41% saved)

soundness2.0min (7.5%)

Rules

106540×	`associate-r`
106178×	`*-commutative`
83693×	`+-commutative`
82977×	`associate-/l*`
81904×	`associate-l`

Stop Event

5×	unsound
9×	saturated
370×	node limit

Results

Compiler

Compiled 46669 to 26597 computations (43% saved)

regimes1.5min (5.6%)

Counts

18061 → 824

Calls

138 calls:

6.3s	phi1
5.7s	lambda1
5.5s	phi2
5.0s	lambda2
4.7s	b

Results

Compiler

Compiled 439947 to 236140 computations (46.3% saved)

preprocess1.2min (4.5%)

Algorithm

51×	egg-herbie

Rules

20885×	`fma-def`
16431×	`*-commutative`
13671×	`distribute-lft-in`
11180×	`associate-r`
11057×	`+-commutative`

Stop Event

9×	saturated
42×	node limit

Compiler

Compiled 42428 to 23245 computations (45.2% saved)

simplify1.1min (4.4%)

Algorithm

219×	egg-herbie

Rules

61125×	`*-commutative`
53937×	`+-commutative`
53450×	`associate-/l*`
53258×	`associate-r`
50142×	`associate-/r*`

Stop Event

2×	unsound
48×	saturated
7×	done
41×	fuel
169×	node limit

Counts

98218 → 84024

Compiler

Compiled 14711 to 9718 computations (33.9% saved)

prune1.0min (4%)

Counts: 169515 → 6932
Compiler: Compiled 763770 to 539006 computations (29.4% saved)

rewrite36.4s (2.3%)

Algorithm

171×	batch-egg-rewrite

Rules

42626×	`associate-r`
42608×	`*-un-lft-identity`
33713×	`add-sqr-sqrt`
30649×	`add-cube-cbrt`
29147×	`add-cbrt-cube`

Stop Event

3×	unsound
168×	node limit

Counts

1660 → 61870

analyze35.6s (2.3%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
19.6%	15.5%	63.8%	20.6%	0%	0%	0%	1
27.1%	21.4%	57.6%	21%	0%	0%	0%	2
36.8%	28.5%	48.9%	21.2%	0%	1.4%	0%	3
42.3%	32.2%	43.9%	21.2%	0%	2.8%	0%	4
47.2%	35.4%	39.6%	21.2%	0%	3.8%	0%	5
50.2%	37.2%	36.9%	21.2%	0%	4.6%	0%	6
53.6%	39.3%	34%	21.2%	0%	5.4%	0.1%	7
55.3%	40.3%	32.5%	21.3%	0%	5.8%	0.1%	8
58.3%	42%	30.1%	21.3%	0%	6.4%	0.2%	9
59.6%	42.8%	29%	21.3%	0%	6.7%	0.2%	10
61.9%	44.2%	27.2%	21.3%	0%	7.1%	0.3%	11
63.3%	45%	26%	21.3%	0%	7.4%	0.3%	12

Compiler

Compiled 1919 to 1338 computations (30.3% saved)

bsearch23.5s (1.5%)

Algorithm

287×	binary-search
103×	left-value

Stop Event

279×	narrow-enough
8×	predicate-same

Results

9.2s	6381×	body	1024	valid
6.0s	22911×	body	256	valid
2.1s	2631×	body	512	valid
1.6s	1347×	body	2048	valid
1.5s	322×	body	1024	infinite
647.0ms	271×	body	512	infinite
570.0ms	897×	body	256	infinite
554.0ms	600×	body	4096	valid
389.0ms	2209×	body	256	invalid
67.0ms	64×	body	1024	invalid
43.0ms	63×	body	2048	invalid
9.0ms	28×	body	512	invalid
2.0ms	26×	body	256	unsamplable

Compiler

Compiled 79447 to 59328 computations (25.3% saved)

series11.0s (0.7%)

Counts

1660 → 36348

Calls

9531 calls:

Time	Variable		Point	Expression
335.0ms	A	@	-inf	(/.f64 (atan.f64 (-.f64 (/.f64 (-.f64 C A) B) (/.f64 (hypot.f64 (-.f64 A C) B) B))) (PI.f64))
148.0ms	t	@	0	(/.f64 (.f64 (tan.f64 t) (/.f64 eh (/.f64 ew (sin.f64 t)))) (hypot.f64 1 (.f64 (tan.f64 t) (/.f64 eh ew))))
135.0ms	a	@	-inf	(.f64 a (cos.f64 (.f64 (/.f64 (PI.f64) -180) angle)))
124.0ms	delta	@	-inf	(log1p.f64 (*.f64 (cos.f64 delta) (sin.f64 phi1)))
102.0ms	ew	@	inf	(log.f64 (.f64 (sin.f64 t) (.f64 (sin.f64 (atan.f64 (*.f64 (tan.f64 t) (/.f64 eh ew)))) eh)))

Herbie run

sample7.8min (29.9%)

localize7.1min (27.2%)

eval2.6min (10.1%)

soundness2.0min (7.5%)

regimes1.5min (5.6%)

preprocess1.2min (4.5%)

simplify1.1min (4.4%)

prune1.0min (4%)

rewrite36.4s (2.3%)

analyze35.6s (2.3%)

bsearch23.5s (1.5%)

series11.0s (0.7%)

end16.0ms (0%)

Profiling