Metrics for Herbie run

Date:	Tuesday, October 24th, 2023
Commit:	4c861e3a on platforms
Hostname:	nightly with Racket 8.6
Seed:	2023297
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

soundness12.2min (22.3%)

Rules

776278×	`fma-def`
647836×	`*-commutative`
485313×	`+-commutative`
485104×	`times-frac`
477112×	`cancel-sign-sub-inv`

Stop Event

84×	saturated
18×	unsound
1633×	node limit

Results

Compiler

Compiled 135118 to 73314 computations (45.7% saved)

sample7.8min (14.2%)

Results

5.6min	1787675×	body	256	valid
49.0s	337108×	body	256	infinite
25.3s	142352×	body	256	invalid
23.6s	45824×	body	1024	valid
10.8s	31616×	body	512	valid
7.3s	9829×	body	2048	valid
2.0s	5044×	body	1024	infinite
1.4s	1558×	body	8192	exit
1000.0ms	3412×	body	512	infinite
574.0ms	356×	body	4096	valid
344.0ms	1275×	body	1024	invalid
173.0ms	912×	body	512	invalid
1.0ms	4×	body	2048	invalid

Bogosity

eval7.4min (13.6%)

Compiler: Compiled 20485846 to 9682776 computations (52.7% saved)

simplify5.7min (10.5%)

Algorithm

1109×

egg-herbie

Rules

424005×	`*-commutative`
401713×	`fma-def`
297199×	`times-frac`
281624×	`+-commutative`
277521×	`associate-*r/`

Stop Event

66×	done
7×	unsound
267×	saturated
202×	fuel
835×	node limit

Counts

578188 → 513613

Results

Compiler

Compiled 68066 to 41091 computations (39.6% saved)

regimes5.2min (9.5%)

Counts

38631 → 5823

Calls

492 calls:

48.5s	x
47.4s	y
46.0s	z
31.0s	t
21.8s	a

Compiler

Compiled 491362 to 258974 computations (47.3% saved)

prune4.6min (8.4%)

Counts: 654358 → 13942
Compiler: Compiled 833936 to 554754 computations (33.5% saved)

rewrite4.3min (7.8%)

Algorithm

2523×	rewrite-once
841×	batch-egg-rewrite

Rules

371794×	`frac-2neg`
231666×	`cancel-sign-sub-inv`
206385×	`div-sub`
197041×	`frac-sub`
195985×	`frac-add`

Stop Event

7×	unsound
7×	saturated
827×	node limit

Counts

6050 → 409765

Calls

6141 calls:

114.0ms	(/.f64 y (sin.f64 y))
73.0ms	(*.f64 z (-.f64 (/.f64 y t) (/.f64 x t)))
53.0ms	(+.f64 (.f64 (/.f64 y x) (/.f64 (/.f64 z y) x)) (.f64 z 1/2))
52.0ms	(+.f64 (/.f64 x y) (/.f64 2 (/.f64 t (-.f64 1 t))))
43.0ms	(+.f64 (.f64 (-.f64 1 x) y) (.f64 x z))

localize3.3min (5.9%)

Compiler: Compiled 128219 to 52810 computations (58.8% saved)

preprocess2.0min (3.7%)

Algorithm

269×	egg-herbie

Rules

202111×	`fma-def`
77036×	`*-commutative`
71233×	`fma-neg`
67742×	`+-commutative`
66715×	`div-sub`

Stop Event

125×	saturated
144×	node limit

Compiler

Compiled 158680 to 75544 computations (52.4% saved)

bsearch1.5min (2.7%)

Algorithm

3440×	binary-search
275×	left-value

Stop Event

3386×	narrow-enough
54×	predicate-same

Results

51.0s	320130×	body	256	valid
22.5s	89087×	body	256	infinite
3.2s	4892×	body	1024	valid
2.3s	6647×	body	512	valid
839.0ms	6991×	body	256	invalid
557.0ms	706×	body	1024	infinite
168.0ms	473×	body	512	infinite
166.0ms	224×	body	2048	valid
2.0ms	10×	body	512	invalid
1.0ms	5×	body	1024	invalid
0.0ms	1×	body	4096	valid

Compiler

Compiled 786405 to 583631 computations (25.8% saved)

series27.5s (0.8%)

Counts

6050 → 168423

Calls

43062 calls:

Time	Variable		Point	Expression
393.0ms	x	@	0	(*.f64 x (log.f64 x))
155.0ms	x	@	0	(*.f64 x (log.f64 y))
140.0ms	x	@	0	(pow.f64 (pow.f64 (-.f64 (*.f64 x (log.f64 (/.f64 x y))) z) -1/2) -2)
109.0ms	t	@	inf	(log.f64 (.f64 (.f64 y z) (pow.f64 t (+.f64 a -1/2))))
108.0ms	x	@	-inf	(log.f64 (/.f64 y x))

analyze16.7s (0.5%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
49.9%	49.7%	49.9%	0.1%	0%	0.2%	0%	2
57.9%	57.4%	41.7%	0.1%	0%	0.7%	0%	3
64%	63.2%	35.5%	0.1%	0%	1.2%	0%	4
69.8%	68.7%	29.8%	0.1%	0%	1.4%	0%	5
74.4%	72.7%	25.1%	0.1%	0%	2.1%	0%	6
78.5%	76%	20.8%	0.1%	0%	3%	0%	7
80.3%	77.4%	19%	0.1%	0%	3.5%	0%	8
83.1%	79.6%	16.2%	0.1%	0%	4.1%	0%	9
84.8%	80.8%	14.4%	0.1%	0%	4.7%	0%	10
87.7%	83.1%	11.7%	0.1%	0%	5.1%	0%	11
88.9%	83.8%	10.5%	0.1%	0%	5.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Herbie run

soundness12.2min (22.3%)

sample7.8min (14.2%)

eval7.4min (13.6%)

simplify5.7min (10.5%)

regimes5.2min (9.5%)

prune4.6min (8.4%)

rewrite4.3min (7.8%)

localize3.3min (5.9%)

preprocess2.0min (3.7%)

bsearch1.5min (2.7%)

series27.5s (0.8%)

analyze16.7s (0.5%)

end119.0ms (0%)

Profiling