Metrics for Herbie run

Date:	Tuesday, July 18th, 2023
Commit:	6cb26432 on main
Hostname:	nightly with Racket 8.6
Seed:	2023199
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample6.1min (20.2%)

Results

4.0min	1795176×	body	256	valid
47.7s	337669×	body	256	infinite
26.1s	143392×	body	256	invalid
23.2s	45625×	body	1024	valid
11.1s	31935×	body	512	valid
8.0s	10104×	body	2048	valid
1.9s	4939×	body	1024	infinite
1.6s	1587×	body	8192	exit
719.0ms	3319×	body	512	infinite
524.0ms	1235×	body	1024	invalid
488.0ms	351×	body	4096	valid
223.0ms	905×	body	512	invalid
1.0ms	4×	body	2048	invalid
1.0ms	2×	body	2048	infinite

Bogosity

soundness5.0min (16.4%)

Rules

1215234×	`fma-def`
645546×	`associate-r`
559204×	`log-prod`
535408×	`times-frac`
526112×	`associate-l`

Stop Event

138×	saturated
7×	unsound
1418×	node limit

Compiler

Compiled 109312 to 60137 computations (45% saved)

regimes4.3min (14.2%)

Counts

32248 → 5527

Calls

489 calls:

40.4s	y
39.5s	x
36.6s	z
27.0s	t
19.9s	a

Compiler

Compiled 373708 to 206338 computations (44.8% saved)

simplify3.0min (10%)

Algorithm

1362×

egg-herbie

Rules

898186×	`fma-def`
487426×	`associate-r`
476594×	`log-prod`
442602×	`fma-neg`
424962×	`associate-l`

Stop Event

5×	unsound
67×	done
436×	saturated
203×	fuel
921×	node limit

Counts

367700 → 270298

Compiler

Compiled 62315 to 38224 computations (38.7% saved)

localize3.0min (9.8%)

Compiler: Compiled 113413 to 46228 computations (59.2% saved)

eval2.5min (8.2%)

Compiler: Compiled 8255240 to 3967678 computations (51.9% saved)

prune1.7min (5.5%)

Counts: 341311 → 13733
Compiler: Compiled 687858 to 471981 computations (31.4% saved)

rewrite1.6min (5.3%)

Algorithm

822×	batch-egg-rewrite

Rules

528012×	`pow1`
497430×	`add-exp-log`
497132×	`log1p-expm1-u`
497092×	`expm1-log1p-u`
466756×	`add-log-exp`

Stop Event

1×	unsound
821×	node limit

Counts

5792 → 207995

bsearch1.4min (4.6%)

Algorithm

3229×	binary-search
302×	left-value

Stop Event

3174×	narrow-enough
55×	predicate-same

Results

51.1s	314995×	body	256	valid
18.5s	78409×	body	256	infinite
3.1s	4389×	body	1024	valid
2.0s	4839×	body	512	valid
640.0ms	6193×	body	256	invalid
241.0ms	329×	body	1024	infinite
107.0ms	234×	body	2048	valid
60.0ms	245×	body	512	infinite

Compiler

Compiled 713510 to 533912 computations (25.2% saved)

preprocess57.8s (3.2%)

Algorithm

270×	egg-herbie

Rules

380012×	`fma-def`
124642×	`fma-neg`
117048×	`sub-neg`
102858×	`unsub-neg`
98826×	`div-sub`

Stop Event

124×	saturated
146×	node limit

Compiler

Compiled 139845 to 69498 computations (50.3% saved)

series29.6s (1.6%)

Counts

5792 → 159435

Calls

41277 calls:

Time	Variable		Point	Expression
257.0ms	x	@	inf	(pow.f64 (sqrt.f64 (+.f64 y (+.f64 (/.f64 1/9 x) -1))) 2)
231.0ms	t	@	0	(fma.f64 z (-.f64 1 (log.f64 t)) (fma.f64 (+.f64 a -1/2) b y))
224.0ms	t	@	-inf	(fma.f64 z (-.f64 1 (log.f64 t)) (fma.f64 (+.f64 a -1/2) b y))
200.0ms	y	@	inf	(log.f64 (-.f64 (log.f64 y) t))
199.0ms	y	@	0	(fma.f64 (log.f64 y) (-.f64 1 x) t)

analyze16.7s (0.9%)

Algorithm

270×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.7%	46.6%	53.2%	0.1%	0%	0%	0%	1
50.1%	49.9%	49.7%	0.1%	0%	0.2%	0%	2
58%	57.5%	41.6%	0.1%	0%	0.7%	0%	3
64.2%	63.3%	35.4%	0.1%	0%	1.2%	0%	4
69.9%	68.8%	29.6%	0.1%	0%	1.4%	0%	5
74.5%	72.8%	25%	0.1%	0%	2%	0%	6
78.6%	76.1%	20.7%	0.1%	0%	3%	0%	7
80.4%	77.4%	18.9%	0.1%	0%	3.5%	0%	8
83.2%	79.7%	16.1%	0.1%	0%	4%	0%	9
84.9%	80.8%	14.4%	0.1%	0%	4.6%	0%	10
87.7%	83.1%	11.6%	0.1%	0%	5.1%	0%	11
88.9%	83.9%	10.5%	0.1%	0%	5.5%	0%	12

Compiler

Compiled 4021 to 2770 computations (31.1% saved)

Herbie run

sample6.1min (20.2%)

soundness5.0min (16.4%)

regimes4.3min (14.2%)

simplify3.0min (10%)

localize3.0min (9.8%)

eval2.5min (8.2%)

prune1.7min (5.5%)

rewrite1.6min (5.3%)

bsearch1.4min (4.6%)

preprocess57.8s (3.2%)

series29.6s (1.6%)

analyze16.7s (0.9%)

end100.0ms (0%)

Profiling