Metrics for Herbie run

Date:	Thursday, October 5th, 2023
Commit:	d0ce0259 on arb-support
Hostname:	nightly with Racket 8.6
Seed:	2023278
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.1hr (41.7%)

Results

29.3min	1385046×	body	8192	exit
8.8min	1724638×	body	256	valid
5.2min	551193×	body	1024	valid
5.1min	978174×	body	256	invalid
4.8min	400979×	body	2048	valid
2.9min	486053×	body	256	infinite
2.6min	550824×	body	256	precondition
2.2min	303516×	body	512	valid
1.4min	91197×	body	4096	valid
19.6s	28385×	body	1024	infinite
14.5s	33476×	body	512	infinite
7.9s	14300×	body	1024	invalid
6.6s	7664×	body	2048	infinite
4.9s	10908×	body	512	invalid
4.3s	5692×	body	2048	invalid
3.5s	2176×	body	8192	valid
499.0ms	1945×	body	1024	unsamplable
274.0ms	1003×	body	512	unsamplable
134.0ms	979×	body	256	unsamplable
123.0ms	153×	body	4096	infinite
11.0ms	9×	body	8192	infinite
5.0ms	5×	body	8192	invalid
3.0ms	4×	body	4096	invalid

Bogosity

localize24.0min (15.7%)

Compiler: Compiled 238845 to 100479 computations (57.9% saved)

analyze14.3min (9.3%)

Algorithm

540×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	91.5%	8.5%	0%	0%	0%	0
2.3%	4.1%	174.8%	-78.8%	0%	0%	0%	1
3.7%	12.6%	332.2%	-244.7%	0%	0%	0%	2
7.8%	49.9%	588.9%	-538.8%	0%	0%	0%	3
7.7%	91.7%	1093.2%	-1084.9%	0%	0%	0%	4
5.7%	127.9%	2112.8%	-2140.7%	0%	0%	0%	5
3.1%	134.5%	4209.3%	-4243.8%	0%	0%	0%	6
2.2%	183.2%	8317.1%	-8400.3%	0%	0%	0%	7
1.1%	184.6%	16621.7%	-16706.3%	0%	0%	0%	8
0.8%	281.8%	33034.6%	-33216.4%	0%	0%	0%	9
0.7%	473.3%	65652.6%	-66025.9%	0%	0%	0%	10
0.5%	667.4%	130864.2%	-131431.6%	0%	0%	0%	11
0.3%	672.8%	261600.2%	-262173%	0%	0%	0%	12

Compiler

Compiled 11868 to 8225 computations (30.7% saved)

soundness10.8min (7.1%)

Rules

1894362×	`fma-def`
1068706×	`associate-r`
931204×	`log-prod`
906580×	`times-frac`
852260×	`associate-l`

Stop Event

28×	unsound
170×	saturated
2444×	node limit

Compiler

Compiled 203079 to 110438 computations (45.6% saved)

eval9.6min (6.3%)

Compiler: Compiled 17949621 to 9244253 computations (48.5% saved)

regimes8.8min (5.8%)

Counts

55202 → 7212

Calls

860 calls:

59.0s	x
54.6s	y
52.1s	z
41.3s	t
38.0s	a

Compiler

Compiled 729056 to 342973 computations (53% saved)

simplify6.7min (4.4%)

Algorithm

2141×

egg-herbie

Rules

1450838×	`fma-def`
754958×	`associate-r`
696996×	`log-prod`
669004×	`fma-neg`
647574×	`times-frac`

Stop Event

7×	unsound
675×	saturated
124×	done
311×	fuel
1459×	node limit

Counts

530351 → 420961

Compiler

Compiled 80095 to 49895 computations (37.7% saved)

prune4.3min (2.8%)

Counts

596779 → 25048

Results

Compiler

Compiled 1416469 to 922257 computations (34.9% saved)

rewrite3.5min (2.3%)

Algorithm

1267×

batch-egg-rewrite

Rules

813188×	`pow1`
766078×	`add-exp-log`
765356×	`log1p-expm1-u`
765206×	`expm1-log1p-u`
728764×	`add-log-exp`

Stop Event

8×	unsound
1259×	node limit

Counts

9091 → 307784

bsearch3.5min (2.3%)

Algorithm

3778×	binary-search
343×	left-value

Stop Event

3705×	narrow-enough
73×	predicate-same

Results

59.6s	226358×	body	256	valid
44.2s	103245×	body	256	infinite
34.5s	56772×	body	1024	valid
23.5s	29539×	body	2048	valid
14.2s	35837×	body	512	valid
9.9s	10339×	body	8192	exit
3.7s	4889×	body	1024	infinite
2.5s	2939×	body	4096	valid
2.2s	5366×	body	512	infinite
2.2s	9700×	body	256	invalid
1.0s	1197×	body	2048	infinite
51.0ms	63×	body	2048	invalid
45.0ms	72×	body	1024	invalid
24.0ms	42×	body	512	invalid
4.0ms	3×	body	8192	valid
1.0ms	2×	body	4096	infinite

Compiler

Compiled 875600 to 642802 computations (26.6% saved)

preprocess2.2min (1.5%)

Algorithm

439×	egg-herbie

Rules

586044×	`fma-def`
219440×	`fma-neg`
175950×	`sub-neg`
160834×	`unsub-neg`
160300×	`div-sub`

Stop Event

175×	saturated
264×	node limit

Compiler

Compiled 188731 to 96664 computations (48.8% saved)

series1.3min (0.8%)

Counts

9091 → 222128

Calls

57507 calls:

Time	Variable		Point	Expression
453.0ms	y	@	inf	(log1p.f64 (log.f64 (/.f64 x y)))
449.0ms	x	@	0	(+.f64 (log.f64 2) (log.f64 x))
406.0ms	x	@	-inf	(log.f64 (cbrt.f64 (pow.f64 x (/.f64 1 n))))
329.0ms	cosTheta_O	@	inf	(.f32 (.f32 cosTheta_O (/.f32 cosTheta_i v)) (/.f32 (/.f32 1/2 (pow.f32 (exp.f32 sinTheta_O) (/.f32 sinTheta_i v))) (*.f32 v (sinh.f32 (/.f32 1 v)))))
304.0ms	b	@	-inf	(log.f64 (*.f64 (sin.f64 b) (/.f64 r (cos.f64 a))))

Herbie run

sample1.1hr (41.7%)

localize24.0min (15.7%)

analyze14.3min (9.3%)

soundness10.8min (7.1%)

eval9.6min (6.3%)

regimes8.8min (5.8%)

simplify6.7min (4.4%)

prune4.3min (2.8%)

rewrite3.5min (2.3%)

bsearch3.5min (2.3%)

preprocess2.2min (1.5%)

series1.3min (0.8%)

end260.0ms (0%)

Profiling