Metrics for Herbie run

Date:	Wednesday, July 3rd, 2024
Commit:	276d3a06 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024185
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

simplify2.4min (26.4%)

Memory

1 256.2MiB live, 187 221.2MiB allocated

Algorithm

267×	egg-herbie

Rules

221 432×	`fma-define`
121 268×	`distribute-lft-in`
115 558×	`*-commutative`
109 382×	`associate-r`
107 342×	`fmm-def`

Stop Event

193×	node limit
74×	saturated

Counts

96 882 → 71 558

soundness1.4min (15.1%)

Memory

215.4MiB live, 98 130.2MiB allocated

Rules

89 096×	`fma-define`
58 222×	`associate-r`
57 258×	`*-commutative`
54 074×	`times-frac`
50 796×	`distribute-lft-in`

Stop Event

150×	node limit
29×	fuel
8×	saturated
1×	done

Compiler

Compiled 70 743 to 11 745 computations (83.4% saved)

sample1.3min (14.2%)

Memory

613.3MiB live, 106 429.9MiB allocated

Samples

57.1s	247 617×	0	valid
2.0s	10 623×	0	invalid
10.0ms	63×	1	valid

Precisions

Click to see histograms. Total time spent on operations: 47.2s

ival-mult: 10.5s (22.2% of total)

...in/eval/compile.rkt:111:19: 7.4s (15.7% of total)

ival-<=: 7.2s (15.3% of total)

ival-div: 3.9s (8.3% of total)

ival-sin: 2.0s (4.2% of total)

ival-sub: 1.9s (4% of total)

ival-add: 1.7s (3.5% of total)

ival-fabs: 1.6s (3.5% of total)

ival-log: 1.3s (2.9% of total)

ival-sqrt: 1.2s (2.6% of total)

ival-exp: 1.1s (2.4% of total)

ival-and: 1.1s (2.4% of total)

ival-cos: 975.0ms (2.1% of total)

ival-pi: 844.0ms (1.8% of total)

ival-tan: 815.0ms (1.7% of total)

ival-floor: 712.0ms (1.5% of total)

ival-neg: 574.0ms (1.2% of total)

ival-if: 322.0ms (0.7% of total)

...in/eval/compile.rkt:110:19: 313.0ms (0.7% of total)

ival-log2: 304.0ms (0.6% of total)

ival-fmax: 283.0ms (0.6% of total)

ival->: 205.0ms (0.4% of total)

ival-<: 174.0ms (0.4% of total)

ival-==: 173.0ms (0.4% of total)

ival-atan: 154.0ms (0.3% of total)

ival-asin: 133.0ms (0.3% of total)

ival-assert: 94.0ms (0.2% of total)

ival-sinh: 93.0ms (0.2% of total)

ival->=: 47.0ms (0.1% of total)

adjust: 1.0ms (0% of total)

Bogosity

prune48.3s (8.9%)

Memory: -202.5MiB live, 81 880.2MiB allocated
Counts: 147 129 → 3 951
Compiler: Compiled 351 856 to 131 214 computations (62.7% saved)

rewrite33.0s (6.1%)

Memory

-420.0MiB live, 33 752.5MiB allocated

Algorithm

118×	batch-egg-rewrite

Rules

61 442×	`log1p-expm1-u`
49 272×	`expm1-log1p-u`
37 627×	`pow1`
36 513×	`add-exp-log`
36 120×	`log-prod`

Stop Event

118×	node limit

Counts

1 939 → 43 248

eval32.8s (6%)

Memory: 917.4MiB live, 54 036.4MiB allocated
Compiler: Compiled 15 045 355 to 616 513 computations (95.9% saved)

localize30.1s (5.5%)

Memory

49.7MiB live, 45 813.5MiB allocated

Samples

12.5s	26 863×	0	valid
919.0ms	1 044×	1	valid
483.0ms	1 379×	0	exit
460.0ms	1 038×	0	invalid
144.0ms	102×	1	exit
114.0ms	38×	5	exit

Compiler

Compiled 98 313 to 5 562 computations (94.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 10.9s

ival-mult: 3.5s (31.7% of total)

ival-div: 1.5s (14.1% of total)

ival-pow: 608.0ms (5.6% of total)

ival-add: 606.0ms (5.5% of total)

ival-pow2: 589.0ms (5.4% of total)

ival-sqrt: 502.0ms (4.6% of total)

ival-sub: 477.0ms (4.4% of total)

ival-log: 367.0ms (3.4% of total)

ival-hypot: 351.0ms (3.2% of total)

ival-exp: 346.0ms (3.2% of total)

ival-sin: 282.0ms (2.6% of total)

...in/eval/compile.rkt:111:19: 232.0ms (2.1% of total)

ival-log1p: 187.0ms (1.7% of total)

adjust: 174.0ms (1.6% of total)

ival-neg: 158.0ms (1.4% of total)

ival-fmax: 150.0ms (1.4% of total)

ival-cos: 117.0ms (1.1% of total)

ival-if: 112.0ms (1% of total)

ival-log2: 93.0ms (0.9% of total)

ival-floor: 90.0ms (0.8% of total)

ival-cbrt: 89.0ms (0.8% of total)

ival-atan: 63.0ms (0.6% of total)

ival-tan: 58.0ms (0.5% of total)

ival-pi: 46.0ms (0.4% of total)

...in/eval/compile.rkt:110:19: 37.0ms (0.3% of total)

ival-expm1: 35.0ms (0.3% of total)

ival-asin: 32.0ms (0.3% of total)

ival-true: 28.0ms (0.3% of total)

ival->=: 26.0ms (0.2% of total)

ival-fabs: 22.0ms (0.2% of total)

ival->: 14.0ms (0.1% of total)

ival-sinh: 13.0ms (0.1% of total)

ival-assert: 13.0ms (0.1% of total)

ival-<: 4.0ms (0% of total)

ival-e: 3.0ms (0% of total)

ival-acos: 2.0ms (0% of total)

regimes29.1s (5.3%)

Memory

-12.9MiB live, 45 069.5MiB allocated

Counts

9 419 → 389

Calls

145 calls:

1.1s	s
826.0ms	u1
695.0ms	maxCos
678.0ms	cosTheta_i
634.0ms	dX.v

Compiler

Compiled 13 776 to 9 612 computations (30.2% saved)

series25.4s (4.7%)

Memory

990.5MiB live, 41 618.3MiB allocated

Counts

1 939 → 53 634

Calls

13224 calls:

Time	Variable		Point	Expression
326.0ms	s	@	-inf	(* -1 (log s))
185.0ms	sinTheta_i	@	-inf	(* (pow (exp sinTheta_i) (/ sinTheta_O (neg v))) (/ (* cosTheta_O (/ (/ cosTheta_i v) v)) (* (sinh (/ 1 v)) 2)))
180.0ms	w	@	-inf	(log (+ 1 (pow (sqrt (+ (* (* (floor h) dX.v) (* (floor h) dX.v)) (* (* (floor w) dX.u) (* (floor w) dX.u)))) 2)))
176.0ms	dX.u	@	-inf	(if (>= (+ (* (floor w) (* (* dX.u dX.u) (floor w))) (* (floor h) (* (floor h) (* dX.v dX.v)))) (+ (* (floor h) (* dY.v (* (floor h) dY.v))) (* dY.u (* dY.u (* (floor w) (floor w)))))) (/ (* (floor h) dX.v) (sqrt (fmax (+ (* (floor w) (* (* dX.u dX.u) (floor w))) (* (floor h) (* (floor h) (* dX.v dX.v)))) (+ (* (floor h) (* dY.v (* (floor h) dY.v))) (* dY.u (* dY.u (* (floor w) (floor w)))))))) (/ (* (floor h) dY.v) (sqrt (fmax (+ (* (floor w) (* (* dX.u dX.u) (floor w))) (* (floor h) (* (floor h) (* dX.v dX.v)))) (+ (* (floor h) (* dY.v (* (floor h) dY.v))) (* dY.u (* dY.u (* (floor w) (floor w)))))))))
166.0ms	s	@	0	(+ (* 2 (log (+ 1 (exp (/ x s))))) (log s))

analyze22.9s (4.2%)

Memory

-98.4MiB live, 30 845.9MiB allocated

Algorithm

30×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	2.6%	97.4%	0%	0%	0%	0
0%	0%	2.6%	97.4%	0%	0%	0%	1
7.8%	0.2%	2.4%	97.4%	0%	0%	0%	2
8.5%	0.2%	2.4%	97.4%	0%	0%	0%	3
12.8%	0.3%	2.3%	97.4%	0%	0%	0%	4
47%	1.2%	1.4%	97.4%	0%	0%	0%	5
51.8%	1.3%	1.2%	97.4%	0%	0.1%	0%	6
69.5%	1.8%	0.8%	97.4%	0%	0.1%	0%	7
71.6%	1.8%	0.7%	97.4%	0%	0.1%	0%	8
81.1%	2.1%	0.5%	97.4%	0%	0.1%	0%	9
82.6%	2.1%	0.4%	97.4%	0%	0.1%	0%	10
88.3%	2.2%	0.3%	97.4%	0%	0.1%	0%	11
89.1%	2.2%	0.3%	97.4%	0%	0.1%	0%	12

Compiler

Compiled 2 586 to 1 076 computations (58.4% saved)

preprocess10.4s (1.9%)

Memory

-484.5MiB live, 10 856.7MiB allocated

Algorithm

30×	egg-herbie

Rules

30 620×	`fma-define`
21 784×	`fmm-def`
14 698×	`distribute-lft-neg-in`
14 266×	`unsub-neg`
11 858×	`distribute-rgt-neg-in`

Stop Event

19×	node limit
11×	saturated

Compiler

Compiled 48 684 to 14 922 computations (69.3% saved)

explain9.0s (1.7%)

Memory

-267.7MiB live, 13 426.9MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`log.f32`	`#f`	sensitivity	1032	74
`-.f32`	`#f`	cancellation	420	32
`sqrt.f32`	`#f`	oflow-rescue	374	0
`tan.f32`	`(tan.f32 (+.f32 (.f32 (.f32 #s(literal 2 binary32) (PI.f32)) u1) (*.f32 #s(literal 1/2 binary32) (PI.f32))))`	cancellation	193	16
`cos.f32`	`#f`	sensitivity	192	16
`/.f32`	`#f`	o/n	138	0
`exp.f32`	`#f`	sensitivity	25	22
`/.f32`	`#f`	u/n	16	0
`sqrt.f32`	`(sqrt.f32 (-.f32 (.f32 eta eta) (/.f32 (.f32 sinTheta_O sinTheta_O) (sqrt.f32 (-.f32 #s(literal 1 binary32) (*.f32 sinTheta_O sinTheta_O))))))`	uflow-rescue	13	0
↳	`(*.f32 sinTheta_O sinTheta_O)`	underflow	286
↳	`(-.f32 (.f32 eta eta) (/.f32 (.f32 sinTheta_O sinTheta_O) (sqrt.f32 (-.f32 #s(literal 1 binary32) (*.f32 sinTheta_O sinTheta_O)))))`	underflow	13
↳	`(/.f32 (.f32 sinTheta_O sinTheta_O) (sqrt.f32 (-.f32 #s(literal 1 binary32) (.f32 sinTheta_O sinTheta_O))))`	underflow	143
↳	`(*.f32 eta eta)`	underflow	13
`/.f32`	`(/.f32 (neg.f32 (log.f32 (-.f32 #s(literal 1 binary32) u0))) (+.f32 (/.f32 cos2phi (.f32 alphax alphax)) (/.f32 sin2phi (.f32 alphay alphay))))`	n/o	7	0
↳	`(/.f32 sin2phi (*.f32 alphay alphay))`	overflow	13
↳	`(+.f32 (/.f32 cos2phi (.f32 alphax alphax)) (/.f32 sin2phi (.f32 alphay alphay)))`	overflow	13
`/.f32`	`#f`	o/o	6	0
`*.f32`	`(.f32 (sin.f32 (.f32 u normAngle)) (/.f32 #s(literal 1 binary32) (sin.f32 normAngle)))`	*nu**	3	0
`*.f32`	`#f`	*no**	2	0

Confusion

	Predicted +	Predicted -
+	1702	47
-	396	5535

Precision

0.8112488083889419

Recall

0.9731275014293882

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	1702	26	21
-	396	107	5428

Precision?

0.7745405647691618

Recall?

0.9879931389365352

Freqs

test

number	freq
0	5582
1	1781
2	311
3	6

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	18	1	1
-	7	1	2

Precision?

0.7037037037037037

Recall?

0.95

Samples

2.6s	15 316×	0	valid
19.0ms	44×	1	valid

Compiler

Compiled 18 280 to 2 256 computations (87.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.9s

ival-mult: 476.0ms (24.7% of total)

ival-floor: 293.0ms (15.2% of total)

ival-div: 232.0ms (12% of total)

ival-add: 179.0ms (9.3% of total)

ival-sin: 157.0ms (8.1% of total)

ival-log: 109.0ms (5.7% of total)

ival-sub: 83.0ms (4.3% of total)

ival-sqrt: 63.0ms (3.3% of total)

ival-exp: 55.0ms (2.9% of total)

ival-neg: 53.0ms (2.7% of total)

ival-cos: 41.0ms (2.1% of total)

...in/eval/compile.rkt:111:19: 30.0ms (1.6% of total)

ival-pi: 30.0ms (1.6% of total)

ival-tan: 18.0ms (0.9% of total)

ival-fmax: 16.0ms (0.8% of total)

ival-if: 14.0ms (0.7% of total)

ival-log2: 14.0ms (0.7% of total)

ival-true: 14.0ms (0.7% of total)

...in/eval/compile.rkt:110:19: 8.0ms (0.4% of total)

ival-atan: 8.0ms (0.4% of total)

ival-fabs: 8.0ms (0.4% of total)

ival-assert: 6.0ms (0.3% of total)

ival-asin: 5.0ms (0.3% of total)

ival-sinh: 5.0ms (0.3% of total)

adjust: 4.0ms (0.2% of total)

ival->=: 3.0ms (0.2% of total)

ival->: 2.0ms (0.1% of total)

ival-<: 1.0ms (0.1% of total)

bsearch40.0ms (0%)

Memory

60.8MiB live, 99.9MiB allocated

Algorithm

71×	binary-search
8×	left-value

Stop Event

71×	narrow-enough

Compiler

Compiled 4 081 to 1 945 computations (52.3% saved)

end0.0ms (0%)

Memory: 0.5MiB live, 0.5MiB allocated

simplify2.4min (26.4%)

soundness1.4min (15.1%)

sample1.3min (14.2%)

prune48.3s (8.9%)

rewrite33.0s (6.1%)

eval32.8s (6%)

localize30.1s (5.5%)

regimes29.1s (5.3%)

series25.4s (4.7%)

analyze22.9s (4.2%)

preprocess10.4s (1.9%)

explain9.0s (1.7%)

bsearch40.0ms (0%)

end0.0ms (0%)

Profiling