If you think that there is an error in how your package is being tested or represented, please file an issue at NewPkgEval.jl , making sure to read the FAQ first.
Results with Julia v1.2.0
Testing was successful .
Last evaluation was ago and took 1 minute, 20 seconds.
Click here to download the log file.
Click here to show the log contents.
Resolving package versions...
Installed Missings ─────────── v0.4.3
Installed DataAPI ──────────── v1.1.0
Installed KCenters ─────────── v0.1.4
Installed SortingAlgorithms ── v0.3.1
Installed Parsers ──────────── v0.3.10
Installed DataStructures ───── v0.17.6
Installed StatsBase ────────── v0.32.0
Installed SimilaritySearch ─── v0.3.16
Installed JSON ─────────────── v0.21.0
Installed OrderedCollections ─ v1.1.0
Updating `~/.julia/environments/v1.2/Project.toml`
[5d8de97f] + KCenters v0.1.4
Updating `~/.julia/environments/v1.2/Manifest.toml`
[9a962f9c] + DataAPI v1.1.0
[864edb3b] + DataStructures v0.17.6
[682c06a0] + JSON v0.21.0
[5d8de97f] + KCenters v0.1.4
[e1d29d7a] + Missings v0.4.3
[bac558e1] + OrderedCollections v1.1.0
[69de0a69] + Parsers v0.3.10
[053f045d] + SimilaritySearch v0.3.16
[a2af1166] + SortingAlgorithms v0.3.1
[2913bbd2] + StatsBase v0.32.0
[2a0f44e3] + Base64
[ade2ca70] + Dates
[8bb1440f] + DelimitedFiles
[8ba89e20] + Distributed
[b77e0a4c] + InteractiveUtils
[8f399da3] + Libdl
[37e2e46d] + LinearAlgebra
[56ddb016] + Logging
[d6f4376e] + Markdown
[a63ad114] + Mmap
[de0858da] + Printf
[9a3f8284] + Random
[9e88b42a] + Serialization
[6462fe0b] + Sockets
[2f01184e] + SparseArrays
[10745b16] + Statistics
[8dfed614] + Test
[4ec0a83e] + Unicode
Testing KCenters
Status `/tmp/jl_F6NQUY/Manifest.toml`
[9a962f9c] DataAPI v1.1.0
[864edb3b] DataStructures v0.17.6
[682c06a0] JSON v0.21.0
[5d8de97f] KCenters v0.1.4
[e1d29d7a] Missings v0.4.3
[bac558e1] OrderedCollections v1.1.0
[69de0a69] Parsers v0.3.10
[053f045d] SimilaritySearch v0.3.16
[a2af1166] SortingAlgorithms v0.3.1
[2913bbd2] StatsBase v0.32.0
[2a0f44e3] Base64 [`@stdlib/Base64`]
[ade2ca70] Dates [`@stdlib/Dates`]
[8bb1440f] DelimitedFiles [`@stdlib/DelimitedFiles`]
[8ba89e20] Distributed [`@stdlib/Distributed`]
[b77e0a4c] InteractiveUtils [`@stdlib/InteractiveUtils`]
[8f399da3] Libdl [`@stdlib/Libdl`]
[37e2e46d] LinearAlgebra [`@stdlib/LinearAlgebra`]
[56ddb016] Logging [`@stdlib/Logging`]
[d6f4376e] Markdown [`@stdlib/Markdown`]
[a63ad114] Mmap [`@stdlib/Mmap`]
[de0858da] Printf [`@stdlib/Printf`]
[9a3f8284] Random [`@stdlib/Random`]
[9e88b42a] Serialization [`@stdlib/Serialization`]
[6462fe0b] Sockets [`@stdlib/Sockets`]
[2f01184e] SparseArrays [`@stdlib/SparseArrays`]
[10745b16] Statistics [`@stdlib/Statistics`]
[8dfed614] Test [`@stdlib/Test`]
[4ec0a83e] Unicode [`@stdlib/Unicode`]
Test Summary: | Pass Total
Scores | 9 9
[ Info: 143.40999999999997
[ Info: 90.53000000000004
[ Info: 42.19999999999998
[ Info: 25.679999999999996
Test Summary: | Pass Total
Clustering with enet | 4 4
[ Info: 313.64000338064864
[ Info: 547.7199992669996
[ Info: 146.21999835129265
[ Info: 75.72000115944812
Test Summary: |
Clustering with dnet | No tests
inertia(cfft.distances) = 18.92661663451262
inertia(cdnet.distances) = 28.325769766053636
inertia(crand.distances) = 21.21327434150045
Test Summary: |
Clustering with KCenters | No tests
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.3876953125, conf: {"ssize":2,"bsize":2}, perf: {"precision":null,"recall":0.3876953125,"f1":null,"seconds":4.507601261138916e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":5.8125,"distances_sum":1016.4823969398803}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.681640625, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.681640625,"f1":0.7988599941724949,"seconds":1.4582648873329163e-5,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":7.8515625,"distances_sum":1763.2593922908625}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.681640625,"state":{"ssize":1,"bsize":4},"perf":{"precision":1.0,"recall":0.681640625,"f1":0.7988599941724949,"seconds":1.4582648873329163e-5,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":7.8515625,"distances_sum":1763.2593922908625}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8408203125, conf: {"ssize":2,"bsize":6}, perf: {"precision":1.0,"recall":0.8408203125,"f1":0.9065476190476198,"seconds":6.1783939599990845e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":8.453125,"distances_sum":2322.756298602149}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8408203125,"state":{"ssize":2,"bsize":6},"perf":{"precision":1.0,"recall":0.8408203125,"f1":0.9065476190476198,"seconds":6.1783939599990845e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":8.453125,"distances_sum":2322.756298602149}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9296875, conf: {"ssize":1,"bsize":10}, perf: {"precision":1.0,"recall":0.9296875,"f1":0.960250686813187,"seconds":7.113441824913025e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":8.84375,"distances_sum":2701.6953109920864}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9296875,"state":{"ssize":1,"bsize":10},"perf":{"precision":1.0,"recall":0.9296875,"f1":0.960250686813187,"seconds":7.113441824913025e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":8.84375,"distances_sum":2701.6953109920864}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9296875,"state":{"ssize":1,"bsize":10},"perf":{"precision":1.0,"recall":0.9296875,"f1":0.960250686813187,"seconds":7.113441824913025e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":8.84375,"distances_sum":2701.6953109920864}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.421875, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.421875,"f1":null,"seconds":4.1853636503219604e-6,"exhaustive_search_seconds":1.5310943126678467e-6,"evaluations":6.2890625,"distances_sum":945.6434063276746}, best_list's length: 2, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.421875,"state":{"ssize":1,"bsize":2},"perf":{"precision":null,"recall":0.421875,"f1":null,"seconds":4.1853636503219604e-6,"exhaustive_search_seconds":1.5310943126678467e-6,"evaluations":6.2890625,"distances_sum":945.6434063276746}}, beam: 2, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.60546875, conf: {"ssize":3,"bsize":3}, perf: {"precision":1.0,"recall":0.60546875,"f1":0.7408208111333118,"seconds":4.520639777183533e-6,"exhaustive_search_seconds":1.5310943126678467e-6,"evaluations":6.8984375,"distances_sum":1474.9269951260744}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.669921875, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.669921875,"f1":0.7907658313908321,"seconds":5.276873707771301e-6,"exhaustive_search_seconds":1.5310943126678467e-6,"evaluations":7.6953125,"distances_sum":1646.3302015733423}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.669921875,"state":{"ssize":1,"bsize":4},"perf":{"precision":1.0,"recall":0.669921875,"f1":0.7907658313908321,"seconds":5.276873707771301e-6,"exhaustive_search_seconds":1.5310943126678467e-6,"evaluations":7.6953125,"distances_sum":1646.3302015733423}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.92578125, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.92578125,"f1":0.9579300907425915,"seconds":6.81169331073761e-6,"exhaustive_search_seconds":1.5310943126678467e-6,"evaluations":8.90625,"distances_sum":2608.3751937363536}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8740234375, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.8740234375,"f1":0.9288289835164841,"seconds":6.4838677644729614e-6,"exhaustive_search_seconds":1.5310943126678467e-6,"evaluations":8.75,"distances_sum":2367.8310471114974}, best_list's length: 7, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.92578125,"state":{"ssize":1,"bsize":8},"perf":{"precision":1.0,"recall":0.92578125,"f1":0.9579300907425915,"seconds":6.81169331073761e-6,"exhaustive_search_seconds":1.5310943126678467e-6,"evaluations":8.90625,"distances_sum":2608.3751937363536}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.92578125,"state":{"ssize":1,"bsize":8},"perf":{"precision":1.0,"recall":0.92578125,"f1":0.9579300907425915,"seconds":6.81169331073761e-6,"exhaustive_search_seconds":1.5310943126678467e-6,"evaluations":8.90625,"distances_sum":2608.3751937363536}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.173828125, conf: {"ssize":3,"bsize":1}, perf: {"precision":null,"recall":0.173828125,"f1":null,"seconds":2.9299408197402954e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":4.28125,"distances_sum":422.0974560454119}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.29296875, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.29296875,"f1":null,"seconds":3.384426236152649e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":4.859375,"distances_sum":715.1714902700749}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.4609375, conf: {"ssize":1,"bsize":3}, perf: {"precision":1.0,"recall":0.4609375,"f1":0.6150328837828842,"seconds":4.190951585769653e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":6.3828125,"distances_sum":1094.9004056377157}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.4609375,"state":{"ssize":1,"bsize":3},"perf":{"precision":1.0,"recall":0.4609375,"f1":0.6150328837828842,"seconds":4.190951585769653e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":6.3828125,"distances_sum":1094.9004056377157}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7568359375, conf: {"ssize":3,"bsize":5}, perf: {"precision":1.0,"recall":0.7568359375,"f1":0.849169927294928,"seconds":5.537644028663635e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.359375,"distances_sum":1865.8514896351621}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.71484375, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.71484375,"f1":0.8194597069597078,"seconds":5.2694231271743774e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.125,"distances_sum":1751.0120417937756}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6494140625, conf: {"ssize":3,"bsize":4}, perf: {"precision":1.0,"recall":0.6494140625,"f1":0.7737337315462323,"seconds":5.25452196598053e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":7.8359375,"distances_sum":1560.0401302025277}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.4755859375, conf: {"ssize":2,"bsize":3}, perf: {"precision":1.0,"recall":0.4755859375,"f1":0.6298056110556116,"seconds":4.250556230545044e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":6.4296875,"distances_sum":1198.533559674356}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7568359375,"state":{"ssize":3,"bsize":5},"perf":{"precision":1.0,"recall":0.7568359375,"f1":0.849169927294928,"seconds":5.537644028663635e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.359375,"distances_sum":1865.8514896351621}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.908203125, conf: {"ssize":4,"bsize":9}, perf: {"precision":1.0,"recall":0.908203125,"f1":0.9480139652014659,"seconds":6.2193721532821655e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.7890625,"distances_sum":2415.996399210204}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8466796875, conf: {"ssize":7,"bsize":6}, perf: {"precision":1.0,"recall":0.8466796875,"f1":0.9095841658341666,"seconds":6.0461461544036865e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.6484375,"distances_sum":2168.9780937274604}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.869140625, conf: {"ssize":2,"bsize":8}, perf: {"precision":1.0,"recall":0.869140625,"f1":0.9241357600732606,"seconds":5.772337317466736e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.5234375,"distances_sum":2302.6861287106885}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8623046875, conf: {"ssize":5,"bsize":7}, perf: {"precision":1.0,"recall":0.8623046875,"f1":0.9199748168498177,"seconds":6.016343832015991e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.65625,"distances_sum":2222.42928690048}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8857421875, conf: {"ssize":6,"bsize":8}, perf: {"precision":1.0,"recall":0.8857421875,"f1":0.9336023351648357,"seconds":5.926936864852905e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.625,"distances_sum":2385.308683214372}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.908203125,"state":{"ssize":4,"bsize":9},"perf":{"precision":1.0,"recall":0.908203125,"f1":0.9480139652014659,"seconds":6.2193721532821655e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.7890625,"distances_sum":2415.996399210204}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.908203125,"state":{"ssize":4,"bsize":9},"perf":{"precision":1.0,"recall":0.908203125,"f1":0.9480139652014659,"seconds":6.2193721532821655e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.7890625,"distances_sum":2415.996399210204}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.71484375, conf: {"ssize":3,"bsize":4}, perf: {"precision":1.0,"recall":0.71484375,"f1":0.826097340159841,"seconds":5.433335900306702e-6,"exhaustive_search_seconds":1.5702098608016968e-6,"evaluations":8.21875,"distances_sum":1574.8217594215678}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.234375, conf: {"ssize":4,"bsize":1}, perf: {"precision":null,"recall":0.234375,"f1":null,"seconds":3.689900040626526e-6,"exhaustive_search_seconds":1.5702098608016968e-6,"evaluations":6.3671875,"distances_sum":550.9443792253028}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.71484375,"state":{"ssize":3,"bsize":4},"perf":{"precision":1.0,"recall":0.71484375,"f1":0.826097340159841,"seconds":5.433335900306702e-6,"exhaustive_search_seconds":1.5702098608016968e-6,"evaluations":8.21875,"distances_sum":1574.8217594215678}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9140625, conf: {"ssize":6,"bsize":8}, perf: {"precision":1.0,"recall":0.9140625,"f1":0.9520489926739932,"seconds":6.230548024177551e-6,"exhaustive_search_seconds":1.5702098608016968e-6,"evaluations":8.8984375,"distances_sum":2266.68502586026}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9140625,"state":{"ssize":6,"bsize":8},"perf":{"precision":1.0,"recall":0.9140625,"f1":0.9520489926739932,"seconds":6.230548024177551e-6,"exhaustive_search_seconds":1.5702098608016968e-6,"evaluations":8.8984375,"distances_sum":2266.68502586026}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9296875, conf: {"ssize":3,"bsize":9}, perf: {"precision":1.0,"recall":0.9296875,"f1":0.9600675366300372,"seconds":9.3020498752594e-6,"exhaustive_search_seconds":1.5702098608016968e-6,"evaluations":8.890625,"distances_sum":2327.463274708916}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9375, conf: {"ssize":4,"bsize":10}, perf: {"precision":1.0,"recall":0.9375,"f1":0.9651442307692311,"seconds":5.906447768211365e-6,"exhaustive_search_seconds":1.5702098608016968e-6,"evaluations":8.96875,"distances_sum":2348.2248309008864}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9443359375, conf: {"ssize":2,"bsize":10}, perf: {"precision":1.0,"recall":0.9443359375,"f1":0.9686984890109896,"seconds":9.65408980846405e-6,"exhaustive_search_seconds":1.5702098608016968e-6,"evaluations":8.9375,"distances_sum":2381.1518750221353}, best_list's length: 8, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9443359375,"state":{"ssize":2,"bsize":10},"perf":{"precision":1.0,"recall":0.9443359375,"f1":0.9686984890109896,"seconds":9.65408980846405e-6,"exhaustive_search_seconds":1.5702098608016968e-6,"evaluations":8.9375,"distances_sum":2381.1518750221353}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9443359375,"state":{"ssize":2,"bsize":10},"perf":{"precision":1.0,"recall":0.9443359375,"f1":0.9686984890109896,"seconds":9.65408980846405e-6,"exhaustive_search_seconds":1.5702098608016968e-6,"evaluations":8.9375,"distances_sum":2381.1518750221353}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.435546875, conf: {"ssize":5,"bsize":2}, perf: {"precision":null,"recall":0.435546875,"f1":null,"seconds":3.861263394355774e-6,"exhaustive_search_seconds":1.4062970876693726e-6,"evaluations":6.6953125,"distances_sum":926.3289433765377}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.435546875,"state":{"ssize":5,"bsize":2},"perf":{"precision":null,"recall":0.435546875,"f1":null,"seconds":3.861263394355774e-6,"exhaustive_search_seconds":1.4062970876693726e-6,"evaluations":6.6953125,"distances_sum":926.3289433765377}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.568359375, conf: {"ssize":7,"bsize":3}, perf: {"precision":null,"recall":0.568359375,"f1":null,"seconds":4.233792424201965e-6,"exhaustive_search_seconds":1.4062970876693726e-6,"evaluations":7.2890625,"distances_sum":1262.0974967184206}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5966796875, conf: {"ssize":1,"bsize":3}, perf: {"precision":null,"recall":0.5966796875,"f1":null,"seconds":4.433095455169678e-6,"exhaustive_search_seconds":1.4062970876693726e-6,"evaluations":7.46875,"distances_sum":1383.7100090042184}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6025390625, conf: {"ssize":2,"bsize":3}, perf: {"precision":null,"recall":0.6025390625,"f1":null,"seconds":4.278495907783508e-6,"exhaustive_search_seconds":1.4062970876693726e-6,"evaluations":7.4609375,"distances_sum":1369.4099380263988}, best_list's length: 7, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.6025390625,"state":{"ssize":2,"bsize":3},"perf":{"precision":null,"recall":0.6025390625,"f1":null,"seconds":4.278495907783508e-6,"exhaustive_search_seconds":1.4062970876693726e-6,"evaluations":7.4609375,"distances_sum":1369.4099380263988}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8662109375, conf: {"ssize":5,"bsize":7}, perf: {"precision":1.0,"recall":0.8662109375,"f1":0.9239010989010994,"seconds":5.792826414108276e-6,"exhaustive_search_seconds":1.4062970876693726e-6,"evaluations":8.5703125,"distances_sum":2197.701675125296}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6943359375, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.6943359375,"f1":0.8090586496836504,"seconds":4.76837158203125e-6,"exhaustive_search_seconds":1.4062970876693726e-6,"evaluations":7.984375,"distances_sum":1674.354132720209}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8359375, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.8359375,"f1":0.9059268856143862,"seconds":5.505979061126709e-6,"exhaustive_search_seconds":1.4062970876693726e-6,"evaluations":8.4921875,"distances_sum":2049.8971518746125}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.802734375, conf: {"ssize":9,"bsize":6}, perf: {"precision":1.0,"recall":0.802734375,"f1":0.884624229936731,"seconds":5.295500159263611e-6,"exhaustive_search_seconds":1.4062970876693726e-6,"evaluations":8.390625,"distances_sum":1932.1575330023707}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8662109375,"state":{"ssize":5,"bsize":7},"perf":{"precision":1.0,"recall":0.8662109375,"f1":0.9239010989010994,"seconds":5.792826414108276e-6,"exhaustive_search_seconds":1.4062970876693726e-6,"evaluations":8.5703125,"distances_sum":2197.701675125296}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.8662109375,"state":{"ssize":5,"bsize":7},"perf":{"precision":1.0,"recall":0.8662109375,"f1":0.9239010989010994,"seconds":5.792826414108276e-6,"exhaustive_search_seconds":1.4062970876693726e-6,"evaluations":8.5703125,"distances_sum":2197.701675125296}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7060546875, conf: {"ssize":3,"bsize":4}, perf: {"precision":1.0,"recall":0.7060546875,"f1":0.819162608225109,"seconds":4.775822162628174e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":7.96875,"distances_sum":1600.812625944682}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6962890625, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.6962890625,"f1":0.811539502164503,"seconds":9.825453162193298e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":7.921875,"distances_sum":1572.3622409036795}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2021484375, conf: {"ssize":5,"bsize":1}, perf: {"precision":null,"recall":0.2021484375,"f1":null,"seconds":3.0118972063064575e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":5.8671875,"distances_sum":426.6031982366968}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7060546875,"state":{"ssize":3,"bsize":4},"perf":{"precision":1.0,"recall":0.7060546875,"f1":0.819162608225109,"seconds":4.775822162628174e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":7.96875,"distances_sum":1600.812625944682}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.865234375, conf: {"ssize":2,"bsize":7}, perf: {"precision":1.0,"recall":0.865234375,"f1":0.923815247252748,"seconds":5.995854735374451e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.7578125,"distances_sum":2122.861778114417}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8759765625, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.8759765625,"f1":0.9300709706959714,"seconds":1.1032447218894958e-5,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.7421875,"distances_sum":2176.139570839756}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8251953125, conf: {"ssize":4,"bsize":6}, perf: {"precision":1.0,"recall":0.8251953125,"f1":0.8982148060273069,"seconds":5.619600415229797e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.5546875,"distances_sum":1978.1053694869552}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.91015625, conf: {"ssize":3,"bsize":8}, perf: {"precision":1.0,"recall":0.91015625,"f1":0.948969780219781,"seconds":5.548819899559021e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.8671875,"distances_sum":2322.9503856696856}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.91015625,"state":{"ssize":3,"bsize":8},"perf":{"precision":1.0,"recall":0.91015625,"f1":0.948969780219781,"seconds":5.548819899559021e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.8671875,"distances_sum":2322.9503856696856}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9130859375, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.9130859375,"f1":0.9504922161172168,"seconds":5.688518285751343e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.828125,"distances_sum":2340.6818417239865}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9580078125, conf: {"ssize":5,"bsize":11}, perf: {"precision":1.0,"recall":0.9580078125,"f1":0.9771577380952383,"seconds":6.22868537902832e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.984375,"distances_sum":2506.2495445252985}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9384765625, conf: {"ssize":6,"bsize":9}, perf: {"precision":1.0,"recall":0.9384765625,"f1":0.9651442307692311,"seconds":6.202608346939087e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.890625,"distances_sum":2428.463006681543}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9501953125, conf: {"ssize":4,"bsize":11}, perf: {"precision":1.0,"recall":0.9501953125,"f1":0.9719322344322349,"seconds":6.24731183052063e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.890625,"distances_sum":2494.6966613757213}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.947265625, conf: {"ssize":3,"bsize":10}, perf: {"precision":1.0,"recall":0.947265625,"f1":0.9707245879120883,"seconds":6.502494215965271e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.9375,"distances_sum":2459.540308264275}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.95703125, conf: {"ssize":7,"bsize":10}, perf: {"precision":1.0,"recall":0.95703125,"f1":0.9761561355311357,"seconds":6.448477506637573e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.9453125,"distances_sum":2507.9504837191776}, best_list's length: 11, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9580078125,"state":{"ssize":5,"bsize":11},"perf":{"precision":1.0,"recall":0.9580078125,"f1":0.9771577380952383,"seconds":6.22868537902832e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.984375,"distances_sum":2506.2495445252985}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9580078125,"state":{"ssize":5,"bsize":11},"perf":{"precision":1.0,"recall":0.9580078125,"f1":0.9771577380952383,"seconds":6.22868537902832e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.984375,"distances_sum":2506.2495445252985}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.4052734375, conf: {"ssize":2,"bsize":2}, perf: {"precision":null,"recall":0.4052734375,"f1":null,"seconds":4.552304744720459e-6,"exhaustive_search_seconds":1.991167664527893e-6,"evaluations":6.3125,"distances_sum":888.0937575128731}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.681640625, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.681640625,"f1":0.8014345029970038,"seconds":5.5730342864990234e-6,"exhaustive_search_seconds":1.991167664527893e-6,"evaluations":8.0859375,"distances_sum":1588.4108621249377}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7646484375, conf: {"ssize":2,"bsize":5}, perf: {"precision":1.0,"recall":0.7646484375,"f1":0.858580482017983,"seconds":5.781650543212891e-6,"exhaustive_search_seconds":1.991167664527893e-6,"evaluations":8.4921875,"distances_sum":1888.9579728387407}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7646484375,"state":{"ssize":2,"bsize":5},"perf":{"precision":1.0,"recall":0.7646484375,"f1":0.858580482017983,"seconds":5.781650543212891e-6,"exhaustive_search_seconds":1.991167664527893e-6,"evaluations":8.4921875,"distances_sum":1888.9579728387407}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8896484375, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.8896484375,"f1":0.9354655760905767,"seconds":5.668029189109802e-6,"exhaustive_search_seconds":1.991167664527893e-6,"evaluations":8.8046875,"distances_sum":2312.0939435229398}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.93359375, conf: {"ssize":3,"bsize":9}, perf: {"precision":1.0,"recall":0.93359375,"f1":0.9628605769230774,"seconds":5.837529897689819e-6,"exhaustive_search_seconds":1.991167664527893e-6,"evaluations":8.9296875,"distances_sum":2490.3903195320036}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8232421875, conf: {"ssize":2,"bsize":6}, perf: {"precision":1.0,"recall":0.8232421875,"f1":0.8958536255411262,"seconds":5.617737770080566e-6,"exhaustive_search_seconds":1.991167664527893e-6,"evaluations":8.640625,"distances_sum":2072.2582516161033}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9306640625, conf: {"ssize":5,"bsize":8}, perf: {"precision":1.0,"recall":0.9306640625,"f1":0.9608516483516486,"seconds":5.9157609939575195e-6,"exhaustive_search_seconds":1.991167664527893e-6,"evaluations":8.9140625,"distances_sum":2461.330560610382}, best_list's length: 11, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.93359375,"state":{"ssize":3,"bsize":9},"perf":{"precision":1.0,"recall":0.93359375,"f1":0.9628605769230774,"seconds":5.837529897689819e-6,"exhaustive_search_seconds":1.991167664527893e-6,"evaluations":8.9296875,"distances_sum":2490.3903195320036}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9501953125, conf: {"ssize":6,"bsize":11}, perf: {"precision":1.0,"recall":0.9501953125,"f1":0.9717891483516488,"seconds":6.459653377532959e-6,"exhaustive_search_seconds":1.991167664527893e-6,"evaluations":8.96875,"distances_sum":2549.280531096125}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.955078125, conf: {"ssize":5,"bsize":10}, perf: {"precision":1.0,"recall":0.955078125,"f1":0.9747081043956048,"seconds":6.3497573137283325e-6,"exhaustive_search_seconds":1.991167664527893e-6,"evaluations":8.9375,"distances_sum":2590.665836107871}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9404296875, conf: {"ssize":3,"bsize":11}, perf: {"precision":1.0,"recall":0.9404296875,"f1":0.9661916208791211,"seconds":6.4373016357421875e-6,"exhaustive_search_seconds":1.991167664527893e-6,"evaluations":8.953125,"distances_sum":2515.5936072324575}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9658203125, conf: {"ssize":5,"bsize":12}, perf: {"precision":1.0,"recall":0.9658203125,"f1":0.9812156593406596,"seconds":7.288530468940735e-6,"exhaustive_search_seconds":1.991167664527893e-6,"evaluations":8.9921875,"distances_sum":2626.3843268679984}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9541015625, conf: {"ssize":4,"bsize":12}, perf: {"precision":1.0,"recall":0.9541015625,"f1":0.9748340201465205,"seconds":6.122514605522156e-6,"exhaustive_search_seconds":1.991167664527893e-6,"evaluations":8.9609375,"distances_sum":2574.370951142401}, best_list's length: 12, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9658203125,"state":{"ssize":5,"bsize":12},"perf":{"precision":1.0,"recall":0.9658203125,"f1":0.9812156593406596,"seconds":7.288530468940735e-6,"exhaustive_search_seconds":1.991167664527893e-6,"evaluations":8.9921875,"distances_sum":2626.3843268679984}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9658203125,"state":{"ssize":5,"bsize":12},"perf":{"precision":1.0,"recall":0.9658203125,"f1":0.9812156593406596,"seconds":7.288530468940735e-6,"exhaustive_search_seconds":1.991167664527893e-6,"evaluations":8.9921875,"distances_sum":2626.3843268679984}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.3154296875, conf: {"ssize":2,"bsize":2}, perf: {"precision":null,"recall":0.3154296875,"f1":null,"seconds":3.417953848838806e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":5.6796875,"distances_sum":734.3826629541273}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.69921875, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.69921875,"f1":0.8106789044289051,"seconds":6.087124347686768e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.203125,"distances_sum":1657.3991155442363}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.17578125, conf: {"ssize":2,"bsize":1}, perf: {"precision":null,"recall":0.17578125,"f1":null,"seconds":3.1888484954833984e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":5.390625,"distances_sum":434.32099730435675}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.69921875,"state":{"ssize":1,"bsize":4},"perf":{"precision":1.0,"recall":0.69921875,"f1":0.8106789044289051,"seconds":6.087124347686768e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.203125,"distances_sum":1657.3991155442363}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.833984375, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.833984375,"f1":0.900436022311023,"seconds":6.152316927909851e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.75,"distances_sum":2100.998790807534}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.833984375,"state":{"ssize":1,"bsize":6},"perf":{"precision":1.0,"recall":0.833984375,"f1":0.900436022311023,"seconds":6.152316927909851e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.75,"distances_sum":2100.998790807534}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9287109375, conf: {"ssize":4,"bsize":9}, perf: {"precision":1.0,"recall":0.9287109375,"f1":0.9595467032967039,"seconds":6.1355531215667725e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.9140625,"distances_sum":2457.9300549500445}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9140625, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.9140625,"f1":0.9506581959706963,"seconds":5.710870027542114e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.828125,"distances_sum":2426.2836580673325}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8857421875, conf: {"ssize":2,"bsize":7}, perf: {"precision":1.0,"recall":0.8857421875,"f1":0.9341606310356315,"seconds":5.8300793170928955e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.8203125,"distances_sum":2276.6323706232283}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8935546875, conf: {"ssize":7,"bsize":8}, perf: {"precision":1.0,"recall":0.8935546875,"f1":0.9397035256410261,"seconds":5.759298801422119e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.8046875,"distances_sum":2320.7438029944565}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8466796875, conf: {"ssize":6,"bsize":6}, perf: {"precision":1.0,"recall":0.8466796875,"f1":0.9083140817515823,"seconds":5.675479769706726e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.8046875,"distances_sum":2128.2700670962286}, best_list's length: 12, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9287109375,"state":{"ssize":4,"bsize":9},"perf":{"precision":1.0,"recall":0.9287109375,"f1":0.9595467032967039,"seconds":6.1355531215667725e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.9140625,"distances_sum":2457.9300549500445}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9287109375,"state":{"ssize":4,"bsize":9},"perf":{"precision":1.0,"recall":0.9287109375,"f1":0.9595467032967039,"seconds":6.1355531215667725e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.9140625,"distances_sum":2457.9300549500445}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.4111328125, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.4111328125,"f1":null,"seconds":3.732740879058838e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":5.9375,"distances_sum":813.847284218553}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5556640625, conf: {"ssize":1,"bsize":3}, perf: {"precision":1.0,"recall":0.5556640625,"f1":0.6947231587856593,"seconds":3.8526952266693115e-5,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":6.796875,"distances_sum":1115.2239054576535}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.5556640625,"state":{"ssize":1,"bsize":3},"perf":{"precision":1.0,"recall":0.5556640625,"f1":0.6947231587856593,"seconds":3.8526952266693115e-5,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":6.796875,"distances_sum":1115.2239054576535}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.77734375, conf: {"ssize":5,"bsize":5}, perf: {"precision":1.0,"recall":0.77734375,"f1":0.8678430944055953,"seconds":5.412846803665161e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.0234375,"distances_sum":1755.0399330296116}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.77734375,"state":{"ssize":5,"bsize":5},"perf":{"precision":1.0,"recall":0.77734375,"f1":0.8678430944055953,"seconds":5.412846803665161e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.0234375,"distances_sum":1755.0399330296116}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9365234375, conf: {"ssize":2,"bsize":9}, perf: {"precision":1.0,"recall":0.9365234375,"f1":0.9647550366300371,"seconds":6.170943379402161e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.84375,"distances_sum":2348.2823814377807}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.830078125, conf: {"ssize":5,"bsize":6}, perf: {"precision":1.0,"recall":0.830078125,"f1":0.8996456668331677,"seconds":5.6121498346328735e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.3671875,"distances_sum":1922.5221214931064}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8681640625, conf: {"ssize":8,"bsize":7}, perf: {"precision":1.0,"recall":0.8681640625,"f1":0.9246394230769238,"seconds":5.727633833885193e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.609375,"distances_sum":2047.4763256352046}, best_list's length: 8, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9365234375,"state":{"ssize":2,"bsize":9},"perf":{"precision":1.0,"recall":0.9365234375,"f1":0.9647550366300371,"seconds":6.170943379402161e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.84375,"distances_sum":2348.2823814377807}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9365234375,"state":{"ssize":2,"bsize":9},"perf":{"precision":1.0,"recall":0.9365234375,"f1":0.9647550366300371,"seconds":6.170943379402161e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.84375,"distances_sum":2348.2823814377807}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.65234375, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.65234375,"f1":0.7768611596736604,"seconds":4.829838871955872e-6,"exhaustive_search_seconds":1.3522803783416748e-6,"evaluations":7.671875,"distances_sum":1360.3132531530493}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.771484375, conf: {"ssize":3,"bsize":5}, perf: {"precision":1.0,"recall":0.771484375,"f1":0.8621003996004005,"seconds":5.219131708145142e-6,"exhaustive_search_seconds":1.3522803783416748e-6,"evaluations":8.0078125,"distances_sum":1746.3822117978052}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.771484375,"state":{"ssize":3,"bsize":5},"perf":{"precision":1.0,"recall":0.771484375,"f1":0.8621003996004005,"seconds":5.219131708145142e-6,"exhaustive_search_seconds":1.3522803783416748e-6,"evaluations":8.0078125,"distances_sum":1746.3822117978052}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.93359375, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.93359375,"f1":0.9623740842490847,"seconds":5.889683961868286e-6,"exhaustive_search_seconds":1.3522803783416748e-6,"evaluations":8.8828125,"distances_sum":2335.631612568309}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.916015625, conf: {"ssize":4,"bsize":8}, perf: {"precision":1.0,"recall":0.916015625,"f1":0.9525927197802203,"seconds":5.641952157020569e-6,"exhaustive_search_seconds":1.3522803783416748e-6,"evaluations":8.796875,"distances_sum":2282.4744940711457}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7783203125, conf: {"ssize":4,"bsize":5}, perf: {"precision":1.0,"recall":0.7783203125,"f1":0.8687333499833506,"seconds":5.088746547698975e-6,"exhaustive_search_seconds":1.3522803783416748e-6,"evaluations":8.1953125,"distances_sum":1761.55920334492}, best_list's length: 7, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.93359375,"state":{"ssize":1,"bsize":9},"perf":{"precision":1.0,"recall":0.93359375,"f1":0.9623740842490847,"seconds":5.889683961868286e-6,"exhaustive_search_seconds":1.3522803783416748e-6,"evaluations":8.8828125,"distances_sum":2335.631612568309}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9736328125, conf: {"ssize":3,"bsize":12}, perf: {"precision":1.0,"recall":0.9736328125,"f1":0.9855654761904763,"seconds":5.7891011238098145e-6,"exhaustive_search_seconds":1.3522803783416748e-6,"evaluations":8.96875,"distances_sum":2501.613625202297}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.951171875, conf: {"ssize":3,"bsize":13}, perf: {"precision":1.0,"recall":0.951171875,"f1":0.9732886904761908,"seconds":6.1802566051483154e-6,"exhaustive_search_seconds":1.3522803783416748e-6,"evaluations":8.9609375,"distances_sum":2393.00020548426}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9365234375, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.9365234375,"f1":0.9643257783882788,"seconds":5.675479769706726e-6,"exhaustive_search_seconds":1.3522803783416748e-6,"evaluations":8.8828125,"distances_sum":2361.5658618605185}, best_list's length: 7, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9736328125,"state":{"ssize":3,"bsize":12},"perf":{"precision":1.0,"recall":0.9736328125,"f1":0.9855654761904763,"seconds":5.7891011238098145e-6,"exhaustive_search_seconds":1.3522803783416748e-6,"evaluations":8.96875,"distances_sum":2501.613625202297}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9736328125,"state":{"ssize":3,"bsize":12},"perf":{"precision":1.0,"recall":0.9736328125,"f1":0.9855654761904763,"seconds":5.7891011238098145e-6,"exhaustive_search_seconds":1.3522803783416748e-6,"evaluations":8.96875,"distances_sum":2501.613625202297}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.576171875, conf: {"ssize":2,"bsize":3}, perf: {"precision":1.0,"recall":0.576171875,"f1":0.7184166527916536,"seconds":4.367902874946594e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":7.5234375,"distances_sum":1192.1683635036602}, best_list's length: 2, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.576171875,"state":{"ssize":2,"bsize":3},"perf":{"precision":1.0,"recall":0.576171875,"f1":0.7184166527916536,"seconds":4.367902874946594e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":7.5234375,"distances_sum":1192.1683635036602}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.873046875, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.873046875,"f1":0.9274813727938735,"seconds":5.6438148021698e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.6875,"distances_sum":2133.820757865998}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.873046875,"state":{"ssize":1,"bsize":7},"perf":{"precision":1.0,"recall":0.873046875,"f1":0.9274813727938735,"seconds":5.6438148021698e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.6875,"distances_sum":2133.820757865998}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9580078125, conf: {"ssize":5,"bsize":11}, perf: {"precision":1.0,"recall":0.9580078125,"f1":0.9770661630036634,"seconds":5.610287189483643e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.953125,"distances_sum":2468.842269324445}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.92578125, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.92578125,"f1":0.9586710164835167,"seconds":5.256384611129761e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.8671875,"distances_sum":2336.9853666577424}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9326171875, conf: {"ssize":3,"bsize":10}, perf: {"precision":1.0,"recall":0.9326171875,"f1":0.9629292582417587,"seconds":5.478039383888245e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.921875,"distances_sum":2357.9893850947387}, best_list's length: 8, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9580078125,"state":{"ssize":5,"bsize":11},"perf":{"precision":1.0,"recall":0.9580078125,"f1":0.9770661630036634,"seconds":5.610287189483643e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.953125,"distances_sum":2468.842269324445}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9580078125,"state":{"ssize":5,"bsize":11},"perf":{"precision":1.0,"recall":0.9580078125,"f1":0.9770661630036634,"seconds":5.610287189483643e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.953125,"distances_sum":2468.842269324445}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.28125,"state":{"ssize":1,"bsize":1},"perf":{"precision":null,"recall":0.28125,"f1":null,"seconds":3.155320882797241e-6,"exhaustive_search_seconds":1.210719347000122e-6,"evaluations":6.359375,"distances_sum":547.365936633697}}, beam: 3, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.28125,"state":{"ssize":1,"bsize":1},"perf":{"precision":null,"recall":0.28125,"f1":null,"seconds":3.155320882797241e-6,"exhaustive_search_seconds":1.210719347000122e-6,"evaluations":6.359375,"distances_sum":547.365936633697}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.408203125, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.408203125,"f1":null,"seconds":3.4924596548080444e-6,"exhaustive_search_seconds":1.210719347000122e-6,"evaluations":6.515625,"distances_sum":873.1330115269598}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.763671875, conf: {"ssize":4,"bsize":5}, perf: {"precision":1.0,"recall":0.763671875,"f1":0.8593755203130212,"seconds":5.4407864809036255e-6,"exhaustive_search_seconds":1.210719347000122e-6,"evaluations":8.265625,"distances_sum":1802.2215164198099}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.763671875,"state":{"ssize":4,"bsize":5},"perf":{"precision":1.0,"recall":0.763671875,"f1":0.8593755203130212,"seconds":5.4407864809036255e-6,"exhaustive_search_seconds":1.210719347000122e-6,"evaluations":8.265625,"distances_sum":1802.2215164198099}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.841796875, conf: {"ssize":3,"bsize":6}, perf: {"precision":1.0,"recall":0.841796875,"f1":0.9081964910089916,"seconds":5.3513795137405396e-6,"exhaustive_search_seconds":1.210719347000122e-6,"evaluations":8.7109375,"distances_sum":2067.7165326201907}, best_list's length: 4, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9013671875, conf: {"ssize":5,"bsize":8}, perf: {"precision":1.0,"recall":0.9013671875,"f1":0.9425314269064275,"seconds":6.601214408874512e-6,"exhaustive_search_seconds":1.210719347000122e-6,"evaluations":8.828125,"distances_sum":2312.041027057042}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9013671875,"state":{"ssize":5,"bsize":8},"perf":{"precision":1.0,"recall":0.9013671875,"f1":0.9425314269064275,"seconds":6.601214408874512e-6,"exhaustive_search_seconds":1.210719347000122e-6,"evaluations":8.828125,"distances_sum":2312.041027057042}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9365234375, conf: {"ssize":9,"bsize":9}, perf: {"precision":1.0,"recall":0.9365234375,"f1":0.9641197344322346,"seconds":5.999580025672913e-6,"exhaustive_search_seconds":1.210719347000122e-6,"evaluations":8.890625,"distances_sum":2483.2610625622256}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9423828125, conf: {"ssize":4,"bsize":11}, perf: {"precision":1.0,"recall":0.9423828125,"f1":0.9683035714285717,"seconds":6.0070306062698364e-6,"exhaustive_search_seconds":1.210719347000122e-6,"evaluations":8.9453125,"distances_sum":2476.822481135648}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9326171875, conf: {"ssize":6,"bsize":8}, perf: {"precision":1.0,"recall":0.9326171875,"f1":0.9624656593406598,"seconds":5.7015568017959595e-6,"exhaustive_search_seconds":1.210719347000122e-6,"evaluations":8.8984375,"distances_sum":2449.9227701186}, best_list's length: 11, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9423828125,"state":{"ssize":4,"bsize":11},"perf":{"precision":1.0,"recall":0.9423828125,"f1":0.9683035714285717,"seconds":6.0070306062698364e-6,"exhaustive_search_seconds":1.210719347000122e-6,"evaluations":8.9453125,"distances_sum":2476.822481135648}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9423828125,"state":{"ssize":4,"bsize":11},"perf":{"precision":1.0,"recall":0.9423828125,"f1":0.9683035714285717,"seconds":6.0070306062698364e-6,"exhaustive_search_seconds":1.210719347000122e-6,"evaluations":8.9453125,"distances_sum":2476.822481135648}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2568359375, conf: {"ssize":2,"bsize":1}, perf: {"precision":null,"recall":0.2568359375,"f1":null,"seconds":3.2633543014526367e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":5.6796875,"distances_sum":532.3916950566977}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2568359375, conf: {"ssize":5,"bsize":1}, perf: {"precision":null,"recall":0.2568359375,"f1":null,"seconds":3.1311064958572388e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":5.703125,"distances_sum":531.8909839934167}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7587890625, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.7587890625,"f1":0.8526561979686987,"seconds":5.058944225311279e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":8.125,"distances_sum":1817.9467555504502}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7587890625,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.7587890625,"f1":0.8526561979686987,"seconds":5.058944225311279e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":8.125,"distances_sum":1817.9467555504502}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.908203125, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.908203125,"f1":0.9477964743589748,"seconds":5.424022674560547e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":8.6953125,"distances_sum":2380.1205952772225}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.763671875, conf: {"ssize":4,"bsize":5}, perf: {"precision":null,"recall":0.763671875,"f1":null,"seconds":5.088746547698975e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":8.078125,"distances_sum":1792.5607420535505}, best_list's length: 8, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.908203125,"state":{"ssize":1,"bsize":8},"perf":{"precision":1.0,"recall":0.908203125,"f1":0.9477964743589748,"seconds":5.424022674560547e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":8.6953125,"distances_sum":2380.1205952772225}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.951171875, conf: {"ssize":1,"bsize":12}, perf: {"precision":1.0,"recall":0.951171875,"f1":0.9733630952380955,"seconds":5.690380930900574e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":8.9140625,"distances_sum":2543.4321934908417}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9326171875, conf: {"ssize":4,"bsize":9}, perf: {"precision":1.0,"recall":0.9326171875,"f1":0.9626888736263741,"seconds":5.6587159633636475e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":8.8671875,"distances_sum":2469.9988376020365}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.927734375, conf: {"ssize":3,"bsize":9}, perf: {"precision":1.0,"recall":0.927734375,"f1":0.958917124542125,"seconds":5.636364221572876e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":8.8359375,"distances_sum":2435.6103444218265}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.951171875,"state":{"ssize":1,"bsize":12},"perf":{"precision":1.0,"recall":0.951171875,"f1":0.9733630952380955,"seconds":5.690380930900574e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":8.9140625,"distances_sum":2543.4321934908417}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.951171875,"state":{"ssize":1,"bsize":12},"perf":{"precision":1.0,"recall":0.951171875,"f1":0.9733630952380955,"seconds":5.690380930900574e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":8.9140625,"distances_sum":2543.4321934908417}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2587890625, conf: {"ssize":4,"bsize":1}, perf: {"precision":null,"recall":0.2587890625,"f1":null,"seconds":3.4496188163757324e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":5.6015625,"distances_sum":577.5704997054371}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.771484375, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.771484375,"f1":0.8622486888111897,"seconds":5.537644028663635e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.2109375,"distances_sum":1892.1204398675752}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.771484375,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.771484375,"f1":0.8622486888111897,"seconds":5.537644028663635e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.2109375,"distances_sum":1892.1204398675752}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8916015625, conf: {"ssize":5,"bsize":8}, perf: {"precision":1.0,"recall":0.8916015625,"f1":0.9372367216117222,"seconds":6.362795829772949e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.5859375,"distances_sum":2414.5105202135933}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8916015625,"state":{"ssize":5,"bsize":8},"perf":{"precision":1.0,"recall":0.8916015625,"f1":0.9372367216117222,"seconds":6.362795829772949e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.5859375,"distances_sum":2414.5105202135933}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.927734375, conf: {"ssize":2,"bsize":9}, perf: {"precision":1.0,"recall":0.927734375,"f1":0.9588999542124548,"seconds":6.731599569320679e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.8359375,"distances_sum":2499.7899079535646}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9462890625, conf: {"ssize":6,"bsize":10}, perf: {"precision":1.0,"recall":0.9462890625,"f1":0.9699233058608063,"seconds":5.749985575675964e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.875,"distances_sum":2614.1918610499856}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.904296875, conf: {"ssize":4,"bsize":8}, perf: {"precision":1.0,"recall":0.904296875,"f1":0.9454873251748258,"seconds":5.498528480529785e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.6796875,"distances_sum":2465.323897980194}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9013671875, conf: {"ssize":2,"bsize":8}, perf: {"precision":1.0,"recall":0.9013671875,"f1":0.9446314102564107,"seconds":5.532056093215942e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.7734375,"distances_sum":2408.6387434071153}, best_list's length: 11, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9462890625,"state":{"ssize":6,"bsize":10},"perf":{"precision":1.0,"recall":0.9462890625,"f1":0.9699233058608063,"seconds":5.749985575675964e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.875,"distances_sum":2614.1918610499856}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9462890625,"state":{"ssize":6,"bsize":10},"perf":{"precision":1.0,"recall":0.9462890625,"f1":0.9699233058608063,"seconds":5.749985575675964e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.875,"distances_sum":2614.1918610499856}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7861328125, conf: {"ssize":3,"bsize":5}, perf: {"precision":1.0,"recall":0.7861328125,"f1":0.8722766816516825,"seconds":4.2786821722984314e-5,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.25,"distances_sum":1885.9581206801156}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7822265625, conf: {"ssize":4,"bsize":5}, perf: {"precision":1.0,"recall":0.7822265625,"f1":0.8711512445887454,"seconds":6.07222318649292e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.4375,"distances_sum":1850.1126241069862}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7861328125,"state":{"ssize":3,"bsize":5},"perf":{"precision":1.0,"recall":0.7861328125,"f1":0.8722766816516825,"seconds":4.2786821722984314e-5,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.25,"distances_sum":1885.9581206801156}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.828125, conf: {"ssize":4,"bsize":6}, perf: {"precision":1.0,"recall":0.828125,"f1":0.8973479645354651,"seconds":5.6587159633636475e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.4921875,"distances_sum":2026.7708238524378}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.927734375, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.927734375,"f1":0.9597298534798541,"seconds":5.941838026046753e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.890625,"distances_sum":2423.6918761741376}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.91015625, conf: {"ssize":7,"bsize":9}, perf: {"precision":1.0,"recall":0.91015625,"f1":0.9492616758241763,"seconds":5.7891011238098145e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.7890625,"distances_sum":2375.847176945816}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.912109375, conf: {"ssize":8,"bsize":8}, perf: {"precision":1.0,"recall":0.912109375,"f1":0.9493449259074265,"seconds":5.6549906730651855e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.8125,"distances_sum":2379.0398350811747}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.90625, conf: {"ssize":7,"bsize":8}, perf: {"precision":1.0,"recall":0.90625,"f1":0.9466632326007332,"seconds":5.3960829973220825e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.703125,"distances_sum":2387.9214337291332}, best_list's length: 12, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.927734375,"state":{"ssize":1,"bsize":9},"perf":{"precision":1.0,"recall":0.927734375,"f1":0.9597298534798541,"seconds":5.941838026046753e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.890625,"distances_sum":2423.6918761741376}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9619140625, conf: {"ssize":1,"bsize":13}, perf: {"precision":1.0,"recall":0.9619140625,"f1":0.9790006868131871,"seconds":6.357207894325256e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.953125,"distances_sum":2551.610061107229}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9375, conf: {"ssize":9,"bsize":10}, perf: {"precision":1.0,"recall":0.9375,"f1":0.9650698260073263,"seconds":5.89713454246521e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.8828125,"distances_sum":2467.295253170897}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9345703125, conf: {"ssize":3,"bsize":9}, perf: {"precision":1.0,"recall":0.9345703125,"f1":0.9636733058608061,"seconds":5.887821316719055e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.8671875,"distances_sum":2445.8779585221537}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.94140625, conf: {"ssize":7,"bsize":10}, perf: {"precision":1.0,"recall":0.94140625,"f1":0.9667639652014657,"seconds":6.1746686697006226e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.890625,"distances_sum":2479.983917282172}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.931640625, conf: {"ssize":6,"bsize":10}, perf: {"precision":1.0,"recall":0.931640625,"f1":0.9620764652014655,"seconds":5.889683961868286e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.890625,"distances_sum":2444.0087974326507}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9619140625,"state":{"ssize":1,"bsize":13},"perf":{"precision":1.0,"recall":0.9619140625,"f1":0.9790006868131871,"seconds":6.357207894325256e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.953125,"distances_sum":2551.610061107229}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9619140625,"state":{"ssize":1,"bsize":13},"perf":{"precision":1.0,"recall":0.9619140625,"f1":0.9790006868131871,"seconds":6.357207894325256e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.953125,"distances_sum":2551.610061107229}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.650390625, conf: {"ssize":3,"bsize":4}, perf: {"precision":1.0,"recall":0.650390625,"f1":0.7737071955821964,"seconds":4.624947905540466e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":7.640625,"distances_sum":1492.7236360543627}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.779296875, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.779296875,"f1":0.8689133782883791,"seconds":5.2265822887420654e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.0625,"distances_sum":1872.8589184013103}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.779296875,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.779296875,"f1":0.8689133782883791,"seconds":5.2265822887420654e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.0625,"distances_sum":1872.8589184013103}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9365234375, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.9365234375,"f1":0.9633585164835169,"seconds":5.589798092842102e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.90625,"distances_sum":2480.8348522733922}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8740234375, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.8740234375,"f1":0.9263195138195145,"seconds":5.343928933143616e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.609375,"distances_sum":2198.824400318707}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8818359375, conf: {"ssize":4,"bsize":7}, perf: {"precision":1.0,"recall":0.8818359375,"f1":0.9320455586080594,"seconds":5.606561899185181e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.7109375,"distances_sum":2239.796676963254}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9365234375,"state":{"ssize":1,"bsize":9},"perf":{"precision":1.0,"recall":0.9365234375,"f1":0.9633585164835169,"seconds":5.589798092842102e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.90625,"distances_sum":2480.8348522733922}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.962890625, conf: {"ssize":1,"bsize":12}, perf: {"precision":1.0,"recall":0.962890625,"f1":0.9796875000000003,"seconds":6.334856152534485e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.9765625,"distances_sum":2584.544321894642}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9462890625, conf: {"ssize":1,"bsize":10}, perf: {"precision":1.0,"recall":0.9462890625,"f1":0.9697401556776563,"seconds":6.05359673500061e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.8984375,"distances_sum":2514.8323361256985}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9609375, conf: {"ssize":1,"bsize":11}, perf: {"precision":1.0,"recall":0.9609375,"f1":0.9786286630036634,"seconds":6.34416937828064e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.9609375,"distances_sum":2565.305333548246}, best_list's length: 8, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.962890625,"state":{"ssize":1,"bsize":12},"perf":{"precision":1.0,"recall":0.962890625,"f1":0.9796875000000003,"seconds":6.334856152534485e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.9765625,"distances_sum":2584.544321894642}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.962890625,"state":{"ssize":1,"bsize":12},"perf":{"precision":1.0,"recall":0.962890625,"f1":0.9796875000000003,"seconds":6.334856152534485e-6,"exhaustive_search_seconds":1.30385160446167e-6,"evaluations":8.9765625,"distances_sum":2584.544321894642}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.24609375, conf: {"ssize":5,"bsize":1}, perf: {"precision":null,"recall":0.24609375,"f1":null,"seconds":3.1907111406326294e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":5.328125,"distances_sum":542.4960280238114}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2412109375, conf: {"ssize":3,"bsize":1}, perf: {"precision":null,"recall":0.2412109375,"f1":null,"seconds":3.1366944313049316e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":5.328125,"distances_sum":521.3091624236715}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7392578125, conf: {"ssize":4,"bsize":5}, perf: {"precision":1.0,"recall":0.7392578125,"f1":0.8421333874458884,"seconds":5.044043064117432e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":7.9375,"distances_sum":1757.9052772306575}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7392578125,"state":{"ssize":4,"bsize":5},"perf":{"precision":1.0,"recall":0.7392578125,"f1":0.8421333874458884,"seconds":5.044043064117432e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":7.9375,"distances_sum":1757.9052772306575}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9072265625, conf: {"ssize":6,"bsize":9}, perf: {"precision":1.0,"recall":0.9072265625,"f1":0.947269917582418,"seconds":5.686655640602112e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":8.78125,"distances_sum":2405.9621879360093}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.900390625, conf: {"ssize":8,"bsize":8}, perf: {"precision":1.0,"recall":0.900390625,"f1":0.9423305860805866,"seconds":5.427747964859009e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":8.6484375,"distances_sum":2392.0297651950455}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.748046875, conf: {"ssize":6,"bsize":5}, perf: {"precision":1.0,"recall":0.748046875,"f1":0.8480176073926082,"seconds":5.198642611503601e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":8.0546875,"distances_sum":1813.4109417952577}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9072265625,"state":{"ssize":6,"bsize":9},"perf":{"precision":1.0,"recall":0.9072265625,"f1":0.947269917582418,"seconds":5.686655640602112e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":8.78125,"distances_sum":2405.9621879360093}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9345703125, conf: {"ssize":9,"bsize":12}, perf: {"precision":1.0,"recall":0.9345703125,"f1":0.9639709249084253,"seconds":5.649402737617493e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":8.84375,"distances_sum":2512.45541449802}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9609375, conf: {"ssize":4,"bsize":13}, perf: {"precision":1.0,"recall":0.9609375,"f1":0.9786458333333333,"seconds":6.249174475669861e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":8.921875,"distances_sum":2630.6145072481295}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9521484375, conf: {"ssize":2,"bsize":12}, perf: {"precision":1.0,"recall":0.9521484375,"f1":0.9734203296703301,"seconds":6.085261702537537e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":8.8984375,"distances_sum":2571.6985907078333}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9541015625, conf: {"ssize":4,"bsize":11}, perf: {"precision":1.0,"recall":0.9541015625,"f1":0.9743704212454216,"seconds":5.8766454458236694e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":8.859375,"distances_sum":2614.6125392555637}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9150390625, conf: {"ssize":4,"bsize":9}, perf: {"precision":1.0,"recall":0.9150390625,"f1":0.9506009615384622,"seconds":5.89713454246521e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":8.7109375,"distances_sum":2456.681507157425}, best_list's length: 12, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9609375,"state":{"ssize":4,"bsize":13},"perf":{"precision":1.0,"recall":0.9609375,"f1":0.9786458333333333,"seconds":6.249174475669861e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":8.921875,"distances_sum":2630.6145072481295}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9609375,"state":{"ssize":4,"bsize":13},"perf":{"precision":1.0,"recall":0.9609375,"f1":0.9786458333333333,"seconds":6.249174475669861e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":8.921875,"distances_sum":2630.6145072481295}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5400390625, conf: {"ssize":5,"bsize":3}, perf: {"precision":1.0,"recall":0.5400390625,"f1":0.6868860306360313,"seconds":4.166737198829651e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":7.2265625,"distances_sum":1148.058218377817}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.251953125, conf: {"ssize":2,"bsize":1}, perf: {"precision":null,"recall":0.251953125,"f1":null,"seconds":3.203749656677246e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":5.9765625,"distances_sum":565.9102853055894}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.5400390625,"state":{"ssize":5,"bsize":3},"perf":{"precision":1.0,"recall":0.5400390625,"f1":0.6868860306360313,"seconds":4.166737198829651e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":7.2265625,"distances_sum":1148.058218377817}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7412109375, conf: {"ssize":3,"bsize":5}, perf: {"precision":1.0,"recall":0.7412109375,"f1":0.8431292665667675,"seconds":5.1371753215789795e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":7.9453125,"distances_sum":1771.8069474021047}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.65234375, conf: {"ssize":3,"bsize":4}, perf: {"precision":1.0,"recall":0.65234375,"f1":0.7763573232323239,"seconds":4.999339580535889e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":7.5859375,"distances_sum":1483.6999003075966}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6533203125, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.6533203125,"f1":0.7800777347652356,"seconds":4.481524229049683e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":7.7109375,"distances_sum":1494.289748353495}, best_list's length: 7, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7412109375,"state":{"ssize":3,"bsize":5},"perf":{"precision":1.0,"recall":0.7412109375,"f1":0.8431292665667675,"seconds":5.1371753215789795e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":7.9453125,"distances_sum":1771.8069474021047}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7607421875, conf: {"ssize":4,"bsize":5}, perf: {"precision":1.0,"recall":0.7607421875,"f1":0.8575065559440568,"seconds":5.062669515609741e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":8.1015625,"distances_sum":1855.860435109519}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8330078125, conf: {"ssize":2,"bsize":6}, perf: {"precision":1.0,"recall":0.8330078125,"f1":0.901840347152848,"seconds":5.321577191352844e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":8.328125,"distances_sum":2107.4694451314485}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8212890625, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.8212890625,"f1":0.8949441183816192,"seconds":5.206093192100525e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":8.28125,"distances_sum":2039.6250773109457}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.857421875, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.857421875,"f1":0.9165095321345329,"seconds":5.2638351917266846e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":8.4609375,"distances_sum":2182.554308967068}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8125, conf: {"ssize":5,"bsize":6}, perf: {"precision":1.0,"recall":0.8125,"f1":0.8889142107892116,"seconds":5.3104013204574585e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":8.2578125,"distances_sum":2032.1450503617064}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.90234375, conf: {"ssize":4,"bsize":8}, perf: {"precision":1.0,"recall":0.90234375,"f1":0.9440590659340665,"seconds":5.859881639480591e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":8.6875,"distances_sum":2394.490919020746}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.90234375,"state":{"ssize":4,"bsize":8},"perf":{"precision":1.0,"recall":0.90234375,"f1":0.9440590659340665,"seconds":5.859881639480591e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":8.6875,"distances_sum":2394.490919020746}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.90234375,"state":{"ssize":4,"bsize":8},"perf":{"precision":1.0,"recall":0.90234375,"f1":0.9440590659340665,"seconds":5.859881639480591e-6,"exhaustive_search_seconds":1.2498348951339722e-6,"evaluations":8.6875,"distances_sum":2394.490919020746}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.3681640625, conf: {"ssize":5,"bsize":2}, perf: {"precision":null,"recall":0.3681640625,"f1":null,"seconds":3.7010759115219116e-6,"exhaustive_search_seconds":1.4230608940124512e-6,"evaluations":6.5859375,"distances_sum":751.2575592524186}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.3681640625,"state":{"ssize":5,"bsize":2},"perf":{"precision":null,"recall":0.3681640625,"f1":null,"seconds":3.7010759115219116e-6,"exhaustive_search_seconds":1.4230608940124512e-6,"evaluations":6.5859375,"distances_sum":751.2575592524186}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.66015625, conf: {"ssize":2,"bsize":4}, perf: {"precision":1.0,"recall":0.66015625,"f1":0.7841824841824852,"seconds":4.5727938413619995e-6,"exhaustive_search_seconds":1.4230608940124512e-6,"evaluations":8.25,"distances_sum":1459.921649334678}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6689453125, conf: {"ssize":6,"bsize":4}, perf: {"precision":1.0,"recall":0.6689453125,"f1":0.793742195304696,"seconds":4.602596163749695e-6,"exhaustive_search_seconds":1.4230608940124512e-6,"evaluations":8.234375,"distances_sum":1489.503711833474}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.78515625, conf: {"ssize":7,"bsize":5}, perf: {"precision":1.0,"recall":0.78515625,"f1":0.8732434232434241,"seconds":5.1781535148620605e-6,"exhaustive_search_seconds":1.4230608940124512e-6,"evaluations":8.5703125,"distances_sum":1846.3030996203156}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7900390625, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.7900390625,"f1":0.8753782675657684,"seconds":4.930421710014343e-6,"exhaustive_search_seconds":1.4230608940124512e-6,"evaluations":8.4921875,"distances_sum":1879.188188649854}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.76953125, conf: {"ssize":2,"bsize":5}, perf: {"precision":1.0,"recall":0.76953125,"f1":0.8620827089577098,"seconds":5.2265822887420654e-6,"exhaustive_search_seconds":1.4230608940124512e-6,"evaluations":8.5,"distances_sum":1788.3206032113692}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5185546875, conf: {"ssize":4,"bsize":3}, perf: {"precision":1.0,"recall":0.5185546875,"f1":0.6704247141747146,"seconds":4.2244791984558105e-6,"exhaustive_search_seconds":1.4230608940124512e-6,"evaluations":7.4921875,"distances_sum":1054.2277179874375}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.3984375, conf: {"ssize":4,"bsize":2}, perf: {"precision":null,"recall":0.3984375,"f1":null,"seconds":3.471970558166504e-6,"exhaustive_search_seconds":1.4230608940124512e-6,"evaluations":6.625,"distances_sum":855.9803673822593}, best_list's length: 11, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7900390625,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.7900390625,"f1":0.8753782675657684,"seconds":4.930421710014343e-6,"exhaustive_search_seconds":1.4230608940124512e-6,"evaluations":8.4921875,"distances_sum":1879.188188649854}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9345703125, conf: {"ssize":3,"bsize":9}, perf: {"precision":1.0,"recall":0.9345703125,"f1":0.9637305402930407,"seconds":5.640089511871338e-6,"exhaustive_search_seconds":1.4230608940124512e-6,"evaluations":8.875,"distances_sum":2427.1392496195617}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9091796875, conf: {"ssize":11,"bsize":8}, perf: {"precision":1.0,"recall":0.9091796875,"f1":0.9482028388278393,"seconds":5.623325705528259e-6,"exhaustive_search_seconds":1.4230608940124512e-6,"evaluations":8.8359375,"distances_sum":2335.06678298489}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.919921875, conf: {"ssize":9,"bsize":9}, perf: {"precision":1.0,"recall":0.919921875,"f1":0.9541552197802203,"seconds":6.152316927909851e-6,"exhaustive_search_seconds":1.4230608940124512e-6,"evaluations":8.8515625,"distances_sum":2369.9211168766665}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.927734375, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.927734375,"f1":0.9597699175824181,"seconds":6.126239895820618e-6,"exhaustive_search_seconds":1.4230608940124512e-6,"evaluations":8.875,"distances_sum":2396.9122974187617}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.91796875, conf: {"ssize":4,"bsize":8}, perf: {"precision":1.0,"recall":0.91796875,"f1":0.9536343864468868,"seconds":5.6140124797821045e-6,"exhaustive_search_seconds":1.4230608940124512e-6,"evaluations":8.8359375,"distances_sum":2378.560804365596}, best_list's length: 11, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9345703125,"state":{"ssize":3,"bsize":9},"perf":{"precision":1.0,"recall":0.9345703125,"f1":0.9637305402930407,"seconds":5.640089511871338e-6,"exhaustive_search_seconds":1.4230608940124512e-6,"evaluations":8.875,"distances_sum":2427.1392496195617}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9345703125,"state":{"ssize":3,"bsize":9},"perf":{"precision":1.0,"recall":0.9345703125,"f1":0.9637305402930407,"seconds":5.640089511871338e-6,"exhaustive_search_seconds":1.4230608940124512e-6,"evaluations":8.875,"distances_sum":2427.1392496195617}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.732421875, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.732421875,"f1":0.8349846334221342,"seconds":4.4405460357666016e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.1953125,"distances_sum":1301.7416832479591}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.404296875, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.404296875,"f1":null,"seconds":3.999099135398865e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":6.234375,"distances_sum":698.0082720940736}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2470703125, conf: {"ssize":4,"bsize":1}, perf: {"precision":null,"recall":0.2470703125,"f1":null,"seconds":2.348795533180237e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":5.5625,"distances_sum":458.16812998402617}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.732421875,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.732421875,"f1":0.8349846334221342,"seconds":4.4405460357666016e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.1953125,"distances_sum":1301.7416832479591}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9130859375, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.9130859375,"f1":0.9499542124542127,"seconds":4.308298230171204e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.796875,"distances_sum":1819.7160067249793}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.91796875, conf: {"ssize":4,"bsize":8}, perf: {"precision":1.0,"recall":0.91796875,"f1":0.9537831959706967,"seconds":5.392357707023621e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.8125,"distances_sum":1808.7422037977124}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.939453125, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.939453125,"f1":0.9659455128205131,"seconds":3.857538104057312e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.921875,"distances_sum":1892.2189987157963}, best_list's length: 7, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.939453125,"state":{"ssize":1,"bsize":9},"perf":{"precision":1.0,"recall":0.939453125,"f1":0.9659455128205131,"seconds":3.857538104057312e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.921875,"distances_sum":1892.2189987157963}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9443359375, conf: {"ssize":1,"bsize":12}, perf: {"precision":1.0,"recall":0.9443359375,"f1":0.9687156593406596,"seconds":4.049390554428101e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.9140625,"distances_sum":1891.3790150734897}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.951171875, conf: {"ssize":1,"bsize":10}, perf: {"precision":1.0,"recall":0.951171875,"f1":0.9732886904761909,"seconds":4.908069968223572e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.875,"distances_sum":1939.7964687779481}, best_list's length: 13, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.951171875,"state":{"ssize":1,"bsize":10},"perf":{"precision":1.0,"recall":0.951171875,"f1":0.9732886904761909,"seconds":4.908069968223572e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.875,"distances_sum":1939.7964687779481}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.951171875,"state":{"ssize":1,"bsize":10},"perf":{"precision":1.0,"recall":0.951171875,"f1":0.9732886904761909,"seconds":4.908069968223572e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.875,"distances_sum":1939.7964687779481}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2548828125, conf: {"ssize":3,"bsize":1}, perf: {"precision":null,"recall":0.2548828125,"f1":null,"seconds":3.1832605600357056e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":6.234375,"distances_sum":477.02558693010957}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7607421875, conf: {"ssize":5,"bsize":5}, perf: {"precision":1.0,"recall":0.7607421875,"f1":0.8547577422577431,"seconds":3.1087547540664673e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":8.0,"distances_sum":1362.425448628963}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7607421875,"state":{"ssize":5,"bsize":5},"perf":{"precision":1.0,"recall":0.7607421875,"f1":0.8547577422577431,"seconds":3.1087547540664673e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":8.0,"distances_sum":1362.425448628963}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.92578125, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.92578125,"f1":0.9586881868131875,"seconds":4.740431904792786e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":8.8203125,"distances_sum":1864.8291766576378}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7744140625, conf: {"ssize":6,"bsize":5}, perf: {"precision":1.0,"recall":0.7744140625,"f1":0.8660032675657684,"seconds":5.129724740982056e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":8.03125,"distances_sum":1420.4090573433673}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.92578125,"state":{"ssize":1,"bsize":8},"perf":{"precision":1.0,"recall":0.92578125,"f1":0.9586881868131875,"seconds":4.740431904792786e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":8.8203125,"distances_sum":1864.8291766576378}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.943359375, conf: {"ssize":1,"bsize":11}, perf: {"precision":1.0,"recall":0.943359375,"f1":0.9684352106227109,"seconds":6.5248459577560425e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":8.8984375,"distances_sum":1911.5261071207276}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9375, conf: {"ssize":5,"bsize":10}, perf: {"precision":1.0,"recall":0.9375,"f1":0.9655334249084252,"seconds":6.148591637611389e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":8.90625,"distances_sum":1884.6940618154595}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9267578125, conf: {"ssize":9,"bsize":9}, perf: {"precision":1.0,"recall":0.9267578125,"f1":0.9583218864468869,"seconds":5.9176236391067505e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":8.75,"distances_sum":1887.7695780502713}, best_list's length: 11, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.943359375,"state":{"ssize":1,"bsize":11},"perf":{"precision":1.0,"recall":0.943359375,"f1":0.9684352106227109,"seconds":6.5248459577560425e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":8.8984375,"distances_sum":1911.5261071207276}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.943359375,"state":{"ssize":1,"bsize":11},"perf":{"precision":1.0,"recall":0.943359375,"f1":0.9684352106227109,"seconds":6.5248459577560425e-6,"exhaustive_search_seconds":1.2740492820739746e-6,"evaluations":8.8984375,"distances_sum":1911.5261071207276}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7568359375, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.7568359375,"f1":0.8543820762570772,"seconds":5.012378096580505e-6,"exhaustive_search_seconds":1.2889504432678223e-6,"evaluations":7.8828125,"distances_sum":1326.1298680505352}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7568359375,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.7568359375,"f1":0.8543820762570772,"seconds":5.012378096580505e-6,"exhaustive_search_seconds":1.2889504432678223e-6,"evaluations":7.8828125,"distances_sum":1326.1298680505352}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9072265625, conf: {"ssize":3,"bsize":8}, perf: {"precision":1.0,"recall":0.9072265625,"f1":0.9475675366300375,"seconds":5.645677447319031e-6,"exhaustive_search_seconds":1.2889504432678223e-6,"evaluations":8.7421875,"distances_sum":1756.7702627618485}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9072265625,"state":{"ssize":3,"bsize":8},"perf":{"precision":1.0,"recall":0.9072265625,"f1":0.9475675366300375,"seconds":5.645677447319031e-6,"exhaustive_search_seconds":1.2889504432678223e-6,"evaluations":8.7421875,"distances_sum":1756.7702627618485}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9599609375, conf: {"ssize":2,"bsize":12}, perf: {"precision":1.0,"recall":0.9599609375,"f1":0.9780334249084252,"seconds":5.777925252914429e-6,"exhaustive_search_seconds":1.2889504432678223e-6,"evaluations":8.9375,"distances_sum":1916.8648403460897}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9296875, conf: {"ssize":4,"bsize":10}, perf: {"precision":1.0,"recall":0.9296875,"f1":0.9603282134532142,"seconds":4.434958100318909e-6,"exhaustive_search_seconds":1.2889504432678223e-6,"evaluations":8.84375,"distances_sum":1857.8041189608005}, best_list's length: 6, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9599609375,"state":{"ssize":2,"bsize":12},"perf":{"precision":1.0,"recall":0.9599609375,"f1":0.9780334249084252,"seconds":5.777925252914429e-6,"exhaustive_search_seconds":1.2889504432678223e-6,"evaluations":8.9375,"distances_sum":1916.8648403460897}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9599609375,"state":{"ssize":2,"bsize":12},"perf":{"precision":1.0,"recall":0.9599609375,"f1":0.9780334249084252,"seconds":5.777925252914429e-6,"exhaustive_search_seconds":1.2889504432678223e-6,"evaluations":8.9375,"distances_sum":1916.8648403460897}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6826171875, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.6826171875,"f1":0.8013897560772568,"seconds":3.961846232414246e-6,"exhaustive_search_seconds":8.735805749893188e-7,"evaluations":7.671875,"distances_sum":1138.4043595385829}, best_list's length: 2, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.6826171875,"state":{"ssize":1,"bsize":4},"perf":{"precision":1.0,"recall":0.6826171875,"f1":0.8013897560772568,"seconds":3.961846232414246e-6,"exhaustive_search_seconds":8.735805749893188e-7,"evaluations":7.671875,"distances_sum":1138.4043595385829}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8359375, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.8359375,"f1":0.9043357683982696,"seconds":5.172565579414368e-6,"exhaustive_search_seconds":8.735805749893188e-7,"evaluations":8.484375,"distances_sum":1493.901481367641}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8359375,"state":{"ssize":1,"bsize":6},"perf":{"precision":1.0,"recall":0.8359375,"f1":0.9043357683982696,"seconds":5.172565579414368e-6,"exhaustive_search_seconds":8.735805749893188e-7,"evaluations":8.484375,"distances_sum":1493.901481367641}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8779296875, conf: {"ssize":5,"bsize":7}, perf: {"precision":1.0,"recall":0.8779296875,"f1":0.9295902014652021,"seconds":5.11854887008667e-6,"exhaustive_search_seconds":8.735805749893188e-7,"evaluations":8.71875,"distances_sum":1655.2145304996334}, best_list's length: 7, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8779296875,"state":{"ssize":5,"bsize":7},"perf":{"precision":1.0,"recall":0.8779296875,"f1":0.9295902014652021,"seconds":5.11854887008667e-6,"exhaustive_search_seconds":8.735805749893188e-7,"evaluations":8.71875,"distances_sum":1655.2145304996334}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.8779296875,"state":{"ssize":5,"bsize":7},"perf":{"precision":1.0,"recall":0.8779296875,"f1":0.9295902014652021,"seconds":5.11854887008667e-6,"exhaustive_search_seconds":8.735805749893188e-7,"evaluations":8.71875,"distances_sum":1655.2145304996334}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2529296875, conf: {"ssize":4,"bsize":1}, perf: {"precision":null,"recall":0.2529296875,"f1":null,"seconds":2.995133399963379e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":6.0,"distances_sum":499.9068263161387}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6708984375, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.6708984375,"f1":0.7898584054834062,"seconds":4.334375262260437e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":7.6875,"distances_sum":1312.631202004089}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.390625, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.390625,"f1":null,"seconds":3.4403055906295776e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":6.109375,"distances_sum":734.9556356581326}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.6708984375,"state":{"ssize":1,"bsize":4},"perf":{"precision":1.0,"recall":0.6708984375,"f1":0.7898584054834062,"seconds":4.334375262260437e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":7.6875,"distances_sum":1312.631202004089}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.908203125, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.908203125,"f1":0.9477392399267407,"seconds":5.252659320831299e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.671875,"distances_sum":2000.8619846167157}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.896484375, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.896484375,"f1":0.940095841658342,"seconds":5.280598998069763e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.6171875,"distances_sum":1945.371502320477}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.771484375, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.771484375,"f1":0.861465097402598,"seconds":4.610046744346619e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":7.9765625,"distances_sum":1571.9102819662794}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.83984375, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.83984375,"f1":0.9058727730602738,"seconds":4.909932613372803e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.328125,"distances_sum":1746.5910199626464}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.908203125,"state":{"ssize":1,"bsize":8},"perf":{"precision":1.0,"recall":0.908203125,"f1":0.9477392399267407,"seconds":5.252659320831299e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.671875,"distances_sum":2000.8619846167157}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.927734375, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.927734375,"f1":0.9594894688644691,"seconds":4.507601261138916e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.8515625,"distances_sum":2014.5436572572946}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.935546875, conf: {"ssize":3,"bsize":10}, perf: {"precision":1.0,"recall":0.935546875,"f1":0.9644745879120884,"seconds":3.7606805562973022e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.828125,"distances_sum":2055.8563639446297}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9580078125, conf: {"ssize":5,"bsize":11}, perf: {"precision":1.0,"recall":0.9580078125,"f1":0.9769173534798539,"seconds":4.928559064865112e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.921875,"distances_sum":2150.4465646611316}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9091796875, conf: {"ssize":4,"bsize":8}, perf: {"precision":1.0,"recall":0.9091796875,"f1":0.9472215284715289,"seconds":3.635883331298828e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.71875,"distances_sum":1984.5662011550883}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9580078125,"state":{"ssize":5,"bsize":11},"perf":{"precision":1.0,"recall":0.9580078125,"f1":0.9769173534798539,"seconds":4.928559064865112e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.921875,"distances_sum":2150.4465646611316}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9580078125,"state":{"ssize":5,"bsize":11},"perf":{"precision":1.0,"recall":0.9580078125,"f1":0.9769173534798539,"seconds":4.928559064865112e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.921875,"distances_sum":2150.4465646611316}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.3544921875, conf: {"ssize":3,"bsize":2}, perf: {"precision":null,"recall":0.3544921875,"f1":null,"seconds":3.514811396598816e-6,"exhaustive_search_seconds":1.5925616025924683e-6,"evaluations":5.515625,"distances_sum":597.4846651020306}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.3544921875,"state":{"ssize":3,"bsize":2},"perf":{"precision":null,"recall":0.3544921875,"f1":null,"seconds":3.514811396598816e-6,"exhaustive_search_seconds":1.5925616025924683e-6,"evaluations":5.515625,"distances_sum":597.4846651020306}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6494140625, conf: {"ssize":2,"bsize":4}, perf: {"precision":1.0,"recall":0.6494140625,"f1":0.7764620795870805,"seconds":4.852190613746643e-6,"exhaustive_search_seconds":1.5925616025924683e-6,"evaluations":7.4375,"distances_sum":1144.5939530056787}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8173828125, conf: {"ssize":3,"bsize":6}, perf: {"precision":1.0,"recall":0.8173828125,"f1":0.8914699883449889,"seconds":5.5655837059021e-6,"exhaustive_search_seconds":1.5925616025924683e-6,"evaluations":8.2265625,"distances_sum":1505.7885203337125}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.36328125, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.36328125,"f1":null,"seconds":3.676861524581909e-6,"exhaustive_search_seconds":1.5925616025924683e-6,"evaluations":5.65625,"distances_sum":630.4357644014974}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8291015625, conf: {"ssize":7,"bsize":6}, perf: {"precision":1.0,"recall":0.8291015625,"f1":0.8990747100122105,"seconds":5.545094609260559e-6,"exhaustive_search_seconds":1.5925616025924683e-6,"evaluations":8.3671875,"distances_sum":1520.1898634823538}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.375, conf: {"ssize":4,"bsize":2}, perf: {"precision":null,"recall":0.375,"f1":null,"seconds":3.5446137189865112e-6,"exhaustive_search_seconds":1.5925616025924683e-6,"evaluations":5.71875,"distances_sum":629.7701610461003}, best_list's length: 11, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7392578125, conf: {"ssize":8,"bsize":5}, perf: {"precision":1.0,"recall":0.7392578125,"f1":0.8398226773226782,"seconds":5.168840289115906e-6,"exhaustive_search_seconds":1.5925616025924683e-6,"evaluations":7.8359375,"distances_sum":1284.5376159457114}, best_list's length: 12, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8291015625,"state":{"ssize":7,"bsize":6},"perf":{"precision":1.0,"recall":0.8291015625,"f1":0.8990747100122105,"seconds":5.545094609260559e-6,"exhaustive_search_seconds":1.5925616025924683e-6,"evaluations":8.3671875,"distances_sum":1520.1898634823538}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9306640625, conf: {"ssize":10,"bsize":10}, perf: {"precision":1.0,"recall":0.9306640625,"f1":0.9608859890109892,"seconds":5.781650543212891e-6,"exhaustive_search_seconds":1.5925616025924683e-6,"evaluations":8.859375,"distances_sum":1842.6285958667595}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8759765625, conf: {"ssize":3,"bsize":7}, perf: {"precision":1.0,"recall":0.8759765625,"f1":0.926931922244423,"seconds":5.7462602853775024e-6,"exhaustive_search_seconds":1.5925616025924683e-6,"evaluations":8.578125,"distances_sum":1687.0958040947808}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8662109375, conf: {"ssize":10,"bsize":7}, perf: {"precision":1.0,"recall":0.8662109375,"f1":0.9218521062271069,"seconds":5.556270480155945e-6,"exhaustive_search_seconds":1.5925616025924683e-6,"evaluations":8.6171875,"distances_sum":1631.8439246193757}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.927734375, conf: {"ssize":5,"bsize":9}, perf: {"precision":1.0,"recall":0.927734375,"f1":0.9592319139194141,"seconds":5.815178155899048e-6,"exhaustive_search_seconds":1.5925616025924683e-6,"evaluations":8.7890625,"distances_sum":1846.4985308855885}, best_list's length: 11, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9267578125, conf: {"ssize":11,"bsize":9}, perf: {"precision":1.0,"recall":0.9267578125,"f1":0.9586710164835167,"seconds":5.8766454458236694e-6,"exhaustive_search_seconds":1.5925616025924683e-6,"evaluations":8.796875,"distances_sum":1814.6109590073202}, best_list's length: 12, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.90234375, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.90234375,"f1":0.9425969863469871,"seconds":5.554407835006714e-6,"exhaustive_search_seconds":1.5925616025924683e-6,"evaluations":8.6640625,"distances_sum":1764.4665078589528}, best_list's length: 14, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8349609375, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.8349609375,"f1":0.9036775724275733,"seconds":5.6140124797821045e-6,"exhaustive_search_seconds":1.5925616025924683e-6,"evaluations":8.328125,"distances_sum":1532.1086225858915}, best_list's length: 15, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9306640625,"state":{"ssize":10,"bsize":10},"perf":{"precision":1.0,"recall":0.9306640625,"f1":0.9608859890109892,"seconds":5.781650543212891e-6,"exhaustive_search_seconds":1.5925616025924683e-6,"evaluations":8.859375,"distances_sum":1842.6285958667595}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9306640625,"state":{"ssize":10,"bsize":10},"perf":{"precision":1.0,"recall":0.9306640625,"f1":0.9608859890109892,"seconds":5.781650543212891e-6,"exhaustive_search_seconds":1.5925616025924683e-6,"evaluations":8.859375,"distances_sum":1842.6285958667595}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.2802734375,"state":{"ssize":1,"bsize":1},"perf":{"precision":null,"recall":0.2802734375,"f1":null,"seconds":3.1385570764541626e-6,"exhaustive_search_seconds":1.3131648302078247e-6,"evaluations":6.5,"distances_sum":517.9102707536508}}, beam: 1, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.2802734375,"state":{"ssize":1,"bsize":1},"perf":{"precision":null,"recall":0.2802734375,"f1":null,"seconds":3.1385570764541626e-6,"exhaustive_search_seconds":1.3131648302078247e-6,"evaluations":6.5,"distances_sum":517.9102707536508}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7578125, conf: {"ssize":5,"bsize":5}, perf: {"precision":1.0,"recall":0.7578125,"f1":0.8536323051948059,"seconds":5.4407864809036255e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":7.8828125,"distances_sum":1376.9068123210939}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6953125, conf: {"ssize":2,"bsize":4}, perf: {"precision":1.0,"recall":0.6953125,"f1":0.8097556956931964,"seconds":4.872679710388184e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":7.625,"distances_sum":1266.9586472630372}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7578125,"state":{"ssize":5,"bsize":5},"perf":{"precision":1.0,"recall":0.7578125,"f1":0.8536323051948059,"seconds":5.4407864809036255e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":7.8828125,"distances_sum":1376.9068123210939}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.806640625, conf: {"ssize":8,"bsize":6}, perf: {"precision":1.0,"recall":0.806640625,"f1":0.8839348151848159,"seconds":5.3960829973220825e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.21875,"distances_sum":1553.4608675927434}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.76953125, conf: {"ssize":6,"bsize":5}, perf: {"precision":1.0,"recall":0.76953125,"f1":0.8614874708624716,"seconds":5.09992241859436e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.0703125,"distances_sum":1452.1163219397595}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.78125, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.78125,"f1":0.8722985347985357,"seconds":5.155801773071289e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.0625,"distances_sum":1424.6299477950622}, best_list's length: 7, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.806640625,"state":{"ssize":8,"bsize":6},"perf":{"precision":1.0,"recall":0.806640625,"f1":0.8839348151848159,"seconds":5.3960829973220825e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.21875,"distances_sum":1553.4608675927434}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9384765625, conf: {"ssize":8,"bsize":10}, perf: {"precision":1.0,"recall":0.9384765625,"f1":0.9662603021978027,"seconds":5.8710575103759766e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.90625,"distances_sum":1869.3980965234407}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.87109375, conf: {"ssize":8,"bsize":7}, perf: {"precision":1.0,"recall":0.87109375,"f1":0.9263653013653019,"seconds":5.880370736122131e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.609375,"distances_sum":1675.0297232236176}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.943359375, conf: {"ssize":12,"bsize":10}, perf: {"precision":1.0,"recall":0.943359375,"f1":0.9682520604395609,"seconds":6.455928087234497e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.8671875,"distances_sum":1945.803916654551}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9453125, conf: {"ssize":10,"bsize":10}, perf: {"precision":1.0,"recall":0.9453125,"f1":0.9694425366300368,"seconds":6.459653377532959e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.8828125,"distances_sum":1945.2525028930982}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8876953125, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.8876953125,"f1":0.9351794039294047,"seconds":6.712973117828369e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.6953125,"distances_sum":1755.1744217671746}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.87109375, conf: {"ssize":4,"bsize":7}, perf: {"precision":1.0,"recall":0.87109375,"f1":0.9261046245421252,"seconds":6.513670086860657e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.65625,"distances_sum":1696.203959582565}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8701171875, conf: {"ssize":5,"bsize":7}, perf: {"precision":1.0,"recall":0.8701171875,"f1":0.9262419871794878,"seconds":5.813315510749817e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.6484375,"distances_sum":1681.7953763963847}, best_list's length: 11, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8486328125, conf: {"ssize":3,"bsize":6}, perf: {"precision":1.0,"recall":0.8486328125,"f1":0.9133272977022984,"seconds":5.7425349950790405e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.4921875,"distances_sum":1628.601277871992}, best_list's length: 12, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.93359375, conf: {"ssize":6,"bsize":9}, perf: {"precision":1.0,"recall":0.93359375,"f1":0.9631524725274727,"seconds":3.511086106300354e-5,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.875,"distances_sum":1896.1998716893283}, best_list's length: 13, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8525390625, conf: {"ssize":10,"bsize":6}, perf: {"precision":1.0,"recall":0.8525390625,"f1":0.9155620421245428,"seconds":5.798414349555969e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.4375,"distances_sum":1630.5374120879737}, best_list's length: 14, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9453125,"state":{"ssize":10,"bsize":10},"perf":{"precision":1.0,"recall":0.9453125,"f1":0.9694425366300368,"seconds":6.459653377532959e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.8828125,"distances_sum":1945.2525028930982}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9453125,"state":{"ssize":10,"bsize":10},"perf":{"precision":1.0,"recall":0.9453125,"f1":0.9694425366300368,"seconds":6.459653377532959e-6,"exhaustive_search_seconds":1.3988465070724487e-6,"evaluations":8.8828125,"distances_sum":1945.2525028930982}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.4287109375, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.4287109375,"f1":null,"seconds":3.762543201446533e-6,"exhaustive_search_seconds":1.2349337339401245e-6,"evaluations":6.3515625,"distances_sum":741.4392529333674}, best_list's length: 2, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.4287109375,"state":{"ssize":1,"bsize":2},"perf":{"precision":null,"recall":0.4287109375,"f1":null,"seconds":3.762543201446533e-6,"exhaustive_search_seconds":1.2349337339401245e-6,"evaluations":6.3515625,"distances_sum":741.4392529333674}}, beam: 2, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.763671875, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.763671875,"f1":0.8586314726939737,"seconds":5.465000867843628e-6,"exhaustive_search_seconds":1.2349337339401245e-6,"evaluations":8.0703125,"distances_sum":1411.21608605426}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6748046875, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.6748046875,"f1":0.7958942099567107,"seconds":5.044043064117432e-6,"exhaustive_search_seconds":1.2349337339401245e-6,"evaluations":7.859375,"distances_sum":1250.0902546170314}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.763671875,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.763671875,"f1":0.8586314726939737,"seconds":5.465000867843628e-6,"exhaustive_search_seconds":1.2349337339401245e-6,"evaluations":8.0703125,"distances_sum":1411.21608605426}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9365234375, conf: {"ssize":3,"bsize":9}, perf: {"precision":1.0,"recall":0.9365234375,"f1":0.9649210164835169,"seconds":5.653128027915955e-6,"exhaustive_search_seconds":1.2349337339401245e-6,"evaluations":8.890625,"distances_sum":1901.4967311800829}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.849609375, conf: {"ssize":3,"bsize":6}, perf: {"precision":1.0,"recall":0.849609375,"f1":0.9144230769230774,"seconds":5.638226866722107e-6,"exhaustive_search_seconds":1.2349337339401245e-6,"evaluations":8.46875,"distances_sum":1648.0561018686967}, best_list's length: 7, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9365234375,"state":{"ssize":3,"bsize":9},"perf":{"precision":1.0,"recall":0.9365234375,"f1":0.9649210164835169,"seconds":5.653128027915955e-6,"exhaustive_search_seconds":1.2349337339401245e-6,"evaluations":8.890625,"distances_sum":1901.4967311800829}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9365234375,"state":{"ssize":3,"bsize":9},"perf":{"precision":1.0,"recall":0.9365234375,"f1":0.9649210164835169,"seconds":5.653128027915955e-6,"exhaustive_search_seconds":1.2349337339401245e-6,"evaluations":8.890625,"distances_sum":1901.4967311800829}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.658203125, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.658203125,"f1":0.7826983780108787,"seconds":4.7441571950912476e-6,"exhaustive_search_seconds":1.4603137969970703e-6,"evaluations":7.6171875,"distances_sum":1209.4374573497737}, best_list's length: 2, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.658203125,"state":{"ssize":1,"bsize":4},"perf":{"precision":1.0,"recall":0.658203125,"f1":0.7826983780108787,"seconds":4.7441571950912476e-6,"exhaustive_search_seconds":1.4603137969970703e-6,"evaluations":7.6171875,"distances_sum":1209.4374573497737}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8828125, conf: {"ssize":4,"bsize":7}, perf: {"precision":1.0,"recall":0.8828125,"f1":0.9319113178488185,"seconds":5.748122930526733e-6,"exhaustive_search_seconds":1.4603137969970703e-6,"evaluations":8.703125,"distances_sum":1730.684141772343}, best_list's length: 4, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9169921875, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.9169921875,"f1":0.9519033050283056,"seconds":5.556270480155945e-6,"exhaustive_search_seconds":1.4603137969970703e-6,"evaluations":8.8046875,"distances_sum":1837.838761942475}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9169921875,"state":{"ssize":1,"bsize":8},"perf":{"precision":1.0,"recall":0.9169921875,"f1":0.9519033050283056,"seconds":5.556270480155945e-6,"exhaustive_search_seconds":1.4603137969970703e-6,"evaluations":8.8046875,"distances_sum":1837.838761942475}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9404296875, conf: {"ssize":1,"bsize":10}, perf: {"precision":1.0,"recall":0.9404296875,"f1":0.9660542582417585,"seconds":5.9138983488082886e-6,"exhaustive_search_seconds":1.4603137969970703e-6,"evaluations":8.8984375,"distances_sum":1902.0315759910682}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.966796875, conf: {"ssize":5,"bsize":12}, perf: {"precision":1.0,"recall":0.966796875,"f1":0.9819196428571433,"seconds":5.941838026046753e-6,"exhaustive_search_seconds":1.4603137969970703e-6,"evaluations":8.9609375,"distances_sum":1993.785343890057}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.935546875, conf: {"ssize":5,"bsize":10}, perf: {"precision":1.0,"recall":0.935546875,"f1":0.9637706043956047,"seconds":6.021931767463684e-6,"exhaustive_search_seconds":1.4603137969970703e-6,"evaluations":8.84375,"distances_sum":1889.990177692786}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9501953125, conf: {"ssize":8,"bsize":10}, perf: {"precision":1.0,"recall":0.9501953125,"f1":0.9721382783882787,"seconds":5.66430389881134e-6,"exhaustive_search_seconds":1.4603137969970703e-6,"evaluations":8.8984375,"distances_sum":1939.048606673535}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.966796875,"state":{"ssize":5,"bsize":12},"perf":{"precision":1.0,"recall":0.966796875,"f1":0.9819196428571433,"seconds":5.941838026046753e-6,"exhaustive_search_seconds":1.4603137969970703e-6,"evaluations":8.9609375,"distances_sum":1993.785343890057}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.966796875,"state":{"ssize":5,"bsize":12},"perf":{"precision":1.0,"recall":0.966796875,"f1":0.9819196428571433,"seconds":5.941838026046753e-6,"exhaustive_search_seconds":1.4603137969970703e-6,"evaluations":8.9609375,"distances_sum":1993.785343890057}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.75, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.75,"f1":0.8491539710289717,"seconds":4.986301064491272e-6,"exhaustive_search_seconds":1.1175870895385742e-6,"evaluations":7.921875,"distances_sum":1358.5700743032246}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.408203125, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.408203125,"f1":null,"seconds":3.807246685028076e-6,"exhaustive_search_seconds":1.1175870895385742e-6,"evaluations":5.90625,"distances_sum":719.0293256485339}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.75,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.75,"f1":0.8491539710289717,"seconds":4.986301064491272e-6,"exhaustive_search_seconds":1.1175870895385742e-6,"evaluations":7.921875,"distances_sum":1358.5700743032246}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7568359375, conf: {"ssize":4,"bsize":5}, perf: {"precision":1.0,"recall":0.7568359375,"f1":0.8498184107559114,"seconds":5.3513795137405396e-6,"exhaustive_search_seconds":1.1175870895385742e-6,"evaluations":7.9765625,"distances_sum":1374.8471641160106}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.771484375, conf: {"ssize":2,"bsize":5}, perf: {"precision":1.0,"recall":0.771484375,"f1":0.8608884171384179,"seconds":5.723908543586731e-6,"exhaustive_search_seconds":1.1175870895385742e-6,"evaluations":8.109375,"distances_sum":1424.045672889305}, best_list's length: 6, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.771484375,"state":{"ssize":2,"bsize":5},"perf":{"precision":1.0,"recall":0.771484375,"f1":0.8608884171384179,"seconds":5.723908543586731e-6,"exhaustive_search_seconds":1.1175870895385742e-6,"evaluations":8.109375,"distances_sum":1424.045672889305}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9072265625, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.9072265625,"f1":0.9463286713286718,"seconds":5.5693089962005615e-6,"exhaustive_search_seconds":1.1175870895385742e-6,"evaluations":8.75,"distances_sum":1820.1982691140665}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.826171875, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.826171875,"f1":0.897699696137197,"seconds":5.723908543586731e-6,"exhaustive_search_seconds":1.1175870895385742e-6,"evaluations":8.1796875,"distances_sum":1557.5012457002629}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.873046875, conf: {"ssize":2,"bsize":7}, perf: {"precision":1.0,"recall":0.873046875,"f1":0.9280448717948725,"seconds":5.889683961868286e-6,"exhaustive_search_seconds":1.1175870895385742e-6,"evaluations":8.671875,"distances_sum":1681.760111421128}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9140625, conf: {"ssize":2,"bsize":9}, perf: {"precision":1.0,"recall":0.9140625,"f1":0.9507185522810527,"seconds":5.934387445449829e-6,"exhaustive_search_seconds":1.1175870895385742e-6,"evaluations":8.7734375,"distances_sum":1840.8764210835493}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9140625,"state":{"ssize":2,"bsize":9},"perf":{"precision":1.0,"recall":0.9140625,"f1":0.9507185522810527,"seconds":5.934387445449829e-6,"exhaustive_search_seconds":1.1175870895385742e-6,"evaluations":8.7734375,"distances_sum":1840.8764210835493}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9140625,"state":{"ssize":2,"bsize":9},"perf":{"precision":1.0,"recall":0.9140625,"f1":0.9507185522810527,"seconds":5.934387445449829e-6,"exhaustive_search_seconds":1.1175870895385742e-6,"evaluations":8.7734375,"distances_sum":1840.8764210835493}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.3798828125, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.3798828125,"f1":null,"seconds":3.647059202194214e-6,"exhaustive_search_seconds":1.3373792171478271e-6,"evaluations":5.6875,"distances_sum":659.7971452085058}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7255859375, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.7255859375,"f1":0.8309851606726615,"seconds":5.198642611503601e-6,"exhaustive_search_seconds":1.3373792171478271e-6,"evaluations":7.84375,"distances_sum":1264.894695121755}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7255859375,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.7255859375,"f1":0.8309851606726615,"seconds":5.198642611503601e-6,"exhaustive_search_seconds":1.3373792171478271e-6,"evaluations":7.84375,"distances_sum":1264.894695121755}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8427734375, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.8427734375,"f1":0.9091065184815192,"seconds":5.325302481651306e-6,"exhaustive_search_seconds":1.3373792171478271e-6,"evaluations":8.359375,"distances_sum":1583.0119036407104}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8798828125, conf: {"ssize":2,"bsize":7}, perf: {"precision":1.0,"recall":0.8798828125,"f1":0.9290114399489404,"seconds":5.4389238357543945e-6,"exhaustive_search_seconds":1.3373792171478271e-6,"evaluations":8.6484375,"distances_sum":1686.948012097034}, best_list's length: 6, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8798828125,"state":{"ssize":2,"bsize":7},"perf":{"precision":1.0,"recall":0.8798828125,"f1":0.9290114399489404,"seconds":5.4389238357543945e-6,"exhaustive_search_seconds":1.3373792171478271e-6,"evaluations":8.6484375,"distances_sum":1686.948012097034}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.947265625, conf: {"ssize":2,"bsize":11}, perf: {"precision":1.0,"recall":0.947265625,"f1":0.9710565476190478,"seconds":5.5730342864990234e-6,"exhaustive_search_seconds":1.3373792171478271e-6,"evaluations":8.9140625,"distances_sum":1902.975557248666}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.935546875, conf: {"ssize":2,"bsize":9}, perf: {"precision":1.0,"recall":0.935546875,"f1":0.9640853937728943,"seconds":6.303191184997559e-6,"exhaustive_search_seconds":1.3373792171478271e-6,"evaluations":8.8515625,"distances_sum":1875.0144682147302}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.94921875, conf: {"ssize":1,"bsize":10}, perf: {"precision":1.0,"recall":0.94921875,"f1":0.9719150641025645,"seconds":5.802139639854431e-6,"exhaustive_search_seconds":1.3373792171478271e-6,"evaluations":8.8671875,"distances_sum":1929.361563032964}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.94921875,"state":{"ssize":1,"bsize":10},"perf":{"precision":1.0,"recall":0.94921875,"f1":0.9719150641025645,"seconds":5.802139639854431e-6,"exhaustive_search_seconds":1.3373792171478271e-6,"evaluations":8.8671875,"distances_sum":1929.361563032964}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.94921875,"state":{"ssize":1,"bsize":10},"perf":{"precision":1.0,"recall":0.94921875,"f1":0.9719150641025645,"seconds":5.802139639854431e-6,"exhaustive_search_seconds":1.3373792171478271e-6,"evaluations":8.8671875,"distances_sum":1929.361563032964}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.76171875, conf: {"ssize":5,"bsize":5}, perf: {"precision":1.0,"recall":0.76171875,"f1":0.85519046925297,"seconds":5.459412932395935e-6,"exhaustive_search_seconds":1.3597309589385986e-6,"evaluations":7.984375,"distances_sum":1533.340660343467}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.76171875,"state":{"ssize":5,"bsize":5},"perf":{"precision":1.0,"recall":0.76171875,"f1":0.85519046925297,"seconds":5.459412932395935e-6,"exhaustive_search_seconds":1.3597309589385986e-6,"evaluations":7.984375,"distances_sum":1533.340660343467}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8173828125, conf: {"ssize":5,"bsize":6}, perf: {"precision":1.0,"recall":0.8173828125,"f1":0.894119422244423,"seconds":5.515292286872864e-6,"exhaustive_search_seconds":1.3597309589385986e-6,"evaluations":8.21875,"distances_sum":1660.4279958739214}, best_list's length: 7, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8173828125,"state":{"ssize":5,"bsize":6},"perf":{"precision":1.0,"recall":0.8173828125,"f1":0.894119422244423,"seconds":5.515292286872864e-6,"exhaustive_search_seconds":1.3597309589385986e-6,"evaluations":8.21875,"distances_sum":1660.4279958739214}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.841796875, conf: {"ssize":3,"bsize":6}, perf: {"precision":1.0,"recall":0.841796875,"f1":0.9090945512820519,"seconds":5.578622221946716e-6,"exhaustive_search_seconds":1.3597309589385986e-6,"evaluations":8.3828125,"distances_sum":1756.6987890271334}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.88671875, conf: {"ssize":6,"bsize":7}, perf: {"precision":1.0,"recall":0.88671875,"f1":0.935130494505495,"seconds":5.478039383888245e-6,"exhaustive_search_seconds":1.3597309589385986e-6,"evaluations":8.6796875,"distances_sum":1888.8563712064458}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8828125, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.8828125,"f1":0.9322115384615391,"seconds":5.759298801422119e-6,"exhaustive_search_seconds":1.3597309589385986e-6,"evaluations":8.6875,"distances_sum":1887.793364351693}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.88671875,"state":{"ssize":6,"bsize":7},"perf":{"precision":1.0,"recall":0.88671875,"f1":0.935130494505495,"seconds":5.478039383888245e-6,"exhaustive_search_seconds":1.3597309589385986e-6,"evaluations":8.6796875,"distances_sum":1888.8563712064458}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.88671875,"state":{"ssize":6,"bsize":7},"perf":{"precision":1.0,"recall":0.88671875,"f1":0.935130494505495,"seconds":5.478039383888245e-6,"exhaustive_search_seconds":1.3597309589385986e-6,"evaluations":8.6796875,"distances_sum":1888.8563712064458}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.26953125, conf: {"ssize":5,"bsize":1}, perf: {"precision":null,"recall":0.26953125,"f1":null,"seconds":3.719702363014221e-6,"exhaustive_search_seconds":1.0784715414047241e-6,"evaluations":6.0703125,"distances_sum":485.85674910687356}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.75390625, conf: {"ssize":4,"bsize":5}, perf: {"precision":1.0,"recall":0.75390625,"f1":0.8511960261960271,"seconds":5.392357707023621e-6,"exhaustive_search_seconds":1.0784715414047241e-6,"evaluations":8.0234375,"distances_sum":1318.038737514395}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.75390625,"state":{"ssize":4,"bsize":5},"perf":{"precision":1.0,"recall":0.75390625,"f1":0.8511960261960271,"seconds":5.392357707023621e-6,"exhaustive_search_seconds":1.0784715414047241e-6,"evaluations":8.0234375,"distances_sum":1318.038737514395}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.865234375, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.865234375,"f1":0.9230196886446894,"seconds":5.660578608512878e-6,"exhaustive_search_seconds":1.0784715414047241e-6,"evaluations":8.6484375,"distances_sum":1605.9832640711509}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.865234375,"state":{"ssize":1,"bsize":7},"perf":{"precision":1.0,"recall":0.865234375,"f1":0.9230196886446894,"seconds":5.660578608512878e-6,"exhaustive_search_seconds":1.0784715414047241e-6,"evaluations":8.6484375,"distances_sum":1605.9832640711509}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.935546875, conf: {"ssize":4,"bsize":9}, perf: {"precision":1.0,"recall":0.935546875,"f1":0.9640853937728945,"seconds":5.7015568017959595e-6,"exhaustive_search_seconds":1.0784715414047241e-6,"evaluations":8.8984375,"distances_sum":1808.5429616327929}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.923828125, conf: {"ssize":5,"bsize":8}, perf: {"precision":1.0,"recall":0.923828125,"f1":0.9568509615384622,"seconds":5.815178155899048e-6,"exhaustive_search_seconds":1.0784715414047241e-6,"evaluations":8.8515625,"distances_sum":1784.779481256926}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.935546875,"state":{"ssize":4,"bsize":9},"perf":{"precision":1.0,"recall":0.935546875,"f1":0.9640853937728945,"seconds":5.7015568017959595e-6,"exhaustive_search_seconds":1.0784715414047241e-6,"evaluations":8.8984375,"distances_sum":1808.5429616327929}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.935546875,"state":{"ssize":4,"bsize":9},"perf":{"precision":1.0,"recall":0.935546875,"f1":0.9640853937728945,"seconds":5.7015568017959595e-6,"exhaustive_search_seconds":1.0784715414047241e-6,"evaluations":8.8984375,"distances_sum":1808.5429616327929}}, n: 9
inertia(cfft.distances) = 18.926616563513107
inertia(cdnet.distances) = 31.565963744588746
inertia(crand.distances) = 19.664055186042027
Test Summary: |
Clustering with KCenters with an approximate index | No tests
===> k=3
===> (k=3, initial=fft, maxiters=0); macro-recall: 0.8977777777777778
===> (k=3, initial=fft, maxiters=3); macro-recall: 0.9022222222222224
===> (k=3, initial=fft, maxiters=10); macro-recall: 0.8933333333333334
===> (k=3, initial=dnet, maxiters=0); macro-recall: 0.8933333333333334
===> (k=3, initial=dnet, maxiters=3); macro-recall: 0.8933333333333334
===> (k=3, initial=dnet, maxiters=10); macro-recall: 0.9022222222222221
===> (k=3, initial=rand, maxiters=0); macro-recall: 0.8933333333333334
===> (k=3, initial=rand, maxiters=3); macro-recall: 0.8955555555555555
===> (k=3, initial=rand, maxiters=10); macro-recall: 0.9
===> k=5
===> (k=5, initial=fft, maxiters=0); macro-recall: 0.94
===> (k=5, initial=fft, maxiters=3); macro-recall: 0.9444444444444443
===> (k=5, initial=fft, maxiters=10); macro-recall: 0.9444444444444445
===> (k=5, initial=dnet, maxiters=0); macro-recall: 0.8822222222222221
===> (k=5, initial=dnet, maxiters=3); macro-recall: 0.8866666666666667
===> (k=5, initial=dnet, maxiters=10); macro-recall: 0.8888888888888888
===> (k=5, initial=rand, maxiters=0); macro-recall: 0.8888888888888888
===> (k=5, initial=rand, maxiters=3); macro-recall: 0.9466666666666667
===> (k=5, initial=rand, maxiters=10); macro-recall: 0.9555555555555556
===> k=7
===> (k=7, initial=fft, maxiters=0); macro-recall: 0.9244444444444445
===> (k=7, initial=fft, maxiters=3); macro-recall: 0.9222222222222222
===> (k=7, initial=fft, maxiters=10); macro-recall: 0.931111111111111
===> (k=7, initial=dnet, maxiters=0); macro-recall: 0.9288888888888889
===> (k=7, initial=dnet, maxiters=3); macro-recall: 0.9266666666666667
===> (k=7, initial=dnet, maxiters=10); macro-recall: 0.8822222222222224
===> (k=7, initial=rand, maxiters=0); macro-recall: 0.9
===> (k=7, initial=rand, maxiters=3); macro-recall: 0.9177777777777778
===> (k=7, initial=rand, maxiters=10); macro-recall: 0.8733333333333334
===> k=11
===> (k=11, initial=fft, maxiters=0); macro-recall: 0.8911111111111111
===> (k=11, initial=fft, maxiters=3); macro-recall: 0.9066666666666666
===> (k=11, initial=fft, maxiters=10); macro-recall: 0.9
===> (k=11, initial=dnet, maxiters=0); macro-recall: 0.8955555555555555
===> (k=11, initial=dnet, maxiters=3); macro-recall: 0.9111111111111111
===> (k=11, initial=dnet, maxiters=10); macro-recall: 0.9111111111111111
===> (k=11, initial=rand, maxiters=0); macro-recall: 0.9133333333333332
===> (k=11, initial=rand, maxiters=3); macro-recall: 0.9066666666666666
===> (k=11, initial=rand, maxiters=10); macro-recall: 0.88
Test Summary: | Pass Total
One class classifier with DeloneHistogram | 144 144
[ Info: ("XXXXXX===== rocchio like>", (KCenters.gaussian_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX===== rocchio like>", (KCenters.laplacian_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX===== rocchio like>", (KCenters.cauchy_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX===== rocchio like>", (KCenters.sigmoid_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX===== rocchio like>", (KCenters.tanh_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX===== rocchio like>", (KCenters.relu_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX===== rocchio like>", (KCenters.direct_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX==== clustering>", (KCenters.relu_kernel, SimilaritySearch.l2_distance))
nc.class_map = [1, 3, 3, 2, 3, 2, 1, 2, 3, 3, 3, 3, 2, 3, 3, 1, 2, 1, 3, 1, 1]
[ Info: ("XXXXXX==== split_entropy>", (KCenters.relu_kernel, SimilaritySearch.l2_distance))
** centroid: 1, normalized-entropy: 0.0, [14, 0, 0]
** centroid: 2, normalized-entropy: 0.0, [0, 0, 4]
** centroid: 3, normalized-entropy: 0.8112781244591327, [0, 3, 1]
centroid 3, labels=[2, 3], freqs: [0, 3, 1]
** centroid: 4, normalized-entropy: 0.0, [0, 18, 0]
** centroid: 5, normalized-entropy: 0.0, [8, 0, 0]
** centroid: 6, normalized-entropy: 0.0, [0, 0, 21]
** centroid: 7, normalized-entropy: 0.0, [0, 7, 0]
** centroid: 8, normalized-entropy: 0.0, [0, 19, 0]
** centroid: 9, normalized-entropy: 0.6500224216483541, [0, 3, 15]
centroid 9, labels=[2, 3], freqs: [0, 3, 15]
** centroid: 10, normalized-entropy: 0.0, [0, 0, 3]
** centroid: 11, normalized-entropy: 0.0, [28, 0, 0]
** centroid: 12, normalized-entropy: 0.0, [0, 0, 6]
finished with 14 centroids; started with 12
nc.class_map = [1, 3, 2, 3, 2, 1, 3, 2, 2, 2, 3, 3, 1, 3]
acc = 0.9266666666666666
*** starting iteration: 1; err: [Inf, 0.3664000012066081] ***
*** computing centroids ***
*** computing 12 nearest references ***
*** new score with 12 references: [Inf, 0.3664000012066081, 0.1749362217679194] ***
*** starting iteration: 2; err: [Inf, 0.3664000012066081, 0.1749362217679194] ***
*** computing centroids ***
*** computing 12 nearest references ***
*** new score with 12 references: [Inf, 0.3664000012066081, 0.1749362217679194, 0.16670901859068907] ***
*** starting iteration: 3; err: [Inf, 0.3664000012066081, 0.1749362217679194, 0.16670901859068907] ***
*** computing centroids ***
*** computing 12 nearest references ***
*** new score with 12 references: [Inf, 0.3664000012066081, 0.1749362217679194, 0.16670901859068907, 0.16412949602206506] ***
*** starting iteration: 4; err: [Inf, 0.3664000012066081, 0.1749362217679194, 0.16670901859068907, 0.16412949602206506] ***
*** computing centroids ***
*** computing 12 nearest references ***
*** new score with 12 references: [Inf, 0.3664000012066081, 0.1749362217679194, 0.16670901859068907, 0.16412949602206506, 0.16146033828164752] ***
*** starting iteration: 5; err: [Inf, 0.3664000012066081, 0.1749362217679194, 0.16670901859068907, 0.16412949602206506, 0.16146033828164752] ***
*** computing centroids ***
*** computing 12 nearest references ***
*** new score with 12 references: [Inf, 0.3664000012066081, 0.1749362217679194, 0.16670901859068907, 0.16412949602206506, 0.16146033828164752, 0.16048832685835576] ***
*** finished computation of 12 references, err: [Inf, 0.3664000012066081, 0.1749362217679194, 0.16670901859068907, 0.16412949602206506, 0.16146033828164752, 0.16048832685835576] ***
** centroid: 1, normalized-entropy: 0.7424875695421234, [0, 4, 15]
centroid 1, labels=[2, 3], freqs: [0, 4, 15]
** centroid: 2, normalized-entropy: 0.0, [18, 0, 0]
** centroid: 3, normalized-entropy: 0.0, [0, 0, 3]
** centroid: 4, normalized-entropy: 0.0, [0, 5, 0]
** centroid: 5, normalized-entropy: 0.0, [7, 0, 0]
** centroid: 6, normalized-entropy: 0.0, [0, 18, 0]
** centroid: 7, normalized-entropy: 0.0, [0, 20, 0]
** centroid: 8, normalized-entropy: 0.0, [0, 0, 22]
** centroid: 9, normalized-entropy: 0.0, [4, 0, 0]
** centroid: 10, normalized-entropy: 0.0, [0, 0, 9]
** centroid: 11, normalized-entropy: 0.8112781244591327, [0, 3, 1]
centroid 11, labels=[2, 3], freqs: [0, 3, 1]
** centroid: 12, normalized-entropy: 0.0, [21, 0, 0]
finished with 14 centroids; started with 12
acc = 0.9333333333333333
Test Summary: | Pass Total
NearestCentroid | 10 10
[70, 1, 1, 1, 3, 2, 1, 15, 28, 15, 39, 23, 29, 33, 22, 30, 30, 32, 1, 57, 27, 2, 31, 25, 19, 1, 30, 3, 24, 38, 26, 23, 47, 32, 31, 35, 20, 20, 27, 41, 48, 21, 45, 26, 42, 25, 39, 22, 36, 30, 25, 39, 22, 41, 25, 14, 28, 26, 18, 17, 79, 16, 43, 13, 18, 41, 33, 7, 24, 1, 17, 30, 45, 48, 28, 45, 35, 52, 36, 34, 46, 19, 29, 44, 32, 35, 42, 32, 17, 28, 23, 27, 40, 33, 39, 40, 19, 8, 41, 33, 17, 55, 3, 7, 39, 36, 30, 62, 37, 2, 21, 39, 35, 19, 49, 31, 36, 37, 22, 39, 49, 48, 35, 38, 40, 44, 30, 35, 47, 40, 46, 6, 25, 24, 1, 38, 20, 15, 22, 47, 30, 36, 45, 61, 19, 20, 47, 22, 34, 34, 19, 26, 37, 60, 18, 30, 33, 43, 55, 42, 35, 19, 48, 39, 34, 29, 48, 42, 32, 36, 40, 30, 38, 39, 67, 25, 50, 46, 5, 32, 8, 34, 30, 48, 41, 29, 44, 87, 23, 43, 34, 41, 25, 40, 46, 15, 32, 48, 42, 55, 45, 11, 85, 61, 29, 34, 40, 35, 26, 35, 73, 47, 31, 27, 43, 49, 40, 20, 41, 56, 40, 33, 33, 29, 49, 50, 51, 26, 45, 50, 40, 33, 32, 34, 31, 32, 39, 29, 24, 29, 53, 20, 35, 26, 52, 33, 31, 34, 51, 42, 42, 18, 39, 33, 1, 51, 39, 24, 37, 29, 21, 30, 46, 41, 26, 44, 46, 53, 59, 49, 23, 38, 35, 34, 33, 30, 43, 47, 44, 57, 33, 41, 44, 41, 3, 21, 29, 36, 50, 25, 28, 26, 40, 36, 36, 47, 37, 42, 49, 18]
┌ Info: before optimization
└ (recall = p.recall, speedup = p.exhaustive_search_seconds / p.seconds, eval_ratio = p.evaluations / length(X)) = (recall = 0.616, speedup = 0.6096539085935451, eval_ratio = 0.042074)
KCenters.DeloneInvIndex> optimizing for recall=0.8
KCenters.DeloneInvIndex> optimize! step region_expansion=2, performance {"precision":null,"recall":0.4062499999999998,"f1":null,"seconds":6.734766066074371e-5,"exhaustive_search_seconds":0.00035386718809604645,"evaluations":341.171875,"distances_sum":1730.6347506685695}
KCenters.DeloneInvIndex> optimize! step region_expansion=3, performance {"precision":0.5529513888888887,"recall":0.5529513888888887,"f1":null,"seconds":9.631551802158356e-5,"exhaustive_search_seconds":0.00035386718809604645,"evaluations":379.6171875,"distances_sum":1662.3587195942498}
KCenters.DeloneInvIndex> optimize! step region_expansion=4, performance {"precision":0.6649305555555551,"recall":0.6649305555555551,"f1":null,"seconds":0.0001292116940021515,"exhaustive_search_seconds":0.00035386718809604645,"evaluations":421.328125,"distances_sum":1613.2829406294998}
KCenters.DeloneInvIndex> optimize! step region_expansion=5, performance {"precision":0.7326388888888882,"recall":0.7326388888888882,"f1":0.7326388888888882,"seconds":0.00016020797193050385,"exhaustive_search_seconds":0.00035386718809604645,"evaluations":459.53125,"distances_sum":1590.490901909937}
KCenters.DeloneInvIndex> optimize! step region_expansion=6, performance {"precision":0.777777777777777,"recall":0.777777777777777,"f1":0.777777777777777,"seconds":0.00018741749227046967,"exhaustive_search_seconds":0.00035386718809604645,"evaluations":498.15625,"distances_sum":1577.9898048040181}
KCenters.DeloneInvIndex> reached performance {"precision":0.8185763888888881,"recall":0.8185763888888881,"f1":0.8185763888888881,"seconds":0.00021311454474925995,"exhaustive_search_seconds":0.00035386718809604645,"evaluations":537.78125,"distances_sum":1568.5642361782068}
┌ Info: after optimization
└ (recall = p.recall, speedup = p.exhaustive_search_seconds / p.seconds, eval_ratio = p.evaluations / length(X)) = (recall = 0.804, speedup = 1.68227740534416, eval_ratio = 0.054303)
Test Summary: | Pass Total
Testing Delone Inverted Index | 1 1
Testing KCenters tests passed
Results with Julia v1.3.0
Testing was successful .
Last evaluation was ago and took 1 minute, 22 seconds.
Click here to download the log file.
Click here to show the log contents.
Resolving package versions...
Installed DataAPI ──────────── v1.1.0
Installed Missings ─────────── v0.4.3
Installed SortingAlgorithms ── v0.3.1
Installed KCenters ─────────── v0.1.4
Installed OrderedCollections ─ v1.1.0
Installed DataStructures ───── v0.17.6
Installed StatsBase ────────── v0.32.0
Installed SimilaritySearch ─── v0.3.16
Installed JSON ─────────────── v0.21.0
Installed Parsers ──────────── v0.3.10
Updating `~/.julia/environments/v1.3/Project.toml`
[5d8de97f] + KCenters v0.1.4
Updating `~/.julia/environments/v1.3/Manifest.toml`
[9a962f9c] + DataAPI v1.1.0
[864edb3b] + DataStructures v0.17.6
[682c06a0] + JSON v0.21.0
[5d8de97f] + KCenters v0.1.4
[e1d29d7a] + Missings v0.4.3
[bac558e1] + OrderedCollections v1.1.0
[69de0a69] + Parsers v0.3.10
[053f045d] + SimilaritySearch v0.3.16
[a2af1166] + SortingAlgorithms v0.3.1
[2913bbd2] + StatsBase v0.32.0
[2a0f44e3] + Base64
[ade2ca70] + Dates
[8bb1440f] + DelimitedFiles
[8ba89e20] + Distributed
[b77e0a4c] + InteractiveUtils
[8f399da3] + Libdl
[37e2e46d] + LinearAlgebra
[56ddb016] + Logging
[d6f4376e] + Markdown
[a63ad114] + Mmap
[de0858da] + Printf
[9a3f8284] + Random
[9e88b42a] + Serialization
[6462fe0b] + Sockets
[2f01184e] + SparseArrays
[10745b16] + Statistics
[8dfed614] + Test
[4ec0a83e] + Unicode
Testing KCenters
Status `/tmp/jl_pMcLYh/Manifest.toml`
[9a962f9c] DataAPI v1.1.0
[864edb3b] DataStructures v0.17.6
[682c06a0] JSON v0.21.0
[5d8de97f] KCenters v0.1.4
[e1d29d7a] Missings v0.4.3
[bac558e1] OrderedCollections v1.1.0
[69de0a69] Parsers v0.3.10
[053f045d] SimilaritySearch v0.3.16
[a2af1166] SortingAlgorithms v0.3.1
[2913bbd2] StatsBase v0.32.0
[2a0f44e3] Base64 [`@stdlib/Base64`]
[ade2ca70] Dates [`@stdlib/Dates`]
[8bb1440f] DelimitedFiles [`@stdlib/DelimitedFiles`]
[8ba89e20] Distributed [`@stdlib/Distributed`]
[b77e0a4c] InteractiveUtils [`@stdlib/InteractiveUtils`]
[8f399da3] Libdl [`@stdlib/Libdl`]
[37e2e46d] LinearAlgebra [`@stdlib/LinearAlgebra`]
[56ddb016] Logging [`@stdlib/Logging`]
[d6f4376e] Markdown [`@stdlib/Markdown`]
[a63ad114] Mmap [`@stdlib/Mmap`]
[de0858da] Printf [`@stdlib/Printf`]
[9a3f8284] Random [`@stdlib/Random`]
[9e88b42a] Serialization [`@stdlib/Serialization`]
[6462fe0b] Sockets [`@stdlib/Sockets`]
[2f01184e] SparseArrays [`@stdlib/SparseArrays`]
[10745b16] Statistics [`@stdlib/Statistics`]
[8dfed614] Test [`@stdlib/Test`]
[4ec0a83e] Unicode [`@stdlib/Unicode`]
Test Summary: | Pass Total
Scores | 9 9
[ Info: 146.12999999999997
Test Summary: | Pass Total
Clustering with enet | 4 4
[ Info: 79.80999999999999
[ Info: 37.349999999999994
[ Info: 26.659999999999993
[ Info: 313.64000338064864
[ Info: 547.7999992523
[ Info: 146.21999839687118
[ Info: 75.68000114231452
Test Summary: |
Clustering with dnet | No tests
inertia(cfft.distances) = 18.350264362312732
inertia(cdnet.distances) = 25.609056527847187
inertia(crand.distances) = 22.189134724845037
Test Summary: |
Clustering with KCenters | No tests
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.21875, conf: {"ssize":3,"bsize":1}, perf: {"precision":null,"recall":0.21875,"f1":null,"seconds":3.6116689443588257e-6,"exhaustive_search_seconds":1.6260892152786255e-6,"evaluations":6.65625,"distances_sum":574.0088313724301}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.79296875, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.79296875,"f1":0.8786146145521154,"seconds":6.213784217834473e-6,"exhaustive_search_seconds":1.6260892152786255e-6,"evaluations":8.6640625,"distances_sum":2242.3003197673775}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5888671875, conf: {"ssize":1,"bsize":3}, perf: {"precision":1.0,"recall":0.5888671875,"f1":0.7267728798978806,"seconds":4.393979907035828e-6,"exhaustive_search_seconds":1.6260892152786255e-6,"evaluations":7.53125,"distances_sum":1575.8567457032455}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.79296875,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.79296875,"f1":0.8786146145521154,"seconds":6.213784217834473e-6,"exhaustive_search_seconds":1.6260892152786255e-6,"evaluations":8.6640625,"distances_sum":2242.3003197673775}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.890625, conf: {"ssize":2,"bsize":7}, perf: {"precision":1.0,"recall":0.890625,"f1":0.9366472069597079,"seconds":6.0033053159713745e-6,"exhaustive_search_seconds":1.6260892152786255e-6,"evaluations":8.8125,"distances_sum":2645.751314046091}, best_list's length: 6, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.890625,"state":{"ssize":2,"bsize":7},"perf":{"precision":1.0,"recall":0.890625,"f1":0.9366472069597079,"seconds":6.0033053159713745e-6,"exhaustive_search_seconds":1.6260892152786255e-6,"evaluations":8.8125,"distances_sum":2645.751314046091}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9306640625, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.9306640625,"f1":0.9601648351648356,"seconds":8.648261427879333e-6,"exhaustive_search_seconds":1.6260892152786255e-6,"evaluations":8.859375,"distances_sum":2860.615610452208}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9345703125, conf: {"ssize":4,"bsize":9}, perf: {"precision":1.0,"recall":0.9345703125,"f1":0.9633985805860811,"seconds":7.163733243942261e-6,"exhaustive_search_seconds":1.6260892152786255e-6,"evaluations":8.9453125,"distances_sum":2869.2980426022173}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.93359375, conf: {"ssize":6,"bsize":8}, perf: {"precision":1.0,"recall":0.93359375,"f1":0.9624885531135535,"seconds":7.243826985359192e-6,"exhaustive_search_seconds":1.6260892152786255e-6,"evaluations":8.8828125,"distances_sum":2883.356372947444}, best_list's length: 8, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9345703125,"state":{"ssize":4,"bsize":9},"perf":{"precision":1.0,"recall":0.9345703125,"f1":0.9633985805860811,"seconds":7.163733243942261e-6,"exhaustive_search_seconds":1.6260892152786255e-6,"evaluations":8.9453125,"distances_sum":2869.2980426022173}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9345703125,"state":{"ssize":4,"bsize":9},"perf":{"precision":1.0,"recall":0.9345703125,"f1":0.9633985805860811,"seconds":7.163733243942261e-6,"exhaustive_search_seconds":1.6260892152786255e-6,"evaluations":8.9453125,"distances_sum":2869.2980426022173}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2314453125, conf: {"ssize":4,"bsize":1}, perf: {"precision":null,"recall":0.2314453125,"f1":null,"seconds":4.211440682411194e-6,"exhaustive_search_seconds":8.609145879745483e-6,"evaluations":6.859375,"distances_sum":587.8326748362578}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5888671875, conf: {"ssize":3,"bsize":3}, perf: {"precision":1.0,"recall":0.5888671875,"f1":0.7270850677100683,"seconds":5.338340997695923e-6,"exhaustive_search_seconds":8.609145879745483e-6,"evaluations":7.5546875,"distances_sum":1393.0995940558862}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2177734375, conf: {"ssize":5,"bsize":1}, perf: {"precision":null,"recall":0.2177734375,"f1":null,"seconds":4.161149263381958e-6,"exhaustive_search_seconds":8.609145879745483e-6,"evaluations":6.6875,"distances_sum":518.1460029910618}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.5888671875,"state":{"ssize":3,"bsize":3},"perf":{"precision":1.0,"recall":0.5888671875,"f1":0.7270850677100683,"seconds":5.338340997695923e-6,"exhaustive_search_seconds":8.609145879745483e-6,"evaluations":7.5546875,"distances_sum":1393.0995940558862}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7939453125, conf: {"ssize":7,"bsize":5}, perf: {"precision":1.0,"recall":0.7939453125,"f1":0.8797681485181494,"seconds":7.031485438346863e-6,"exhaustive_search_seconds":8.609145879745483e-6,"evaluations":8.75,"distances_sum":2011.9704709523674}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8203125, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.8203125,"f1":0.8945341117216125,"seconds":5.4836273193359375e-6,"exhaustive_search_seconds":8.609145879745483e-6,"evaluations":8.9140625,"distances_sum":2102.0650512950697}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.59375, conf: {"ssize":1,"bsize":3}, perf: {"precision":1.0,"recall":0.59375,"f1":0.7322597541347546,"seconds":4.822388291358948e-6,"exhaustive_search_seconds":8.609145879745483e-6,"evaluations":7.6328125,"distances_sum":1372.0971737569814}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.693359375, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.693359375,"f1":0.8106466450216459,"seconds":4.999339580535889e-6,"exhaustive_search_seconds":8.609145879745483e-6,"evaluations":8.4140625,"distances_sum":1661.775291501771}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.703125, conf: {"ssize":7,"bsize":4}, perf: {"precision":1.0,"recall":0.703125,"f1":0.812475545288046,"seconds":4.991888999938965e-6,"exhaustive_search_seconds":8.609145879745483e-6,"evaluations":8.359375,"distances_sum":1731.5121980211884}, best_list's length: 11, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7734375, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.7734375,"f1":0.8637711247086255,"seconds":5.4426491260528564e-6,"exhaustive_search_seconds":8.609145879745483e-6,"evaluations":8.6796875,"distances_sum":1930.8531834562004}, best_list's length: 12, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5986328125, conf: {"ssize":8,"bsize":3}, perf: {"precision":null,"recall":0.5986328125,"f1":null,"seconds":4.334375262260437e-6,"exhaustive_search_seconds":8.609145879745483e-6,"evaluations":7.6328125,"distances_sum":1425.5937889934942}, best_list's length: 14, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8203125,"state":{"ssize":1,"bsize":6},"perf":{"precision":1.0,"recall":0.8203125,"f1":0.8945341117216125,"seconds":5.4836273193359375e-6,"exhaustive_search_seconds":8.609145879745483e-6,"evaluations":8.9140625,"distances_sum":2102.0650512950697}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9033203125, conf: {"ssize":4,"bsize":8}, perf: {"precision":1.0,"recall":0.9033203125,"f1":0.9448889652014656,"seconds":5.947425961494446e-6,"exhaustive_search_seconds":8.609145879745483e-6,"evaluations":8.9765625,"distances_sum":2434.4891335099956}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9228515625, conf: {"ssize":2,"bsize":8}, perf: {"precision":1.0,"recall":0.9228515625,"f1":0.95604967948718,"seconds":6.159767508506775e-6,"exhaustive_search_seconds":8.609145879745483e-6,"evaluations":8.96875,"distances_sum":2533.7155219152255}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.89453125, conf: {"ssize":3,"bsize":7}, perf: {"precision":1.0,"recall":0.89453125,"f1":0.9394459706959712,"seconds":5.77978789806366e-6,"exhaustive_search_seconds":8.609145879745483e-6,"evaluations":8.9609375,"distances_sum":2416.0535053701756}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9326171875, conf: {"ssize":8,"bsize":9}, perf: {"precision":1.0,"recall":0.9326171875,"f1":0.9620592948717954,"seconds":6.1783939599990845e-6,"exhaustive_search_seconds":8.609145879745483e-6,"evaluations":8.921875,"distances_sum":2569.2703333840386}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9140625, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.9140625,"f1":0.9512133699633705,"seconds":6.331130862236023e-6,"exhaustive_search_seconds":8.609145879745483e-6,"evaluations":8.96875,"distances_sum":2487.601325556249}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8955078125, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.8955078125,"f1":0.9397009240759245,"seconds":5.843117833137512e-6,"exhaustive_search_seconds":8.609145879745483e-6,"evaluations":8.9609375,"distances_sum":2396.497545961587}, best_list's length: 11, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9326171875,"state":{"ssize":8,"bsize":9},"perf":{"precision":1.0,"recall":0.9326171875,"f1":0.9620592948717954,"seconds":6.1783939599990845e-6,"exhaustive_search_seconds":8.609145879745483e-6,"evaluations":8.921875,"distances_sum":2569.2703333840386}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9326171875,"state":{"ssize":8,"bsize":9},"perf":{"precision":1.0,"recall":0.9326171875,"f1":0.9620592948717954,"seconds":6.1783939599990845e-6,"exhaustive_search_seconds":8.609145879745483e-6,"evaluations":8.921875,"distances_sum":2569.2703333840386}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2001953125, conf: {"ssize":5,"bsize":1}, perf: {"precision":null,"recall":0.2001953125,"f1":null,"seconds":3.252178430557251e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":6.109375,"distances_sum":490.4616919477318}, best_list's length: 2, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.2001953125,"state":{"ssize":5,"bsize":1},"perf":{"precision":null,"recall":0.2001953125,"f1":null,"seconds":3.252178430557251e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":6.109375,"distances_sum":490.4616919477318}}, beam: 2, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6162109375, conf: {"ssize":2,"bsize":3}, perf: {"precision":1.0,"recall":0.6162109375,"f1":0.7508734321234328,"seconds":4.4889748096466064e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":7.6796875,"distances_sum":1461.2920168955695}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.203125, conf: {"ssize":7,"bsize":1}, perf: {"precision":null,"recall":0.203125,"f1":null,"seconds":3.5017728805541992e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":6.2109375,"distances_sum":490.0354244821308}, best_list's length: 4, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7275390625, conf: {"ssize":5,"bsize":4}, perf: {"precision":1.0,"recall":0.7275390625,"f1":0.8324243464868473,"seconds":4.993751645088196e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":8.2265625,"distances_sum":1807.7094637965786}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7255859375, conf: {"ssize":7,"bsize":4}, perf: {"precision":1.0,"recall":0.7255859375,"f1":0.8351107226107235,"seconds":5.114823579788208e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":8.28125,"distances_sum":1800.050480146569}, best_list's length: 6, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7275390625,"state":{"ssize":5,"bsize":4},"perf":{"precision":1.0,"recall":0.7275390625,"f1":0.8324243464868473,"seconds":4.993751645088196e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":8.2265625,"distances_sum":1807.7094637965786}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.759765625, conf: {"ssize":7,"bsize":5}, perf: {"precision":1.0,"recall":0.759765625,"f1":0.8565908050283059,"seconds":5.27501106262207e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":8.5,"distances_sum":1930.3562594116179}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.888671875, conf: {"ssize":4,"bsize":7}, perf: {"precision":1.0,"recall":0.888671875,"f1":0.9371737637362644,"seconds":5.5301934480667114e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":8.890625,"distances_sum":2407.208165685684}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7666015625, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.7666015625,"f1":0.8629755661005668,"seconds":5.710870027542114e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":8.46875,"distances_sum":1935.118033396266}, best_list's length: 12, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.888671875,"state":{"ssize":4,"bsize":7},"perf":{"precision":1.0,"recall":0.888671875,"f1":0.9371737637362644,"seconds":5.5301934480667114e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":8.890625,"distances_sum":2407.208165685684}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.888671875,"state":{"ssize":4,"bsize":7},"perf":{"precision":1.0,"recall":0.888671875,"f1":0.9371737637362644,"seconds":5.5301934480667114e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":8.890625,"distances_sum":2407.208165685684}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5615234375, conf: {"ssize":1,"bsize":3}, perf: {"precision":null,"recall":0.5615234375,"f1":null,"seconds":4.276633262634277e-6,"exhaustive_search_seconds":1.5404075384140015e-6,"evaluations":7.0,"distances_sum":1311.7981843059517}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.388671875, conf: {"ssize":4,"bsize":2}, perf: {"precision":null,"recall":0.388671875,"f1":null,"seconds":3.732740879058838e-6,"exhaustive_search_seconds":1.5404075384140015e-6,"evaluations":5.9921875,"distances_sum":878.826941059213}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.208984375, conf: {"ssize":5,"bsize":1}, perf: {"precision":null,"recall":0.208984375,"f1":null,"seconds":3.429129719734192e-6,"exhaustive_search_seconds":1.5404075384140015e-6,"evaluations":5.8828125,"distances_sum":500.95687312377976}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.5615234375,"state":{"ssize":1,"bsize":3},"perf":{"precision":null,"recall":0.5615234375,"f1":null,"seconds":4.276633262634277e-6,"exhaustive_search_seconds":1.5404075384140015e-6,"evaluations":7.0,"distances_sum":1311.7981843059517}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8046875, conf: {"ssize":2,"bsize":6}, perf: {"precision":1.0,"recall":0.8046875,"f1":0.8824498418248428,"seconds":5.111098289489746e-6,"exhaustive_search_seconds":1.5404075384140015e-6,"evaluations":8.4453125,"distances_sum":2129.000167623494}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.740234375, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.740234375,"f1":0.8430866008991018,"seconds":5.064532160758972e-6,"exhaustive_search_seconds":1.5404075384140015e-6,"evaluations":8.2578125,"distances_sum":1840.6674186369107}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7353515625, conf: {"ssize":4,"bsize":5}, perf: {"precision":1.0,"recall":0.7353515625,"f1":0.8378590159840167,"seconds":5.3513795137405396e-6,"exhaustive_search_seconds":1.5404075384140015e-6,"evaluations":8.2734375,"distances_sum":1843.5856632165}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6640625, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.6640625,"f1":0.7850215756465764,"seconds":4.5727938413619995e-6,"exhaustive_search_seconds":1.5404075384140015e-6,"evaluations":7.6484375,"distances_sum":1602.2422823567015}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8046875,"state":{"ssize":2,"bsize":6},"perf":{"precision":1.0,"recall":0.8046875,"f1":0.8824498418248428,"seconds":5.111098289489746e-6,"exhaustive_search_seconds":1.5404075384140015e-6,"evaluations":8.4453125,"distances_sum":2129.000167623494}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.814453125, conf: {"ssize":5,"bsize":6}, perf: {"precision":1.0,"recall":0.814453125,"f1":0.891612554112555,"seconds":5.504116415977478e-6,"exhaustive_search_seconds":1.5404075384140015e-6,"evaluations":8.5234375,"distances_sum":2134.8949341099797}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8642578125, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.8642578125,"f1":0.9217433608058613,"seconds":5.705282092094421e-6,"exhaustive_search_seconds":1.5404075384140015e-6,"evaluations":8.609375,"distances_sum":2342.5121243353597}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.912109375, conf: {"ssize":7,"bsize":8}, perf: {"precision":1.0,"recall":0.912109375,"f1":0.9499141483516489,"seconds":5.893409252166748e-6,"exhaustive_search_seconds":1.5404075384140015e-6,"evaluations":8.8046875,"distances_sum":2486.9116407702477}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.896484375, conf: {"ssize":6,"bsize":8}, perf: {"precision":1.0,"recall":0.896484375,"f1":0.9397035256410262,"seconds":5.893409252166748e-6,"exhaustive_search_seconds":1.5404075384140015e-6,"evaluations":8.6796875,"distances_sum":2447.5104924465636}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8935546875, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.8935546875,"f1":0.9370109057609058,"seconds":5.887821316719055e-6,"exhaustive_search_seconds":1.5404075384140015e-6,"evaluations":8.734375,"distances_sum":2411.121061336611}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.912109375,"state":{"ssize":7,"bsize":8},"perf":{"precision":1.0,"recall":0.912109375,"f1":0.9499141483516489,"seconds":5.893409252166748e-6,"exhaustive_search_seconds":1.5404075384140015e-6,"evaluations":8.8046875,"distances_sum":2486.9116407702477}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.912109375,"state":{"ssize":7,"bsize":8},"perf":{"precision":1.0,"recall":0.912109375,"f1":0.9499141483516489,"seconds":5.893409252166748e-6,"exhaustive_search_seconds":1.5404075384140015e-6,"evaluations":8.8046875,"distances_sum":2486.9116407702477}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6787109375, conf: {"ssize":2,"bsize":4}, perf: {"precision":1.0,"recall":0.6787109375,"f1":0.8010770479520488,"seconds":5.055218935012817e-6,"exhaustive_search_seconds":1.477077603340149e-6,"evaluations":7.9296875,"distances_sum":1572.6182172879373}, best_list's length: 2, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.6787109375,"state":{"ssize":2,"bsize":4},"perf":{"precision":1.0,"recall":0.6787109375,"f1":0.8010770479520488,"seconds":5.055218935012817e-6,"exhaustive_search_seconds":1.477077603340149e-6,"evaluations":7.9296875,"distances_sum":1572.6182172879373}}, beam: 2, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8251953125, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.8251953125,"f1":0.8982288544788554,"seconds":5.533918738365173e-6,"exhaustive_search_seconds":1.477077603340149e-6,"evaluations":8.75,"distances_sum":2080.686996813329}, best_list's length: 4, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8798828125, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.8798828125,"f1":0.9322859432234439,"seconds":6.083399057388306e-6,"exhaustive_search_seconds":1.477077603340149e-6,"evaluations":8.9140625,"distances_sum":2275.562865199699}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8798828125,"state":{"ssize":1,"bsize":7},"perf":{"precision":1.0,"recall":0.8798828125,"f1":0.9322859432234439,"seconds":6.083399057388306e-6,"exhaustive_search_seconds":1.477077603340149e-6,"evaluations":8.9140625,"distances_sum":2275.562865199699}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.923828125, conf: {"ssize":2,"bsize":9}, perf: {"precision":1.0,"recall":0.923828125,"f1":0.9564789377289382,"seconds":6.020069122314453e-6,"exhaustive_search_seconds":1.477077603340149e-6,"evaluations":8.953125,"distances_sum":2461.6288781031412}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9443359375, conf: {"ssize":1,"bsize":10}, perf: {"precision":1.0,"recall":0.9443359375,"f1":0.9689388736263741,"seconds":6.137415766716003e-6,"exhaustive_search_seconds":1.477077603340149e-6,"evaluations":8.9375,"distances_sum":2570.1547393355945}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.919921875, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.919921875,"f1":0.9542467948717954,"seconds":6.2175095081329346e-6,"exhaustive_search_seconds":1.477077603340149e-6,"evaluations":8.9140625,"distances_sum":2455.269575785519}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9404296875, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.9404296875,"f1":0.9661515567765572,"seconds":5.953013896942139e-6,"exhaustive_search_seconds":1.477077603340149e-6,"evaluations":8.9375,"distances_sum":2553.1619221907704}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9345703125, conf: {"ssize":3,"bsize":10}, perf: {"precision":1.0,"recall":0.9345703125,"f1":0.9630093864468869,"seconds":6.16908073425293e-6,"exhaustive_search_seconds":1.477077603340149e-6,"evaluations":8.9765625,"distances_sum":2494.4939253559296}, best_list's length: 11, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9443359375,"state":{"ssize":1,"bsize":10},"perf":{"precision":1.0,"recall":0.9443359375,"f1":0.9689388736263741,"seconds":6.137415766716003e-6,"exhaustive_search_seconds":1.477077603340149e-6,"evaluations":8.9375,"distances_sum":2570.1547393355945}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9443359375,"state":{"ssize":1,"bsize":10},"perf":{"precision":1.0,"recall":0.9443359375,"f1":0.9689388736263741,"seconds":6.137415766716003e-6,"exhaustive_search_seconds":1.477077603340149e-6,"evaluations":8.9375,"distances_sum":2570.1547393355945}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.1953125, conf: {"ssize":4,"bsize":1}, perf: {"precision":null,"recall":0.1953125,"f1":null,"seconds":3.462657332420349e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":5.9296875,"distances_sum":476.56094388275216}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.794921875, conf: {"ssize":2,"bsize":5}, perf: {"precision":1.0,"recall":0.794921875,"f1":0.8781700937950946,"seconds":5.3942203521728516e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.5625,"distances_sum":1951.2766915396348}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.794921875,"state":{"ssize":2,"bsize":5},"perf":{"precision":1.0,"recall":0.794921875,"f1":0.8781700937950946,"seconds":5.3942203521728516e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.5625,"distances_sum":1951.2766915396348}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.927734375, conf: {"ssize":3,"bsize":9}, perf: {"precision":1.0,"recall":0.927734375,"f1":0.9597470238095241,"seconds":6.712973117828369e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.9140625,"distances_sum":2453.830106993459}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.873046875, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.873046875,"f1":0.9260931776556783,"seconds":6.560236215591431e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.7734375,"distances_sum":2254.613117298567}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.927734375, conf: {"ssize":2,"bsize":8}, perf: {"precision":1.0,"recall":0.927734375,"f1":0.9587142024642029,"seconds":6.560236215591431e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.8984375,"distances_sum":2445.12072153293}, best_list's length: 7, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.927734375,"state":{"ssize":3,"bsize":9},"perf":{"precision":1.0,"recall":0.927734375,"f1":0.9597470238095241,"seconds":6.712973117828369e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.9140625,"distances_sum":2453.830106993459}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9541015625, conf: {"ssize":3,"bsize":12}, perf: {"precision":1.0,"recall":0.9541015625,"f1":0.9745364010989013,"seconds":7.66851007938385e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.984375,"distances_sum":2562.114360259917}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9560546875, conf: {"ssize":5,"bsize":13}, perf: {"precision":1.0,"recall":0.9560546875,"f1":0.9762648809523813,"seconds":7.335096597671509e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.953125,"distances_sum":2576.628212996008}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9482421875, conf: {"ssize":7,"bsize":11}, perf: {"precision":1.0,"recall":0.9482421875,"f1":0.9712625915750919,"seconds":6.917864084243774e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.96875,"distances_sum":2547.8550902860306}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9423828125, conf: {"ssize":4,"bsize":10}, perf: {"precision":1.0,"recall":0.9423828125,"f1":0.968137591575092,"seconds":6.664544343948364e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.921875,"distances_sum":2522.863641943043}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9560546875,"state":{"ssize":5,"bsize":13},"perf":{"precision":1.0,"recall":0.9560546875,"f1":0.9762648809523813,"seconds":7.335096597671509e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.953125,"distances_sum":2576.628212996008}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9560546875,"state":{"ssize":5,"bsize":13},"perf":{"precision":1.0,"recall":0.9560546875,"f1":0.9762648809523813,"seconds":7.335096597671509e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.953125,"distances_sum":2576.628212996008}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.3056640625, conf: {"ssize":4,"bsize":2}, perf: {"precision":1.0,"recall":0.3056640625,"f1":0.4548853923853919,"seconds":3.9208680391311646e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":5.2421875,"distances_sum":776.2740079422387}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7490234375, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.7490234375,"f1":0.8445434773559783,"seconds":5.807727575302124e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.4296875,"distances_sum":1960.5428476585735}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7490234375,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.7490234375,"f1":0.8445434773559783,"seconds":5.807727575302124e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.4296875,"distances_sum":1960.5428476585735}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.90625, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.90625,"f1":0.9464228479853486,"seconds":6.4354389905929565e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.8125,"distances_sum":2531.3863790988507}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8310546875, conf: {"ssize":2,"bsize":6}, perf: {"precision":1.0,"recall":0.8310546875,"f1":0.9007268772893781,"seconds":6.087124347686768e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.6796875,"distances_sum":2241.483282983762}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8056640625, conf: {"ssize":4,"bsize":6}, perf: {"precision":1.0,"recall":0.8056640625,"f1":0.8813826798201807,"seconds":6.293877959251404e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.6328125,"distances_sum":2139.0445423827728}, best_list's length: 8, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.90625,"state":{"ssize":1,"bsize":8},"perf":{"precision":1.0,"recall":0.90625,"f1":0.9464228479853486,"seconds":6.4354389905929565e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.8125,"distances_sum":2531.3863790988507}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9267578125, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.9267578125,"f1":0.9589686355311361,"seconds":6.774440407752991e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.84375,"distances_sum":2597.900595499357}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9521484375, conf: {"ssize":1,"bsize":11}, perf: {"precision":1.0,"recall":0.9521484375,"f1":0.973031135531136,"seconds":6.5658241510391235e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.9375,"distances_sum":2705.725498493191}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9482421875, conf: {"ssize":2,"bsize":12}, perf: {"precision":1.0,"recall":0.9482421875,"f1":0.9711538461538467,"seconds":7.228925824165344e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.9296875,"distances_sum":2671.697146190484}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9375, conf: {"ssize":3,"bsize":10}, perf: {"precision":1.0,"recall":0.9375,"f1":0.9650354853479858,"seconds":6.61797821521759e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.875,"distances_sum":2652.9443420017233}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.935546875, conf: {"ssize":2,"bsize":9}, perf: {"precision":1.0,"recall":0.935546875,"f1":0.9643086080586083,"seconds":6.703659892082214e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.890625,"distances_sum":2611.048853615907}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9521484375,"state":{"ssize":1,"bsize":11},"perf":{"precision":1.0,"recall":0.9521484375,"f1":0.973031135531136,"seconds":6.5658241510391235e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.9375,"distances_sum":2705.725498493191}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9521484375,"state":{"ssize":1,"bsize":11},"perf":{"precision":1.0,"recall":0.9521484375,"f1":0.973031135531136,"seconds":6.5658241510391235e-6,"exhaustive_search_seconds":1.562759280204773e-6,"evaluations":8.9375,"distances_sum":2705.725498493191}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.1865234375, conf: {"ssize":4,"bsize":1}, perf: {"precision":null,"recall":0.1865234375,"f1":null,"seconds":3.6563724279403687e-6,"exhaustive_search_seconds":1.7043203115463257e-6,"evaluations":5.328125,"distances_sum":500.8524271188046}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.3671875, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.3671875,"f1":null,"seconds":4.246830940246582e-6,"exhaustive_search_seconds":1.7043203115463257e-6,"evaluations":5.9296875,"distances_sum":879.5811246478675}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5302734375, conf: {"ssize":1,"bsize":3}, perf: {"precision":1.0,"recall":0.5302734375,"f1":0.6773355117105123,"seconds":4.550442099571228e-6,"exhaustive_search_seconds":1.7043203115463257e-6,"evaluations":6.765625,"distances_sum":1294.241201660713}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.5302734375,"state":{"ssize":1,"bsize":3},"perf":{"precision":1.0,"recall":0.5302734375,"f1":0.6773355117105123,"seconds":4.550442099571228e-6,"exhaustive_search_seconds":1.7043203115463257e-6,"evaluations":6.765625,"distances_sum":1294.241201660713}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7314453125, conf: {"ssize":4,"bsize":5}, perf: {"precision":1.0,"recall":0.7314453125,"f1":0.8363563519813528,"seconds":5.9176236391067505e-6,"exhaustive_search_seconds":1.7043203115463257e-6,"evaluations":8.2109375,"distances_sum":1884.1008294953203}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.73828125, conf: {"ssize":2,"bsize":5}, perf: {"precision":1.0,"recall":0.73828125,"f1":0.8416791541791551,"seconds":5.757436156272888e-6,"exhaustive_search_seconds":1.7043203115463257e-6,"evaluations":8.1640625,"distances_sum":1929.8831327328828}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8134765625, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.8134765625,"f1":0.8902815934065941,"seconds":6.226822733879089e-6,"exhaustive_search_seconds":1.7043203115463257e-6,"evaluations":8.484375,"distances_sum":2151.5998389565293}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6533203125, conf: {"ssize":2,"bsize":4}, perf: {"precision":1.0,"recall":0.6533203125,"f1":0.7799230283605291,"seconds":5.46872615814209e-6,"exhaustive_search_seconds":1.7043203115463257e-6,"evaluations":7.609375,"distances_sum":1647.1993387707219}, best_list's length: 8, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8134765625,"state":{"ssize":1,"bsize":6},"perf":{"precision":1.0,"recall":0.8134765625,"f1":0.8902815934065941,"seconds":6.226822733879089e-6,"exhaustive_search_seconds":1.7043203115463257e-6,"evaluations":8.484375,"distances_sum":2151.5998389565293}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9384765625, conf: {"ssize":1,"bsize":10}, perf: {"precision":1.0,"recall":0.9384765625,"f1":0.9657222985347989,"seconds":6.604939699172974e-6,"exhaustive_search_seconds":1.7043203115463257e-6,"evaluations":8.9375,"distances_sum":2588.1864703598676}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.921875, conf: {"ssize":8,"bsize":8}, perf: {"precision":1.0,"recall":0.921875,"f1":0.9563873626373631,"seconds":7.160007953643799e-6,"exhaustive_search_seconds":1.7043203115463257e-6,"evaluations":8.9140625,"distances_sum":2504.3434175347948}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.921875, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.921875,"f1":0.9555746336996342,"seconds":6.556510925292969e-6,"exhaustive_search_seconds":1.7043203115463257e-6,"evaluations":8.8515625,"distances_sum":2541.674268232102}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9228515625, conf: {"ssize":6,"bsize":8}, perf: {"precision":1.0,"recall":0.9228515625,"f1":0.9551625457875461,"seconds":6.9569796323776245e-6,"exhaustive_search_seconds":1.7043203115463257e-6,"evaluations":8.8515625,"distances_sum":2536.965475256883}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9384765625,"state":{"ssize":1,"bsize":10},"perf":{"precision":1.0,"recall":0.9384765625,"f1":0.9657222985347989,"seconds":6.604939699172974e-6,"exhaustive_search_seconds":1.7043203115463257e-6,"evaluations":8.9375,"distances_sum":2588.1864703598676}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9384765625,"state":{"ssize":1,"bsize":10},"perf":{"precision":1.0,"recall":0.9384765625,"f1":0.9657222985347989,"seconds":6.604939699172974e-6,"exhaustive_search_seconds":1.7043203115463257e-6,"evaluations":8.9375,"distances_sum":2588.1864703598676}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.41796875, conf: {"ssize":5,"bsize":2}, perf: {"precision":null,"recall":0.41796875,"f1":null,"seconds":4.567205905914307e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":6.578125,"distances_sum":965.983584953276}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.69921875, conf: {"ssize":4,"bsize":4}, perf: {"precision":1.0,"recall":0.69921875,"f1":0.8104575979575986,"seconds":5.504116415977478e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":8.0,"distances_sum":1729.5627148563556}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.55078125, conf: {"ssize":3,"bsize":3}, perf: {"precision":null,"recall":0.55078125,"f1":null,"seconds":5.010515451431274e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":7.5390625,"distances_sum":1342.8819892296276}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.69921875,"state":{"ssize":4,"bsize":4},"perf":{"precision":1.0,"recall":0.69921875,"f1":0.8104575979575986,"seconds":5.504116415977478e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":8.0,"distances_sum":1729.5627148563556}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.888671875, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.888671875,"f1":0.9360004578754585,"seconds":6.658956408500671e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":8.65625,"distances_sum":2437.704103948429}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7724609375, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.7724609375,"f1":0.8629188519813529,"seconds":5.995854735374451e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":8.3515625,"distances_sum":1938.278492155595}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8291015625, conf: {"ssize":4,"bsize":6}, perf: {"precision":1.0,"recall":0.8291015625,"f1":0.89906811938062,"seconds":6.18956983089447e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":8.5859375,"distances_sum":2199.51224922783}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.767578125, conf: {"ssize":6,"bsize":5}, perf: {"precision":1.0,"recall":0.767578125,"f1":0.8583421786546794,"seconds":5.824491381645203e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":8.328125,"distances_sum":1904.0404779325545}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.888671875,"state":{"ssize":1,"bsize":8},"perf":{"precision":1.0,"recall":0.888671875,"f1":0.9360004578754585,"seconds":6.658956408500671e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":8.65625,"distances_sum":2437.704103948429}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9052734375, conf: {"ssize":2,"bsize":8}, perf: {"precision":1.0,"recall":0.9052734375,"f1":0.945655906593407,"seconds":6.726011633872986e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":8.8125,"distances_sum":2458.3315891804987}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9365234375, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.9365234375,"f1":0.9634329212454217,"seconds":6.776303052902222e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":8.8515625,"distances_sum":2594.647225248992}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9453125, conf: {"ssize":5,"bsize":10}, perf: {"precision":1.0,"recall":0.9453125,"f1":0.9697573260073264,"seconds":6.878748536109924e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":8.9296875,"distances_sum":2629.334853417886}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.94140625, conf: {"ssize":1,"bsize":10}, perf: {"precision":1.0,"recall":0.94140625,"f1":0.967765567765568,"seconds":7.299706339836121e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":8.90625,"distances_sum":2599.342193068054}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9375, conf: {"ssize":7,"bsize":10}, perf: {"precision":1.0,"recall":0.9375,"f1":0.9648268398268403,"seconds":6.604939699172974e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":8.890625,"distances_sum":2590.726195267193}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9453125,"state":{"ssize":5,"bsize":10},"perf":{"precision":1.0,"recall":0.9453125,"f1":0.9697573260073264,"seconds":6.878748536109924e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":8.9296875,"distances_sum":2629.334853417886}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9453125,"state":{"ssize":5,"bsize":10},"perf":{"precision":1.0,"recall":0.9453125,"f1":0.9697573260073264,"seconds":6.878748536109924e-6,"exhaustive_search_seconds":1.687556505203247e-6,"evaluations":8.9296875,"distances_sum":2629.334853417886}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5888671875, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.5888671875,"f1":0.7261264776889783,"seconds":5.37186861038208e-6,"exhaustive_search_seconds":1.6577541828155518e-6,"evaluations":6.96875,"distances_sum":1478.7242814356894}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7197265625, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.7197265625,"f1":0.8254734848484857,"seconds":5.81890344619751e-6,"exhaustive_search_seconds":1.6577541828155518e-6,"evaluations":7.9296875,"distances_sum":1820.2684961602522}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7197265625,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.7197265625,"f1":0.8254734848484857,"seconds":5.81890344619751e-6,"exhaustive_search_seconds":1.6577541828155518e-6,"evaluations":7.9296875,"distances_sum":1820.2684961602522}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8583984375, conf: {"ssize":4,"bsize":7}, perf: {"precision":1.0,"recall":0.8583984375,"f1":0.9158143939393945,"seconds":6.28642737865448e-6,"exhaustive_search_seconds":1.6577541828155518e-6,"evaluations":8.4765625,"distances_sum":2271.9843732853533}, best_list's length: 4, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8974609375, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.8974609375,"f1":0.9408997252747261,"seconds":6.359070539474487e-6,"exhaustive_search_seconds":1.6577541828155518e-6,"evaluations":8.578125,"distances_sum":2431.377272374335}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8818359375, conf: {"ssize":3,"bsize":8}, perf: {"precision":1.0,"recall":0.8818359375,"f1":0.9321771978021984,"seconds":6.128102540969849e-6,"exhaustive_search_seconds":1.6577541828155518e-6,"evaluations":8.5546875,"distances_sum":2351.794676100934}, best_list's length: 6, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8974609375,"state":{"ssize":1,"bsize":9},"perf":{"precision":1.0,"recall":0.8974609375,"f1":0.9408997252747261,"seconds":6.359070539474487e-6,"exhaustive_search_seconds":1.6577541828155518e-6,"evaluations":8.578125,"distances_sum":2431.377272374335}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9404296875, conf: {"ssize":1,"bsize":12}, perf: {"precision":1.0,"recall":0.9404296875,"f1":0.9673363095238101,"seconds":6.629154086112976e-6,"exhaustive_search_seconds":1.6577541828155518e-6,"evaluations":8.765625,"distances_sum":2574.0987974138293}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9287109375, conf: {"ssize":1,"bsize":11}, perf: {"precision":1.0,"recall":0.9287109375,"f1":0.9606055402930408,"seconds":6.416812539100647e-6,"exhaustive_search_seconds":1.6577541828155518e-6,"evaluations":8.7734375,"distances_sum":2504.4541644390215}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9384765625, conf: {"ssize":4,"bsize":11}, perf: {"precision":1.0,"recall":0.9384765625,"f1":0.9657967032967038,"seconds":6.385147571563721e-6,"exhaustive_search_seconds":1.6577541828155518e-6,"evaluations":8.7890625,"distances_sum":2555.385608376003}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9404296875,"state":{"ssize":1,"bsize":12},"perf":{"precision":1.0,"recall":0.9404296875,"f1":0.9673363095238101,"seconds":6.629154086112976e-6,"exhaustive_search_seconds":1.6577541828155518e-6,"evaluations":8.765625,"distances_sum":2574.0987974138293}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9404296875,"state":{"ssize":1,"bsize":12},"perf":{"precision":1.0,"recall":0.9404296875,"f1":0.9673363095238101,"seconds":6.629154086112976e-6,"exhaustive_search_seconds":1.6577541828155518e-6,"evaluations":8.765625,"distances_sum":2574.0987974138293}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5078125, conf: {"ssize":1,"bsize":3}, perf: {"precision":1.0,"recall":0.5078125,"f1":0.657738615551116,"seconds":4.090368747711182e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":6.8515625,"distances_sum":1151.1207516397571}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.734375, conf: {"ssize":3,"bsize":5}, perf: {"precision":1.0,"recall":0.734375,"f1":0.8393294205794214,"seconds":5.016103386878967e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":7.8984375,"distances_sum":1710.7103215292395}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.734375,"state":{"ssize":3,"bsize":5},"perf":{"precision":1.0,"recall":0.734375,"f1":0.8393294205794214,"seconds":5.016103386878967e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":7.8984375,"distances_sum":1710.7103215292395}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8779296875, conf: {"ssize":7,"bsize":7}, perf: {"precision":1.0,"recall":0.8779296875,"f1":0.9299393315018321,"seconds":5.535781383514404e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":8.7890625,"distances_sum":2215.2613576737454}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8779296875,"state":{"ssize":7,"bsize":7},"perf":{"precision":1.0,"recall":0.8779296875,"f1":0.9299393315018321,"seconds":5.535781383514404e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":8.7890625,"distances_sum":2215.2613576737454}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9287109375, conf: {"ssize":7,"bsize":9}, perf: {"precision":1.0,"recall":0.9287109375,"f1":0.9601076007326012,"seconds":6.454065442085266e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":8.828125,"distances_sum":2431.6633179539385}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9169921875, conf: {"ssize":4,"bsize":9}, perf: {"precision":1.0,"recall":0.9169921875,"f1":0.9534855769230774,"seconds":5.718320608139038e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":8.75,"distances_sum":2400.3559488791143}, best_list's length: 6, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9287109375,"state":{"ssize":7,"bsize":9},"perf":{"precision":1.0,"recall":0.9287109375,"f1":0.9601076007326012,"seconds":6.454065442085266e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":8.828125,"distances_sum":2431.6633179539385}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9287109375,"state":{"ssize":7,"bsize":9},"perf":{"precision":1.0,"recall":0.9287109375,"f1":0.9601076007326012,"seconds":6.454065442085266e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":8.828125,"distances_sum":2431.6633179539385}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.783203125, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.783203125,"f1":0.8680491383616392,"seconds":5.248934030532837e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.2734375,"distances_sum":1925.100734079988}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7802734375, conf: {"ssize":4,"bsize":5}, perf: {"precision":1.0,"recall":0.7802734375,"f1":0.8675116550116557,"seconds":5.0477683544158936e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.2734375,"distances_sum":1906.3026641718411}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6953125, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.6953125,"f1":0.807100538350539,"seconds":4.684552550315857e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.0,"distances_sum":1637.6602030725069}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.783203125,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.783203125,"f1":0.8680491383616392,"seconds":5.248934030532837e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.2734375,"distances_sum":1925.100734079988}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9033203125, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.9033203125,"f1":0.9443884240759249,"seconds":5.541369318962097e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.734375,"distances_sum":2389.1361836220344}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.892578125, conf: {"ssize":4,"bsize":7}, perf: {"precision":1.0,"recall":0.892578125,"f1":0.9371196511821516,"seconds":5.520880222320557e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.640625,"distances_sum":2369.5150966011465}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8271484375, conf: {"ssize":5,"bsize":6}, perf: {"precision":1.0,"recall":0.8271484375,"f1":0.8948494214119223,"seconds":5.597248673439026e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.359375,"distances_sum":2096.26368771589}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.931640625, conf: {"ssize":8,"bsize":9}, perf: {"precision":1.0,"recall":0.931640625,"f1":0.9617788461538466,"seconds":5.980953574180603e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.859375,"distances_sum":2494.0258032639404}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8544921875, conf: {"ssize":8,"bsize":7}, perf: {"precision":1.0,"recall":0.8544921875,"f1":0.9158627830502838,"seconds":5.513429641723633e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.6484375,"distances_sum":2180.676920364339}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9248046875, conf: {"ssize":3,"bsize":9}, perf: {"precision":1.0,"recall":0.9248046875,"f1":0.9580586080586087,"seconds":5.861744284629822e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.84375,"distances_sum":2479.1875807411475}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.884765625, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.884765625,"f1":0.9334165834165842,"seconds":5.552545189857483e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.703125,"distances_sum":2329.928891399951}, best_list's length: 11, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9189453125, conf: {"ssize":5,"bsize":8}, perf: {"precision":1.0,"recall":0.9189453125,"f1":0.9535771520146524,"seconds":5.662441253662109e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.859375,"distances_sum":2442.020440600289}, best_list's length: 12, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8681640625, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.8681640625,"f1":0.9235119047619053,"seconds":5.817040801048279e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.640625,"distances_sum":2244.8034253102433}, best_list's length: 13, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.931640625,"state":{"ssize":8,"bsize":9},"perf":{"precision":1.0,"recall":0.931640625,"f1":0.9617788461538466,"seconds":5.980953574180603e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.859375,"distances_sum":2494.0258032639404}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.970703125, conf: {"ssize":8,"bsize":13}, perf: {"precision":1.0,"recall":0.970703125,"f1":0.9839114010989014,"seconds":6.025657057762146e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.9375,"distances_sum":2641.9298330249026}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9345703125, conf: {"ssize":10,"bsize":10}, perf: {"precision":1.0,"recall":0.9345703125,"f1":0.9634901556776561,"seconds":5.990266799926758e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.8203125,"distances_sum":2513.645306401048}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.947265625, conf: {"ssize":9,"bsize":11}, perf: {"precision":1.0,"recall":0.947265625,"f1":0.9704269688644692,"seconds":6.726011633872986e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.90625,"distances_sum":2553.0348352448127}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.955078125, conf: {"ssize":7,"bsize":10}, perf: {"precision":1.0,"recall":0.955078125,"f1":0.9754464285714288,"seconds":6.318092346191406e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.921875,"distances_sum":2578.0381966784303}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.958984375, conf: {"ssize":2,"bsize":12}, perf: {"precision":1.0,"recall":0.958984375,"f1":0.9775869963369966,"seconds":6.822869181632996e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.8984375,"distances_sum":2600.7081013093684}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.93359375, conf: {"ssize":1,"bsize":10}, perf: {"precision":1.0,"recall":0.93359375,"f1":0.9620192307692311,"seconds":5.956739187240601e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.828125,"distances_sum":2501.590775629943}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.970703125,"state":{"ssize":8,"bsize":13},"perf":{"precision":1.0,"recall":0.970703125,"f1":0.9839114010989014,"seconds":6.025657057762146e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.9375,"distances_sum":2641.9298330249026}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.970703125,"state":{"ssize":8,"bsize":13},"perf":{"precision":1.0,"recall":0.970703125,"f1":0.9839114010989014,"seconds":6.025657057762146e-6,"exhaustive_search_seconds":1.469627022743225e-6,"evaluations":8.9375,"distances_sum":2641.9298330249026}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.52734375, conf: {"ssize":3,"bsize":3}, perf: {"precision":1.0,"recall":0.52734375,"f1":0.677063214563215,"seconds":4.43682074546814e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":7.1640625,"distances_sum":1113.5928071292628}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6767578125, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.6767578125,"f1":0.7934863747363756,"seconds":4.738569259643555e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":7.84375,"distances_sum":1564.771046708714}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.6767578125,"state":{"ssize":1,"bsize":4},"perf":{"precision":1.0,"recall":0.6767578125,"f1":0.7934863747363756,"seconds":4.738569259643555e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":7.84375,"distances_sum":1564.771046708714}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.83984375, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.83984375,"f1":0.9054289460539469,"seconds":5.504116415977478e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":8.515625,"distances_sum":2088.324321140051}, best_list's length: 4, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.857421875, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.857421875,"f1":0.9160714285714293,"seconds":5.645677447319031e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":8.6015625,"distances_sum":2151.9638428248527}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.857421875,"state":{"ssize":1,"bsize":7},"perf":{"precision":1.0,"recall":0.857421875,"f1":0.9160714285714293,"seconds":5.645677447319031e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":8.6015625,"distances_sum":2151.9638428248527}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.921875, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.921875,"f1":0.9556776556776561,"seconds":6.154179573059082e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":8.8515625,"distances_sum":2408.1327051550807}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9443359375, conf: {"ssize":1,"bsize":11}, perf: {"precision":1.0,"recall":0.9443359375,"f1":0.9689045329670333,"seconds":6.0442835092544556e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":8.890625,"distances_sum":2483.679465516728}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9482421875, conf: {"ssize":3,"bsize":11}, perf: {"precision":1.0,"recall":0.9482421875,"f1":0.9707620504495508,"seconds":5.951151251792908e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":8.9140625,"distances_sum":2481.02756443428}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.91015625, conf: {"ssize":3,"bsize":8}, perf: {"precision":1.0,"recall":0.91015625,"f1":0.9483745421245425,"seconds":5.943700671195984e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":8.8046875,"distances_sum":2366.1972454236657}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9375, conf: {"ssize":4,"bsize":10}, perf: {"precision":1.0,"recall":0.9375,"f1":0.9650698260073264,"seconds":6.170943379402161e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":8.8984375,"distances_sum":2454.7872473514794}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9482421875,"state":{"ssize":3,"bsize":11},"perf":{"precision":1.0,"recall":0.9482421875,"f1":0.9707620504495508,"seconds":5.951151251792908e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":8.9140625,"distances_sum":2481.02756443428}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9482421875,"state":{"ssize":3,"bsize":11},"perf":{"precision":1.0,"recall":0.9482421875,"f1":0.9707620504495508,"seconds":5.951151251792908e-6,"exhaustive_search_seconds":1.383945345878601e-6,"evaluations":8.9140625,"distances_sum":2481.02756443428}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.267578125, conf: {"ssize":2,"bsize":1}, perf: {"precision":null,"recall":0.267578125,"f1":null,"seconds":3.997236490249634e-6,"exhaustive_search_seconds":1.5851110219955444e-6,"evaluations":6.359375,"distances_sum":582.2220985753239}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2626953125, conf: {"ssize":3,"bsize":1}, perf: {"precision":null,"recall":0.2626953125,"f1":null,"seconds":3.293156623840332e-6,"exhaustive_search_seconds":1.5851110219955444e-6,"evaluations":6.25,"distances_sum":573.76891537396}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.267578125,"state":{"ssize":2,"bsize":1},"perf":{"precision":null,"recall":0.267578125,"f1":null,"seconds":3.997236490249634e-6,"exhaustive_search_seconds":1.5851110219955444e-6,"evaluations":6.359375,"distances_sum":582.2220985753239}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.267578125,"state":{"ssize":2,"bsize":1},"perf":{"precision":null,"recall":0.267578125,"f1":null,"seconds":3.997236490249634e-6,"exhaustive_search_seconds":1.5851110219955444e-6,"evaluations":6.359375,"distances_sum":582.2220985753239}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.54296875, conf: {"ssize":2,"bsize":3}, perf: {"precision":1.0,"recall":0.54296875,"f1":0.6857602466977473,"seconds":4.3977051973342896e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":7.6015625,"distances_sum":1181.898177537496}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6953125, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.6953125,"f1":0.8102387196137202,"seconds":4.895031452178955e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.3359375,"distances_sum":1570.6381604638707}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7890625, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.7890625,"f1":0.874444826007327,"seconds":5.584210157394409e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.5703125,"distances_sum":1841.3055471002895}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7890625,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.7890625,"f1":0.874444826007327,"seconds":5.584210157394409e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.5703125,"distances_sum":1841.3055471002895}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8876953125, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.8876953125,"f1":0.9366872710622717,"seconds":5.459412932395935e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.609375,"distances_sum":2229.5504240893865}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8388671875, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.8388671875,"f1":0.9053800366300373,"seconds":5.833804607391357e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.6875,"distances_sum":2033.474926421076}, best_list's length: 11, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.830078125, conf: {"ssize":3,"bsize":6}, perf: {"precision":1.0,"recall":0.830078125,"f1":0.8999490093240101,"seconds":5.811452865600586e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.640625,"distances_sum":2002.3093639737199}, best_list's length: 12, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8828125, conf: {"ssize":6,"bsize":7}, perf: {"precision":1.0,"recall":0.8828125,"f1":0.9321943681318687,"seconds":5.584210157394409e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.6796875,"distances_sum":2215.404527246751}, best_list's length: 13, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8876953125,"state":{"ssize":1,"bsize":7},"perf":{"precision":1.0,"recall":0.8876953125,"f1":0.9366872710622717,"seconds":5.459412932395935e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.609375,"distances_sum":2229.5504240893865}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9287109375, conf: {"ssize":1,"bsize":11}, perf: {"precision":1.0,"recall":0.9287109375,"f1":0.960233516483517,"seconds":5.83939254283905e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.875,"distances_sum":2379.705653419062}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.927734375, conf: {"ssize":7,"bsize":10}, perf: {"precision":1.0,"recall":0.927734375,"f1":0.9592891483516488,"seconds":6.632879376411438e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.8046875,"distances_sum":2422.4840855177717}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9111328125, conf: {"ssize":7,"bsize":9}, perf: {"precision":1.0,"recall":0.9111328125,"f1":0.9495421245421252,"seconds":6.034970283508301e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.8359375,"distances_sum":2309.7097950596967}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.904296875, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.904296875,"f1":0.9447146603396609,"seconds":5.768612027168274e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.8203125,"distances_sum":2295.395903093134}, best_list's length: 11, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.947265625, conf: {"ssize":4,"bsize":10}, perf: {"precision":1.0,"recall":0.947265625,"f1":0.9701865842490847,"seconds":5.949288606643677e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.9140625,"distances_sum":2471.5515737279984}, best_list's length: 12, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8916015625, conf: {"ssize":3,"bsize":8}, perf: {"precision":1.0,"recall":0.8916015625,"f1":0.9380723443223451,"seconds":5.738809704780579e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.734375,"distances_sum":2247.6352893777807}, best_list's length: 13, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9150390625, conf: {"ssize":5,"bsize":9}, perf: {"precision":1.0,"recall":0.9150390625,"f1":0.9506581959706963,"seconds":5.776062607765198e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.7578125,"distances_sum":2358.9714215193726}, best_list's length: 14, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.947265625,"state":{"ssize":4,"bsize":10},"perf":{"precision":1.0,"recall":0.947265625,"f1":0.9701865842490847,"seconds":5.949288606643677e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.9140625,"distances_sum":2471.5515737279984}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.947265625,"state":{"ssize":4,"bsize":10},"perf":{"precision":1.0,"recall":0.947265625,"f1":0.9701865842490847,"seconds":5.949288606643677e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.9140625,"distances_sum":2471.5515737279984}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.66796875, conf: {"ssize":4,"bsize":4}, perf: {"precision":1.0,"recall":0.66796875,"f1":0.7891592782217789,"seconds":4.8745423555374146e-6,"exhaustive_search_seconds":1.3746321201324463e-6,"evaluations":7.796875,"distances_sum":1575.8008004102853}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.3330078125, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.3330078125,"f1":null,"seconds":3.5278499126434326e-6,"exhaustive_search_seconds":1.3746321201324463e-6,"evaluations":5.046875,"distances_sum":777.8969517264417}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.66796875,"state":{"ssize":4,"bsize":4},"perf":{"precision":1.0,"recall":0.66796875,"f1":0.7891592782217789,"seconds":4.8745423555374146e-6,"exhaustive_search_seconds":1.3746321201324463e-6,"evaluations":7.796875,"distances_sum":1575.8008004102853}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8876953125, conf: {"ssize":5,"bsize":8}, perf: {"precision":1.0,"recall":0.8876953125,"f1":0.9344436813186819,"seconds":5.694106221199036e-6,"exhaustive_search_seconds":1.3746321201324463e-6,"evaluations":8.7265625,"distances_sum":2287.6212507957503}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8330078125, conf: {"ssize":5,"bsize":6}, perf: {"precision":1.0,"recall":0.8330078125,"f1":0.9017316017316024,"seconds":5.470588803291321e-6,"exhaustive_search_seconds":1.3746321201324463e-6,"evaluations":8.53125,"distances_sum":2046.670593273327}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7255859375, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.7255859375,"f1":0.8270259254634261,"seconds":4.991888999938965e-6,"exhaustive_search_seconds":1.3746321201324463e-6,"evaluations":8.1328125,"distances_sum":1725.4548725933828}, best_list's length: 7, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8876953125,"state":{"ssize":5,"bsize":8},"perf":{"precision":1.0,"recall":0.8876953125,"f1":0.9344436813186819,"seconds":5.694106221199036e-6,"exhaustive_search_seconds":1.3746321201324463e-6,"evaluations":8.7265625,"distances_sum":2287.6212507957503}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9462890625, conf: {"ssize":5,"bsize":10}, perf: {"precision":1.0,"recall":0.9462890625,"f1":0.9705013736263742,"seconds":5.964189767837524e-6,"exhaustive_search_seconds":1.3746321201324463e-6,"evaluations":8.9375,"distances_sum":2473.9687188182515}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8916015625, conf: {"ssize":3,"bsize":8}, perf: {"precision":1.0,"recall":0.8916015625,"f1":0.9364474067599075,"seconds":5.2638351917266846e-6,"exhaustive_search_seconds":1.3746321201324463e-6,"evaluations":8.6484375,"distances_sum":2335.821955167465}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.90234375, conf: {"ssize":6,"bsize":8}, perf: {"precision":1.0,"recall":0.90234375,"f1":0.9438530219780227,"seconds":5.9604644775390625e-6,"exhaustive_search_seconds":1.3746321201324463e-6,"evaluations":8.765625,"distances_sum":2337.00058487916}, best_list's length: 11, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.912109375, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.912109375,"f1":0.9504521520146525,"seconds":5.6978315114974976e-6,"exhaustive_search_seconds":1.3746321201324463e-6,"evaluations":8.8203125,"distances_sum":2359.21180962813}, best_list's length: 13, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9462890625,"state":{"ssize":5,"bsize":10},"perf":{"precision":1.0,"recall":0.9462890625,"f1":0.9705013736263742,"seconds":5.964189767837524e-6,"exhaustive_search_seconds":1.3746321201324463e-6,"evaluations":8.9375,"distances_sum":2473.9687188182515}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9462890625,"state":{"ssize":5,"bsize":10},"perf":{"precision":1.0,"recall":0.9462890625,"f1":0.9705013736263742,"seconds":5.964189767837524e-6,"exhaustive_search_seconds":1.3746321201324463e-6,"evaluations":8.9375,"distances_sum":2473.9687188182515}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5517578125, conf: {"ssize":3,"bsize":3}, perf: {"precision":1.0,"recall":0.5517578125,"f1":0.6980150058275063,"seconds":4.6137720346450806e-6,"exhaustive_search_seconds":1.3355165719985962e-6,"evaluations":7.8359375,"distances_sum":1196.363556302924}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2529296875, conf: {"ssize":2,"bsize":1}, perf: {"precision":null,"recall":0.2529296875,"f1":null,"seconds":3.5446137189865112e-6,"exhaustive_search_seconds":1.3355165719985962e-6,"evaluations":6.359375,"distances_sum":527.6183120564857}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.3974609375, conf: {"ssize":3,"bsize":2}, perf: {"precision":null,"recall":0.3974609375,"f1":null,"seconds":3.973022103309631e-6,"exhaustive_search_seconds":1.3355165719985962e-6,"evaluations":6.6171875,"distances_sum":833.3009854642988}, best_list's length: 4, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.41796875, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.41796875,"f1":null,"seconds":3.777444362640381e-6,"exhaustive_search_seconds":1.3355165719985962e-6,"evaluations":6.7890625,"distances_sum":886.9116547117817}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.5517578125,"state":{"ssize":3,"bsize":3},"perf":{"precision":1.0,"recall":0.5517578125,"f1":0.6980150058275063,"seconds":4.6137720346450806e-6,"exhaustive_search_seconds":1.3355165719985962e-6,"evaluations":7.8359375,"distances_sum":1196.363556302924}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.853515625, conf: {"ssize":2,"bsize":6}, perf: {"precision":1.0,"recall":0.853515625,"f1":0.9151161338661343,"seconds":5.433335900306702e-6,"exhaustive_search_seconds":1.3355165719985962e-6,"evaluations":8.84375,"distances_sum":2051.5215363287193}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7802734375, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.7802734375,"f1":0.8693655303030312,"seconds":4.949048161506653e-6,"exhaustive_search_seconds":1.3355165719985962e-6,"evaluations":8.5625,"distances_sum":1787.0270866203753}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7998046875, conf: {"ssize":4,"bsize":5}, perf: {"precision":1.0,"recall":0.7998046875,"f1":0.8821491008991018,"seconds":5.317851901054382e-6,"exhaustive_search_seconds":1.3355165719985962e-6,"evaluations":8.5625,"distances_sum":1868.9498903946294}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6796875, conf: {"ssize":2,"bsize":4}, perf: {"precision":1.0,"recall":0.6796875,"f1":0.7985899517149525,"seconds":5.073845386505127e-6,"exhaustive_search_seconds":1.3355165719985962e-6,"evaluations":8.3359375,"distances_sum":1496.2365306172496}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.853515625,"state":{"ssize":2,"bsize":6},"perf":{"precision":1.0,"recall":0.853515625,"f1":0.9151161338661343,"seconds":5.433335900306702e-6,"exhaustive_search_seconds":1.3355165719985962e-6,"evaluations":8.84375,"distances_sum":2051.5215363287193}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9521484375, conf: {"ssize":4,"bsize":10}, perf: {"precision":1.0,"recall":0.9521484375,"f1":0.9738667582417584,"seconds":6.3069164752960205e-6,"exhaustive_search_seconds":1.3355165719985962e-6,"evaluations":8.96875,"distances_sum":2412.222284284086}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.943359375, conf: {"ssize":4,"bsize":9}, perf: {"precision":1.0,"recall":0.943359375,"f1":0.9682348901098905,"seconds":6.008893251419067e-6,"exhaustive_search_seconds":1.3355165719985962e-6,"evaluations":8.9296875,"distances_sum":2384.021404493528}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.916015625, conf: {"ssize":7,"bsize":8}, perf: {"precision":1.0,"recall":0.916015625,"f1":0.9523523351648354,"seconds":5.805864930152893e-6,"exhaustive_search_seconds":1.3355165719985962e-6,"evaluations":8.921875,"distances_sum":2253.0679037936975}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9326171875, conf: {"ssize":2,"bsize":8}, perf: {"precision":1.0,"recall":0.9326171875,"f1":0.9603713994338997,"seconds":5.621463060379028e-6,"exhaustive_search_seconds":1.3355165719985962e-6,"evaluations":8.8984375,"distances_sum":2342.155476787606}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.86328125, conf: {"ssize":4,"bsize":6}, perf: {"precision":1.0,"recall":0.86328125,"f1":0.9221726190476199,"seconds":5.474314093589783e-6,"exhaustive_search_seconds":1.3355165719985962e-6,"evaluations":8.8046875,"distances_sum":2057.9810864269566}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9404296875, conf: {"ssize":5,"bsize":9}, perf: {"precision":1.0,"recall":0.9404296875,"f1":0.9671531593406598,"seconds":5.770474672317505e-6,"exhaustive_search_seconds":1.3355165719985962e-6,"evaluations":8.953125,"distances_sum":2353.9775908170272}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9521484375,"state":{"ssize":4,"bsize":10},"perf":{"precision":1.0,"recall":0.9521484375,"f1":0.9738667582417584,"seconds":6.3069164752960205e-6,"exhaustive_search_seconds":1.3355165719985962e-6,"evaluations":8.96875,"distances_sum":2412.222284284086}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9521484375,"state":{"ssize":4,"bsize":10},"perf":{"precision":1.0,"recall":0.9521484375,"f1":0.9738667582417584,"seconds":6.3069164752960205e-6,"exhaustive_search_seconds":1.3355165719985962e-6,"evaluations":8.96875,"distances_sum":2412.222284284086}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.53515625, conf: {"ssize":4,"bsize":3}, perf: {"precision":null,"recall":0.53515625,"f1":null,"seconds":7.1711838245391846e-6,"exhaustive_search_seconds":1.34296715259552e-6,"evaluations":7.0,"distances_sum":1141.8263760941481}, best_list's length: 2, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.53515625,"state":{"ssize":4,"bsize":3},"perf":{"precision":null,"recall":0.53515625,"f1":null,"seconds":7.1711838245391846e-6,"exhaustive_search_seconds":1.34296715259552e-6,"evaluations":7.0,"distances_sum":1141.8263760941481}}, beam: 2, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.53515625,"state":{"ssize":4,"bsize":3},"perf":{"precision":null,"recall":0.53515625,"f1":null,"seconds":7.1711838245391846e-6,"exhaustive_search_seconds":1.34296715259552e-6,"evaluations":7.0,"distances_sum":1141.8263760941481}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.53515625,"state":{"ssize":4,"bsize":3},"perf":{"precision":null,"recall":0.53515625,"f1":null,"seconds":7.1711838245391846e-6,"exhaustive_search_seconds":1.34296715259552e-6,"evaluations":7.0,"distances_sum":1141.8263760941481}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.375, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.375,"f1":null,"seconds":3.458932042121887e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":6.140625,"distances_sum":868.3400515722162}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.375,"state":{"ssize":1,"bsize":2},"perf":{"precision":null,"recall":0.375,"f1":null,"seconds":3.458932042121887e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":6.140625,"distances_sum":868.3400515722162}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5107421875, conf: {"ssize":1,"bsize":3}, perf: {"precision":1.0,"recall":0.5107421875,"f1":0.6608127983127988,"seconds":4.120171070098877e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":7.1328125,"distances_sum":1111.107747878644}, best_list's length: 4, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6748046875, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.6748046875,"f1":0.794224005161506,"seconds":4.684552550315857e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.1953125,"distances_sum":1480.3735857807271}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5400390625, conf: {"ssize":4,"bsize":3}, perf: {"precision":1.0,"recall":0.5400390625,"f1":0.6894667832167838,"seconds":4.295259714126587e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":7.34375,"distances_sum":1216.218010809263}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6806640625, conf: {"ssize":6,"bsize":4}, perf: {"precision":1.0,"recall":0.6806640625,"f1":0.7959188381063389,"seconds":5.597248673439026e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.1328125,"distances_sum":1496.3978701536341}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.52734375, conf: {"ssize":9,"bsize":3}, perf: {"precision":1.0,"recall":0.52734375,"f1":0.677825646575647,"seconds":4.1425228118896484e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":7.3984375,"distances_sum":1183.3877323804643}, best_list's length: 8, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.6806640625,"state":{"ssize":6,"bsize":4},"perf":{"precision":1.0,"recall":0.6806640625,"f1":0.7959188381063389,"seconds":5.597248673439026e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.1328125,"distances_sum":1496.3978701536341}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.767578125, conf: {"ssize":8,"bsize":5}, perf: {"precision":1.0,"recall":0.767578125,"f1":0.8579940892440899,"seconds":4.92483377456665e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.3046875,"distances_sum":1732.2593710635372}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.771484375, conf: {"ssize":3,"bsize":5}, perf: {"precision":1.0,"recall":0.771484375,"f1":0.8622695013320021,"seconds":5.085021257400513e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.359375,"distances_sum":1754.3128465793309}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.826171875, conf: {"ssize":8,"bsize":6}, perf: {"precision":1.0,"recall":0.826171875,"f1":0.8979655760905768,"seconds":5.172565579414368e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.5078125,"distances_sum":1938.4854084460142}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8388671875, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.8388671875,"f1":0.9070283882783889,"seconds":5.185604095458984e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.6171875,"distances_sum":1982.271848810074}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.830078125, conf: {"ssize":4,"bsize":6}, perf: {"precision":1.0,"recall":0.830078125,"f1":0.8996144480519488,"seconds":5.206093192100525e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.5546875,"distances_sum":1974.9874900853667}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7490234375, conf: {"ssize":5,"bsize":5}, perf: {"precision":1.0,"recall":0.7490234375,"f1":0.8471138236763246,"seconds":5.317851901054382e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.2578125,"distances_sum":1688.7378904383886}, best_list's length: 11, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8388671875,"state":{"ssize":1,"bsize":6},"perf":{"precision":1.0,"recall":0.8388671875,"f1":0.9070283882783889,"seconds":5.185604095458984e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.6171875,"distances_sum":1982.271848810074}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.8388671875,"state":{"ssize":1,"bsize":6},"perf":{"precision":1.0,"recall":0.8388671875,"f1":0.9070283882783889,"seconds":5.185604095458984e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.6171875,"distances_sum":1982.271848810074}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6728515625, conf: {"ssize":5,"bsize":4}, perf: {"precision":1.0,"recall":0.6728515625,"f1":0.7917733308358318,"seconds":4.634261131286621e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":7.7734375,"distances_sum":1487.668794464097}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2294921875, conf: {"ssize":5,"bsize":1}, perf: {"precision":null,"recall":0.2294921875,"f1":null,"seconds":3.296881914138794e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":6.1953125,"distances_sum":486.8979519115318}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.21875, conf: {"ssize":4,"bsize":1}, perf: {"precision":null,"recall":0.21875,"f1":null,"seconds":3.129243850708008e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":6.1171875,"distances_sum":452.3159772032325}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.6728515625,"state":{"ssize":5,"bsize":4},"perf":{"precision":1.0,"recall":0.6728515625,"f1":0.7917733308358318,"seconds":4.634261131286621e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":7.7734375,"distances_sum":1487.668794464097}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9111328125, conf: {"ssize":3,"bsize":8}, perf: {"precision":1.0,"recall":0.9111328125,"f1":0.9494677197802203,"seconds":5.60469925403595e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":8.796875,"distances_sum":2314.4025830203022}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.869140625, conf: {"ssize":2,"bsize":7}, perf: {"precision":1.0,"recall":0.869140625,"f1":0.9239703005328012,"seconds":5.288049578666687e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":8.7265625,"distances_sum":2126.1004931162033}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6767578125, conf: {"ssize":9,"bsize":4}, perf: {"precision":1.0,"recall":0.6767578125,"f1":0.7946515290265299,"seconds":4.610046744346619e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":7.734375,"distances_sum":1467.1181849651377}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7802734375, conf: {"ssize":7,"bsize":5}, perf: {"precision":1.0,"recall":0.7802734375,"f1":0.8679726523476532,"seconds":4.669651389122009e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":8.1640625,"distances_sum":1808.6971553591495}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.689453125, conf: {"ssize":4,"bsize":4}, perf: {"precision":1.0,"recall":0.689453125,"f1":0.8062146187146194,"seconds":4.643574357032776e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":7.7421875,"distances_sum":1505.5505385508407}, best_list's length: 11, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6865234375, conf: {"ssize":7,"bsize":4}, perf: {"precision":1.0,"recall":0.6865234375,"f1":0.8028580794205802,"seconds":4.600733518600464e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":7.90625,"distances_sum":1527.727229491032}, best_list's length: 12, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9111328125,"state":{"ssize":3,"bsize":8},"perf":{"precision":1.0,"recall":0.9111328125,"f1":0.9494677197802203,"seconds":5.60469925403595e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":8.796875,"distances_sum":2314.4025830203022}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9296875, conf: {"ssize":7,"bsize":9}, perf: {"precision":1.0,"recall":0.9296875,"f1":0.9604967948717952,"seconds":5.3085386753082275e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":8.828125,"distances_sum":2378.6998312167602}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9267578125, conf: {"ssize":5,"bsize":9}, perf: {"precision":1.0,"recall":0.9267578125,"f1":0.9581704753579758,"seconds":5.5264681577682495e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":8.8828125,"distances_sum":2352.170998309241}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.951171875, conf: {"ssize":1,"bsize":11}, perf: {"precision":1.0,"recall":0.951171875,"f1":0.9726591117216121,"seconds":5.515292286872864e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":8.96875,"distances_sum":2435.2515006990293}, best_list's length: 8, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.951171875,"state":{"ssize":1,"bsize":11},"perf":{"precision":1.0,"recall":0.951171875,"f1":0.9726591117216121,"seconds":5.515292286872864e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":8.96875,"distances_sum":2435.2515006990293}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.951171875,"state":{"ssize":1,"bsize":11},"perf":{"precision":1.0,"recall":0.951171875,"f1":0.9726591117216121,"seconds":5.515292286872864e-6,"exhaustive_search_seconds":1.2423843145370483e-6,"evaluations":8.96875,"distances_sum":2435.2515006990293}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.59375, conf: {"ssize":1,"bsize":4}, perf: {"precision":0.9631510416666665,"recall":0.59375,"f1":0.7260195533633036,"seconds":4.241243004798889e-6,"exhaustive_search_seconds":1.2330710887908936e-6,"evaluations":7.4765625,"distances_sum":971.0780332374712}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2275390625, conf: {"ssize":4,"bsize":1}, perf: {"precision":null,"recall":0.2275390625,"f1":null,"seconds":3.1795352697372437e-6,"exhaustive_search_seconds":1.2330710887908936e-6,"evaluations":6.5078125,"distances_sum":425.837344468597}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.59375,"state":{"ssize":1,"bsize":4},"perf":{"precision":0.9631510416666665,"recall":0.59375,"f1":0.7260195533633036,"seconds":4.241243004798889e-6,"exhaustive_search_seconds":1.2330710887908936e-6,"evaluations":7.4765625,"distances_sum":971.0780332374712}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6181640625, conf: {"ssize":4,"bsize":4}, perf: {"precision":0.9654947916666664,"recall":0.6181640625,"f1":0.7451119193306696,"seconds":4.559755325317383e-6,"exhaustive_search_seconds":1.2330710887908936e-6,"evaluations":7.59375,"distances_sum":1083.2069882054186}, best_list's length: 4, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.740234375, conf: {"ssize":1,"bsize":5}, perf: {"precision":0.9712332589285713,"recall":0.740234375,"f1":0.83269965711372,"seconds":4.868954420089722e-6,"exhaustive_search_seconds":1.2330710887908936e-6,"evaluations":8.0,"distances_sum":1308.2672315901086}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.740234375,"state":{"ssize":1,"bsize":5},"perf":{"precision":0.9712332589285713,"recall":0.740234375,"f1":0.83269965711372,"seconds":4.868954420089722e-6,"exhaustive_search_seconds":1.2330710887908936e-6,"evaluations":8.0,"distances_sum":1308.2672315901086}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.787109375, conf: {"ssize":2,"bsize":6}, perf: {"precision":0.9713727678571429,"recall":0.787109375,"f1":0.8642585279304033,"seconds":6.234273314476013e-6,"exhaustive_search_seconds":1.2330710887908936e-6,"evaluations":8.5703125,"distances_sum":1424.8876807510946}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8388671875, conf: {"ssize":3,"bsize":7}, perf: {"precision":0.9718563988095238,"recall":0.8388671875,"f1":0.895431261446887,"seconds":5.364418029785156e-6,"exhaustive_search_seconds":1.2330710887908936e-6,"evaluations":8.7734375,"distances_sum":1578.971551180545}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8291015625, conf: {"ssize":1,"bsize":7}, perf: {"precision":0.9739304315476192,"recall":0.8291015625,"f1":0.8902808779761909,"seconds":5.343928933143616e-6,"exhaustive_search_seconds":1.2330710887908936e-6,"evaluations":8.6875,"distances_sum":1563.7085402760924}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8369140625, conf: {"ssize":7,"bsize":7}, perf: {"precision":0.971586681547619,"recall":0.8369140625,"f1":0.8929852048992678,"seconds":5.168840289115906e-6,"exhaustive_search_seconds":1.2330710887908936e-6,"evaluations":8.7109375,"distances_sum":1584.5631103194785}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8388671875,"state":{"ssize":3,"bsize":7},"perf":{"precision":0.9718563988095238,"recall":0.8388671875,"f1":0.895431261446887,"seconds":5.364418029785156e-6,"exhaustive_search_seconds":1.2330710887908936e-6,"evaluations":8.7734375,"distances_sum":1578.971551180545}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.8388671875,"state":{"ssize":3,"bsize":7},"perf":{"precision":0.9718563988095238,"recall":0.8388671875,"f1":0.895431261446887,"seconds":5.364418029785156e-6,"exhaustive_search_seconds":1.2330710887908936e-6,"evaluations":8.7734375,"distances_sum":1578.971551180545}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.3798828125, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.3798828125,"f1":null,"seconds":3.343448042869568e-6,"exhaustive_search_seconds":1.3057142496109009e-6,"evaluations":6.0078125,"distances_sum":665.678468746879}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.212890625, conf: {"ssize":5,"bsize":1}, perf: {"precision":null,"recall":0.212890625,"f1":null,"seconds":2.9187649488449097e-6,"exhaustive_search_seconds":1.3057142496109009e-6,"evaluations":5.5546875,"distances_sum":359.44728448715847}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.3798828125,"state":{"ssize":1,"bsize":2},"perf":{"precision":null,"recall":0.3798828125,"f1":null,"seconds":3.343448042869568e-6,"exhaustive_search_seconds":1.3057142496109009e-6,"evaluations":6.0078125,"distances_sum":665.678468746879}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.50390625, conf: {"ssize":1,"bsize":3}, perf: {"precision":1.0,"recall":0.50390625,"f1":0.6523497335997341,"seconds":3.866851329803467e-6,"exhaustive_search_seconds":1.3057142496109009e-6,"evaluations":6.8125,"distances_sum":892.1100899454697}, best_list's length: 4, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7890625, conf: {"ssize":5,"bsize":5}, perf: {"precision":1.0,"recall":0.7890625,"f1":0.8747429653679663,"seconds":4.94346022605896e-6,"exhaustive_search_seconds":1.3057142496109009e-6,"evaluations":8.515625,"distances_sum":1397.0552634144863}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7890625,"state":{"ssize":5,"bsize":5},"perf":{"precision":1.0,"recall":0.7890625,"f1":0.8747429653679663,"seconds":4.94346022605896e-6,"exhaustive_search_seconds":1.3057142496109009e-6,"evaluations":8.515625,"distances_sum":1397.0552634144863}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8291015625, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.8291015625,"f1":0.8973250707625715,"seconds":5.2247196435928345e-6,"exhaustive_search_seconds":1.3057142496109009e-6,"evaluations":8.7265625,"distances_sum":1545.873091385498}, best_list's length: 8, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8291015625,"state":{"ssize":1,"bsize":6},"perf":{"precision":1.0,"recall":0.8291015625,"f1":0.8973250707625715,"seconds":5.2247196435928345e-6,"exhaustive_search_seconds":1.3057142496109009e-6,"evaluations":8.7265625,"distances_sum":1545.873091385498}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.8291015625,"state":{"ssize":1,"bsize":6},"perf":{"precision":1.0,"recall":0.8291015625,"f1":0.8973250707625715,"seconds":5.2247196435928345e-6,"exhaustive_search_seconds":1.3057142496109009e-6,"evaluations":8.7265625,"distances_sum":1545.873091385498}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5263671875, conf: {"ssize":2,"bsize":3}, perf: {"precision":null,"recall":0.5263671875,"f1":null,"seconds":4.213303327560425e-6,"exhaustive_search_seconds":1.3671815395355225e-6,"evaluations":6.71875,"distances_sum":847.134549584145}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2216796875, conf: {"ssize":2,"bsize":1}, perf: {"precision":null,"recall":0.2216796875,"f1":null,"seconds":3.341585397720337e-6,"exhaustive_search_seconds":1.3671815395355225e-6,"evaluations":5.140625,"distances_sum":442.80482470700645}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5732421875, conf: {"ssize":1,"bsize":3}, perf: {"precision":null,"recall":0.5732421875,"f1":null,"seconds":4.248693585395813e-6,"exhaustive_search_seconds":1.3671815395355225e-6,"evaluations":7.171875,"distances_sum":930.5339835000002}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.5732421875,"state":{"ssize":1,"bsize":3},"perf":{"precision":null,"recall":0.5732421875,"f1":null,"seconds":4.248693585395813e-6,"exhaustive_search_seconds":1.3671815395355225e-6,"evaluations":7.171875,"distances_sum":930.5339835000002}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8173828125, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.8173828125,"f1":0.8917702089577098,"seconds":5.25452196598053e-6,"exhaustive_search_seconds":1.3671815395355225e-6,"evaluations":8.3515625,"distances_sum":1528.7692435814836}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.583984375, conf: {"ssize":3,"bsize":3}, perf: {"precision":1.0,"recall":0.583984375,"f1":0.7205157689532695,"seconds":4.10713255405426e-6,"exhaustive_search_seconds":1.3671815395355225e-6,"evaluations":7.203125,"distances_sum":967.956278861455}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.64453125, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.64453125,"f1":0.7697304431679439,"seconds":4.4014304876327515e-6,"exhaustive_search_seconds":1.3671815395355225e-6,"evaluations":7.6796875,"distances_sum":1102.2144165085915}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8173828125,"state":{"ssize":1,"bsize":6},"perf":{"precision":1.0,"recall":0.8173828125,"f1":0.8917702089577098,"seconds":5.25452196598053e-6,"exhaustive_search_seconds":1.3671815395355225e-6,"evaluations":8.3515625,"distances_sum":1528.7692435814836}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8408203125, conf: {"ssize":2,"bsize":6}, perf: {"precision":1.0,"recall":0.8408203125,"f1":0.9074607683982692,"seconds":5.025416612625122e-6,"exhaustive_search_seconds":1.3671815395355225e-6,"evaluations":8.4609375,"distances_sum":1615.9625868486228}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.87109375, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.87109375,"f1":0.9224676365301373,"seconds":5.500391125679016e-6,"exhaustive_search_seconds":1.3671815395355225e-6,"evaluations":8.6015625,"distances_sum":1739.6715264811799}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8662109375, conf: {"ssize":6,"bsize":7}, perf: {"precision":1.0,"recall":0.8662109375,"f1":0.9218895687645693,"seconds":5.364418029785156e-6,"exhaustive_search_seconds":1.3671815395355225e-6,"evaluations":8.6171875,"distances_sum":1708.5029174306853}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.87109375,"state":{"ssize":1,"bsize":7},"perf":{"precision":1.0,"recall":0.87109375,"f1":0.9224676365301373,"seconds":5.500391125679016e-6,"exhaustive_search_seconds":1.3671815395355225e-6,"evaluations":8.6015625,"distances_sum":1739.6715264811799}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.87109375,"state":{"ssize":1,"bsize":7},"perf":{"precision":1.0,"recall":0.87109375,"f1":0.9224676365301373,"seconds":5.500391125679016e-6,"exhaustive_search_seconds":1.3671815395355225e-6,"evaluations":8.6015625,"distances_sum":1739.6715264811799}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.46875, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.46875,"f1":null,"seconds":3.777444362640381e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":6.8046875,"distances_sum":841.96370430516}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2822265625, conf: {"ssize":3,"bsize":1}, perf: {"precision":null,"recall":0.2822265625,"f1":null,"seconds":3.3490359783172607e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":6.8984375,"distances_sum":510.5992734601792}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2587890625, conf: {"ssize":5,"bsize":1}, perf: {"precision":null,"recall":0.2587890625,"f1":null,"seconds":3.388151526451111e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":6.59375,"distances_sum":428.25892627197203}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.46875,"state":{"ssize":1,"bsize":2},"perf":{"precision":null,"recall":0.46875,"f1":null,"seconds":3.777444362640381e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":6.8046875,"distances_sum":841.96370430516}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5986328125, conf: {"ssize":1,"bsize":3}, perf: {"precision":1.0,"recall":0.5986328125,"f1":0.7358237248862254,"seconds":4.3101608753204346e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":7.3359375,"distances_sum":1060.7252233776017}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5498046875, conf: {"ssize":5,"bsize":3}, perf: {"precision":1.0,"recall":0.5498046875,"f1":0.6940503940503947,"seconds":4.3138861656188965e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":6.9453125,"distances_sum":913.3481153107195}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.65234375, conf: {"ssize":7,"bsize":4}, perf: {"precision":1.0,"recall":0.65234375,"f1":0.7802619255744263,"seconds":4.559755325317383e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":7.5859375,"distances_sum":1182.622459636696}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5546875, conf: {"ssize":8,"bsize":3}, perf: {"precision":1.0,"recall":0.5546875,"f1":0.6972354034854042,"seconds":4.131346940994263e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":6.9453125,"distances_sum":945.5574617454362}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.65234375,"state":{"ssize":7,"bsize":4},"perf":{"precision":1.0,"recall":0.65234375,"f1":0.7802619255744263,"seconds":4.559755325317383e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":7.5859375,"distances_sum":1182.622459636696}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8291015625, conf: {"ssize":3,"bsize":6}, perf: {"precision":1.0,"recall":0.8291015625,"f1":0.9013850732600739,"seconds":5.368143320083618e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.765625,"distances_sum":1642.4259659737531}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6728515625, conf: {"ssize":9,"bsize":4}, perf: {"precision":1.0,"recall":0.6728515625,"f1":0.7930198273948282,"seconds":4.420056939125061e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":7.828125,"distances_sum":1222.038538298294}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6630859375, conf: {"ssize":12,"bsize":4}, perf: {"precision":1.0,"recall":0.6630859375,"f1":0.7898819930069939,"seconds":4.4871121644973755e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":7.7109375,"distances_sum":1187.8579769691519}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.888671875, conf: {"ssize":2,"bsize":7}, perf: {"precision":1.0,"recall":0.888671875,"f1":0.9377690018315025,"seconds":5.537644028663635e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.953125,"distances_sum":1824.5038623815747}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.888671875,"state":{"ssize":2,"bsize":7},"perf":{"precision":1.0,"recall":0.888671875,"f1":0.9377690018315025,"seconds":5.537644028663635e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.953125,"distances_sum":1824.5038623815747}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.888671875,"state":{"ssize":2,"bsize":7},"perf":{"precision":1.0,"recall":0.888671875,"f1":0.9377690018315025,"seconds":5.537644028663635e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.953125,"distances_sum":1824.5038623815747}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7353515625, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.7353515625,"f1":0.8393720862470871,"seconds":4.7925859689712524e-6,"exhaustive_search_seconds":1.4062970876693726e-6,"evaluations":8.125,"distances_sum":1457.7927017144625}, best_list's length: 2, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7353515625,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.7353515625,"f1":0.8393720862470871,"seconds":4.7925859689712524e-6,"exhaustive_search_seconds":1.4062970876693726e-6,"evaluations":8.125,"distances_sum":1457.7927017144625}}, beam: 2, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8935546875, conf: {"ssize":2,"bsize":7}, perf: {"precision":1.0,"recall":0.8935546875,"f1":0.9381269771894776,"seconds":5.41098415851593e-6,"exhaustive_search_seconds":1.4062970876693726e-6,"evaluations":8.7421875,"distances_sum":1901.3439264449025}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8935546875,"state":{"ssize":2,"bsize":7},"perf":{"precision":1.0,"recall":0.8935546875,"f1":0.9381269771894776,"seconds":5.41098415851593e-6,"exhaustive_search_seconds":1.4062970876693726e-6,"evaluations":8.7421875,"distances_sum":1901.3439264449025}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9404296875, conf: {"ssize":5,"bsize":11}, perf: {"precision":1.0,"recall":0.9404296875,"f1":0.9663747710622717,"seconds":5.695968866348267e-6,"exhaustive_search_seconds":1.4062970876693726e-6,"evaluations":8.8828125,"distances_sum":2061.671433332112}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9326171875, conf: {"ssize":2,"bsize":10}, perf: {"precision":1.0,"recall":0.9326171875,"f1":0.9619448260073267,"seconds":5.552545189857483e-6,"exhaustive_search_seconds":1.4062970876693726e-6,"evaluations":8.8671875,"distances_sum":2033.7182896395113}, best_list's length: 6, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9404296875,"state":{"ssize":5,"bsize":11},"perf":{"precision":1.0,"recall":0.9404296875,"f1":0.9663747710622717,"seconds":5.695968866348267e-6,"exhaustive_search_seconds":1.4062970876693726e-6,"evaluations":8.8828125,"distances_sum":2061.671433332112}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9404296875,"state":{"ssize":5,"bsize":11},"perf":{"precision":1.0,"recall":0.9404296875,"f1":0.9663747710622717,"seconds":5.695968866348267e-6,"exhaustive_search_seconds":1.4062970876693726e-6,"evaluations":8.8828125,"distances_sum":2061.671433332112}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.3896484375, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.3896484375,"f1":null,"seconds":3.5353004932403564e-6,"exhaustive_search_seconds":1.298263669013977e-6,"evaluations":5.8359375,"distances_sum":646.3388644252515}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2275390625, conf: {"ssize":5,"bsize":1}, perf: {"precision":null,"recall":0.2275390625,"f1":null,"seconds":3.3192336559295654e-6,"exhaustive_search_seconds":1.298263669013977e-6,"evaluations":5.8359375,"distances_sum":452.09932023806437}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.4248046875, conf: {"ssize":2,"bsize":2}, perf: {"precision":null,"recall":0.4248046875,"f1":null,"seconds":3.676861524581909e-6,"exhaustive_search_seconds":1.298263669013977e-6,"evaluations":6.109375,"distances_sum":782.9100421235026}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.4248046875,"state":{"ssize":2,"bsize":2},"perf":{"precision":null,"recall":0.4248046875,"f1":null,"seconds":3.676861524581909e-6,"exhaustive_search_seconds":1.298263669013977e-6,"evaluations":6.109375,"distances_sum":782.9100421235026}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8173828125, conf: {"ssize":6,"bsize":6}, perf: {"precision":1.0,"recall":0.8173828125,"f1":0.894660027472528,"seconds":5.219131708145142e-6,"exhaustive_search_seconds":1.298263669013977e-6,"evaluations":8.3203125,"distances_sum":1678.133665209746}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.75, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.75,"f1":0.8477309149184159,"seconds":4.991888999938965e-6,"exhaustive_search_seconds":1.298263669013977e-6,"evaluations":8.0859375,"distances_sum":1482.7653639614537}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8173828125,"state":{"ssize":6,"bsize":6},"perf":{"precision":1.0,"recall":0.8173828125,"f1":0.894660027472528,"seconds":5.219131708145142e-6,"exhaustive_search_seconds":1.298263669013977e-6,"evaluations":8.3203125,"distances_sum":1678.133665209746}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8671875, conf: {"ssize":9,"bsize":7}, perf: {"precision":1.0,"recall":0.8671875,"f1":0.924012966200467,"seconds":5.168840289115906e-6,"exhaustive_search_seconds":1.298263669013977e-6,"evaluations":8.5234375,"distances_sum":1841.3355234998428}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9326171875, conf: {"ssize":3,"bsize":9}, perf: {"precision":1.0,"recall":0.9326171875,"f1":0.9615956959706965,"seconds":5.4836273193359375e-6,"exhaustive_search_seconds":1.298263669013977e-6,"evaluations":8.90625,"distances_sum":2039.7043305865661}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8193359375, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.8193359375,"f1":0.8947744963369971,"seconds":5.248934030532837e-6,"exhaustive_search_seconds":1.298263669013977e-6,"evaluations":8.3359375,"distances_sum":1681.4005649718385}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.861328125, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.861328125,"f1":0.9211252289377297,"seconds":5.710870027542114e-6,"exhaustive_search_seconds":1.298263669013977e-6,"evaluations":8.515625,"distances_sum":1816.63685424894}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9326171875,"state":{"ssize":3,"bsize":9},"perf":{"precision":1.0,"recall":0.9326171875,"f1":0.9615956959706965,"seconds":5.4836273193359375e-6,"exhaustive_search_seconds":1.298263669013977e-6,"evaluations":8.90625,"distances_sum":2039.7043305865661}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9326171875,"state":{"ssize":3,"bsize":9},"perf":{"precision":1.0,"recall":0.9326171875,"f1":0.9615956959706965,"seconds":5.4836273193359375e-6,"exhaustive_search_seconds":1.298263669013977e-6,"evaluations":8.90625,"distances_sum":2039.7043305865661}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.349609375, conf: {"ssize":2,"bsize":2}, perf: {"precision":null,"recall":0.349609375,"f1":null,"seconds":3.3657997846603394e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":5.5390625,"distances_sum":564.8959649264792}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.74609375, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.74609375,"f1":0.8475623334998346,"seconds":4.881992936134338e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":7.9296875,"distances_sum":1475.6310079417146}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.74609375,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.74609375,"f1":0.8475623334998346,"seconds":4.881992936134338e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":7.9296875,"distances_sum":1475.6310079417146}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.802734375, conf: {"ssize":5,"bsize":6}, perf: {"precision":1.0,"recall":0.802734375,"f1":0.8837860056610066,"seconds":5.034729838371277e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.2421875,"distances_sum":1622.7550375276278}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8115234375, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.8115234375,"f1":0.8888049450549458,"seconds":4.980713129043579e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.2734375,"distances_sum":1671.1303966148453}, best_list's length: 6, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8115234375,"state":{"ssize":1,"bsize":6},"perf":{"precision":1.0,"recall":0.8115234375,"f1":0.8888049450549458,"seconds":4.980713129043579e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.2734375,"distances_sum":1671.1303966148453}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.939453125, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.939453125,"f1":0.966317536630037,"seconds":5.427747964859009e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.8984375,"distances_sum":2047.4913892381535}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.939453125,"state":{"ssize":1,"bsize":9},"perf":{"precision":1.0,"recall":0.939453125,"f1":0.966317536630037,"seconds":5.427747964859009e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.8984375,"distances_sum":2047.4913892381535}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.939453125,"state":{"ssize":1,"bsize":9},"perf":{"precision":1.0,"recall":0.939453125,"f1":0.966317536630037,"seconds":5.427747964859009e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.8984375,"distances_sum":2047.4913892381535}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.759765625, conf: {"ssize":2,"bsize":5}, perf: {"precision":1.0,"recall":0.759765625,"f1":0.8541687479187487,"seconds":5.1353126764297485e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.6171875,"distances_sum":1468.6901810423278}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.578125, conf: {"ssize":1,"bsize":3}, perf: {"precision":1.0,"recall":0.578125,"f1":0.7195048007548015,"seconds":4.189088940620422e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":7.5859375,"distances_sum":1014.4508073985465}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.759765625, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.759765625,"f1":0.8551432942057953,"seconds":4.809349775314331e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.46875,"distances_sum":1464.2169855800769}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.759765625,"state":{"ssize":2,"bsize":5},"perf":{"precision":1.0,"recall":0.759765625,"f1":0.8541687479187487,"seconds":5.1353126764297485e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.6171875,"distances_sum":1468.6901810423278}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.81640625, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.81640625,"f1":0.8921620046620052,"seconds":5.23589551448822e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.4765625,"distances_sum":1640.6120246281218}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.931640625, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.931640625,"f1":0.9619448260073263,"seconds":5.533918738365173e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.8671875,"distances_sum":2014.4797250224117}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.875, conf: {"ssize":4,"bsize":7}, perf: {"precision":1.0,"recall":0.875,"f1":0.9277446511821518,"seconds":5.3122639656066895e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.734375,"distances_sum":1808.129020808023}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7734375, conf: {"ssize":3,"bsize":5}, perf: {"precision":1.0,"recall":0.7734375,"f1":0.8648955211455219,"seconds":5.023553967475891e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.625,"distances_sum":1498.8203462334282}, best_list's length: 11, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7705078125, conf: {"ssize":5,"bsize":5}, perf: {"precision":1.0,"recall":0.7705078125,"f1":0.861687271062272,"seconds":5.202367901802063e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.5859375,"distances_sum":1488.8443339622077}, best_list's length: 12, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.931640625,"state":{"ssize":1,"bsize":9},"perf":{"precision":1.0,"recall":0.931640625,"f1":0.9619448260073263,"seconds":5.533918738365173e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.8671875,"distances_sum":2014.4797250224117}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9541015625, conf: {"ssize":2,"bsize":10}, perf: {"precision":1.0,"recall":0.9541015625,"f1":0.9749084249084253,"seconds":5.826354026794434e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.9609375,"distances_sum":2084.0252117864934}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9326171875, conf: {"ssize":1,"bsize":10}, perf: {"precision":1.0,"recall":0.9326171875,"f1":0.9623569139194146,"seconds":4.510022699832916e-5,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.8828125,"distances_sum":2012.8599313166735}, best_list's length: 8, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9541015625,"state":{"ssize":2,"bsize":10},"perf":{"precision":1.0,"recall":0.9541015625,"f1":0.9749084249084253,"seconds":5.826354026794434e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.9609375,"distances_sum":2084.0252117864934}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9541015625,"state":{"ssize":2,"bsize":10},"perf":{"precision":1.0,"recall":0.9541015625,"f1":0.9749084249084253,"seconds":5.826354026794434e-6,"exhaustive_search_seconds":1.2665987014770508e-6,"evaluations":8.9609375,"distances_sum":2084.0252117864934}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.203125, conf: {"ssize":3,"bsize":1}, perf: {"precision":null,"recall":0.203125,"f1":null,"seconds":2.86102294921875e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":5.0859375,"distances_sum":421.37047371101863}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.201171875, conf: {"ssize":2,"bsize":1}, perf: {"precision":null,"recall":0.201171875,"f1":null,"seconds":3.0212104320526123e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":5.078125,"distances_sum":426.16691885262935}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.203125,"state":{"ssize":3,"bsize":1},"perf":{"precision":null,"recall":0.203125,"f1":null,"seconds":2.86102294921875e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":5.0859375,"distances_sum":421.37047371101863}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6611328125, conf: {"ssize":2,"bsize":4}, perf: {"precision":1.0,"recall":0.6611328125,"f1":0.7864838286713294,"seconds":4.578381776809692e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.0546875,"distances_sum":1248.988668088052}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.6611328125,"state":{"ssize":2,"bsize":4},"perf":{"precision":1.0,"recall":0.6611328125,"f1":0.7864838286713294,"seconds":4.578381776809692e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.0546875,"distances_sum":1248.988668088052}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.84765625, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.84765625,"f1":0.9090747793872801,"seconds":5.29363751411438e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.6796875,"distances_sum":1784.4894533414047}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8759765625, conf: {"ssize":4,"bsize":7}, perf: {"precision":1.0,"recall":0.8759765625,"f1":0.9283997252747259,"seconds":5.973502993583679e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.8203125,"distances_sum":1864.9029672830845}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8759765625, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.8759765625,"f1":0.9275812728937735,"seconds":5.3122639656066895e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.6015625,"distances_sum":1926.1773581072673}, best_list's length: 7, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8759765625,"state":{"ssize":4,"bsize":7},"perf":{"precision":1.0,"recall":0.8759765625,"f1":0.9283997252747259,"seconds":5.973502993583679e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.8203125,"distances_sum":1864.9029672830845}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.8759765625,"state":{"ssize":4,"bsize":7},"perf":{"precision":1.0,"recall":0.8759765625,"f1":0.9283997252747259,"seconds":5.973502993583679e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":8.8203125,"distances_sum":1864.9029672830845}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.18359375, conf: {"ssize":2,"bsize":1}, perf: {"precision":null,"recall":0.18359375,"f1":null,"seconds":2.862885594367981e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":4.8828125,"distances_sum":372.0318417370847}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.220703125, conf: {"ssize":3,"bsize":1}, perf: {"precision":null,"recall":0.220703125,"f1":null,"seconds":3.03611159324646e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":5.421875,"distances_sum":497.79618066358853}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.18359375, conf: {"ssize":5,"bsize":1}, perf: {"precision":null,"recall":0.18359375,"f1":null,"seconds":2.9224902391433716e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":5.2265625,"distances_sum":385.4390441588631}, best_list's length: 4, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7412109375, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.7412109375,"f1":0.8412956834831843,"seconds":4.816800355911255e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.0234375,"distances_sum":1451.244811016532}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7412109375,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.7412109375,"f1":0.8412956834831843,"seconds":4.816800355911255e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.0234375,"distances_sum":1451.244811016532}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8974609375, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.8974609375,"f1":0.9406936813186819,"seconds":5.153939127922058e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.6484375,"distances_sum":2011.9350054942915}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.830078125, conf: {"ssize":5,"bsize":6}, perf: {"precision":1.0,"recall":0.830078125,"f1":0.8993754509379519,"seconds":5.116686224937439e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.328125,"distances_sum":1739.115465012446}, best_list's length: 8, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8974609375,"state":{"ssize":1,"bsize":8},"perf":{"precision":1.0,"recall":0.8974609375,"f1":0.9406936813186819,"seconds":5.153939127922058e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.6484375,"distances_sum":2011.9350054942915}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.939453125, conf: {"ssize":1,"bsize":10}, perf: {"precision":1.0,"recall":0.939453125,"f1":0.966409111721612,"seconds":5.461275577545166e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.828125,"distances_sum":2119.7361994561393}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.919921875, conf: {"ssize":3,"bsize":10}, perf: {"precision":1.0,"recall":0.919921875,"f1":0.9554372710622717,"seconds":5.323439836502075e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.828125,"distances_sum":2050.5618967308997}, best_list's length: 7, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.939453125,"state":{"ssize":1,"bsize":10},"perf":{"precision":1.0,"recall":0.939453125,"f1":0.966409111721612,"seconds":5.461275577545166e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.828125,"distances_sum":2119.7361994561393}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.939453125,"state":{"ssize":1,"bsize":10},"perf":{"precision":1.0,"recall":0.939453125,"f1":0.966409111721612,"seconds":5.461275577545166e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.828125,"distances_sum":2119.7361994561393}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.447265625, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.447265625,"f1":null,"seconds":3.8016587495803833e-6,"exhaustive_search_seconds":1.1883676052093506e-6,"evaluations":6.375,"distances_sum":788.9224845805944}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7861328125, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.7861328125,"f1":0.8737325174825185,"seconds":4.734843969345093e-6,"exhaustive_search_seconds":1.1883676052093506e-6,"evaluations":8.234375,"distances_sum":1599.4892687772765}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6474609375, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.6474609375,"f1":0.7741002053502061,"seconds":5.2228569984436035e-6,"exhaustive_search_seconds":1.1883676052093506e-6,"evaluations":7.953125,"distances_sum":1250.8719185349314}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7861328125,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.7861328125,"f1":0.8737325174825185,"seconds":4.734843969345093e-6,"exhaustive_search_seconds":1.1883676052093506e-6,"evaluations":8.234375,"distances_sum":1599.4892687772765}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.853515625, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.853515625,"f1":0.9161718489843498,"seconds":5.217269062995911e-6,"exhaustive_search_seconds":1.1883676052093506e-6,"evaluations":8.421875,"distances_sum":1802.8124169678313}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.943359375, conf: {"ssize":3,"bsize":9}, perf: {"precision":1.0,"recall":0.943359375,"f1":0.9689732142857145,"seconds":5.982816219329834e-6,"exhaustive_search_seconds":1.1883676052093506e-6,"evaluations":8.8359375,"distances_sum":2148.668705934252}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.84375, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.84375,"f1":0.9073697136197144,"seconds":5.016103386878967e-6,"exhaustive_search_seconds":1.1883676052093506e-6,"evaluations":8.4375,"distances_sum":1827.2974824954229}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.943359375,"state":{"ssize":3,"bsize":9},"perf":{"precision":1.0,"recall":0.943359375,"f1":0.9689732142857145,"seconds":5.982816219329834e-6,"exhaustive_search_seconds":1.1883676052093506e-6,"evaluations":8.8359375,"distances_sum":2148.668705934252}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.966796875, conf: {"ssize":6,"bsize":13}, perf: {"precision":1.0,"recall":0.966796875,"f1":0.9817536630036632,"seconds":5.992129445075989e-6,"exhaustive_search_seconds":1.1883676052093506e-6,"evaluations":8.9296875,"distances_sum":2207.917657859675}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.95703125, conf: {"ssize":5,"bsize":11}, perf: {"precision":1.0,"recall":0.95703125,"f1":0.9765625000000004,"seconds":5.926936864852905e-6,"exhaustive_search_seconds":1.1883676052093506e-6,"evaluations":8.9140625,"distances_sum":2181.5957343377104}, best_list's length: 8, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.966796875,"state":{"ssize":6,"bsize":13},"perf":{"precision":1.0,"recall":0.966796875,"f1":0.9817536630036632,"seconds":5.992129445075989e-6,"exhaustive_search_seconds":1.1883676052093506e-6,"evaluations":8.9296875,"distances_sum":2207.917657859675}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.966796875,"state":{"ssize":6,"bsize":13},"perf":{"precision":1.0,"recall":0.966796875,"f1":0.9817536630036632,"seconds":5.992129445075989e-6,"exhaustive_search_seconds":1.1883676052093506e-6,"evaluations":8.9296875,"distances_sum":2207.917657859675}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.759765625, conf: {"ssize":2,"bsize":5}, perf: {"precision":1.0,"recall":0.759765625,"f1":0.8557442557442566,"seconds":5.1781535148620605e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.0546875,"distances_sum":1620.4809808350826}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.66796875, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.66796875,"f1":0.7846696706071714,"seconds":4.459172487258911e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":7.4765625,"distances_sum":1359.7045823434653}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5771484375, conf: {"ssize":1,"bsize":3}, perf: {"precision":1.0,"recall":0.5771484375,"f1":0.719681013431014,"seconds":4.077330231666565e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":7.0859375,"distances_sum":1111.8020477295709}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.759765625,"state":{"ssize":2,"bsize":5},"perf":{"precision":1.0,"recall":0.759765625,"f1":0.8557442557442566,"seconds":5.1781535148620605e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.0546875,"distances_sum":1620.4809808350826}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.875, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.875,"f1":0.9265630203130212,"seconds":5.319714546203613e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.59375,"distances_sum":1975.7012539228176}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.80859375, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.80859375,"f1":0.8869848901098908,"seconds":4.930421710014343e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.3046875,"distances_sum":1792.5965760726838}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.875,"state":{"ssize":1,"bsize":7},"perf":{"precision":1.0,"recall":0.875,"f1":0.9265630203130212,"seconds":5.319714546203613e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.59375,"distances_sum":1975.7012539228176}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.91015625, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.91015625,"f1":0.9488553113553119,"seconds":5.66430389881134e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.75,"distances_sum":2128.323546488857}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9169921875, conf: {"ssize":5,"bsize":9}, perf: {"precision":1.0,"recall":0.9169921875,"f1":0.9528903388278394,"seconds":5.424022674560547e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.8515625,"distances_sum":2129.6541064882676}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.923828125, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.923828125,"f1":0.9572229853479856,"seconds":5.364418029785156e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.7734375,"distances_sum":2188.2240349112844}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9453125, conf: {"ssize":1,"bsize":10}, perf: {"precision":1.0,"recall":0.9453125,"f1":0.9694425366300369,"seconds":5.6140124797821045e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.921875,"distances_sum":2225.3361195262737}, best_list's length: 8, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9453125,"state":{"ssize":1,"bsize":10},"perf":{"precision":1.0,"recall":0.9453125,"f1":0.9694425366300369,"seconds":5.6140124797821045e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.921875,"distances_sum":2225.3361195262737}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9453125,"state":{"ssize":1,"bsize":10},"perf":{"precision":1.0,"recall":0.9453125,"f1":0.9694425366300369,"seconds":5.6140124797821045e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.921875,"distances_sum":2225.3361195262737}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.3916015625, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.3916015625,"f1":null,"seconds":3.458932042121887e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":6.1875,"distances_sum":743.0825199477522}, best_list's length: 2, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.3916015625,"state":{"ssize":1,"bsize":2},"perf":{"precision":null,"recall":0.3916015625,"f1":null,"seconds":3.458932042121887e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":6.1875,"distances_sum":743.0825199477522}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.845703125, conf: {"ssize":5,"bsize":6}, perf: {"precision":1.0,"recall":0.845703125,"f1":0.9113953754578762,"seconds":5.295500159263611e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.59375,"distances_sum":1894.7558086746417}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.845703125,"state":{"ssize":5,"bsize":6},"perf":{"precision":1.0,"recall":0.845703125,"f1":0.9113953754578762,"seconds":5.295500159263611e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.59375,"distances_sum":1894.7558086746417}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9169921875, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.9169921875,"f1":0.9524439102564107,"seconds":5.844980478286743e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.8515625,"distances_sum":2172.7482239122583}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9541015625, conf: {"ssize":1,"bsize":10}, perf: {"precision":1.0,"recall":0.9541015625,"f1":0.9745192307692313,"seconds":5.688518285751343e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.9140625,"distances_sum":2297.026577368701}, best_list's length: 6, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9541015625,"state":{"ssize":1,"bsize":10},"perf":{"precision":1.0,"recall":0.9541015625,"f1":0.9745192307692313,"seconds":5.688518285751343e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.9140625,"distances_sum":2297.026577368701}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9541015625,"state":{"ssize":1,"bsize":10},"perf":{"precision":1.0,"recall":0.9541015625,"f1":0.9745192307692313,"seconds":5.688518285751343e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.9140625,"distances_sum":2297.026577368701}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.75390625, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.75390625,"f1":0.8498428654678661,"seconds":4.90434467792511e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.1171875,"distances_sum":1550.0641199256881}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.75390625,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.75390625,"f1":0.8498428654678661,"seconds":4.90434467792511e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.1171875,"distances_sum":1550.0641199256881}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9287109375, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.9287109375,"f1":0.9600331959706964,"seconds":5.554407835006714e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.8125,"distances_sum":2113.4725532739917}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.923828125, conf: {"ssize":4,"bsize":8}, perf: {"precision":1.0,"recall":0.923828125,"f1":0.9570169413919419,"seconds":5.453824996948242e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.8359375,"distances_sum":2121.275423133708}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.775390625, conf: {"ssize":4,"bsize":5}, perf: {"precision":1.0,"recall":0.775390625,"f1":0.8659002455877465,"seconds":4.986301064491272e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.1484375,"distances_sum":1611.343339008203}, best_list's length: 12, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9287109375,"state":{"ssize":1,"bsize":9},"perf":{"precision":1.0,"recall":0.9287109375,"f1":0.9600331959706964,"seconds":5.554407835006714e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.8125,"distances_sum":2113.4725532739917}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9599609375, conf: {"ssize":1,"bsize":13}, perf: {"precision":1.0,"recall":0.9599609375,"f1":0.9782566391941394,"seconds":6.2230974435806274e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.9609375,"distances_sum":2227.571945862341}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9404296875, conf: {"ssize":4,"bsize":10}, perf: {"precision":1.0,"recall":0.9404296875,"f1":0.9669127747252753,"seconds":5.7872384786605835e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.890625,"distances_sum":2161.161268226359}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.951171875, conf: {"ssize":5,"bsize":12}, perf: {"precision":1.0,"recall":0.951171875,"f1":0.9726018772893777,"seconds":4.581734538078308e-5,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.921875,"distances_sum":2199.219972436853}, best_list's length: 7, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9599609375,"state":{"ssize":1,"bsize":13},"perf":{"precision":1.0,"recall":0.9599609375,"f1":0.9782566391941394,"seconds":6.2230974435806274e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.9609375,"distances_sum":2227.571945862341}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9599609375,"state":{"ssize":1,"bsize":13},"perf":{"precision":1.0,"recall":0.9599609375,"f1":0.9782566391941394,"seconds":6.2230974435806274e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.9609375,"distances_sum":2227.571945862341}}, n: 9
inertia(cfft.distances) = 18.35026434676434
inertia(cdnet.distances) = 22.080137004801916
inertia(crand.distances) = 20.803308128908117
Test Summary: |
Clustering with KCenters with an approximate index | No tests
===> k=3
===> (k=3, initial=fft, maxiters=0); macro-recall: 0.8933333333333334
===> (k=3, initial=fft, maxiters=3); macro-recall: 0.8955555555555555
===> (k=3, initial=fft, maxiters=10); macro-recall: 0.9400000000000001
===> (k=3, initial=dnet, maxiters=0); macro-recall: 0.8911111111111111
===> (k=3, initial=dnet, maxiters=3); macro-recall: 0.8955555555555555
===> (k=3, initial=dnet, maxiters=10); macro-recall: 0.8933333333333334
===> (k=3, initial=rand, maxiters=0); macro-recall: 0.8933333333333334
===> (k=3, initial=rand, maxiters=3); macro-recall: 0.8955555555555555
===> (k=3, initial=rand, maxiters=10); macro-recall: 0.8977777777777778
===> (k=5, initial=fft, maxiters=0); macro-recall: 0.9377777777777778
===> (k=5, initial=fft, maxiters=3); macro-recall: 0.9288888888888889
===> (k=5, initial=fft, maxiters=10); macro-recall: 0.8933333333333334
===> (k=5, initial=dnet, maxiters=0); macro-recall: 0.9022222222222221
===> (k=5, initial=dnet, maxiters=3); macro-recall: 0.8755555555555555
===> k=5
===> (k=5, initial=dnet, maxiters=10); macro-recall: 0.9355555555555556
===> (k=5, initial=rand, maxiters=0); macro-recall: 0.9333333333333332
===> (k=5, initial=rand, maxiters=3); macro-recall: 0.8866666666666667
===> (k=5, initial=rand, maxiters=10); macro-recall: 0.9377777777777778
===> (k=7, initial=fft, maxiters=0); macro-recall: 0.9199999999999999
===> (k=7, initial=fft, maxiters=3); macro-recall: 0.928888888888889
===> k=7
===> (k=7, initial=fft, maxiters=10); macro-recall: 0.9333333333333332
===> (k=7, initial=dnet, maxiters=0); macro-recall: 0.8777777777777778
===> (k=7, initial=dnet, maxiters=3); macro-recall: 0.8844444444444445
===> (k=7, initial=dnet, maxiters=10); macro-recall: 0.9422222222222222
===> (k=7, initial=rand, maxiters=0); macro-recall: 0.9266666666666666
===> (k=7, initial=rand, maxiters=3); macro-recall: 0.9199999999999999
===> (k=7, initial=rand, maxiters=10); macro-recall: 0.8777777777777778
===> k=11
===> (k=11, initial=fft, maxiters=0); macro-recall: 0.9044444444444445
===> (k=11, initial=fft, maxiters=3); macro-recall: 0.8977777777777778
===> (k=11, initial=fft, maxiters=10); macro-recall: 0.8977777777777778
===> (k=11, initial=dnet, maxiters=0); macro-recall: 0.9111111111111111
===> (k=11, initial=dnet, maxiters=3); macro-recall: 0.9133333333333334
===> (k=11, initial=dnet, maxiters=10); macro-recall: 0.9044444444444445
===> (k=11, initial=rand, maxiters=0); macro-recall: 0.8977777777777778
Test Summary: | Pass Total
One class classifier with DeloneHistogram | 144 144
===> (k=11, initial=rand, maxiters=3); macro-recall: 0.8955555555555555
===> (k=11, initial=rand, maxiters=10); macro-recall: 0.8866666666666667
[ Info: ("XXXXXX===== rocchio like>", (KCenters.gaussian_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX===== rocchio like>", (KCenters.laplacian_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX===== rocchio like>", (KCenters.cauchy_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX===== rocchio like>", (KCenters.sigmoid_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX===== rocchio like>", (KCenters.tanh_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX===== rocchio like>", (KCenters.relu_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX===== rocchio like>", (KCenters.direct_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX==== clustering>", (KCenters.relu_kernel, SimilaritySearch.l2_distance))
nc.class_map = [1, 3, 3, 2, 3, 1, 2, 2, 3, 3, 3, 3, 2, 3, 1, 3, 1, 2, 3, 1, 3]
[ Info: ("XXXXXX==== split_entropy>", (KCenters.relu_kernel, SimilaritySearch.l2_distance))
** centroid: 1, normalized-entropy: 0.0, [0, 0, 7]
** centroid: 2, normalized-entropy: 0.0, [20, 0, 0]
** centroid: 3, normalized-entropy: 1.0, [0, 1, 1]
nc.class_map = [3, 1, 2, 3, 2, 1, 2, 3, 2, 2, 3, 1, 2, 3]
acc = 0.9333333333333333
centroid 3, labels=[2, 3], freqs: [0, 1, 1]
** centroid: 4, normalized-entropy: 0.0, [0, 12, 0]
** centroid: 5, normalized-entropy: 0.0, [8, 0, 0]
** centroid: 6, normalized-entropy: 0.0, [0, 4, 0]
** centroid: 7, normalized-entropy: 0.0, [0, 0, 21]
** centroid: 8, normalized-entropy: 0.0, [0, 19, 0]
** centroid: 9, normalized-entropy: 0.6500224216483541, [0, 3, 15]
centroid 9, labels=[2, 3], freqs: [0, 3, 15]
** centroid: 10, normalized-entropy: 0.0, [22, 0, 0]
** centroid: 11, normalized-entropy: 0.0, [0, 11, 0]
** centroid: 12, normalized-entropy: 0.0, [0, 0, 6]
finished with 14 centroids; started with 12
*** starting iteration: 1; err: [Inf, 0.30420000465017866] ***
*** computing centroids ***
*** computing 12 nearest references ***
*** new score with 12 references: [Inf, 0.30420000465017866, 0.1624163119175064] ***
*** starting iteration: 2; err: [Inf, 0.30420000465017866, 0.1624163119175064] ***
*** computing centroids ***
*** computing 12 nearest references ***
*** new score with 12 references: [Inf, 0.30420000465017866, 0.1624163119175064, 0.1549791902658133] ***
*** starting iteration: 3; err: [Inf, 0.30420000465017866, 0.1624163119175064, 0.1549791902658133] ***
*** computing centroids ***
*** computing 12 nearest references ***
*** new score with 12 references: [Inf, 0.30420000465017866, 0.1624163119175064, 0.1549791902658133, 0.15230511360934226] ***
*** starting iteration: 4; err: [Inf, 0.30420000465017866, 0.1624163119175064, 0.1549791902658133, 0.15230511360934226] ***
*** computing centroids ***
*** computing 12 nearest references ***
*** new score with 12 references: [Inf, 0.30420000465017866, 0.1624163119175064, 0.1549791902658133, 0.15230511360934226, 0.15157486616594754] ***
*** finished computation of 12 references, err: [Inf, 0.30420000465017866, 0.1624163119175064, 0.1549791902658133, 0.15230511360934226, 0.15157486616594754] ***
** centroid: 1, normalized-entropy: 0.0, [0, 0, 23]
** centroid: 2, normalized-entropy: 0.0, [20, 0, 0]
** centroid: 3, normalized-entropy: 0.0, [0, 4, 0]
** centroid: 4, normalized-entropy: 0.0, [8, 0, 0]
** centroid: 5, normalized-entropy: 0.0, [0, 0, 9]
** centroid: 6, normalized-entropy: 0.3912435636292556, [0, 12, 1]
** centroid: 7, normalized-entropy: 0.0, [0, 0, 3]
** centroid: 8, normalized-entropy: 0.0, [0, 15, 0]
** centroid: 9, normalized-entropy: 0.0, [0, 12, 0]
** centroid: 10, normalized-entropy: 0.0, [22, 0, 0]
** centroid: 11, normalized-entropy: 1.0, [0, 6, 6]
centroid 11, labels=[2, 3], freqs: [0, 6, 6]
** centroid: 12, normalized-entropy: 0.5032583347756456, [0, 1, 8]
centroid 12, labels=[2, 3], freqs: [0, 1, 8]
finished with 14 centroids; started with 12
acc = 0.96
Test Summary: | Pass Total
NearestCentroid | 10 10
[57, 15, 1, 6, 15, 2, 34, 1, 31, 3, 36, 1, 1, 23, 41, 19, 35, 15, 23, 22, 30, 14, 18, 34, 4, 35, 25, 32, 29, 2, 22, 15, 33, 35, 41, 26, 38, 36, 1, 41, 39, 35, 23, 15, 23, 20, 34, 38, 2, 19, 42, 14, 35, 47, 1, 16, 17, 45, 31, 30, 28, 41, 27, 30, 32, 28, 26, 38, 30, 43, 1, 17, 46, 50, 23, 27, 17, 36, 30, 24, 38, 64, 25, 33, 37, 26, 46, 24, 15, 36, 23, 26, 40, 56, 15, 37, 23, 35, 16, 13, 31, 38, 39, 27, 44, 30, 23, 28, 38, 13, 59, 45, 34, 22, 24, 31, 41, 45, 26, 31, 44, 55, 75, 40, 26, 24, 38, 27, 76, 46, 48, 30, 39, 35, 38, 46, 16, 60, 45, 50, 22, 37, 46, 21, 52, 31, 40, 36, 39, 31, 59, 51, 53, 47, 1, 31, 33, 2, 34, 25, 25, 40, 43, 48, 44, 46, 29, 48, 38, 46, 28, 59, 30, 40, 61, 36, 40, 34, 13, 44, 55, 30, 41, 44, 45, 30, 54, 35, 32, 38, 38, 37, 19, 42, 62, 2, 42, 29, 44, 42, 33, 24, 61, 37, 22, 30, 34, 38, 10, 32, 44, 48, 21, 6, 36, 20, 28, 50, 39, 44, 43, 35, 53, 31, 44, 26, 1, 40, 25, 39, 43, 37, 54, 58, 1, 38, 42, 41, 45, 46, 43, 32, 46, 41, 40, 45, 29, 26, 26, 55, 30, 45, 48, 34, 28, 25, 37, 31, 37, 55, 39, 37, 96, 40, 41, 28, 29, 36, 40, 48, 43, 47, 22, 41, 37, 32, 28, 33, 32, 25, 25, 38, 31, 14, 28, 39, 39, 65, 12, 29, 31, 18, 43, 52, 39, 31, 52, 34, 20, 23]
┌ Info: before optimization
└ (recall = p.recall, speedup = p.exhaustive_search_seconds / p.seconds, eval_ratio = p.evaluations / length(X)) = (recall = 0.5960000000000002, speedup = 0.4148521300595729, eval_ratio = 0.041951999999999996)
KCenters.DeloneInvIndex> optimizing for recall=0.8
KCenters.DeloneInvIndex> optimize! step region_expansion=2, performance {"precision":0.3663194444444445,"recall":0.36458333333333337,"f1":null,"seconds":7.998757064342499e-5,"exhaustive_search_seconds":0.0003887489438056946,"evaluations":341.3359375,"distances_sum":1750.5693514984775}
KCenters.DeloneInvIndex> optimize! step region_expansion=3, performance {"precision":0.545138888888889,"recall":0.545138888888889,"f1":0.545138888888889,"seconds":0.0002146344631910324,"exhaustive_search_seconds":0.0003887489438056946,"evaluations":380.578125,"distances_sum":1652.1763046446385}
KCenters.DeloneInvIndex> optimize! step region_expansion=4, performance {"precision":0.6553819444444442,"recall":0.6553819444444442,"f1":0.6553819444444442,"seconds":0.00014914199709892273,"exhaustive_search_seconds":0.0003887489438056946,"evaluations":418.8359375,"distances_sum":1604.9842106435633}
KCenters.DeloneInvIndex> optimize! step region_expansion=5, performance {"precision":0.7291666666666663,"recall":0.7291666666666663,"f1":0.7291666666666663,"seconds":0.00018038414418697357,"exhaustive_search_seconds":0.0003887489438056946,"evaluations":455.4453125,"distances_sum":1579.7417097359646}
KCenters.DeloneInvIndex> optimize! step region_expansion=6, performance {"precision":0.7873263888888882,"recall":0.7873263888888882,"f1":0.7873263888888882,"seconds":0.00022146478295326233,"exhaustive_search_seconds":0.0003887489438056946,"evaluations":496.15625,"distances_sum":1564.5150542738388}
KCenters.DeloneInvIndex> reached performance {"precision":0.8263888888888882,"recall":0.8263888888888882,"f1":0.8263888888888882,"seconds":0.0002624671906232834,"exhaustive_search_seconds":0.0003887489438056946,"evaluations":534.4609375,"distances_sum":1555.1082300106307}
┌ Info: after optimization
└ (recall = p.recall, speedup = p.exhaustive_search_seconds / p.seconds, eval_ratio = p.evaluations / length(X)) = (recall = 0.806, speedup = 1.244866116368029, eval_ratio = 0.054011)
Test Summary: | Pass Total
Testing Delone Inverted Index | 1 1
Testing KCenters tests passed
Results with Julia v1.3.1-pre-7704df0a5a
Testing was successful .
Last evaluation was ago and took 1 minute, 16 seconds.
Click here to download the log file.
Click here to show the log contents.
Resolving package versions...
Installed DataAPI ──────────── v1.1.0
Installed Missings ─────────── v0.4.3
Installed KCenters ─────────── v0.1.4
Installed OrderedCollections ─ v1.1.0
Installed DataStructures ───── v0.17.6
Installed StatsBase ────────── v0.32.0
Installed JSON ─────────────── v0.21.0
Installed SimilaritySearch ─── v0.3.16
Installed Parsers ──────────── v0.3.10
Installed SortingAlgorithms ── v0.3.1
Updating `~/.julia/environments/v1.3/Project.toml`
[5d8de97f] + KCenters v0.1.4
Updating `~/.julia/environments/v1.3/Manifest.toml`
[9a962f9c] + DataAPI v1.1.0
[864edb3b] + DataStructures v0.17.6
[682c06a0] + JSON v0.21.0
[5d8de97f] + KCenters v0.1.4
[e1d29d7a] + Missings v0.4.3
[bac558e1] + OrderedCollections v1.1.0
[69de0a69] + Parsers v0.3.10
[053f045d] + SimilaritySearch v0.3.16
[a2af1166] + SortingAlgorithms v0.3.1
[2913bbd2] + StatsBase v0.32.0
[2a0f44e3] + Base64
[ade2ca70] + Dates
[8bb1440f] + DelimitedFiles
[8ba89e20] + Distributed
[b77e0a4c] + InteractiveUtils
[8f399da3] + Libdl
[37e2e46d] + LinearAlgebra
[56ddb016] + Logging
[d6f4376e] + Markdown
[a63ad114] + Mmap
[de0858da] + Printf
[9a3f8284] + Random
[9e88b42a] + Serialization
[6462fe0b] + Sockets
[2f01184e] + SparseArrays
[10745b16] + Statistics
[8dfed614] + Test
[4ec0a83e] + Unicode
Testing KCenters
Status `/tmp/jl_sccgUS/Manifest.toml`
[9a962f9c] DataAPI v1.1.0
[864edb3b] DataStructures v0.17.6
[682c06a0] JSON v0.21.0
[5d8de97f] KCenters v0.1.4
[e1d29d7a] Missings v0.4.3
[bac558e1] OrderedCollections v1.1.0
[69de0a69] Parsers v0.3.10
[053f045d] SimilaritySearch v0.3.16
[a2af1166] SortingAlgorithms v0.3.1
[2913bbd2] StatsBase v0.32.0
[2a0f44e3] Base64 [`@stdlib/Base64`]
[ade2ca70] Dates [`@stdlib/Dates`]
[8bb1440f] DelimitedFiles [`@stdlib/DelimitedFiles`]
[8ba89e20] Distributed [`@stdlib/Distributed`]
[b77e0a4c] InteractiveUtils [`@stdlib/InteractiveUtils`]
[8f399da3] Libdl [`@stdlib/Libdl`]
[37e2e46d] LinearAlgebra [`@stdlib/LinearAlgebra`]
[56ddb016] Logging [`@stdlib/Logging`]
[d6f4376e] Markdown [`@stdlib/Markdown`]
[a63ad114] Mmap [`@stdlib/Mmap`]
[de0858da] Printf [`@stdlib/Printf`]
[9a3f8284] Random [`@stdlib/Random`]
[9e88b42a] Serialization [`@stdlib/Serialization`]
[6462fe0b] Sockets [`@stdlib/Sockets`]
[2f01184e] SparseArrays [`@stdlib/SparseArrays`]
[10745b16] Statistics [`@stdlib/Statistics`]
[8dfed614] Test [`@stdlib/Test`]
[4ec0a83e] Unicode [`@stdlib/Unicode`]
Test Summary: | Pass Total
Scores | 9 9
[ Info: 159.67999999999998
[ Info: 61.48000000000004
[ Info: 40.809999999999995
[ Info: 23.399999999999995
Test Summary: | Pass Total
Clustering with enet | 4 4
[ Info: 313.64000338064864
[ Info: 547.7999992523
[ Info: 146.2399983987154
[ Info: 76.90000120870405
Test Summary: |
Clustering with dnet | No tests
inertia(cfft.distances) = 19.39851459248377
inertia(cdnet.distances) = 26.844380562331285
inertia(crand.distances) = 21.31698046265202
Test Summary: |
Clustering with KCenters | No tests
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.4287109375, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.4287109375,"f1":null,"seconds":3.5241246223449707e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":6.6328125,"distances_sum":1156.784130009012}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.25, conf: {"ssize":2,"bsize":1}, perf: {"precision":null,"recall":0.25,"f1":null,"seconds":3.2782554626464844e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":7.6015625,"distances_sum":718.8202935857121}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5908203125, conf: {"ssize":5,"bsize":3}, perf: {"precision":1.0,"recall":0.5908203125,"f1":0.7292350011100018,"seconds":4.114583134651184e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":7.5859375,"distances_sum":1666.6030014018047}, best_list's length: 4, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7353515625, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.7353515625,"f1":0.8417327464202473,"seconds":5.064532160758972e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.875,"distances_sum":2184.869055549132}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7353515625,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.7353515625,"f1":0.8417327464202473,"seconds":5.064532160758972e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.875,"distances_sum":2184.869055549132}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9384765625, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.9384765625,"f1":0.9656478937728942,"seconds":5.798414349555969e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":9.0,"distances_sum":3115.1220739662813}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7568359375, conf: {"ssize":4,"bsize":5}, perf: {"precision":1.0,"recall":0.7568359375,"f1":0.8559383325008333,"seconds":0.00010197609663009644,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.9375,"distances_sum":2303.7262974131495}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.91015625, conf: {"ssize":6,"bsize":7}, perf: {"precision":1.0,"recall":0.91015625,"f1":0.9494276556776564,"seconds":5.4836273193359375e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.9609375,"distances_sum":2966.3571645967604}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.75, conf: {"ssize":6,"bsize":5}, perf: {"precision":1.0,"recall":0.75,"f1":0.8484671578421586,"seconds":4.811212420463562e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":8.8671875,"distances_sum":2241.967501428676}, best_list's length: 13, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9384765625,"state":{"ssize":1,"bsize":9},"perf":{"precision":1.0,"recall":0.9384765625,"f1":0.9656478937728942,"seconds":5.798414349555969e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":9.0,"distances_sum":3115.1220739662813}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9423828125, conf: {"ssize":1,"bsize":11}, perf: {"precision":1.0,"recall":0.9423828125,"f1":0.96698717948718,"seconds":5.580484867095947e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":9.0,"distances_sum":3126.5071183181444}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9638671875, conf: {"ssize":1,"bsize":12}, perf: {"precision":1.0,"recall":0.9638671875,"f1":0.9802827380952384,"seconds":5.669891834259033e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":9.0,"distances_sum":3223.1586277850174}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9638671875, conf: {"ssize":1,"bsize":13}, perf: {"precision":1.0,"recall":0.9638671875,"f1":0.9799679487179491,"seconds":5.852431058883667e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":9.0,"distances_sum":3243.759507392604}, best_list's length: 7, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9638671875,"state":{"ssize":1,"bsize":12},"perf":{"precision":1.0,"recall":0.9638671875,"f1":0.9802827380952384,"seconds":5.669891834259033e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":9.0,"distances_sum":3223.1586277850174}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9638671875,"state":{"ssize":1,"bsize":12},"perf":{"precision":1.0,"recall":0.9638671875,"f1":0.9802827380952384,"seconds":5.669891834259033e-6,"exhaustive_search_seconds":1.430511474609375e-6,"evaluations":9.0,"distances_sum":3223.1586277850174}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.419921875, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.419921875,"f1":null,"seconds":3.824010491371155e-6,"exhaustive_search_seconds":1.4211982488632202e-6,"evaluations":5.96875,"distances_sum":1077.747857964758}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.572265625, conf: {"ssize":3,"bsize":3}, perf: {"precision":1.0,"recall":0.572265625,"f1":0.7141122766122772,"seconds":4.0065497159957886e-6,"exhaustive_search_seconds":1.4211982488632202e-6,"evaluations":7.0390625,"distances_sum":1559.4711088786075}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.572265625,"state":{"ssize":3,"bsize":3},"perf":{"precision":1.0,"recall":0.572265625,"f1":0.7141122766122772,"seconds":4.0065497159957886e-6,"exhaustive_search_seconds":1.4211982488632202e-6,"evaluations":7.0390625,"distances_sum":1559.4711088786075}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.638671875, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.638671875,"f1":0.7706980519480527,"seconds":4.215165972709656e-6,"exhaustive_search_seconds":1.4211982488632202e-6,"evaluations":7.375,"distances_sum":1700.2882918518721}, best_list's length: 4, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8330078125, conf: {"ssize":7,"bsize":6}, perf: {"precision":1.0,"recall":0.8330078125,"f1":0.9043326465201476,"seconds":5.055218935012817e-6,"exhaustive_search_seconds":1.4211982488632202e-6,"evaluations":8.484375,"distances_sum":2478.3988898356597}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8330078125,"state":{"ssize":7,"bsize":6},"perf":{"precision":1.0,"recall":0.8330078125,"f1":0.9043326465201476,"seconds":5.055218935012817e-6,"exhaustive_search_seconds":1.4211982488632202e-6,"evaluations":8.484375,"distances_sum":2478.3988898356597}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.916015625, conf: {"ssize":4,"bsize":8}, perf: {"precision":1.0,"recall":0.916015625,"f1":0.9531994047619051,"seconds":5.466863512992859e-6,"exhaustive_search_seconds":1.4211982488632202e-6,"evaluations":8.7734375,"distances_sum":2935.190085634856}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8369140625, conf: {"ssize":9,"bsize":6}, perf: {"precision":1.0,"recall":0.8369140625,"f1":0.9056349900099909,"seconds":5.558133125305176e-6,"exhaustive_search_seconds":1.4211982488632202e-6,"evaluations":8.46875,"distances_sum":2516.9714737718004}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8994140625, conf: {"ssize":9,"bsize":8}, perf: {"precision":1.0,"recall":0.8994140625,"f1":0.9422135156510162,"seconds":6.01448118686676e-6,"exhaustive_search_seconds":1.4211982488632202e-6,"evaluations":8.671875,"distances_sum":2865.173173587919}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.87890625, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.87890625,"f1":0.9308524808524814,"seconds":5.280598998069763e-6,"exhaustive_search_seconds":1.4211982488632202e-6,"evaluations":8.5,"distances_sum":2693.803588252504}, best_list's length: 8, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.916015625,"state":{"ssize":4,"bsize":8},"perf":{"precision":1.0,"recall":0.916015625,"f1":0.9531994047619051,"seconds":5.466863512992859e-6,"exhaustive_search_seconds":1.4211982488632202e-6,"evaluations":8.7734375,"distances_sum":2935.190085634856}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.916015625,"state":{"ssize":4,"bsize":8},"perf":{"precision":1.0,"recall":0.916015625,"f1":0.9531994047619051,"seconds":5.466863512992859e-6,"exhaustive_search_seconds":1.4211982488632202e-6,"evaluations":8.7734375,"distances_sum":2935.190085634856}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.546875, conf: {"ssize":1,"bsize":3}, perf: {"precision":null,"recall":0.546875,"f1":null,"seconds":5.753710865974426e-6,"exhaustive_search_seconds":1.5385448932647705e-6,"evaluations":7.0,"distances_sum":1439.9778943144236}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.66015625, conf: {"ssize":2,"bsize":4}, perf: {"precision":1.0,"recall":0.66015625,"f1":0.7849742271617279,"seconds":4.82611358165741e-6,"exhaustive_search_seconds":1.5385448932647705e-6,"evaluations":7.6171875,"distances_sum":1802.90895205154}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6650390625, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.6650390625,"f1":0.7902540168165175,"seconds":4.714354872703552e-6,"exhaustive_search_seconds":1.5385448932647705e-6,"evaluations":7.75,"distances_sum":1785.6835311879722}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.6650390625,"state":{"ssize":1,"bsize":4},"perf":{"precision":1.0,"recall":0.6650390625,"f1":0.7902540168165175,"seconds":4.714354872703552e-6,"exhaustive_search_seconds":1.5385448932647705e-6,"evaluations":7.75,"distances_sum":1785.6835311879722}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9169921875, conf: {"ssize":3,"bsize":8}, perf: {"precision":1.0,"recall":0.9169921875,"f1":0.9525412087912093,"seconds":3.941357135772705e-6,"exhaustive_search_seconds":1.5385448932647705e-6,"evaluations":8.8515625,"distances_sum":2910.2021722869267}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9130859375, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.9130859375,"f1":0.9509729853479859,"seconds":4.155561327934265e-6,"exhaustive_search_seconds":1.5385448932647705e-6,"evaluations":8.828125,"distances_sum":2890.58094756692}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7392578125, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.7392578125,"f1":0.8444368131868141,"seconds":3.4961849451065063e-6,"exhaustive_search_seconds":1.5385448932647705e-6,"evaluations":8.3046875,"distances_sum":2100.3591401537287}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.744140625, conf: {"ssize":4,"bsize":5}, perf: {"precision":1.0,"recall":0.744140625,"f1":0.8430075133200141,"seconds":5.0514936447143555e-6,"exhaustive_search_seconds":1.5385448932647705e-6,"evaluations":8.34375,"distances_sum":2129.6323762883403}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8388671875, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.8388671875,"f1":0.9067828005328015,"seconds":5.327165126800537e-6,"exhaustive_search_seconds":1.5385448932647705e-6,"evaluations":8.671875,"distances_sum":2532.9021971183133}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9169921875,"state":{"ssize":3,"bsize":8},"perf":{"precision":1.0,"recall":0.9169921875,"f1":0.9525412087912093,"seconds":3.941357135772705e-6,"exhaustive_search_seconds":1.5385448932647705e-6,"evaluations":8.8515625,"distances_sum":2910.2021722869267}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9365234375, conf: {"ssize":6,"bsize":10}, perf: {"precision":1.0,"recall":0.9365234375,"f1":0.9645146520146524,"seconds":5.844980478286743e-6,"exhaustive_search_seconds":1.5385448932647705e-6,"evaluations":8.921875,"distances_sum":2994.2320233371524}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.953125, conf: {"ssize":1,"bsize":11}, perf: {"precision":1.0,"recall":0.953125,"f1":0.9743131868131872,"seconds":5.804002285003662e-6,"exhaustive_search_seconds":1.5385448932647705e-6,"evaluations":8.9453125,"distances_sum":3082.0640459519373}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.951171875, conf: {"ssize":1,"bsize":10}, perf: {"precision":1.0,"recall":0.951171875,"f1":0.9724530677655683,"seconds":5.770474672317505e-6,"exhaustive_search_seconds":1.5385448932647705e-6,"evaluations":8.9375,"distances_sum":3078.7019647817847}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9228515625, conf: {"ssize":2,"bsize":8}, perf: {"precision":1.0,"recall":0.9228515625,"f1":0.9564617673992679,"seconds":5.846843123435974e-6,"exhaustive_search_seconds":1.5385448932647705e-6,"evaluations":8.8984375,"distances_sum":2934.400199538177}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9462890625, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.9462890625,"f1":0.9698717948717952,"seconds":5.68293035030365e-6,"exhaustive_search_seconds":1.5385448932647705e-6,"evaluations":8.9140625,"distances_sum":3030.963256376214}, best_list's length: 11, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9501953125, conf: {"ssize":2,"bsize":9}, perf: {"precision":1.0,"recall":0.9501953125,"f1":0.9719894688644691,"seconds":5.714595317840576e-6,"exhaustive_search_seconds":1.5385448932647705e-6,"evaluations":8.921875,"distances_sum":3084.2949243572}, best_list's length: 13, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9287109375, conf: {"ssize":4,"bsize":9}, perf: {"precision":1.0,"recall":0.9287109375,"f1":0.9593635531135535,"seconds":5.81890344619751e-6,"exhaustive_search_seconds":1.5385448932647705e-6,"evaluations":8.8828125,"distances_sum":2962.0514865416744}, best_list's length: 14, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.953125,"state":{"ssize":1,"bsize":11},"perf":{"precision":1.0,"recall":0.953125,"f1":0.9743131868131872,"seconds":5.804002285003662e-6,"exhaustive_search_seconds":1.5385448932647705e-6,"evaluations":8.9453125,"distances_sum":3082.0640459519373}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.953125,"state":{"ssize":1,"bsize":11},"perf":{"precision":1.0,"recall":0.953125,"f1":0.9743131868131872,"seconds":5.804002285003662e-6,"exhaustive_search_seconds":1.5385448932647705e-6,"evaluations":8.9453125,"distances_sum":3082.0640459519373}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.73046875, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.73046875,"f1":0.8348531676656684,"seconds":5.0086528062820435e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":7.9140625,"distances_sum":2066.7115194392}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7568359375, conf: {"ssize":3,"bsize":5}, perf: {"precision":1.0,"recall":0.7568359375,"f1":0.8540012071262079,"seconds":4.939734935760498e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":7.9765625,"distances_sum":2164.663742990746}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7568359375,"state":{"ssize":3,"bsize":5},"perf":{"precision":1.0,"recall":0.7568359375,"f1":0.8540012071262079,"seconds":4.939734935760498e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":7.9765625,"distances_sum":2164.663742990746}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.876953125, conf: {"ssize":7,"bsize":7}, perf: {"precision":1.0,"recall":0.876953125,"f1":0.9272841741591749,"seconds":5.50784170627594e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.640625,"distances_sum":2705.8156426671853}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9140625, conf: {"ssize":5,"bsize":9}, perf: {"precision":1.0,"recall":0.9140625,"f1":0.9519402472527475,"seconds":5.466863512992859e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.8046875,"distances_sum":2911.4558160791994}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.892578125, conf: {"ssize":2,"bsize":7}, perf: {"precision":1.0,"recall":0.892578125,"f1":0.939314331501832,"seconds":5.666166543960571e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.7578125,"distances_sum":2761.5029624630993}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9140625,"state":{"ssize":5,"bsize":9},"perf":{"precision":1.0,"recall":0.9140625,"f1":0.9519402472527475,"seconds":5.466863512992859e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.8046875,"distances_sum":2911.4558160791994}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.953125, conf: {"ssize":8,"bsize":13}, perf: {"precision":1.0,"recall":0.953125,"f1":0.9736263736263737,"seconds":5.971640348434448e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.8984375,"distances_sum":3061.238490587628}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.947265625, conf: {"ssize":1,"bsize":11}, perf: {"precision":1.0,"recall":0.947265625,"f1":0.9704842032967036,"seconds":5.688518285751343e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.8984375,"distances_sum":3043.2714958238394}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9443359375, conf: {"ssize":10,"bsize":11}, perf: {"precision":1.0,"recall":0.9443359375,"f1":0.9687728937728942,"seconds":5.809590220451355e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.921875,"distances_sum":3037.330237056569}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.953125,"state":{"ssize":8,"bsize":13},"perf":{"precision":1.0,"recall":0.953125,"f1":0.9736263736263737,"seconds":5.971640348434448e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.8984375,"distances_sum":3061.238490587628}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.953125,"state":{"ssize":8,"bsize":13},"perf":{"precision":1.0,"recall":0.953125,"f1":0.9736263736263737,"seconds":5.971640348434448e-6,"exhaustive_search_seconds":1.4454126358032227e-6,"evaluations":8.8984375,"distances_sum":3061.238490587628}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.646484375, conf: {"ssize":5,"bsize":4}, perf: {"precision":1.0,"recall":0.646484375,"f1":0.7763642607392616,"seconds":4.49642539024353e-6,"exhaustive_search_seconds":1.4137476682662964e-6,"evaluations":7.1953125,"distances_sum":1702.2107214613616}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7646484375, conf: {"ssize":4,"bsize":5}, perf: {"precision":1.0,"recall":0.7646484375,"f1":0.8598448426573435,"seconds":4.859641194343567e-6,"exhaustive_search_seconds":1.4137476682662964e-6,"evaluations":7.96875,"distances_sum":2174.662785088864}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7646484375,"state":{"ssize":4,"bsize":5},"perf":{"precision":1.0,"recall":0.7646484375,"f1":0.8598448426573435,"seconds":4.859641194343567e-6,"exhaustive_search_seconds":1.4137476682662964e-6,"evaluations":7.96875,"distances_sum":2174.662785088864}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.83203125, conf: {"ssize":3,"bsize":6}, perf: {"precision":1.0,"recall":0.83203125,"f1":0.9008356227106232,"seconds":5.248934030532837e-6,"exhaustive_search_seconds":1.4137476682662964e-6,"evaluations":8.3515625,"distances_sum":2438.482130876374}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8408203125, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.8408203125,"f1":0.9075268481518489,"seconds":5.297362804412842e-6,"exhaustive_search_seconds":1.4137476682662964e-6,"evaluations":8.4140625,"distances_sum":2473.685917617172}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8232421875, conf: {"ssize":8,"bsize":6}, perf: {"precision":1.0,"recall":0.8232421875,"f1":0.896652306027307,"seconds":5.599111318588257e-6,"exhaustive_search_seconds":1.4137476682662964e-6,"evaluations":8.3828125,"distances_sum":2366.6853732372656}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8408203125,"state":{"ssize":1,"bsize":6},"perf":{"precision":1.0,"recall":0.8408203125,"f1":0.9075268481518489,"seconds":5.297362804412842e-6,"exhaustive_search_seconds":1.4137476682662964e-6,"evaluations":8.4140625,"distances_sum":2473.685917617172}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.951171875, conf: {"ssize":1,"bsize":10}, perf: {"precision":1.0,"recall":0.951171875,"f1":0.9728079212454217,"seconds":6.109476089477539e-6,"exhaustive_search_seconds":1.4137476682662964e-6,"evaluations":8.8671875,"distances_sum":2991.5539239233804}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8720703125, conf: {"ssize":5,"bsize":7}, perf: {"precision":1.0,"recall":0.8720703125,"f1":0.9258527930402936,"seconds":5.602836608886719e-6,"exhaustive_search_seconds":1.4137476682662964e-6,"evaluations":8.5,"distances_sum":2655.962688318155}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.927734375, conf: {"ssize":8,"bsize":8}, perf: {"precision":1.0,"recall":0.927734375,"f1":0.9597870879120883,"seconds":5.997717380523682e-6,"exhaustive_search_seconds":1.4137476682662964e-6,"evaluations":8.7890625,"distances_sum":2913.3342474404767}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.951171875,"state":{"ssize":1,"bsize":10},"perf":{"precision":1.0,"recall":0.951171875,"f1":0.9728079212454217,"seconds":6.109476089477539e-6,"exhaustive_search_seconds":1.4137476682662964e-6,"evaluations":8.8671875,"distances_sum":2991.5539239233804}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.951171875,"state":{"ssize":1,"bsize":10},"perf":{"precision":1.0,"recall":0.951171875,"f1":0.9728079212454217,"seconds":6.109476089477539e-6,"exhaustive_search_seconds":1.4137476682662964e-6,"evaluations":8.8671875,"distances_sum":2991.5539239233804}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5751953125, conf: {"ssize":1,"bsize":3}, perf: {"precision":1.0,"recall":0.5751953125,"f1":0.7155110514485521,"seconds":4.546716809272766e-6,"exhaustive_search_seconds":1.5702098608016968e-6,"evaluations":7.3828125,"distances_sum":1564.356480627359}, best_list's length: 2, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.5751953125,"state":{"ssize":1,"bsize":3},"perf":{"precision":1.0,"recall":0.5751953125,"f1":0.7155110514485521,"seconds":4.546716809272766e-6,"exhaustive_search_seconds":1.5702098608016968e-6,"evaluations":7.3828125,"distances_sum":1564.356480627359}}, beam: 2, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7724609375, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.7724609375,"f1":0.862924055111556,"seconds":5.448237061500549e-6,"exhaustive_search_seconds":1.5702098608016968e-6,"evaluations":8.3671875,"distances_sum":2224.9823820830647}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7724609375,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.7724609375,"f1":0.862924055111556,"seconds":5.448237061500549e-6,"exhaustive_search_seconds":1.5702098608016968e-6,"evaluations":8.3671875,"distances_sum":2224.9823820830647}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.90234375, conf: {"ssize":5,"bsize":8}, perf: {"precision":1.0,"recall":0.90234375,"f1":0.9448946886446894,"seconds":5.889683961868286e-6,"exhaustive_search_seconds":1.5702098608016968e-6,"evaluations":8.8203125,"distances_sum":2823.352011563667}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.826171875, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.826171875,"f1":0.8990327380952391,"seconds":5.407258868217468e-6,"exhaustive_search_seconds":1.5702098608016968e-6,"evaluations":8.546875,"distances_sum":2427.6962827222483}, best_list's length: 6, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.90234375,"state":{"ssize":5,"bsize":8},"perf":{"precision":1.0,"recall":0.90234375,"f1":0.9448946886446894,"seconds":5.889683961868286e-6,"exhaustive_search_seconds":1.5702098608016968e-6,"evaluations":8.8203125,"distances_sum":2823.352011563667}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.90234375,"state":{"ssize":5,"bsize":8},"perf":{"precision":1.0,"recall":0.90234375,"f1":0.9448946886446894,"seconds":5.889683961868286e-6,"exhaustive_search_seconds":1.5702098608016968e-6,"evaluations":8.8203125,"distances_sum":2823.352011563667}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.759765625, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.759765625,"f1":0.8563852813852821,"seconds":5.191192030906677e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.4609375,"distances_sum":2169.703724595348}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6640625, conf: {"ssize":4,"bsize":4}, perf: {"precision":1.0,"recall":0.6640625,"f1":0.787640311077812,"seconds":4.518777132034302e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":7.7890625,"distances_sum":1771.957848407483}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.25390625, conf: {"ssize":2,"bsize":1}, perf: {"precision":null,"recall":0.25390625,"f1":null,"seconds":3.3527612686157227e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":6.71875,"distances_sum":628.8557365561811}, best_list's length: 4, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.568359375, conf: {"ssize":3,"bsize":3}, perf: {"precision":1.0,"recall":0.568359375,"f1":0.7124089452214459,"seconds":4.02890145778656e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":7.453125,"distances_sum":1503.62603104564}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.759765625,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.759765625,"f1":0.8563852813852821,"seconds":5.191192030906677e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.4609375,"distances_sum":2169.703724595348}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7646484375, conf: {"ssize":3,"bsize":5}, perf: {"precision":1.0,"recall":0.7646484375,"f1":0.8589259698634705,"seconds":5.031004548072815e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.4296875,"distances_sum":2171.3808815902435}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7646484375,"state":{"ssize":3,"bsize":5},"perf":{"precision":1.0,"recall":0.7646484375,"f1":0.8589259698634705,"seconds":5.031004548072815e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.4296875,"distances_sum":2171.3808815902435}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.7646484375,"state":{"ssize":3,"bsize":5},"perf":{"precision":1.0,"recall":0.7646484375,"f1":0.8589259698634705,"seconds":5.031004548072815e-6,"exhaustive_search_seconds":1.2721866369247437e-6,"evaluations":8.4296875,"distances_sum":2171.3808815902435}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.494140625, conf: {"ssize":1,"bsize":3}, perf: {"precision":0.992578125,"recall":0.494140625,"f1":0.6457565871628372,"seconds":2.648681402206421e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":6.421875,"distances_sum":731.8345963771973}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.76171875, conf: {"ssize":1,"bsize":5}, perf: {"precision":0.9906529017857143,"recall":0.76171875,"f1":0.8515594431610062,"seconds":4.980713129043579e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.140625,"distances_sum":1145.4873129285975}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.1689453125, conf: {"ssize":3,"bsize":1}, perf: {"precision":null,"recall":0.1689453125,"f1":null,"seconds":3.1515955924987793e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":4.4765625,"distances_sum":282.8587869396816}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.76171875,"state":{"ssize":1,"bsize":5},"perf":{"precision":0.9906529017857143,"recall":0.76171875,"f1":0.8515594431610062,"seconds":4.980713129043579e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.140625,"distances_sum":1145.4873129285975}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.876953125, conf: {"ssize":1,"bsize":7}, perf: {"precision":0.990513392857143,"recall":0.876953125,"f1":0.925028877372628,"seconds":5.260109901428223e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.59375,"distances_sum":1408.4315425945244}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9072265625, conf: {"ssize":1,"bsize":9}, perf: {"precision":0.9885137648809524,"recall":0.9072265625,"f1":0.9435017456501834,"seconds":5.42961061000824e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.671875,"distances_sum":1526.1167045521283}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8173828125, conf: {"ssize":1,"bsize":6}, perf: {"precision":0.9930710565476191,"recall":0.8173828125,"f1":0.8899465768606399,"seconds":5.0906091928482056e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.375,"distances_sum":1273.7994675637135}, best_list's length: 8, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9072265625,"state":{"ssize":1,"bsize":9},"perf":{"precision":0.9885137648809524,"recall":0.9072265625,"f1":0.9435017456501834,"seconds":5.42961061000824e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.671875,"distances_sum":1526.1167045521283}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9453125, conf: {"ssize":5,"bsize":13}, perf: {"precision":0.9900948660714286,"recall":0.9453125,"f1":0.9656156994047623,"seconds":6.0461461544036865e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.90625,"distances_sum":1574.9060048652125}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.935546875, conf: {"ssize":5,"bsize":12}, perf: {"precision":0.9881417410714286,"recall":0.935546875,"f1":0.9594215029761908,"seconds":5.945563316345215e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.8359375,"distances_sum":1569.1989253944387}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.939453125, conf: {"ssize":1,"bsize":11}, perf: {"precision":0.9900948660714286,"recall":0.939453125,"f1":0.9620099301739927,"seconds":3.546476364135742e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.875,"distances_sum":1575.314768432498}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9384765625, conf: {"ssize":4,"bsize":11}, perf: {"precision":0.9927455357142858,"recall":0.9384765625,"f1":0.9631324404761906,"seconds":3.6153942346572876e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.828125,"distances_sum":1571.9884093553535}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9453125,"state":{"ssize":5,"bsize":13},"perf":{"precision":0.9900948660714286,"recall":0.9453125,"f1":0.9656156994047623,"seconds":6.0461461544036865e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.90625,"distances_sum":1574.9060048652125}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9453125,"state":{"ssize":5,"bsize":13},"perf":{"precision":0.9900948660714286,"recall":0.9453125,"f1":0.9656156994047623,"seconds":6.0461461544036865e-6,"exhaustive_search_seconds":9.294599294662476e-7,"evaluations":8.90625,"distances_sum":1574.9060048652125}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.3994140625, conf: {"ssize":3,"bsize":2}, perf: {"precision":null,"recall":0.3994140625,"f1":null,"seconds":3.4850090742111206e-6,"exhaustive_search_seconds":1.2274831533432007e-6,"evaluations":6.3359375,"distances_sum":584.3605255314619}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.666015625, conf: {"ssize":4,"bsize":4}, perf: {"precision":1.0,"recall":0.666015625,"f1":0.788258963258964,"seconds":4.518777132034302e-6,"exhaustive_search_seconds":1.2274831533432007e-6,"evaluations":7.78125,"distances_sum":1005.7614084436796}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.666015625,"state":{"ssize":4,"bsize":4},"perf":{"precision":1.0,"recall":0.666015625,"f1":0.788258963258964,"seconds":4.518777132034302e-6,"exhaustive_search_seconds":1.2274831533432007e-6,"evaluations":7.78125,"distances_sum":1005.7614084436796}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9228515625, conf: {"ssize":6,"bsize":8}, perf: {"precision":1.0,"recall":0.9228515625,"f1":0.9564388736263741,"seconds":4.559755325317383e-6,"exhaustive_search_seconds":1.2274831533432007e-6,"evaluations":8.859375,"distances_sum":1576.1796272592658}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.73828125, conf: {"ssize":4,"bsize":5}, perf: {"precision":1.0,"recall":0.73828125,"f1":0.8383033633033641,"seconds":3.207474946975708e-6,"exhaustive_search_seconds":1.2274831533432007e-6,"evaluations":8.2421875,"distances_sum":1187.8917563391376}, best_list's length: 6, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9228515625,"state":{"ssize":6,"bsize":8},"perf":{"precision":1.0,"recall":0.9228515625,"f1":0.9564388736263741,"seconds":4.559755325317383e-6,"exhaustive_search_seconds":1.2274831533432007e-6,"evaluations":8.859375,"distances_sum":1576.1796272592658}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9638671875, conf: {"ssize":8,"bsize":12}, perf: {"precision":1.0,"recall":0.9638671875,"f1":0.9804315476190477,"seconds":5.6568533182144165e-6,"exhaustive_search_seconds":1.2274831533432007e-6,"evaluations":8.9921875,"distances_sum":1693.017083191502}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.943359375, conf: {"ssize":2,"bsize":9}, perf: {"precision":1.0,"recall":0.943359375,"f1":0.9684581043956046,"seconds":3.4514814615249634e-6,"exhaustive_search_seconds":1.2274831533432007e-6,"evaluations":8.9140625,"distances_sum":1633.2973635085805}, best_list's length: 8, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9638671875,"state":{"ssize":8,"bsize":12},"perf":{"precision":1.0,"recall":0.9638671875,"f1":0.9804315476190477,"seconds":5.6568533182144165e-6,"exhaustive_search_seconds":1.2274831533432007e-6,"evaluations":8.9921875,"distances_sum":1693.017083191502}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9638671875,"state":{"ssize":8,"bsize":12},"perf":{"precision":1.0,"recall":0.9638671875,"f1":0.9804315476190477,"seconds":5.6568533182144165e-6,"exhaustive_search_seconds":1.2274831533432007e-6,"evaluations":8.9921875,"distances_sum":1693.017083191502}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.197265625, conf: {"ssize":2,"bsize":1}, perf: {"precision":null,"recall":0.197265625,"f1":null,"seconds":2.732500433921814e-6,"exhaustive_search_seconds":8.977949619293213e-7,"evaluations":5.1015625,"distances_sum":335.75200247242253}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5341796875, conf: {"ssize":1,"bsize":3}, perf: {"precision":1.0,"recall":0.5341796875,"f1":0.68168688949939,"seconds":4.131346940994263e-6,"exhaustive_search_seconds":8.977949619293213e-7,"evaluations":7.0234375,"distances_sum":833.9338596348288}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6640625, conf: {"ssize":5,"bsize":4}, perf: {"precision":1.0,"recall":0.6640625,"f1":0.7873959373959382,"seconds":4.949048161506653e-6,"exhaustive_search_seconds":8.977949619293213e-7,"evaluations":8.0078125,"distances_sum":1065.3026118153866}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.6640625,"state":{"ssize":5,"bsize":4},"perf":{"precision":1.0,"recall":0.6640625,"f1":0.7873959373959382,"seconds":4.949048161506653e-6,"exhaustive_search_seconds":8.977949619293213e-7,"evaluations":8.0078125,"distances_sum":1065.3026118153866}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8916015625, conf: {"ssize":2,"bsize":7}, perf: {"precision":1.0,"recall":0.8916015625,"f1":0.9360576923076926,"seconds":3.5017728805541992e-6,"exhaustive_search_seconds":8.977949619293213e-7,"evaluations":8.7265625,"distances_sum":1547.1994524216855}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8935546875, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.8935546875,"f1":0.9392570970695975,"seconds":3.417953848838806e-6,"exhaustive_search_seconds":8.977949619293213e-7,"evaluations":8.734375,"distances_sum":1533.5001394529725}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8935546875,"state":{"ssize":1,"bsize":7},"perf":{"precision":1.0,"recall":0.8935546875,"f1":0.9392570970695975,"seconds":3.417953848838806e-6,"exhaustive_search_seconds":8.977949619293213e-7,"evaluations":8.734375,"distances_sum":1533.5001394529725}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9052734375, conf: {"ssize":5,"bsize":8}, perf: {"precision":1.0,"recall":0.9052734375,"f1":0.944208395770896,"seconds":3.5390257835388184e-6,"exhaustive_search_seconds":8.977949619293213e-7,"evaluations":8.796875,"distances_sum":1582.2327375954892}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.923828125, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.923828125,"f1":0.9572229853479857,"seconds":4.043802618980408e-6,"exhaustive_search_seconds":8.977949619293213e-7,"evaluations":8.8125,"distances_sum":1631.1345235402048}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8984375, conf: {"ssize":4,"bsize":8}, perf: {"precision":1.0,"recall":0.8984375,"f1":0.9427140567765576,"seconds":3.5446137189865112e-6,"exhaustive_search_seconds":8.977949619293213e-7,"evaluations":8.7734375,"distances_sum":1529.4796902964933}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9033203125, conf: {"ssize":2,"bsize":8}, perf: {"precision":1.0,"recall":0.9033203125,"f1":0.9448889652014661,"seconds":3.7439167499542236e-6,"exhaustive_search_seconds":8.977949619293213e-7,"evaluations":8.6796875,"distances_sum":1590.8729651673991}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9296875, conf: {"ssize":6,"bsize":9}, perf: {"precision":1.0,"recall":0.9296875,"f1":0.9606055402930406,"seconds":4.159286618232727e-6,"exhaustive_search_seconds":8.977949619293213e-7,"evaluations":8.7578125,"distances_sum":1657.035846387435}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9296875,"state":{"ssize":6,"bsize":9},"perf":{"precision":1.0,"recall":0.9296875,"f1":0.9606055402930406,"seconds":4.159286618232727e-6,"exhaustive_search_seconds":8.977949619293213e-7,"evaluations":8.7578125,"distances_sum":1657.035846387435}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9296875,"state":{"ssize":6,"bsize":9},"perf":{"precision":1.0,"recall":0.9296875,"f1":0.9606055402930406,"seconds":4.159286618232727e-6,"exhaustive_search_seconds":8.977949619293213e-7,"evaluations":8.7578125,"distances_sum":1657.035846387435}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2470703125, conf: {"ssize":3,"bsize":1}, perf: {"precision":null,"recall":0.2470703125,"f1":null,"seconds":1.9259750843048096e-6,"exhaustive_search_seconds":1.5944242477416992e-6,"evaluations":6.390625,"distances_sum":367.01692406860644}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6748046875, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.6748046875,"f1":0.791436688311689,"seconds":2.902001142501831e-6,"exhaustive_search_seconds":1.5944242477416992e-6,"evaluations":8.0078125,"distances_sum":1020.1537495074531}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.6748046875,"state":{"ssize":1,"bsize":4},"perf":{"precision":1.0,"recall":0.6748046875,"f1":0.791436688311689,"seconds":2.902001142501831e-6,"exhaustive_search_seconds":1.5944242477416992e-6,"evaluations":8.0078125,"distances_sum":1020.1537495074531}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.90234375, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.90234375,"f1":0.9434809981684986,"seconds":3.7476420402526855e-6,"exhaustive_search_seconds":1.5944242477416992e-6,"evaluations":8.6796875,"distances_sum":1533.6447413459205}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.693359375, conf: {"ssize":4,"bsize":4}, perf: {"precision":1.0,"recall":0.693359375,"f1":0.8089899683649692,"seconds":2.8498470783233643e-6,"exhaustive_search_seconds":1.5944242477416992e-6,"evaluations":8.0859375,"distances_sum":1058.7989200759168}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.90234375,"state":{"ssize":1,"bsize":8},"perf":{"precision":1.0,"recall":0.90234375,"f1":0.9434809981684986,"seconds":3.7476420402526855e-6,"exhaustive_search_seconds":1.5944242477416992e-6,"evaluations":8.6796875,"distances_sum":1533.6447413459205}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9296875, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.9296875,"f1":0.9608859890109893,"seconds":3.5725533962249756e-6,"exhaustive_search_seconds":1.5944242477416992e-6,"evaluations":8.84375,"distances_sum":1587.1503342101878}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9296875,"state":{"ssize":1,"bsize":9},"perf":{"precision":1.0,"recall":0.9296875,"f1":0.9608859890109893,"seconds":3.5725533962249756e-6,"exhaustive_search_seconds":1.5944242477416992e-6,"evaluations":8.84375,"distances_sum":1587.1503342101878}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9296875,"state":{"ssize":1,"bsize":9},"perf":{"precision":1.0,"recall":0.9296875,"f1":0.9608859890109893,"seconds":3.5725533962249756e-6,"exhaustive_search_seconds":1.5944242477416992e-6,"evaluations":8.84375,"distances_sum":1587.1503342101878}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.587890625, conf: {"ssize":1,"bsize":3}, perf: {"precision":1.0,"recall":0.587890625,"f1":0.7286357739482745,"seconds":5.9099867939949036e-5,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":7.515625,"distances_sum":900.3799524854337}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.248046875, conf: {"ssize":4,"bsize":1}, perf: {"precision":null,"recall":0.248046875,"f1":null,"seconds":2.1532177925109863e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":6.1328125,"distances_sum":381.38829173175753}, best_list's length: 4, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.4296875, conf: {"ssize":4,"bsize":2}, perf: {"precision":null,"recall":0.4296875,"f1":null,"seconds":4.034489393234253e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":6.59375,"distances_sum":638.397211257334}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.587890625,"state":{"ssize":1,"bsize":3},"perf":{"precision":1.0,"recall":0.587890625,"f1":0.7286357739482745,"seconds":5.9099867939949036e-5,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":7.515625,"distances_sum":900.3799524854337}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.869140625, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.869140625,"f1":0.9232085622710627,"seconds":3.6992132663726807e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.640625,"distances_sum":1462.7290362590302}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.779296875, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.779296875,"f1":0.8673883408258417,"seconds":3.3527612686157227e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.4140625,"distances_sum":1262.3573283211929}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.814453125, conf: {"ssize":2,"bsize":6}, perf: {"precision":1.0,"recall":0.814453125,"f1":0.8909455128205134,"seconds":3.1981617212295532e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.5078125,"distances_sum":1333.7533952051026}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.669921875, conf: {"ssize":5,"bsize":4}, perf: {"precision":1.0,"recall":0.669921875,"f1":0.7895961677211685,"seconds":3.0677765607833862e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.0390625,"distances_sum":1036.2448771562483}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7490234375, conf: {"ssize":4,"bsize":5}, perf: {"precision":1.0,"recall":0.7490234375,"f1":0.8457714160839168,"seconds":3.3639371395111084e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.3515625,"distances_sum":1192.351273909584}, best_list's length: 11, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.76171875, conf: {"ssize":8,"bsize":5}, perf: {"precision":1.0,"recall":0.76171875,"f1":0.8577099983349993,"seconds":3.5781413316726685e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.375,"distances_sum":1194.7826402502694}, best_list's length: 12, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.869140625,"state":{"ssize":1,"bsize":7},"perf":{"precision":1.0,"recall":0.869140625,"f1":0.9232085622710627,"seconds":3.6992132663726807e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.640625,"distances_sum":1462.7290362590302}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9013671875, conf: {"ssize":6,"bsize":7}, perf: {"precision":1.0,"recall":0.9013671875,"f1":0.9439820596070599,"seconds":3.4775584936141968e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.7109375,"distances_sum":1529.1123826961293}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9013671875,"state":{"ssize":6,"bsize":7},"perf":{"precision":1.0,"recall":0.9013671875,"f1":0.9439820596070599,"seconds":3.4775584936141968e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.7109375,"distances_sum":1529.1123826961293}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9013671875,"state":{"ssize":6,"bsize":7},"perf":{"precision":1.0,"recall":0.9013671875,"f1":0.9439820596070599,"seconds":3.4775584936141968e-6,"exhaustive_search_seconds":1.259148120880127e-6,"evaluations":8.7109375,"distances_sum":1529.1123826961293}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.234375, conf: {"ssize":4,"bsize":1}, perf: {"precision":null,"recall":0.234375,"f1":null,"seconds":1.773238182067871e-6,"exhaustive_search_seconds":8.67992639541626e-7,"evaluations":5.3203125,"distances_sum":395.99603421946324}, best_list's length: 2, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.234375,"state":{"ssize":4,"bsize":1},"perf":{"precision":null,"recall":0.234375,"f1":null,"seconds":1.773238182067871e-6,"exhaustive_search_seconds":8.67992639541626e-7,"evaluations":5.3203125,"distances_sum":395.99603421946324}}, beam: 2, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5751953125, conf: {"ssize":1,"bsize":3}, perf: {"precision":1.0,"recall":0.5751953125,"f1":0.7149250055500062,"seconds":2.602115273475647e-6,"exhaustive_search_seconds":8.67992639541626e-7,"evaluations":7.15625,"distances_sum":974.3173679768441}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.5751953125,"state":{"ssize":1,"bsize":3},"perf":{"precision":1.0,"recall":0.5751953125,"f1":0.7149250055500062,"seconds":2.602115273475647e-6,"exhaustive_search_seconds":8.67992639541626e-7,"evaluations":7.15625,"distances_sum":974.3173679768441}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8740234375, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.8740234375,"f1":0.9260734057609065,"seconds":3.648921847343445e-6,"exhaustive_search_seconds":8.67992639541626e-7,"evaluations":8.6171875,"distances_sum":1598.6244746120758}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8740234375,"state":{"ssize":1,"bsize":7},"perf":{"precision":1.0,"recall":0.8740234375,"f1":0.9260734057609065,"seconds":3.648921847343445e-6,"exhaustive_search_seconds":8.67992639541626e-7,"evaluations":8.6171875,"distances_sum":1598.6244746120758}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.8740234375,"state":{"ssize":1,"bsize":7},"perf":{"precision":1.0,"recall":0.8740234375,"f1":0.9260734057609065,"seconds":3.648921847343445e-6,"exhaustive_search_seconds":8.67992639541626e-7,"evaluations":8.6171875,"distances_sum":1598.6244746120758}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5654296875, conf: {"ssize":5,"bsize":3}, perf: {"precision":null,"recall":0.5654296875,"f1":null,"seconds":4.0102750062942505e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":7.4296875,"distances_sum":852.5964204280353}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5791015625, conf: {"ssize":1,"bsize":3}, perf: {"precision":1.0,"recall":0.5791015625,"f1":0.7192170676545685,"seconds":4.08664345741272e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":7.53125,"distances_sum":903.2100525219918}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.5791015625,"state":{"ssize":1,"bsize":3},"perf":{"precision":1.0,"recall":0.5791015625,"f1":0.7192170676545685,"seconds":4.08664345741272e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":7.53125,"distances_sum":903.2100525219918}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6611328125, conf: {"ssize":3,"bsize":4}, perf: {"precision":1.0,"recall":0.6611328125,"f1":0.7867257742257749,"seconds":2.946704626083374e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.046875,"distances_sum":1044.5227021019875}, best_list's length: 5, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.6611328125,"state":{"ssize":3,"bsize":4},"perf":{"precision":1.0,"recall":0.6611328125,"f1":0.7867257742257749,"seconds":2.946704626083374e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.046875,"distances_sum":1044.5227021019875}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8359375, conf: {"ssize":3,"bsize":6}, perf: {"precision":1.0,"recall":0.8359375,"f1":0.9064503205128212,"seconds":5.671754479408264e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.7421875,"distances_sum":1417.4154178819163}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.67578125, conf: {"ssize":7,"bsize":4}, perf: {"precision":1.0,"recall":0.67578125,"f1":0.797536838161839,"seconds":4.630535840988159e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.21875,"distances_sum":1074.6098827025712}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8310546875, conf: {"ssize":11,"bsize":6}, perf: {"precision":1.0,"recall":0.8310546875,"f1":0.8993053821178829,"seconds":5.504116415977478e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.609375,"distances_sum":1420.2176155524937}, best_list's length: 7, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8359375,"state":{"ssize":3,"bsize":6},"perf":{"precision":1.0,"recall":0.8359375,"f1":0.9064503205128212,"seconds":5.671754479408264e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.7421875,"distances_sum":1417.4154178819163}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.8359375,"state":{"ssize":3,"bsize":6},"perf":{"precision":1.0,"recall":0.8359375,"f1":0.9064503205128212,"seconds":5.671754479408264e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.7421875,"distances_sum":1417.4154178819163}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.75390625, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.75390625,"f1":0.851506306193807,"seconds":3.332272171974182e-6,"exhaustive_search_seconds":1.000240445137024e-6,"evaluations":8.3671875,"distances_sum":1220.7217129091455}, best_list's length: 2, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.75390625,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.75390625,"f1":0.851506306193807,"seconds":3.332272171974182e-6,"exhaustive_search_seconds":1.000240445137024e-6,"evaluations":8.3671875,"distances_sum":1220.7217129091455}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.75390625,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.75390625,"f1":0.851506306193807,"seconds":3.332272171974182e-6,"exhaustive_search_seconds":1.000240445137024e-6,"evaluations":8.3671875,"distances_sum":1220.7217129091455}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.75390625,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.75390625,"f1":0.851506306193807,"seconds":3.332272171974182e-6,"exhaustive_search_seconds":1.000240445137024e-6,"evaluations":8.3671875,"distances_sum":1220.7217129091455}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.185546875,"state":{"ssize":1,"bsize":1},"perf":{"precision":null,"recall":0.185546875,"f1":null,"seconds":2.767890691757202e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":5.28125,"distances_sum":322.8868556196885}}, beam: 1, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.185546875,"state":{"ssize":1,"bsize":1},"perf":{"precision":null,"recall":0.185546875,"f1":null,"seconds":2.767890691757202e-6,"exhaustive_search_seconds":1.2814998626708984e-6,"evaluations":5.28125,"distances_sum":322.8868556196885}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.6328125, conf: {"ssize":5,"bsize":4}, perf: {"precision":1.0,"recall":0.6328125,"f1":0.7600854007104014,"seconds":4.168599843978882e-6,"exhaustive_search_seconds":1.2647360563278198e-6,"evaluations":7.109375,"distances_sum":1305.0799028709152}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5517578125, conf: {"ssize":5,"bsize":3}, perf: {"precision":1.0,"recall":0.5517578125,"f1":0.6929608585858591,"seconds":3.7997961044311523e-6,"exhaustive_search_seconds":1.2647360563278198e-6,"evaluations":6.2890625,"distances_sum":1084.81608904492}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.369140625, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.369140625,"f1":null,"seconds":3.861263394355774e-6,"exhaustive_search_seconds":1.2647360563278198e-6,"evaluations":4.8671875,"distances_sum":741.6103548877853}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.6328125,"state":{"ssize":5,"bsize":4},"perf":{"precision":1.0,"recall":0.6328125,"f1":0.7600854007104014,"seconds":4.168599843978882e-6,"exhaustive_search_seconds":1.2647360563278198e-6,"evaluations":7.109375,"distances_sum":1305.0799028709152}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.64453125, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.64453125,"f1":0.7715227480852488,"seconds":4.297122359275818e-6,"exhaustive_search_seconds":1.2647360563278198e-6,"evaluations":7.1640625,"distances_sum":1301.8412245615998}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9091796875, conf: {"ssize":5,"bsize":8}, perf: {"precision":1.0,"recall":0.9091796875,"f1":0.9487637362637368,"seconds":5.519017577171326e-6,"exhaustive_search_seconds":1.2647360563278198e-6,"evaluations":8.75,"distances_sum":2239.2693773252595}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.736328125, conf: {"ssize":9,"bsize":5}, perf: {"precision":1.0,"recall":0.736328125,"f1":0.838082230269731,"seconds":5.0514936447143555e-6,"exhaustive_search_seconds":1.2647360563278198e-6,"evaluations":7.7109375,"distances_sum":1606.4665256264075}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7412109375, conf: {"ssize":2,"bsize":5}, perf: {"precision":1.0,"recall":0.7412109375,"f1":0.8450185231435239,"seconds":4.7292560338974e-6,"exhaustive_search_seconds":1.2647360563278198e-6,"evaluations":7.71875,"distances_sum":1596.2349430818042}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8720703125, conf: {"ssize":2,"bsize":7}, perf: {"precision":1.0,"recall":0.8720703125,"f1":0.9253636988011995,"seconds":5.288049578666687e-6,"exhaustive_search_seconds":1.2647360563278198e-6,"evaluations":8.578125,"distances_sum":2087.944924317526}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9091796875,"state":{"ssize":5,"bsize":8},"perf":{"precision":1.0,"recall":0.9091796875,"f1":0.9487637362637368,"seconds":5.519017577171326e-6,"exhaustive_search_seconds":1.2647360563278198e-6,"evaluations":8.75,"distances_sum":2239.2693773252595}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.91796875, conf: {"ssize":2,"bsize":9}, perf: {"precision":1.0,"recall":0.91796875,"f1":0.952163461538462,"seconds":5.805864930152893e-6,"exhaustive_search_seconds":1.2647360563278198e-6,"evaluations":8.703125,"distances_sum":2273.231124320537}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.91796875, conf: {"ssize":3,"bsize":8}, perf: {"precision":1.0,"recall":0.91796875,"f1":0.9539091117216122,"seconds":5.8300793170928955e-6,"exhaustive_search_seconds":1.2647360563278198e-6,"evaluations":8.7734375,"distances_sum":2277.388476061818}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.921875, conf: {"ssize":3,"bsize":9}, perf: {"precision":1.0,"recall":0.921875,"f1":0.9550283050283056,"seconds":5.736947059631348e-6,"exhaustive_search_seconds":1.2647360563278198e-6,"evaluations":8.78125,"distances_sum":2285.5732018970075}, best_list's length: 11, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9208984375, conf: {"ssize":13,"bsize":8}, perf: {"precision":1.0,"recall":0.9208984375,"f1":0.9552312271062274,"seconds":5.707144737243652e-6,"exhaustive_search_seconds":1.2647360563278198e-6,"evaluations":8.796875,"distances_sum":2275.1654891869957}, best_list's length: 14, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.921875,"state":{"ssize":3,"bsize":9},"perf":{"precision":1.0,"recall":0.921875,"f1":0.9550283050283056,"seconds":5.736947059631348e-6,"exhaustive_search_seconds":1.2647360563278198e-6,"evaluations":8.78125,"distances_sum":2285.5732018970075}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.921875,"state":{"ssize":3,"bsize":9},"perf":{"precision":1.0,"recall":0.921875,"f1":0.9550283050283056,"seconds":5.736947059631348e-6,"exhaustive_search_seconds":1.2647360563278198e-6,"evaluations":8.78125,"distances_sum":2285.5732018970075}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2275390625, conf: {"ssize":3,"bsize":1}, perf: {"precision":null,"recall":0.2275390625,"f1":null,"seconds":2.3264437913894653e-6,"exhaustive_search_seconds":9.220093488693237e-7,"evaluations":5.21875,"distances_sum":465.5907611019382}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.73046875, conf: {"ssize":5,"bsize":5}, perf: {"precision":1.0,"recall":0.73046875,"f1":0.8310593919968932,"seconds":3.2205134630203247e-6,"exhaustive_search_seconds":9.220093488693237e-7,"evaluations":7.828125,"distances_sum":1567.6233656331906}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2158203125, conf: {"ssize":2,"bsize":1}, perf: {"precision":null,"recall":0.2158203125,"f1":null,"seconds":3.1869858503341675e-6,"exhaustive_search_seconds":9.220093488693237e-7,"evaluations":5.2578125,"distances_sum":473.46625572856397}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.73046875,"state":{"ssize":5,"bsize":5},"perf":{"precision":1.0,"recall":0.73046875,"f1":0.8310593919968932,"seconds":3.2205134630203247e-6,"exhaustive_search_seconds":9.220093488693237e-7,"evaluations":7.828125,"distances_sum":1567.6233656331906}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.91796875, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.91796875,"f1":0.9537259615384619,"seconds":6.468966603279114e-6,"exhaustive_search_seconds":9.220093488693237e-7,"evaluations":8.8125,"distances_sum":2252.5384966815263}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.849609375, conf: {"ssize":3,"bsize":6}, perf: {"precision":1.0,"recall":0.849609375,"f1":0.9130895146520156,"seconds":5.323439836502075e-6,"exhaustive_search_seconds":9.220093488693237e-7,"evaluations":8.3515625,"distances_sum":1967.3197033313925}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9248046875, conf: {"ssize":4,"bsize":9}, perf: {"precision":1.0,"recall":0.9248046875,"f1":0.9585393772893778,"seconds":6.290152668952942e-6,"exhaustive_search_seconds":9.220093488693237e-7,"evaluations":8.7890625,"distances_sum":2271.526042975328}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7734375, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.7734375,"f1":0.8632102272727283,"seconds":5.031004548072815e-6,"exhaustive_search_seconds":9.220093488693237e-7,"evaluations":7.9765625,"distances_sum":1716.4526272396274}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9248046875,"state":{"ssize":4,"bsize":9},"perf":{"precision":1.0,"recall":0.9248046875,"f1":0.9585393772893778,"seconds":6.290152668952942e-6,"exhaustive_search_seconds":9.220093488693237e-7,"evaluations":8.7890625,"distances_sum":2271.526042975328}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9716796875, conf: {"ssize":1,"bsize":13}, perf: {"precision":1.0,"recall":0.9716796875,"f1":0.9845982142857145,"seconds":6.3087791204452515e-6,"exhaustive_search_seconds":9.220093488693237e-7,"evaluations":8.9765625,"distances_sum":2434.327957746926}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9462890625, conf: {"ssize":1,"bsize":11}, perf: {"precision":1.0,"recall":0.9462890625,"f1":0.9697058150183153,"seconds":5.5730342864990234e-6,"exhaustive_search_seconds":9.220093488693237e-7,"evaluations":8.8828125,"distances_sum":2334.4004211423326}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.95703125, conf: {"ssize":2,"bsize":11}, perf: {"precision":1.0,"recall":0.95703125,"f1":0.9761904761904766,"seconds":6.496906280517578e-6,"exhaustive_search_seconds":9.220093488693237e-7,"evaluations":8.9375,"distances_sum":2377.8822775769313}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9443359375, conf: {"ssize":1,"bsize":12}, perf: {"precision":1.0,"recall":0.9443359375,"f1":0.9690132783882788,"seconds":6.427988409996033e-6,"exhaustive_search_seconds":9.220093488693237e-7,"evaluations":8.9140625,"distances_sum":2320.362561531359}, best_list's length: 11, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9287109375, conf: {"ssize":3,"bsize":9}, perf: {"precision":1.0,"recall":0.9287109375,"f1":0.9588770604395608,"seconds":5.541369318962097e-6,"exhaustive_search_seconds":9.220093488693237e-7,"evaluations":8.8046875,"distances_sum":2292.5935718831915}, best_list's length: 14, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9716796875,"state":{"ssize":1,"bsize":13},"perf":{"precision":1.0,"recall":0.9716796875,"f1":0.9845982142857145,"seconds":6.3087791204452515e-6,"exhaustive_search_seconds":9.220093488693237e-7,"evaluations":8.9765625,"distances_sum":2434.327957746926}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9716796875,"state":{"ssize":1,"bsize":13},"perf":{"precision":1.0,"recall":0.9716796875,"f1":0.9845982142857145,"seconds":6.3087791204452515e-6,"exhaustive_search_seconds":9.220093488693237e-7,"evaluations":8.9765625,"distances_sum":2434.327957746926}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.19921875, conf: {"ssize":5,"bsize":1}, perf: {"precision":null,"recall":0.19921875,"f1":null,"seconds":2.780929207801819e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":4.7578125,"distances_sum":444.1072079991291}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.3564453125, conf: {"ssize":4,"bsize":2}, perf: {"precision":null,"recall":0.3564453125,"f1":null,"seconds":3.885477781295776e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":5.15625,"distances_sum":788.2860276746247}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.5068359375, conf: {"ssize":3,"bsize":3}, perf: {"precision":1.0,"recall":0.5068359375,"f1":0.6559114496614499,"seconds":3.820285201072693e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":6.34375,"distances_sum":1136.690049377715}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.5068359375,"state":{"ssize":3,"bsize":3},"perf":{"precision":1.0,"recall":0.5068359375,"f1":0.6559114496614499,"seconds":3.820285201072693e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":6.34375,"distances_sum":1136.690049377715}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.509765625, conf: {"ssize":5,"bsize":3}, perf: {"precision":1.0,"recall":0.509765625,"f1":0.6583241411366416,"seconds":3.7960708141326904e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":6.3125,"distances_sum":1144.833178003675}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8330078125, conf: {"ssize":2,"bsize":6}, perf: {"precision":1.0,"recall":0.8330078125,"f1":0.9033424908424915,"seconds":5.755573511123657e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.6640625,"distances_sum":1972.4900591611072}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.65234375, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.65234375,"f1":0.7780483405483413,"seconds":5.098059773445129e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":7.46875,"distances_sum":1402.0355673327015}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.81640625, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.81640625,"f1":0.8902363261738271,"seconds":5.802139639854431e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.625,"distances_sum":1954.6882399661806}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8095703125, conf: {"ssize":4,"bsize":6}, perf: {"precision":1.0,"recall":0.8095703125,"f1":0.8872773060273068,"seconds":5.7443976402282715e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.4765625,"distances_sum":1949.5623866724977}, best_list's length: 10, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8330078125,"state":{"ssize":2,"bsize":6},"perf":{"precision":1.0,"recall":0.8330078125,"f1":0.9033424908424915,"seconds":5.755573511123657e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.6640625,"distances_sum":1972.4900591611072}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8984375, conf: {"ssize":6,"bsize":8}, perf: {"precision":1.0,"recall":0.8984375,"f1":0.9412150349650357,"seconds":5.736947059631348e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.71875,"distances_sum":2329.9653358161468}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9453125, conf: {"ssize":2,"bsize":10}, perf: {"precision":1.0,"recall":0.9453125,"f1":0.9691449175824178,"seconds":6.204470992088318e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.8828125,"distances_sum":2465.599881347174}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9404296875, conf: {"ssize":1,"bsize":10}, perf: {"precision":1.0,"recall":0.9404296875,"f1":0.9669871794871799,"seconds":6.198883056640625e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.8671875,"distances_sum":2460.150098622488}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.93359375, conf: {"ssize":4,"bsize":10}, perf: {"precision":1.0,"recall":0.93359375,"f1":0.9628376831501836,"seconds":6.1802566051483154e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.8515625,"distances_sum":2444.191883331782}, best_list's length: 9, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.939453125, conf: {"ssize":7,"bsize":10}, perf: {"precision":1.0,"recall":0.939453125,"f1":0.9657222985347989,"seconds":6.075948476791382e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.8828125,"distances_sum":2459.2959655577565}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.900390625, conf: {"ssize":4,"bsize":8}, perf: {"precision":1.0,"recall":0.900390625,"f1":0.9427941849816852,"seconds":5.125999450683594e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.7890625,"distances_sum":2316.2692286000447}, best_list's length: 13, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9453125,"state":{"ssize":2,"bsize":10},"perf":{"precision":1.0,"recall":0.9453125,"f1":0.9691449175824178,"seconds":6.204470992088318e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.8828125,"distances_sum":2465.599881347174}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9453125,"state":{"ssize":2,"bsize":10},"perf":{"precision":1.0,"recall":0.9453125,"f1":0.9691449175824178,"seconds":6.204470992088318e-6,"exhaustive_search_seconds":1.3206154108047485e-6,"evaluations":8.8828125,"distances_sum":2465.599881347174}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.490234375, conf: {"ssize":1,"bsize":3}, perf: {"precision":1.0,"recall":0.490234375,"f1":0.644135031635032,"seconds":3.7476420402526855e-6,"exhaustive_search_seconds":1.344829797744751e-6,"evaluations":6.046875,"distances_sum":1047.1621154675859}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.650390625, conf: {"ssize":4,"bsize":4}, perf: {"precision":null,"recall":0.650390625,"f1":null,"seconds":4.213303327560425e-6,"exhaustive_search_seconds":1.344829797744751e-6,"evaluations":7.046875,"distances_sum":1472.5180337554593}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.642578125, conf: {"ssize":2,"bsize":4}, perf: {"precision":1.0,"recall":0.642578125,"f1":0.7661147879897887,"seconds":4.189088940620422e-6,"exhaustive_search_seconds":1.344829797744751e-6,"evaluations":7.09375,"distances_sum":1425.2198892657389}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.650390625,"state":{"ssize":4,"bsize":4},"perf":{"precision":null,"recall":0.650390625,"f1":null,"seconds":4.213303327560425e-6,"exhaustive_search_seconds":1.344829797744751e-6,"evaluations":7.046875,"distances_sum":1472.5180337554593}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.892578125, conf: {"ssize":4,"bsize":8}, perf: {"precision":1.0,"recall":0.892578125,"f1":0.9379037629037634,"seconds":5.258247256278992e-6,"exhaustive_search_seconds":1.344829797744751e-6,"evaluations":8.6171875,"distances_sum":2302.20485689724}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.65234375, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.65234375,"f1":0.7771096958596967,"seconds":3.8780272006988525e-6,"exhaustive_search_seconds":1.344829797744751e-6,"evaluations":7.09375,"distances_sum":1491.7996252494268}, best_list's length: 8, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8134765625, conf: {"ssize":6,"bsize":6}, perf: {"precision":1.0,"recall":0.8134765625,"f1":0.8880504911754917,"seconds":5.11854887008667e-6,"exhaustive_search_seconds":1.344829797744751e-6,"evaluations":8.2578125,"distances_sum":1956.827155407367}, best_list's length: 10, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8369140625, conf: {"ssize":1,"bsize":6}, perf: {"precision":1.0,"recall":0.8369140625,"f1":0.9030313436563443,"seconds":6.0051679611206055e-6,"exhaustive_search_seconds":1.344829797744751e-6,"evaluations":8.3359375,"distances_sum":2024.2007066931933}, best_list's length: 13, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8486328125, conf: {"ssize":4,"bsize":6}, perf: {"precision":1.0,"recall":0.8486328125,"f1":0.9104884698634708,"seconds":6.230548024177551e-6,"exhaustive_search_seconds":1.344829797744751e-6,"evaluations":8.4140625,"distances_sum":2113.5631282914173}, best_list's length: 14, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.892578125,"state":{"ssize":4,"bsize":8},"perf":{"precision":1.0,"recall":0.892578125,"f1":0.9379037629037634,"seconds":5.258247256278992e-6,"exhaustive_search_seconds":1.344829797744751e-6,"evaluations":8.6171875,"distances_sum":2302.20485689724}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9345703125, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.9345703125,"f1":0.9632497710622715,"seconds":6.511807441711426e-6,"exhaustive_search_seconds":1.344829797744751e-6,"evaluations":8.8671875,"distances_sum":2436.7381890248867}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.94921875, conf: {"ssize":1,"bsize":12}, perf: {"precision":1.0,"recall":0.94921875,"f1":0.9717090201465208,"seconds":6.493180990219116e-6,"exhaustive_search_seconds":1.344829797744751e-6,"evaluations":8.890625,"distances_sum":2485.730095681118}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9033203125, conf: {"ssize":6,"bsize":8}, perf: {"precision":1.0,"recall":0.9033203125,"f1":0.9447802197802204,"seconds":5.906447768211365e-6,"exhaustive_search_seconds":1.344829797744751e-6,"evaluations":8.6953125,"distances_sum":2351.1440478261115}, best_list's length: 9, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.94921875,"state":{"ssize":1,"bsize":12},"perf":{"precision":1.0,"recall":0.94921875,"f1":0.9717090201465208,"seconds":6.493180990219116e-6,"exhaustive_search_seconds":1.344829797744751e-6,"evaluations":8.890625,"distances_sum":2485.730095681118}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.94921875,"state":{"ssize":1,"bsize":12},"perf":{"precision":1.0,"recall":0.94921875,"f1":0.9717090201465208,"seconds":6.493180990219116e-6,"exhaustive_search_seconds":1.344829797744751e-6,"evaluations":8.890625,"distances_sum":2485.730095681118}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.4404296875, conf: {"ssize":5,"bsize":2}, perf: {"precision":null,"recall":0.4404296875,"f1":null,"seconds":4.24310564994812e-6,"exhaustive_search_seconds":1.5553086996078491e-6,"evaluations":6.234375,"distances_sum":911.7696022115305}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7705078125, conf: {"ssize":3,"bsize":5}, perf: {"precision":1.0,"recall":0.7705078125,"f1":0.8624578546453555,"seconds":5.8282166719436646e-6,"exhaustive_search_seconds":1.5553086996078491e-6,"evaluations":8.1015625,"distances_sum":1752.988504640284}, best_list's length: 3, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.2841796875, conf: {"ssize":2,"bsize":1}, perf: {"precision":null,"recall":0.2841796875,"f1":null,"seconds":3.7997961044311523e-6,"exhaustive_search_seconds":1.5553086996078491e-6,"evaluations":6.6328125,"distances_sum":588.6786369189941}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.7705078125,"state":{"ssize":3,"bsize":5},"perf":{"precision":1.0,"recall":0.7705078125,"f1":0.8624578546453555,"seconds":5.8282166719436646e-6,"exhaustive_search_seconds":1.5553086996078491e-6,"evaluations":8.1015625,"distances_sum":1752.988504640284}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9208984375, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.9208984375,"f1":0.9553228021978029,"seconds":6.804242730140686e-6,"exhaustive_search_seconds":1.5553086996078491e-6,"evaluations":8.890625,"distances_sum":2278.775002050508}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.94140625, conf: {"ssize":1,"bsize":9}, perf: {"precision":1.0,"recall":0.94140625,"f1":0.9673191391941396,"seconds":7.074326276779175e-6,"exhaustive_search_seconds":1.5553086996078491e-6,"evaluations":8.890625,"distances_sum":2370.4219603112133}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.935546875, conf: {"ssize":7,"bsize":9}, perf: {"precision":1.0,"recall":0.935546875,"f1":0.9629323801198808,"seconds":6.256625056266785e-6,"exhaustive_search_seconds":1.5553086996078491e-6,"evaluations":8.9375,"distances_sum":2342.4834762816035}, best_list's length: 8, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.94140625,"state":{"ssize":1,"bsize":9},"perf":{"precision":1.0,"recall":0.94140625,"f1":0.9673191391941396,"seconds":7.074326276779175e-6,"exhaustive_search_seconds":1.5553086996078491e-6,"evaluations":8.890625,"distances_sum":2370.4219603112133}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9599609375, conf: {"ssize":1,"bsize":11}, perf: {"precision":1.0,"recall":0.9599609375,"f1":0.9778846153846159,"seconds":6.310641765594482e-6,"exhaustive_search_seconds":1.5553086996078491e-6,"evaluations":8.9609375,"distances_sum":2441.6399738732175}, best_list's length: 6, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9560546875, conf: {"ssize":3,"bsize":11}, perf: {"precision":1.0,"recall":0.9560546875,"f1":0.9756524725274727,"seconds":4.936009645462036e-6,"exhaustive_search_seconds":1.5553086996078491e-6,"evaluations":8.9453125,"distances_sum":2438.639882383057}, best_list's length: 12, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9599609375,"state":{"ssize":1,"bsize":11},"perf":{"precision":1.0,"recall":0.9599609375,"f1":0.9778846153846159,"seconds":6.310641765594482e-6,"exhaustive_search_seconds":1.5553086996078491e-6,"evaluations":8.9609375,"distances_sum":2441.6399738732175}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9599609375,"state":{"ssize":1,"bsize":11},"perf":{"precision":1.0,"recall":0.9599609375,"f1":0.9778846153846159,"seconds":6.310641765594482e-6,"exhaustive_search_seconds":1.5553086996078491e-6,"evaluations":8.9609375,"distances_sum":2441.6399738732175}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.3642578125, conf: {"ssize":1,"bsize":2}, perf: {"precision":null,"recall":0.3642578125,"f1":null,"seconds":2.8070062398910522e-6,"exhaustive_search_seconds":1.3504177331924438e-6,"evaluations":5.6796875,"distances_sum":696.3369116368499}, best_list's length: 2, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.75, conf: {"ssize":1,"bsize":5}, perf: {"precision":1.0,"recall":0.75,"f1":0.8479863886113893,"seconds":3.9711594581604e-6,"exhaustive_search_seconds":1.3504177331924438e-6,"evaluations":7.90625,"distances_sum":1744.2126887738054}, best_list's length: 3, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.75,"state":{"ssize":1,"bsize":5},"perf":{"precision":1.0,"recall":0.75,"f1":0.8479863886113893,"seconds":3.9711594581604e-6,"exhaustive_search_seconds":1.3504177331924438e-6,"evaluations":7.90625,"distances_sum":1744.2126887738054}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.8916015625, conf: {"ssize":3,"bsize":7}, perf: {"precision":1.0,"recall":0.8916015625,"f1":0.9365649975024979,"seconds":4.822388291358948e-6,"exhaustive_search_seconds":1.3504177331924438e-6,"evaluations":8.671875,"distances_sum":2240.3778533353084}, best_list's length: 4, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.8916015625,"state":{"ssize":3,"bsize":7},"perf":{"precision":1.0,"recall":0.8916015625,"f1":0.9365649975024979,"seconds":4.822388291358948e-6,"exhaustive_search_seconds":1.3504177331924438e-6,"evaluations":8.671875,"distances_sum":2240.3778533353084}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.904296875, conf: {"ssize":1,"bsize":8}, perf: {"precision":1.0,"recall":0.904296875,"f1":0.9447115384615391,"seconds":5.81890344619751e-6,"exhaustive_search_seconds":1.3504177331924438e-6,"evaluations":8.734375,"distances_sum":2328.8369414600675}, best_list's length: 6, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.904296875,"state":{"ssize":1,"bsize":8},"perf":{"precision":1.0,"recall":0.904296875,"f1":0.9447115384615391,"seconds":5.81890344619751e-6,"exhaustive_search_seconds":1.3504177331924438e-6,"evaluations":8.734375,"distances_sum":2328.8369414600675}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.904296875,"state":{"ssize":1,"bsize":8},"perf":{"precision":1.0,"recall":0.904296875,"f1":0.9447115384615391,"seconds":5.81890344619751e-6,"exhaustive_search_seconds":1.3504177331924438e-6,"evaluations":8.734375,"distances_sum":2328.8369414600675}}, n: 9
==== BEGIN Opt. BeamSearch, expected recall: 0.99, n: 9
== Begin Opt. BeamSearch iteration: 1, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.62109375, conf: {"ssize":1,"bsize":4}, perf: {"precision":1.0,"recall":0.62109375,"f1":0.7516023906648914,"seconds":4.161149263381958e-6,"exhaustive_search_seconds":1.257285475730896e-6,"evaluations":7.4921875,"distances_sum":1394.4873000164823}, best_list's length: 2, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.62109375,"state":{"ssize":1,"bsize":4},"perf":{"precision":1.0,"recall":0.62109375,"f1":0.7516023906648914,"seconds":4.161149263381958e-6,"exhaustive_search_seconds":1.257285475730896e-6,"evaluations":7.4921875,"distances_sum":1394.4873000164823}}, beam: 3, n: 9
== Begin Opt. BeamSearch iteration: 2, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.896484375, conf: {"ssize":1,"bsize":7}, perf: {"precision":1.0,"recall":0.896484375,"f1":0.9388913170163179,"seconds":4.706904292106628e-6,"exhaustive_search_seconds":1.257285475730896e-6,"evaluations":8.7578125,"distances_sum":2210.123077457505}, best_list's length: 5, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.7880859375, conf: {"ssize":2,"bsize":5}, perf: {"precision":1.0,"recall":0.7880859375,"f1":0.8736612345987355,"seconds":4.1853636503219604e-6,"exhaustive_search_seconds":1.257285475730896e-6,"evaluations":8.640625,"distances_sum":1788.6589477902053}, best_list's length: 7, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.640625, conf: {"ssize":7,"bsize":4}, perf: {"precision":1.0,"recall":0.640625,"f1":0.7680609321234328,"seconds":4.403293132781982e-6,"exhaustive_search_seconds":1.257285475730896e-6,"evaluations":7.6796875,"distances_sum":1448.4043749960356}, best_list's length: 8, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.896484375,"state":{"ssize":1,"bsize":7},"perf":{"precision":1.0,"recall":0.896484375,"f1":0.9388913170163179,"seconds":4.706904292106628e-6,"exhaustive_search_seconds":1.257285475730896e-6,"evaluations":8.7578125,"distances_sum":2210.123077457505}}, beam: 4, n: 9
== Begin Opt. BeamSearch iteration: 3, expected recall: 0.99, n: 9
** Opt. BeamSearch. A new best conf was found> score: 0.9453125, conf: {"ssize":1,"bsize":10}, perf: {"precision":1.0,"recall":0.9453125,"f1":0.969368131868132,"seconds":5.433335900306702e-6,"exhaustive_search_seconds":1.257285475730896e-6,"evaluations":8.953125,"distances_sum":2354.057336727398}, best_list's length: 6, n: 9
== End Opt. BeamSearch. Iteration finished; {"score":0.9453125,"state":{"ssize":1,"bsize":10},"perf":{"precision":1.0,"recall":0.9453125,"f1":0.969368131868132,"seconds":5.433335900306702e-6,"exhaustive_search_seconds":1.257285475730896e-6,"evaluations":8.953125,"distances_sum":2354.057336727398}}, beam: 4, n: 9
==== END Opt. BeamSearch. Finished, best: {"score":0.9453125,"state":{"ssize":1,"bsize":10},"perf":{"precision":1.0,"recall":0.9453125,"f1":0.969368131868132,"seconds":5.433335900306702e-6,"exhaustive_search_seconds":1.257285475730896e-6,"evaluations":8.953125,"distances_sum":2354.057336727398}}, n: 9
inertia(cfft.distances) = 19.398514610389615
inertia(cdnet.distances) = 22.4261291401409
inertia(crand.distances) = 20.583225649350663
Test Summary: |
Clustering with KCenters with an approximate index | No tests
===> k=3
===> (k=3, initial=fft, maxiters=0); macro-recall: 0.8977777777777778
===> (k=3, initial=fft, maxiters=3); macro-recall: 0.8866666666666667
===> (k=3, initial=fft, maxiters=10); macro-recall: 0.8977777777777778
===> (k=3, initial=dnet, maxiters=0); macro-recall: 0.8977777777777778
===> (k=3, initial=dnet, maxiters=3); macro-recall: 0.8911111111111111
===> (k=3, initial=dnet, maxiters=10); macro-recall: 0.8977777777777778
===> (k=3, initial=rand, maxiters=0); macro-recall: 0.8911111111111111
===> (k=3, initial=rand, maxiters=3); macro-recall: 0.8911111111111111
===> (k=3, initial=rand, maxiters=10); macro-recall: 0.8933333333333334
===> k=5
===> (k=5, initial=fft, maxiters=0); macro-recall: 0.9377777777777778
===> (k=5, initial=fft, maxiters=3); macro-recall: 0.94
===> (k=5, initial=fft, maxiters=10); macro-recall: 0.9444444444444445
===> (k=5, initial=dnet, maxiters=0); macro-recall: 0.9266666666666666
===> (k=5, initial=dnet, maxiters=3); macro-recall: 0.9222222222222222
===> (k=5, initial=dnet, maxiters=10); macro-recall: 0.9444444444444445
===> (k=5, initial=rand, maxiters=0); macro-recall: 0.8888888888888888
===> (k=5, initial=rand, maxiters=3); macro-recall: 0.9155555555555556
===> (k=5, initial=rand, maxiters=10); macro-recall: 0.9422222222222222
===> k=7
===> (k=7, initial=fft, maxiters=0); macro-recall: 0.928888888888889
===> (k=7, initial=fft, maxiters=3); macro-recall: 0.9244444444444445
===> (k=7, initial=fft, maxiters=10); macro-recall: 0.9377777777777778
===> (k=7, initial=dnet, maxiters=0); macro-recall: 0.931111111111111
===> (k=7, initial=dnet, maxiters=3); macro-recall: 0.9244444444444445
===> (k=7, initial=dnet, maxiters=10); macro-recall: 0.9177777777777778
===> (k=7, initial=rand, maxiters=0); macro-recall: 0.9288888888888889
===> (k=7, initial=rand, maxiters=3); macro-recall: 0.9288888888888889
===> (k=7, initial=rand, maxiters=10); macro-recall: 0.9222222222222222
===> k=11
===> (k=11, initial=fft, maxiters=0); macro-recall: 0.9044444444444445
===> (k=11, initial=fft, maxiters=3); macro-recall: 0.8977777777777778
===> (k=11, initial=fft, maxiters=10); macro-recall: 0.9022222222222221
===> (k=11, initial=dnet, maxiters=0); macro-recall: 0.9022222222222221
===> (k=11, initial=dnet, maxiters=3); macro-recall: 0.9199999999999999
===> (k=11, initial=dnet, maxiters=10); macro-recall: 0.86
===> (k=11, initial=rand, maxiters=0); macro-recall: 0.9066666666666667
===> (k=11, initial=rand, maxiters=3); macro-recall: 0.8933333333333334
===> (k=11, initial=rand, maxiters=10); macro-recall: 0.9
Test Summary: | Pass Total
One class classifier with DeloneHistogram | 144 144
[ Info: ("XXXXXX===== rocchio like>", (KCenters.gaussian_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX===== rocchio like>", (KCenters.laplacian_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX===== rocchio like>", (KCenters.cauchy_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX===== rocchio like>", (KCenters.sigmoid_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX===== rocchio like>", (KCenters.tanh_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX===== rocchio like>", (KCenters.relu_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX===== rocchio like>", (KCenters.direct_kernel, SimilaritySearch.l2_distance))
[ Info: ("XXXXXX==== clustering>", (KCenters.relu_kernel, SimilaritySearch.l2_distance))
nc.class_map = [2, 1, 3, 2, 1, 3, 3, 3, 3, 3, 3, 2, 1, 3, 2, 3, 3, 2, 1, 3, 3]
[ Info: ("XXXXXX==== split_entropy>", (KCenters.relu_kernel, SimilaritySearch.l2_distance))
** centroid: 1, normalized-entropy: 0.0, [0, 0, 22]
** centroid: 2, normalized-entropy: 0.0, [20, 0, 0]
** centroid: 3, normalized-entropy: 0.0, [0, 4, 0]
** centroid: 4, normalized-entropy: 0.0, [8, 0, 0]
** centroid: 5, normalized-entropy: 0.0, [0, 19, 0]
** centroid: 6, normalized-entropy: 0.0, [0, 0, 3]
** centroid: 7, normalized-entropy: 0.0, [0, 0, 9]
** centroid: 8, normalized-entropy: 0.7219280948873623, [0, 4, 1]
centroid 8, labels=[2, 3], freqs: [0, 4, 1]
** centroid: 9, normalized-entropy: 0.0, [22, 0, 0]
** centroid: 10, normalized-entropy: 0.8812908992306927, [0, 3, 7]
centroid 10, labels=[2, 3], freqs: [0, 3, 7]
** centroid: 11, normalized-entropy: 0.0, [0, 19, 0]
** centroid: 12, normalized-entropy: 0.5032583347756456, [0, 1, 8]
centroid 12, labels=[2, 3], freqs: [0, 1, 8]
finished with 15 centroids; started with 12
nc.class_map = [3, 1, 2, 1, 2, 3, 3, 2, 3, 1, 2, 3, 2, 2, 3]
acc = 0.9333333333333333
*** starting iteration: 1; err: [Inf, 0.33133333562679135] ***
*** computing centroids ***
*** computing 12 nearest references ***
*** new score with 12 references: [Inf, 0.33133333562679135, 0.18075495656656893] ***
*** starting iteration: 2; err: [Inf, 0.33133333562679135, 0.18075495656656893] ***
*** computing centroids ***
*** computing 12 nearest references ***
*** new score with 12 references: [Inf, 0.33133333562679135, 0.18075495656656893, 0.16920577372125448] ***
*** starting iteration: 3; err: [Inf, 0.33133333562679135, 0.18075495656656893, 0.16920577372125448] ***
*** computing centroids ***
*** computing 12 nearest references ***
*** new score with 12 references: [Inf, 0.33133333562679135, 0.18075495656656893, 0.16920577372125448, 0.16340064487211645] ***
*** starting iteration: 4; err: [Inf, 0.33133333562679135, 0.18075495656656893, 0.16920577372125448, 0.16340064487211645] ***
*** computing centroids ***
*** computing 12 nearest references ***
*** new score with 12 references: [Inf, 0.33133333562679135, 0.18075495656656893, 0.16920577372125448, 0.16340064487211645, 0.16111774797772666] ***
*** starting iteration: 5; err: [Inf, 0.33133333562679135, 0.18075495656656893, 0.16920577372125448, 0.16340064487211645, 0.16111774797772666] ***
*** computing centroids ***
*** computing 12 nearest references ***
*** new score with 12 references: [Inf, 0.33133333562679135, 0.18075495656656893, 0.16920577372125448, 0.16340064487211645, 0.16111774797772666, 0.15865059198188872] ***
*** starting iteration: 6; err: [Inf, 0.33133333562679135, 0.18075495656656893, 0.16920577372125448, 0.16340064487211645, 0.16111774797772666, 0.15865059198188872] ***
*** computing centroids ***
*** computing 12 nearest references ***
*** new score with 12 references: [Inf, 0.33133333562679135, 0.18075495656656893, 0.16920577372125448, 0.16340064487211645, 0.16111774797772666, 0.15865059198188872, 0.15841602982984784] ***
*** finished computation of 12 references, err: [Inf, 0.33133333562679135, 0.18075495656656893, 0.16920577372125448, 0.16340064487211645, 0.16111774797772666, 0.15865059198188872, 0.15841602982984784] ***
** centroid: 1, normalized-entropy: 0.0, [0, 0, 9]
** centroid: 2, normalized-entropy: 0.0, [20, 0, 0]
** centroid: 3, normalized-entropy: 0.3533593350214213, [0, 14, 1]
** centroid: 4, normalized-entropy: 0.0, [8, 0, 0]
** centroid: 5, normalized-entropy: 0.6193821946787638, [0, 2, 11]
centroid 5, labels=[2, 3], freqs: [0, 2, 11]
** centroid: 6, normalized-entropy: 0.0, [0, 12, 0]
** centroid: 7, normalized-entropy: 0.8112781244591327, [0, 3, 1]
centroid 7, labels=[2, 3], freqs: [0, 3, 1]
** centroid: 8, normalized-entropy: 0.0, [0, 0, 3]
** centroid: 9, normalized-entropy: 0.0, [0, 0, 9]
** centroid: 10, normalized-entropy: 0.0, [0, 0, 16]
** centroid: 11, normalized-entropy: 0.0, [22, 0, 0]
** centroid: 12, normalized-entropy: 0.0, [0, 19, 0]
finished with 14 centroids; started with 12
acc = 0.9733333333333334
Test Summary: | Pass Total
NearestCentroid | 10 10
[56, 1, 2, 38, 16, 33, 1, 20, 16, 1, 2, 26, 10, 12, 19, 29, 25, 33, 4, 23, 28, 21, 29, 27, 32, 36, 49, 24, 27, 21, 2, 1, 41, 27, 30, 28, 27, 51, 25, 42, 60, 15, 45, 33, 30, 30, 33, 30, 54, 22, 27, 37, 35, 23, 26, 26, 39, 44, 17, 35, 16, 22, 24, 32, 30, 56, 27, 37, 30, 37, 36, 28, 37, 13, 34, 20, 28, 27, 30, 32, 29, 31, 42, 50, 32, 24, 22, 56, 30, 42, 33, 37, 30, 25, 36, 34, 38, 28, 43, 49, 29, 32, 29, 1, 33, 22, 47, 46, 33, 43, 34, 27, 20, 38, 2, 2, 36, 24, 38, 23, 56, 44, 22, 43, 34, 41, 27, 30, 23, 29, 12, 35, 38, 30, 48, 28, 33, 25, 11, 25, 18, 32, 54, 39, 37, 48, 44, 61, 18, 32, 21, 25, 43, 29, 42, 80, 22, 60, 44, 43, 37, 50, 35, 38, 43, 37, 40, 29, 29, 31, 31, 24, 22, 38, 29, 58, 34, 24, 38, 1, 37, 12, 37, 63, 15, 38, 41, 34, 38, 30, 10, 48, 39, 53, 44, 40, 34, 39, 43, 60, 27, 44, 62, 40, 49, 36, 45, 5, 37, 38, 19, 32, 39, 2, 49, 24, 47, 42, 21, 30, 41, 5, 28, 27, 22, 32, 29, 37, 38, 41, 30, 44, 42, 29, 45, 33, 27, 31, 29, 59, 30, 34, 46, 37, 48, 49, 44, 38, 40, 45, 29, 48, 35, 16, 61, 26, 17, 46, 76, 35, 50, 45, 25, 4, 31, 46, 50, 41, 40, 29, 37, 62, 20, 20, 45, 18, 25, 58, 32, 41, 29, 36, 27, 4, 63, 26, 40, 35, 14, 65, 39, 65, 41, 65, 46, 12, 34, 53, 64, 55]
┌ Info: before optimization
└ (recall = p.recall, speedup = p.exhaustive_search_seconds / p.seconds, eval_ratio = p.evaluations / length(X)) = (recall = 0.5950000000000002, speedup = 0.32407111961993906, eval_ratio = 0.041567)
KCenters.DeloneInvIndex> optimizing for recall=0.8
KCenters.DeloneInvIndex> optimize! step region_expansion=2, performance {"precision":0.40364583333333326,"recall":0.40364583333333326,"f1":null,"seconds":7.458962500095367e-5,"exhaustive_search_seconds":0.000360000878572464,"evaluations":341.9140625,"distances_sum":1715.4621441962886}
KCenters.DeloneInvIndex> optimize! step region_expansion=3, performance {"precision":0.5677083333333331,"recall":0.5677083333333331,"f1":null,"seconds":0.00011133775115013123,"exhaustive_search_seconds":0.000360000878572464,"evaluations":379.609375,"distances_sum":1611.8090178575728}
KCenters.DeloneInvIndex> optimize! step region_expansion=4, performance {"precision":0.6571180555555551,"recall":0.6571180555555551,"f1":0.6571180555555551,"seconds":0.0001399107277393341,"exhaustive_search_seconds":0.000360000878572464,"evaluations":418.8203125,"distances_sum":1576.4568581634117}
KCenters.DeloneInvIndex> optimize! step region_expansion=5, performance {"precision":0.7361111111111106,"recall":0.7361111111111106,"f1":0.7361111111111106,"seconds":0.0003027934581041336,"exhaustive_search_seconds":0.000360000878572464,"evaluations":460.4765625,"distances_sum":1553.8427462812606}
KCenters.DeloneInvIndex> optimize! step region_expansion=6, performance {"precision":0.7994791666666657,"recall":0.7994791666666657,"f1":0.7994791666666657,"seconds":0.00020020082592964172,"exhaustive_search_seconds":0.000360000878572464,"evaluations":503.5703125,"distances_sum":1538.32487385658}
KCenters.DeloneInvIndex> reached performance {"precision":0.8411458333333319,"recall":0.8411458333333319,"f1":0.8411458333333319,"seconds":0.00022644735872745514,"exhaustive_search_seconds":0.000360000878572464,"evaluations":545.3125,"distances_sum":1529.2066745600366}
┌ Info: after optimization
└ (recall = p.recall, speedup = p.exhaustive_search_seconds / p.seconds, eval_ratio = p.evaluations / length(X)) = (recall = 0.7909999999999999, speedup = 1.1803400408909934, eval_ratio = 0.053278)
Test Summary: | Pass Total
Testing Delone Inverted Index | 1 1
Testing KCenters tests passed