BenchmarkTools

← Back to package list

If you think that there is an error in how your package is being tested or represented, please file an issue at NewPkgEval.jl, making sure to read the FAQ first.

Results with Julia v1.2.0

Testing was successful. Last evaluation was ago and took 2 minutes, 16 seconds.

Click here to download the log file.

 Resolving package versions...
 Installed Parsers ──────── v0.3.10
 Installed BenchmarkTools ─ v0.4.3
 Installed JSON ─────────── v0.21.0
  Updating `~/.julia/environments/v1.2/Project.toml`
  [6e4b80f9] + BenchmarkTools v0.4.3
  Updating `~/.julia/environments/v1.2/Manifest.toml`
  [6e4b80f9] + BenchmarkTools v0.4.3
  [682c06a0] + JSON v0.21.0
  [69de0a69] + Parsers v0.3.10
  [2a0f44e3] + Base64 
  [ade2ca70] + Dates 
  [8ba89e20] + Distributed 
  [b77e0a4c] + InteractiveUtils 
  [8f399da3] + Libdl 
  [37e2e46d] + LinearAlgebra 
  [56ddb016] + Logging 
  [d6f4376e] + Markdown 
  [a63ad114] + Mmap 
  [de0858da] + Printf 
  [9a3f8284] + Random 
  [9e88b42a] + Serialization 
  [6462fe0b] + Sockets 
  [2f01184e] + SparseArrays 
  [10745b16] + Statistics 
  [8dfed614] + Test 
  [4ec0a83e] + Unicode 
   Testing BenchmarkTools
 Resolving package versions...
    Status `/tmp/jl_dcYRLr/Manifest.toml`
  [6e4b80f9] BenchmarkTools v0.4.3
  [682c06a0] JSON v0.21.0
  [69de0a69] Parsers v0.3.10
  [2a0f44e3] Base64  [`@stdlib/Base64`]
  [ade2ca70] Dates  [`@stdlib/Dates`]
  [8ba89e20] Distributed  [`@stdlib/Distributed`]
  [b77e0a4c] InteractiveUtils  [`@stdlib/InteractiveUtils`]
  [8f399da3] Libdl  [`@stdlib/Libdl`]
  [37e2e46d] LinearAlgebra  [`@stdlib/LinearAlgebra`]
  [56ddb016] Logging  [`@stdlib/Logging`]
  [d6f4376e] Markdown  [`@stdlib/Markdown`]
  [a63ad114] Mmap  [`@stdlib/Mmap`]
  [de0858da] Printf  [`@stdlib/Printf`]
  [9a3f8284] Random  [`@stdlib/Random`]
  [9e88b42a] Serialization  [`@stdlib/Serialization`]
  [6462fe0b] Sockets  [`@stdlib/Sockets`]
  [2f01184e] SparseArrays  [`@stdlib/SparseArrays`]
  [10745b16] Statistics  [`@stdlib/Statistics`]
  [8dfed614] Test  [`@stdlib/Test`]
  [4ec0a83e] Unicode  [`@stdlib/Unicode`]
Testing Parameters...done (took 11.609335632 seconds)
Testing Trial/TrialEstimate/TrialRatio/TrialJudgement...done (took 4.186675919 seconds)
Testing BenchmarkGroup...done (took 20.5286226 seconds)
Testing execution...(1/3) tuning 10...
done (took 0.606965052 seconds)
(2/3) tuning 5...
done (took 0.467365172 seconds)
(3/3) tuning 20...
done (took 0.364891855 seconds)
(1/3) tuning "sum"...
  (1/3) tuning 10...
  done (took 0.770317841 seconds)
  (2/3) tuning 5...
  done (took 0.666635281 seconds)
  (3/3) tuning 20...
  done (took 1.179777055 seconds)
done (took 3.093882839 seconds)
(2/3) tuning "special"...
  (1/4) tuning "comprehension"...
  done (took 0.820137113 seconds)
  (2/4) tuning "macro"...
  done (took 1.185971364 seconds)
  (3/4) tuning "block"...
  done (took 0.662961848 seconds)
  (4/4) tuning "nothing"...
  done (took 0.43444077 seconds)
done (took 3.628478045 seconds)
(3/3) tuning "sin"...
  (1/3) tuning 10...
  done (took 0.000307739 seconds)
  (2/3) tuning 5...
  done (took 0.000265269 seconds)
  (3/3) tuning 20...
  done (took 0.000274078 seconds)
done (took 0.436174238 seconds)
(1/3) benchmarking "sum"...
  (1/3) benchmarking 10...
  done (took 2.250572228 seconds)
  (2/3) benchmarking 5...
  done (took 1.319737207 seconds)
  (3/3) benchmarking 20...
  done (took 2.048439936 seconds)
done (took 6.205591876 seconds)
(2/3) benchmarking "special"...
  (1/4) benchmarking "comprehension"...
  done (took 1.895953037 seconds)
  (2/4) benchmarking "macro"...
  done (took 0.88365888 seconds)
  (3/4) benchmarking "block"...
  done (took 1.978331474 seconds)
  (4/4) benchmarking "nothing"...
  done (took 0.656304797 seconds)
done (took 5.917525051 seconds)
(3/3) benchmarking "sin"...
  (1/3) benchmarking 10...
  done (took 0.131836979 seconds)
  (2/3) benchmarking 5...
  done (took 0.126301792 seconds)
  (3/3) benchmarking 20...
  done (took 0.139541462 seconds)
done (took 0.804139158 seconds)
(1/3) benchmarking "sum"...
  (1/3) benchmarking 10...
  done (took 1.133293882 seconds)
  (2/3) benchmarking 5...
  done (took 0.95327401 seconds)
  (3/3) benchmarking 20...
  done (took 1.127378348 seconds)
done (took 3.651643828 seconds)
(2/3) benchmarking "special"...
  (1/4) benchmarking "comprehension"...
  done (took 1.074137289 seconds)
  (2/4) benchmarking "macro"...
  done (took 0.36560206 seconds)
  (3/4) benchmarking "block"...
  done (took 1.121623751 seconds)
  (4/4) benchmarking "nothing"...
  done (took 0.18229285 seconds)
done (took 3.244328877 seconds)
(3/3) benchmarking "sin"...
  (1/3) benchmarking 10...
  done (took 0.153966809 seconds)
  (2/3) benchmarking 5...
  done (took 0.19150253 seconds)
  (3/3) benchmarking 20...
  done (took 0.219823031 seconds)
done (took 1.164094724 seconds)
(1/3) benchmarking "sum"...
  (1/3) benchmarking 10...
  done (took 0.127469726 seconds)
  (2/3) benchmarking 5...
  done (took 0.115036225 seconds)
  (3/3) benchmarking 20...
  done (took 0.165667528 seconds)
done (took 0.977307675 seconds)
(2/3) benchmarking "special"...
  (1/4) benchmarking "comprehension"...
  done (took 0.086760631 seconds)
  (2/4) benchmarking "macro"...
  done (took 0.093751286 seconds)
  (3/4) benchmarking "block"...
  done (took 0.156987406 seconds)
  (4/4) benchmarking "nothing"...
  done (took 0.153095263 seconds)
done (took 0.90800571 seconds)
(3/3) benchmarking "sin"...
  (1/3) benchmarking 10...
  done (took 0.171663842 seconds)
  (2/3) benchmarking 5...
  done (took 0.141575514 seconds)
  (3/3) benchmarking 20...
  done (took 0.131356114 seconds)
done (took 0.933775018 seconds)
(1/3) benchmarking 10...
done (took 0.019824275 seconds)
(2/3) benchmarking 5...
done (took 0.039551378 seconds)
(3/3) benchmarking 20...
done (took 0.038650253 seconds)
(1/3) benchmarking 10...
done (took 0.020366336 seconds)
(2/3) benchmarking 5...
done (took 0.02174582 seconds)
(3/3) benchmarking 20...
done (took 0.038822015 seconds)
(1/3) benchmarking 10...
done (took 3.3755e-5 seconds)
(2/3) benchmarking 5...
done (took 1.6067e-5 seconds)
(3/3) benchmarking 20...
done (took 1.2609e-5 seconds)
done (took 71.184076696 seconds)
Testing serialization...Test Summary:                | Pass  Total
Successful (de)serialization |    7      7
Test Summary:        | Pass  Total
Deprecated behaviors |   11     11
Test Summary:  | Pass  Total
Error checking |    2      2
done (took 11.715029661 seconds)
   Testing BenchmarkTools tests passed 

Results with Julia v1.3.0

Testing was successful. Last evaluation was ago and took 2 minutes, 11 seconds.

Click here to download the log file.

 Resolving package versions...
 Installed Parsers ──────── v0.3.10
 Installed BenchmarkTools ─ v0.4.3
 Installed JSON ─────────── v0.21.0
  Updating `~/.julia/environments/v1.3/Project.toml`
  [6e4b80f9] + BenchmarkTools v0.4.3
  Updating `~/.julia/environments/v1.3/Manifest.toml`
  [6e4b80f9] + BenchmarkTools v0.4.3
  [682c06a0] + JSON v0.21.0
  [69de0a69] + Parsers v0.3.10
  [2a0f44e3] + Base64 
  [ade2ca70] + Dates 
  [8ba89e20] + Distributed 
  [b77e0a4c] + InteractiveUtils 
  [8f399da3] + Libdl 
  [37e2e46d] + LinearAlgebra 
  [56ddb016] + Logging 
  [d6f4376e] + Markdown 
  [a63ad114] + Mmap 
  [de0858da] + Printf 
  [9a3f8284] + Random 
  [9e88b42a] + Serialization 
  [6462fe0b] + Sockets 
  [2f01184e] + SparseArrays 
  [10745b16] + Statistics 
  [8dfed614] + Test 
  [4ec0a83e] + Unicode 
   Testing BenchmarkTools
 Resolving package versions...
    Status `/tmp/jl_oGqety/Manifest.toml`
  [6e4b80f9] BenchmarkTools v0.4.3
  [682c06a0] JSON v0.21.0
  [69de0a69] Parsers v0.3.10
  [2a0f44e3] Base64  [`@stdlib/Base64`]
  [ade2ca70] Dates  [`@stdlib/Dates`]
  [8ba89e20] Distributed  [`@stdlib/Distributed`]
  [b77e0a4c] InteractiveUtils  [`@stdlib/InteractiveUtils`]
  [8f399da3] Libdl  [`@stdlib/Libdl`]
  [37e2e46d] LinearAlgebra  [`@stdlib/LinearAlgebra`]
  [56ddb016] Logging  [`@stdlib/Logging`]
  [d6f4376e] Markdown  [`@stdlib/Markdown`]
  [a63ad114] Mmap  [`@stdlib/Mmap`]
  [de0858da] Printf  [`@stdlib/Printf`]
  [9a3f8284] Random  [`@stdlib/Random`]
  [9e88b42a] Serialization  [`@stdlib/Serialization`]
  [6462fe0b] Sockets  [`@stdlib/Sockets`]
  [2f01184e] SparseArrays  [`@stdlib/SparseArrays`]
  [10745b16] Statistics  [`@stdlib/Statistics`]
  [8dfed614] Test  [`@stdlib/Test`]
  [4ec0a83e] Unicode  [`@stdlib/Unicode`]
Testing Parameters...done (took 10.745654011 seconds)
Testing Trial/TrialEstimate/TrialRatio/TrialJudgement...done (took 4.725390333 seconds)
Testing BenchmarkGroup...done (took 20.776810056 seconds)
Testing execution...(1/3) tuning 10...
done (took 0.309673776 seconds)
(2/3) tuning 5...
done (took 0.228791428 seconds)
(3/3) tuning 20...
done (took 0.231331298 seconds)
(1/3) tuning "sum"...
  (1/3) tuning 10...
  done (took 0.880032212 seconds)
  (2/3) tuning 5...
  done (took 0.741406057 seconds)
  (3/3) tuning 20...
  done (took 1.061907794 seconds)
done (took 3.14055551 seconds)
(2/3) tuning "special"...
  (1/4) tuning "comprehension"...
  done (took 0.692085692 seconds)
  (2/4) tuning "macro"...
  done (took 1.136517745 seconds)
  (3/4) tuning "block"...
  done (took 0.52940439 seconds)
  (4/4) tuning "nothing"...
  done (took 0.510478066 seconds)
done (took 3.350831959 seconds)
(3/3) tuning "sin"...
  (1/3) tuning 10...
  done (took 0.000336445 seconds)
  (2/3) tuning 5...
  done (took 0.000299683 seconds)
  (3/3) tuning 20...
  done (took 0.000296745 seconds)
done (took 0.484142812 seconds)
(1/3) benchmarking "sum"...
  (1/3) benchmarking 10...
  done (took 2.504929875 seconds)
  (2/3) benchmarking 5...
  done (took 1.468856177 seconds)
  (3/3) benchmarking 20...
  done (took 1.82246857 seconds)
done (took 6.304119144 seconds)
(2/3) benchmarking "special"...
  (1/4) benchmarking "comprehension"...
  done (took 1.736042339 seconds)
  (2/4) benchmarking "macro"...
  done (took 1.06457397 seconds)
  (3/4) benchmarking "block"...
  done (took 1.913310447 seconds)
  (4/4) benchmarking "nothing"...
  done (took 0.584796573 seconds)
done (took 5.744230157 seconds)
(3/3) benchmarking "sin"...
  (1/3) benchmarking 10...
  done (took 0.122266515 seconds)
  (2/3) benchmarking 5...
  done (took 0.122980274 seconds)
  (3/3) benchmarking 20...
  done (took 0.127410683 seconds)
done (took 0.83831063 seconds)
(1/3) benchmarking "sum"...
  (1/3) benchmarking 10...
  done (took 1.118606323 seconds)
  (2/3) benchmarking 5...
  done (took 0.678405931 seconds)
  (3/3) benchmarking 20...
  done (took 1.124996496 seconds)
done (took 3.408314471 seconds)
(2/3) benchmarking "special"...
  (1/4) benchmarking "comprehension"...
  done (took 1.076359207 seconds)
  (2/4) benchmarking "macro"...
  done (took 0.596248942 seconds)
  (3/4) benchmarking "block"...
  done (took 1.110050235 seconds)
  (4/4) benchmarking "nothing"...
  done (took 0.136475457 seconds)
done (took 3.360207652 seconds)
(3/3) benchmarking "sin"...
  (1/3) benchmarking 10...
  done (took 0.131172925 seconds)
  (2/3) benchmarking 5...
  done (took 0.131070331 seconds)
  (3/3) benchmarking 20...
  done (took 0.130247321 seconds)
done (took 0.868298706 seconds)
(1/3) benchmarking "sum"...
  (1/3) benchmarking 10...
  done (took 0.118555295 seconds)
  (2/3) benchmarking 5...
  done (took 0.112512946 seconds)
  (3/3) benchmarking 20...
  done (took 0.102937168 seconds)
done (took 0.831496801 seconds)
(2/3) benchmarking "special"...
  (1/4) benchmarking "comprehension"...
  done (took 0.090268591 seconds)
  (2/4) benchmarking "macro"...
  done (took 0.064725616 seconds)
  (3/4) benchmarking "block"...
  done (took 0.110910342 seconds)
  (4/4) benchmarking "nothing"...
  done (took 0.109425907 seconds)
done (took 0.851646796 seconds)
(3/3) benchmarking "sin"...
  (1/3) benchmarking 10...
  done (took 0.110867559 seconds)
  (2/3) benchmarking 5...
  done (took 0.108040089 seconds)
  (3/3) benchmarking 20...
  done (took 0.107098911 seconds)
done (took 0.776352423 seconds)
(1/3) benchmarking 10...
done (took 0.021956372 seconds)
(2/3) benchmarking 5...
done (took 0.022223148 seconds)
(3/3) benchmarking 20...
done (took 0.02275314 seconds)
(1/3) benchmarking 10...
done (took 0.024961105 seconds)
(2/3) benchmarking 5...
done (took 0.025494695 seconds)
(3/3) benchmarking 20...
done (took 0.02660153 seconds)
(1/3) benchmarking 10...
done (took 3.9539e-5 seconds)
(2/3) benchmarking 5...
done (took 1.4259e-5 seconds)
(3/3) benchmarking 20...
done (took 1.3064e-5 seconds)
done (took 68.349236742 seconds)
Testing serialization...Test Summary:                | Pass  Total
Successful (de)serialization |    7      7
Test Summary:        | Pass  Total
Deprecated behaviors |   11     11
Test Summary:  | Pass  Total
Error checking |    2      2
done (took 11.095206941 seconds)
   Testing BenchmarkTools tests passed 

Results with Julia v1.3.1-pre-7704df0a5a

Testing was successful. Last evaluation was ago and took 2 minutes, 3 seconds.

Click here to download the log file.

 Resolving package versions...
 Installed Parsers ──────── v0.3.10
 Installed BenchmarkTools ─ v0.4.3
 Installed JSON ─────────── v0.21.0
  Updating `~/.julia/environments/v1.3/Project.toml`
  [6e4b80f9] + BenchmarkTools v0.4.3
  Updating `~/.julia/environments/v1.3/Manifest.toml`
  [6e4b80f9] + BenchmarkTools v0.4.3
  [682c06a0] + JSON v0.21.0
  [69de0a69] + Parsers v0.3.10
  [2a0f44e3] + Base64 
  [ade2ca70] + Dates 
  [8ba89e20] + Distributed 
  [b77e0a4c] + InteractiveUtils 
  [8f399da3] + Libdl 
  [37e2e46d] + LinearAlgebra 
  [56ddb016] + Logging 
  [d6f4376e] + Markdown 
  [a63ad114] + Mmap 
  [de0858da] + Printf 
  [9a3f8284] + Random 
  [9e88b42a] + Serialization 
  [6462fe0b] + Sockets 
  [2f01184e] + SparseArrays 
  [10745b16] + Statistics 
  [8dfed614] + Test 
  [4ec0a83e] + Unicode 
   Testing BenchmarkTools
 Resolving package versions...
    Status `/tmp/jl_aOOIP9/Manifest.toml`
  [6e4b80f9] BenchmarkTools v0.4.3
  [682c06a0] JSON v0.21.0
  [69de0a69] Parsers v0.3.10
  [2a0f44e3] Base64  [`@stdlib/Base64`]
  [ade2ca70] Dates  [`@stdlib/Dates`]
  [8ba89e20] Distributed  [`@stdlib/Distributed`]
  [b77e0a4c] InteractiveUtils  [`@stdlib/InteractiveUtils`]
  [8f399da3] Libdl  [`@stdlib/Libdl`]
  [37e2e46d] LinearAlgebra  [`@stdlib/LinearAlgebra`]
  [56ddb016] Logging  [`@stdlib/Logging`]
  [d6f4376e] Markdown  [`@stdlib/Markdown`]
  [a63ad114] Mmap  [`@stdlib/Mmap`]
  [de0858da] Printf  [`@stdlib/Printf`]
  [9a3f8284] Random  [`@stdlib/Random`]
  [9e88b42a] Serialization  [`@stdlib/Serialization`]
  [6462fe0b] Sockets  [`@stdlib/Sockets`]
  [2f01184e] SparseArrays  [`@stdlib/SparseArrays`]
  [10745b16] Statistics  [`@stdlib/Statistics`]
  [8dfed614] Test  [`@stdlib/Test`]
  [4ec0a83e] Unicode  [`@stdlib/Unicode`]
Testing Parameters...done (took 10.067612912 seconds)
Testing Trial/TrialEstimate/TrialRatio/TrialJudgement...done (took 3.940224585 seconds)
Testing BenchmarkGroup...done (took 19.654018407 seconds)
Testing execution...(1/3) tuning 10...
done (took 0.357661098 seconds)
(2/3) tuning 5...
done (took 0.26246341 seconds)
(3/3) tuning 20...
done (took 0.264077724 seconds)
(1/3) tuning "sum"...
  (1/3) tuning 10...
  done (took 0.826904218 seconds)
  (2/3) tuning 5...
  done (took 0.656959557 seconds)
  (3/3) tuning 20...
  done (took 1.00149795 seconds)
done (took 2.930288218 seconds)
(2/3) tuning "special"...
  (1/4) tuning "comprehension"...
  done (took 0.639995816 seconds)
  (2/4) tuning "macro"...
  done (took 1.169174742 seconds)
  (3/4) tuning "block"...
  done (took 0.531898929 seconds)
  (4/4) tuning "nothing"...
  done (took 0.569909909 seconds)
done (took 3.343620739 seconds)
(3/3) tuning "sin"...
  (1/3) tuning 10...
  done (took 0.000303802 seconds)
  (2/3) tuning 5...
  done (took 0.000304091 seconds)
  (3/3) tuning 20...
  done (took 0.00026711 seconds)
done (took 0.436874601 seconds)
(1/3) benchmarking "sum"...
  (1/3) benchmarking 10...
  done (took 2.16901204 seconds)
  (2/3) benchmarking 5...
  done (took 1.166643866 seconds)
  (3/3) benchmarking 20...
  done (took 2.005267887 seconds)
done (took 5.807750942 seconds)
(2/3) benchmarking "special"...
  (1/4) benchmarking "comprehension"...
  done (took 1.53329577 seconds)
  (2/4) benchmarking "macro"...
  done (took 0.710178123 seconds)
  (3/4) benchmarking "block"...
  done (took 1.962603017 seconds)
  (4/4) benchmarking "nothing"...
  done (took 0.599873729 seconds)
done (took 5.264533423 seconds)
(3/3) benchmarking "sin"...
  (1/3) benchmarking 10...
  done (took 0.117821672 seconds)
  (2/3) benchmarking 5...
  done (took 0.127629564 seconds)
  (3/3) benchmarking 20...
  done (took 0.123304605 seconds)
done (took 0.798048677 seconds)
(1/3) benchmarking "sum"...
  (1/3) benchmarking 10...
  done (took 1.115668473 seconds)
  (2/3) benchmarking 5...
  done (took 0.69481422 seconds)
  (3/3) benchmarking 20...
  done (took 1.157523089 seconds)
done (took 3.445216889 seconds)
(2/3) benchmarking "special"...
  (1/4) benchmarking "comprehension"...
  done (took 1.071297809 seconds)
  (2/4) benchmarking "macro"...
  done (took 0.273344311 seconds)
  (3/4) benchmarking "block"...
  done (took 1.111774453 seconds)
  (4/4) benchmarking "nothing"...
  done (took 0.137190558 seconds)
done (took 3.046552382 seconds)
(3/3) benchmarking "sin"...
  (1/3) benchmarking 10...
  done (took 0.156727613 seconds)
  (2/3) benchmarking 5...
  done (took 0.117417368 seconds)
  (3/3) benchmarking 20...
  done (took 0.125283067 seconds)
done (took 0.865330851 seconds)
(1/3) benchmarking "sum"...
  (1/3) benchmarking 10...
  done (took 0.164428995 seconds)
  (2/3) benchmarking 5...
  done (took 0.112666791 seconds)
  (3/3) benchmarking 20...
  done (took 0.107563133 seconds)
done (took 0.904126493 seconds)
(2/3) benchmarking "special"...
  (1/4) benchmarking "comprehension"...
  done (took 0.068435104 seconds)
  (2/4) benchmarking "macro"...
  done (took 0.069144925 seconds)
  (3/4) benchmarking "block"...
  done (took 0.112768384 seconds)
  (4/4) benchmarking "nothing"...
  done (took 0.114082876 seconds)
done (took 0.826149003 seconds)
(3/3) benchmarking "sin"...
  (1/3) benchmarking 10...
  done (took 0.150401159 seconds)
  (2/3) benchmarking 5...
  done (took 0.119296643 seconds)
  (3/3) benchmarking 20...
  done (took 0.120310459 seconds)
done (took 0.89659031 seconds)
(1/3) benchmarking 10...
done (took 0.02206828 seconds)
(2/3) benchmarking 5...
done (took 0.022781731 seconds)
(3/3) benchmarking 20...
done (took 0.023966747 seconds)
(1/3) benchmarking 10...
done (took 0.022539204 seconds)
(2/3) benchmarking 5...
done (took 0.022777022 seconds)
(3/3) benchmarking 20...
done (took 0.026960757 seconds)
(1/3) benchmarking 10...
done (took 3.6979e-5 seconds)
(2/3) benchmarking 5...
done (took 1.4584e-5 seconds)
(3/3) benchmarking 20...
done (took 1.2399e-5 seconds)
done (took 64.645466868 seconds)
Testing serialization...Test Summary:                | Pass  Total
Successful (de)serialization |    7      7
Test Summary:        | Pass  Total
Deprecated behaviors |   11     11
Test Summary:  | Pass  Total
Error checking |    2      2
done (took 10.342648446 seconds)
   Testing BenchmarkTools tests passed