ReferenceTests

← Back to package list

If you think that there is an error in how your package is being tested or represented, please file an issue at NewPkgEval.jl, making sure to read the FAQ first.

Results with Julia v1.2.0

Testing was successful. Last evaluation was ago and took 7 minutes, 53 seconds.

Click here to download the log file.

 Resolving package versions...
 Installed Missings ────────────────── v0.4.3
 Installed DataAPI ─────────────────── v1.1.0
 Installed Conda ───────────────────── v1.3.0
 Installed AbstractFFTs ────────────── v0.5.0
 Installed ReferenceTests ──────────── v0.8.2
 Installed BinaryProvider ──────────── v0.5.8
 Installed Colors ──────────────────── v0.9.6
 Installed StatsBase ───────────────── v0.32.0
 Installed URIParser ───────────────── v0.4.0
 Installed AxisAlgorithms ──────────── v1.0.0
 Installed IdentityRanges ──────────── v0.3.0
 Installed Reexport ────────────────── v0.2.0
 Installed ImageInTerminal ─────────── v0.4.1
 Installed OrderedCollections ──────── v1.1.0
 Installed Compat ──────────────────── v2.2.0
 Installed OffsetArrays ────────────── v0.11.2
 Installed MappedArrays ────────────── v0.2.2
 Installed CoordinateTransformations ─ v0.5.0
 Installed Crayons ─────────────────── v4.0.1
 Installed DataStructures ──────────── v0.17.6
 Installed ColorVectorSpace ────────── v0.7.1
 Installed Parsers ─────────────────── v0.3.10
 Installed FixedPointNumbers ───────── v0.6.1
 Installed Graphics ────────────────── v0.4.0
 Installed JSON ────────────────────── v0.21.0
 Installed Ratios ──────────────────── v0.3.1
 Installed ImageTransformations ────── v0.8.0
 Installed NaNMath ─────────────────── v0.3.3
 Installed PaddedViews ─────────────── v0.4.2
 Installed Interpolations ──────────── v0.12.5
 Installed ImageCore ───────────────── v0.8.5
 Installed FFTW ────────────────────── v1.1.0
 Installed StaticArrays ────────────── v0.12.1
 Installed SortingAlgorithms ───────── v0.3.1
 Installed WoodburyMatrices ────────── v0.4.1
 Installed DeepDiffs ───────────────── v1.1.0
 Installed Distances ───────────────── v0.8.2
 Installed VersionParsing ──────────── v1.1.3
 Installed ColorTypes ──────────────── v0.8.0
 Installed Rotations ───────────────── v0.12.0
 Installed SpecialFunctions ────────── v0.8.0
 Installed BinDeps ─────────────────── v0.8.10
 Installed FileIO ──────────────────── v1.1.0
  Updating `~/.julia/environments/v1.2/Project.toml`
  [324d217c] + ReferenceTests v0.8.2
  Updating `~/.julia/environments/v1.2/Manifest.toml`
  [621f4979] + AbstractFFTs v0.5.0
  [13072b0f] + AxisAlgorithms v1.0.0
  [9e28174c] + BinDeps v0.8.10
  [b99e7846] + BinaryProvider v0.5.8
  [3da002f7] + ColorTypes v0.8.0
  [c3611d14] + ColorVectorSpace v0.7.1
  [5ae59095] + Colors v0.9.6
  [34da2185] + Compat v2.2.0
  [8f4d0f93] + Conda v1.3.0
  [150eb455] + CoordinateTransformations v0.5.0
  [a8cc5b0e] + Crayons v4.0.1
  [9a962f9c] + DataAPI v1.1.0
  [864edb3b] + DataStructures v0.17.6
  [ab62b9b5] + DeepDiffs v1.1.0
  [b4f34e82] + Distances v0.8.2
  [7a1cc6ca] + FFTW v1.1.0
  [5789e2e9] + FileIO v1.1.0
  [53c48c17] + FixedPointNumbers v0.6.1
  [a2bd30eb] + Graphics v0.4.0
  [bbac6d45] + IdentityRanges v0.3.0
  [a09fc81d] + ImageCore v0.8.5
  [d8c32880] + ImageInTerminal v0.4.1
  [02fcd773] + ImageTransformations v0.8.0
  [a98d9a8b] + Interpolations v0.12.5
  [682c06a0] + JSON v0.21.0
  [dbb5928d] + MappedArrays v0.2.2
  [e1d29d7a] + Missings v0.4.3
  [77ba4419] + NaNMath v0.3.3
  [6fe1bfb0] + OffsetArrays v0.11.2
  [bac558e1] + OrderedCollections v1.1.0
  [5432bcbf] + PaddedViews v0.4.2
  [69de0a69] + Parsers v0.3.10
  [c84ed2f1] + Ratios v0.3.1
  [189a3867] + Reexport v0.2.0
  [324d217c] + ReferenceTests v0.8.2
  [6038ab10] + Rotations v0.12.0
  [a2af1166] + SortingAlgorithms v0.3.1
  [276daf66] + SpecialFunctions v0.8.0
  [90137ffa] + StaticArrays v0.12.1
  [2913bbd2] + StatsBase v0.32.0
  [30578b45] + URIParser v0.4.0
  [81def892] + VersionParsing v1.1.3
  [efce3f68] + WoodburyMatrices v0.4.1
  [2a0f44e3] + Base64 
  [ade2ca70] + Dates 
  [8bb1440f] + DelimitedFiles 
  [8ba89e20] + Distributed 
  [b77e0a4c] + InteractiveUtils 
  [76f85450] + LibGit2 
  [8f399da3] + Libdl 
  [37e2e46d] + LinearAlgebra 
  [56ddb016] + Logging 
  [d6f4376e] + Markdown 
  [a63ad114] + Mmap 
  [44cfe95a] + Pkg 
  [de0858da] + Printf 
  [3fa0cd96] + REPL 
  [9a3f8284] + Random 
  [ea8e919c] + SHA 
  [9e88b42a] + Serialization 
  [1a1011a3] + SharedArrays 
  [6462fe0b] + Sockets 
  [2f01184e] + SparseArrays 
  [10745b16] + Statistics 
  [8dfed614] + Test 
  [cf7118a7] + UUIDs 
  [4ec0a83e] + Unicode 
  Building Conda ───────────→ `~/.julia/packages/Conda/kLXeC/deps/build.log`
  Building FFTW ────────────→ `~/.julia/packages/FFTW/loJ3F/deps/build.log`
  Building SpecialFunctions → `~/.julia/packages/SpecialFunctions/ne2iw/deps/build.log`
   Testing ReferenceTests
 Resolving package versions...
 Installed TableTraits ───────────────── v1.0.0
 Installed ImageMagick ───────────────── v0.7.5
 Installed RangeArrays ───────────────── v0.3.1
 Installed TestImages ────────────────── v0.5.1
 Installed CSVFiles ──────────────────── v0.16.1
 Installed GenericSchur ──────────────── v0.3.0
 Installed DataFrames ────────────────── v0.19.4
 Installed MbedTLS ───────────────────── v0.7.0
 Installed Polynomials ───────────────── v0.6.0
 Installed DataValueInterfaces ───────── v1.0.0
 Installed InvertedIndices ───────────── v1.0.0
 Installed Requires ──────────────────── v0.5.2
 Installed Tables ────────────────────── v0.2.11
 Installed GenericSVD ────────────────── v0.2.2
 Installed PooledArrays ──────────────── v0.5.2
 Installed DoubleFloats ──────────────── v1.0.1
 Installed IniFile ───────────────────── v0.5.0
 Installed IterTools ─────────────────── v1.3.0
 Installed TableShowUtils ────────────── v0.2.5
 Installed RecipesBase ───────────────── v0.7.0
 Installed TableTraitsUtils ──────────── v1.0.1
 Installed WeakRefStrings ────────────── v0.6.1
 Installed TextParse ─────────────────── v0.9.1
 Installed IterableTables ────────────── v1.0.0
 Installed CodecZlib ─────────────────── v0.6.0
 Installed TranscodingStreams ────────── v0.9.5
 Installed Quadmath ──────────────────── v0.5.2
 Installed HTTP ──────────────────────── v0.8.8
 Installed ZipFile ───────────────────── v0.8.3
 Installed IntervalSets ──────────────── v0.3.2
 Installed IteratorInterfaceExtensions ─ v1.0.0
 Installed CategoricalArrays ─────────── v0.7.3
 Installed DataValues ────────────────── v0.4.12
 Installed Nullables ─────────────────── v1.0.0
 Installed AxisArrays ────────────────── v0.3.3
  Building ImageMagick → `~/.julia/packages/ImageMagick/vMfoS/deps/build.log`
  Building ZipFile ────→ `~/.julia/packages/ZipFile/oD4uG/deps/build.log`
  Building TestImages ─→ `~/.julia/packages/TestImages/Aoq3X/deps/build.log`
  Building MbedTLS ────→ `~/.julia/packages/MbedTLS/a1JFn/deps/build.log`
  Building CodecZlib ──→ `~/.julia/packages/CodecZlib/5t9zO/deps/build.log`
    Status `/tmp/jl_HyFYLS/Manifest.toml`
  [621f4979] AbstractFFTs v0.5.0
  [13072b0f] AxisAlgorithms v1.0.0
  [39de3d68] AxisArrays v0.3.3
  [9e28174c] BinDeps v0.8.10
  [b99e7846] BinaryProvider v0.5.8
  [5d742f6a] CSVFiles v0.16.1
  [324d7699] CategoricalArrays v0.7.3
  [944b1d66] CodecZlib v0.6.0
  [3da002f7] ColorTypes v0.8.0
  [c3611d14] ColorVectorSpace v0.7.1
  [5ae59095] Colors v0.9.6
  [34da2185] Compat v2.2.0
  [8f4d0f93] Conda v1.3.0
  [150eb455] CoordinateTransformations v0.5.0
  [a8cc5b0e] Crayons v4.0.1
  [9a962f9c] DataAPI v1.1.0
  [a93c6f00] DataFrames v0.19.4
  [864edb3b] DataStructures v0.17.6
  [e2d170a0] DataValueInterfaces v1.0.0
  [e7dc6d0d] DataValues v0.4.12
  [ab62b9b5] DeepDiffs v1.1.0
  [b4f34e82] Distances v0.8.2
  [497a8b3b] DoubleFloats v1.0.1
  [7a1cc6ca] FFTW v1.1.0
  [5789e2e9] FileIO v1.1.0
  [53c48c17] FixedPointNumbers v0.6.1
  [01680d73] GenericSVD v0.2.2
  [c145ed77] GenericSchur v0.3.0
  [a2bd30eb] Graphics v0.4.0
  [cd3eb016] HTTP v0.8.8
  [bbac6d45] IdentityRanges v0.3.0
  [a09fc81d] ImageCore v0.8.5
  [d8c32880] ImageInTerminal v0.4.1
  [6218d12a] ImageMagick v0.7.5
  [02fcd773] ImageTransformations v0.8.0
  [83e8ac13] IniFile v0.5.0
  [a98d9a8b] Interpolations v0.12.5
  [8197267c] IntervalSets v0.3.2
  [41ab1584] InvertedIndices v1.0.0
  [c8e1da08] IterTools v1.3.0
  [1c8ee90f] IterableTables v1.0.0
  [82899510] IteratorInterfaceExtensions v1.0.0
  [682c06a0] JSON v0.21.0
  [dbb5928d] MappedArrays v0.2.2
  [739be429] MbedTLS v0.7.0
  [e1d29d7a] Missings v0.4.3
  [77ba4419] NaNMath v0.3.3
  [4d1e1d77] Nullables v1.0.0
  [6fe1bfb0] OffsetArrays v0.11.2
  [bac558e1] OrderedCollections v1.1.0
  [5432bcbf] PaddedViews v0.4.2
  [69de0a69] Parsers v0.3.10
  [f27b6e38] Polynomials v0.6.0
  [2dfb63ee] PooledArrays v0.5.2
  [be4d8f0f] Quadmath v0.5.2
  [b3c3ace0] RangeArrays v0.3.1
  [c84ed2f1] Ratios v0.3.1
  [3cdcf5f2] RecipesBase v0.7.0
  [189a3867] Reexport v0.2.0
  [324d217c] ReferenceTests v0.8.2
  [ae029012] Requires v0.5.2
  [6038ab10] Rotations v0.12.0
  [a2af1166] SortingAlgorithms v0.3.1
  [276daf66] SpecialFunctions v0.8.0
  [90137ffa] StaticArrays v0.12.1
  [2913bbd2] StatsBase v0.32.0
  [5e66a065] TableShowUtils v0.2.5
  [3783bdb8] TableTraits v1.0.0
  [382cd787] TableTraitsUtils v1.0.1
  [bd369af6] Tables v0.2.11
  [5e47fb64] TestImages v0.5.1
  [e0df1984] TextParse v0.9.1
  [3bb67fe8] TranscodingStreams v0.9.5
  [30578b45] URIParser v0.4.0
  [81def892] VersionParsing v1.1.3
  [ea10d353] WeakRefStrings v0.6.1
  [efce3f68] WoodburyMatrices v0.4.1
  [a5390f91] ZipFile v0.8.3
  [2a0f44e3] Base64  [`@stdlib/Base64`]
  [ade2ca70] Dates  [`@stdlib/Dates`]
  [8bb1440f] DelimitedFiles  [`@stdlib/DelimitedFiles`]
  [8ba89e20] Distributed  [`@stdlib/Distributed`]
  [9fa8497b] Future  [`@stdlib/Future`]
  [b77e0a4c] InteractiveUtils  [`@stdlib/InteractiveUtils`]
  [76f85450] LibGit2  [`@stdlib/LibGit2`]
  [8f399da3] Libdl  [`@stdlib/Libdl`]
  [37e2e46d] LinearAlgebra  [`@stdlib/LinearAlgebra`]
  [56ddb016] Logging  [`@stdlib/Logging`]
  [d6f4376e] Markdown  [`@stdlib/Markdown`]
  [a63ad114] Mmap  [`@stdlib/Mmap`]
  [44cfe95a] Pkg  [`@stdlib/Pkg`]
  [de0858da] Printf  [`@stdlib/Printf`]
  [3fa0cd96] REPL  [`@stdlib/REPL`]
  [9a3f8284] Random  [`@stdlib/Random`]
  [ea8e919c] SHA  [`@stdlib/SHA`]
  [9e88b42a] Serialization  [`@stdlib/Serialization`]
  [1a1011a3] SharedArrays  [`@stdlib/SharedArrays`]
  [6462fe0b] Sockets  [`@stdlib/Sockets`]
  [2f01184e] SparseArrays  [`@stdlib/SparseArrays`]
  [10745b16] Statistics  [`@stdlib/Statistics`]
  [8dfed614] Test  [`@stdlib/Test`]
  [cf7118a7] UUIDs  [`@stdlib/UUIDs`]
  [4ec0a83e] Unicode  [`@stdlib/Unicode`]
[ Info: Nine tests should correctly report failure in the transcript (but not the test summary).
Skipping Base.active_repl
Skipping Base.active_repl_backend
Skipping Base.active_repl
Skipping Base.active_repl_backend
Test for "string1.txt" failed.
- DIFF ------------------------
"{-f-}{+intenti+}o{+nally wr+}o{-b-}{+ng to check that this mess+}a{+ge p+}r{+ints+}"
-------------------------------
Reference file for "wrong.txt" does not exist.
- NEW CONTENT -----------------
intentional error to check that this message prints
-------------------------------
Test for "string5.txt" failed.
- DIFF ------------------------
"""
- This is a
+ This is an incorrect
  multiline string that does not end with a new line."""
-------------------------------
Test for "ansii.txt" failed.
- REFERENCE -------------------
this should be blue
-------------------------------
- ACTUAL ----------------------
this should be red
-------------------------------
Reference file for "wrongfilename.png" does not exist.
- NEW CONTENT -----------------
eltype: Gray{Normed{UInt8,8}}
size: (64, 64)
thumbnail:
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
-------------------------------
Test for "camera.png" failed.
┌ Warning: test fails because PSNR -15.415644645690918 < 25
└ @ ReferenceTests ~/.julia/packages/ReferenceTests/XNSR5/src/equality_metrics.jl:45
- REFERENCE -------------------
eltype: RGB{Normed{UInt8,8}}
size: (64, 64)
thumbnail:
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
-------------------------------
- ACTUAL ----------------------
eltype: RGB{Normed{UInt8,8}}
size: (64, 64)
thumbnail:
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
-------------------------------
Test for "camera.png" failed.
┌ Warning: test fails because size(ref) (64, 64) != size(x) (512, 512)
└ @ ReferenceTests ~/.julia/packages/ReferenceTests/XNSR5/src/equality_metrics.jl:38
- REFERENCE -------------------
eltype: Gray{Normed{UInt8,8}}
size: (64, 64)
thumbnail:
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
-------------------------------
- ACTUAL ----------------------
eltype: Gray{Normed{UInt8,8}}
size: (512, 512)
thumbnail:
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
-------------------------------
Reference file for "wrongfilename.csv" does not exist.
- NEW CONTENT -----------------
3×2 DataFrame
│ Row │ v1    │ v2     │
│     │ Int64 │ String │
├─────┼───────┼────────┤
│ 1   │ 1     │ a      │
│ 2   │ 2     │ b      │
│ 3   │ 3     │ c      │
-------------------------------
Test for "dataframe.csv" failed.
- REFERENCE -------------------
3×2 DataFrame
│ Row │ v1    │ v2     │
│     │ Int64 │ String │
├─────┼───────┼────────┤
│ 1   │ 1     │ a      │
│ 2   │ 2     │ b      │
│ 3   │ 3     │ c      │
-------------------------------
- ACTUAL ----------------------
3×2 DataFrame
│ Row │ v1    │ v2     │
│     │ Int64 │ String │
├─────┼───────┼────────┤
│ 1   │ 1     │ c      │
│ 2   │ 2     │ b      │
│ 3   │ 3     │ c      │
-------------------------------
Test Summary:  | Pass  Total
ReferenceTests |   40     40
   Testing ReferenceTests tests passed 

Results with Julia v1.3.0

Testing was successful. Last evaluation was ago and took 8 minutes, 36 seconds.

Click here to download the log file.

 Resolving package versions...
 Installed Ratios ──────────────────── v0.3.1
 Installed PaddedViews ─────────────── v0.4.2
 Installed CoordinateTransformations ─ v0.5.0
 Installed SortingAlgorithms ───────── v0.3.1
 Installed ImageTransformations ────── v0.8.0
 Installed Rotations ───────────────── v0.12.0
 Installed ReferenceTests ──────────── v0.8.2
 Installed DataStructures ──────────── v0.17.6
 Installed AxisAlgorithms ──────────── v1.0.0
 Installed Compat ──────────────────── v2.2.0
 Installed BinaryProvider ──────────── v0.5.8
 Installed Parsers ─────────────────── v0.3.10
 Installed FileIO ──────────────────── v1.1.0
 Installed FFTW ────────────────────── v1.1.0
 Installed StaticArrays ────────────── v0.12.1
 Installed Missings ────────────────── v0.4.3
 Installed FixedPointNumbers ───────── v0.6.1
 Installed OrderedCollections ──────── v1.1.0
 Installed SpecialFunctions ────────── v0.9.0
 Installed Crayons ─────────────────── v4.0.1
 Installed JSON ────────────────────── v0.21.0
 Installed DeepDiffs ───────────────── v1.1.0
 Installed ImageInTerminal ─────────── v0.4.1
 Installed DataAPI ─────────────────── v1.1.0
 Installed Distances ───────────────── v0.8.2
 Installed ColorTypes ──────────────── v0.8.0
 Installed Interpolations ──────────── v0.12.5
 Installed OpenSpecFun_jll ─────────── v0.5.3+1
 Installed ImageCore ───────────────── v0.8.5
 Installed NaNMath ─────────────────── v0.3.3
 Installed Graphics ────────────────── v0.4.0
 Installed Colors ──────────────────── v0.9.6
 Installed ColorVectorSpace ────────── v0.7.1
 Installed Conda ───────────────────── v1.3.0
 Installed OffsetArrays ────────────── v0.11.2
 Installed VersionParsing ──────────── v1.1.3
 Installed Reexport ────────────────── v0.2.0
 Installed MappedArrays ────────────── v0.2.2
 Installed WoodburyMatrices ────────── v0.4.1
 Installed StatsBase ───────────────── v0.32.0
 Installed IdentityRanges ──────────── v0.3.0
 Installed AbstractFFTs ────────────── v0.5.0
  Updating `~/.julia/environments/v1.3/Project.toml`
  [324d217c] + ReferenceTests v0.8.2
  Updating `~/.julia/environments/v1.3/Manifest.toml`
  [621f4979] + AbstractFFTs v0.5.0
  [13072b0f] + AxisAlgorithms v1.0.0
  [b99e7846] + BinaryProvider v0.5.8
  [3da002f7] + ColorTypes v0.8.0
  [c3611d14] + ColorVectorSpace v0.7.1
  [5ae59095] + Colors v0.9.6
  [34da2185] + Compat v2.2.0
  [8f4d0f93] + Conda v1.3.0
  [150eb455] + CoordinateTransformations v0.5.0
  [a8cc5b0e] + Crayons v4.0.1
  [9a962f9c] + DataAPI v1.1.0
  [864edb3b] + DataStructures v0.17.6
  [ab62b9b5] + DeepDiffs v1.1.0
  [b4f34e82] + Distances v0.8.2
  [7a1cc6ca] + FFTW v1.1.0
  [5789e2e9] + FileIO v1.1.0
  [53c48c17] + FixedPointNumbers v0.6.1
  [a2bd30eb] + Graphics v0.4.0
  [bbac6d45] + IdentityRanges v0.3.0
  [a09fc81d] + ImageCore v0.8.5
  [d8c32880] + ImageInTerminal v0.4.1
  [02fcd773] + ImageTransformations v0.8.0
  [a98d9a8b] + Interpolations v0.12.5
  [682c06a0] + JSON v0.21.0
  [dbb5928d] + MappedArrays v0.2.2
  [e1d29d7a] + Missings v0.4.3
  [77ba4419] + NaNMath v0.3.3
  [6fe1bfb0] + OffsetArrays v0.11.2
  [efe28fd5] + OpenSpecFun_jll v0.5.3+1
  [bac558e1] + OrderedCollections v1.1.0
  [5432bcbf] + PaddedViews v0.4.2
  [69de0a69] + Parsers v0.3.10
  [c84ed2f1] + Ratios v0.3.1
  [189a3867] + Reexport v0.2.0
  [324d217c] + ReferenceTests v0.8.2
  [6038ab10] + Rotations v0.12.0
  [a2af1166] + SortingAlgorithms v0.3.1
  [276daf66] + SpecialFunctions v0.9.0
  [90137ffa] + StaticArrays v0.12.1
  [2913bbd2] + StatsBase v0.32.0
  [81def892] + VersionParsing v1.1.3
  [efce3f68] + WoodburyMatrices v0.4.1
  [2a0f44e3] + Base64 
  [ade2ca70] + Dates 
  [8bb1440f] + DelimitedFiles 
  [8ba89e20] + Distributed 
  [b77e0a4c] + InteractiveUtils 
  [76f85450] + LibGit2 
  [8f399da3] + Libdl 
  [37e2e46d] + LinearAlgebra 
  [56ddb016] + Logging 
  [d6f4376e] + Markdown 
  [a63ad114] + Mmap 
  [44cfe95a] + Pkg 
  [de0858da] + Printf 
  [3fa0cd96] + REPL 
  [9a3f8284] + Random 
  [ea8e919c] + SHA 
  [9e88b42a] + Serialization 
  [1a1011a3] + SharedArrays 
  [6462fe0b] + Sockets 
  [2f01184e] + SparseArrays 
  [10745b16] + Statistics 
  [8dfed614] + Test 
  [cf7118a7] + UUIDs 
  [4ec0a83e] + Unicode 
  Building Conda → `~/.julia/packages/Conda/kLXeC/deps/build.log`
  Building FFTW ─→ `~/.julia/packages/FFTW/loJ3F/deps/build.log`
   Testing ReferenceTests
 Resolving package versions...
 Installed CSVFiles ──────────────────── v0.16.1
 Installed DataFrames ────────────────── v0.19.4
 Installed Quadmath ──────────────────── v0.5.2
 Installed TestImages ────────────────── v0.5.1
 Installed IniFile ───────────────────── v0.5.0
 Installed IterableTables ────────────── v1.0.0
 Installed ImageMagick ───────────────── v0.7.5
 Installed CategoricalArrays ─────────── v0.7.3
 Installed InvertedIndices ───────────── v1.0.0
 Installed IterTools ─────────────────── v1.3.0
 Installed RangeArrays ───────────────── v0.3.1
 Installed IntervalSets ──────────────── v0.3.2
 Installed ZipFile ───────────────────── v0.8.3
 Installed RecipesBase ───────────────── v0.7.0
 Installed TableTraitsUtils ──────────── v1.0.1
 Installed TableShowUtils ────────────── v0.2.5
 Installed Tables ────────────────────── v0.2.11
 Installed DoubleFloats ──────────────── v1.0.1
 Installed MbedTLS ───────────────────── v0.7.0
 Installed TableTraits ───────────────── v1.0.0
 Installed Polynomials ───────────────── v0.6.0
 Installed Nullables ─────────────────── v1.0.0
 Installed GenericSVD ────────────────── v0.2.2
 Installed DataValueInterfaces ───────── v1.0.0
 Installed GenericSchur ──────────────── v0.3.0
 Installed Requires ──────────────────── v0.5.2
 Installed TextParse ─────────────────── v0.9.1
 Installed CodecZlib ─────────────────── v0.6.0
 Installed IteratorInterfaceExtensions ─ v1.0.0
 Installed HTTP ──────────────────────── v0.8.8
 Installed PooledArrays ──────────────── v0.5.2
 Installed DataValues ────────────────── v0.4.12
 Installed WeakRefStrings ────────────── v0.6.1
 Installed TranscodingStreams ────────── v0.9.5
 Installed AxisArrays ────────────────── v0.3.3
  Building ImageMagick → `~/.julia/packages/ImageMagick/vMfoS/deps/build.log`
  Building ZipFile ────→ `~/.julia/packages/ZipFile/oD4uG/deps/build.log`
  Building TestImages ─→ `~/.julia/packages/TestImages/Aoq3X/deps/build.log`
  Building MbedTLS ────→ `~/.julia/packages/MbedTLS/a1JFn/deps/build.log`
  Building CodecZlib ──→ `~/.julia/packages/CodecZlib/5t9zO/deps/build.log`
    Status `/tmp/jl_aNsEDu/Manifest.toml`
  [621f4979] AbstractFFTs v0.5.0
  [13072b0f] AxisAlgorithms v1.0.0
  [39de3d68] AxisArrays v0.3.3
  [b99e7846] BinaryProvider v0.5.8
  [5d742f6a] CSVFiles v0.16.1
  [324d7699] CategoricalArrays v0.7.3
  [944b1d66] CodecZlib v0.6.0
  [3da002f7] ColorTypes v0.8.0
  [c3611d14] ColorVectorSpace v0.7.1
  [5ae59095] Colors v0.9.6
  [34da2185] Compat v2.2.0
  [8f4d0f93] Conda v1.3.0
  [150eb455] CoordinateTransformations v0.5.0
  [a8cc5b0e] Crayons v4.0.1
  [9a962f9c] DataAPI v1.1.0
  [a93c6f00] DataFrames v0.19.4
  [864edb3b] DataStructures v0.17.6
  [e2d170a0] DataValueInterfaces v1.0.0
  [e7dc6d0d] DataValues v0.4.12
  [ab62b9b5] DeepDiffs v1.1.0
  [b4f34e82] Distances v0.8.2
  [497a8b3b] DoubleFloats v1.0.1
  [7a1cc6ca] FFTW v1.1.0
  [5789e2e9] FileIO v1.1.0
  [53c48c17] FixedPointNumbers v0.6.1
  [01680d73] GenericSVD v0.2.2
  [c145ed77] GenericSchur v0.3.0
  [a2bd30eb] Graphics v0.4.0
  [cd3eb016] HTTP v0.8.8
  [bbac6d45] IdentityRanges v0.3.0
  [a09fc81d] ImageCore v0.8.5
  [d8c32880] ImageInTerminal v0.4.1
  [6218d12a] ImageMagick v0.7.5
  [02fcd773] ImageTransformations v0.8.0
  [83e8ac13] IniFile v0.5.0
  [a98d9a8b] Interpolations v0.12.5
  [8197267c] IntervalSets v0.3.2
  [41ab1584] InvertedIndices v1.0.0
  [c8e1da08] IterTools v1.3.0
  [1c8ee90f] IterableTables v1.0.0
  [82899510] IteratorInterfaceExtensions v1.0.0
  [682c06a0] JSON v0.21.0
  [dbb5928d] MappedArrays v0.2.2
  [739be429] MbedTLS v0.7.0
  [e1d29d7a] Missings v0.4.3
  [77ba4419] NaNMath v0.3.3
  [4d1e1d77] Nullables v1.0.0
  [6fe1bfb0] OffsetArrays v0.11.2
  [efe28fd5] OpenSpecFun_jll v0.5.3+1
  [bac558e1] OrderedCollections v1.1.0
  [5432bcbf] PaddedViews v0.4.2
  [69de0a69] Parsers v0.3.10
  [f27b6e38] Polynomials v0.6.0
  [2dfb63ee] PooledArrays v0.5.2
  [be4d8f0f] Quadmath v0.5.2
  [b3c3ace0] RangeArrays v0.3.1
  [c84ed2f1] Ratios v0.3.1
  [3cdcf5f2] RecipesBase v0.7.0
  [189a3867] Reexport v0.2.0
  [324d217c] ReferenceTests v0.8.2
  [ae029012] Requires v0.5.2
  [6038ab10] Rotations v0.12.0
  [a2af1166] SortingAlgorithms v0.3.1
  [276daf66] SpecialFunctions v0.9.0
  [90137ffa] StaticArrays v0.12.1
  [2913bbd2] StatsBase v0.32.0
  [5e66a065] TableShowUtils v0.2.5
  [3783bdb8] TableTraits v1.0.0
  [382cd787] TableTraitsUtils v1.0.1
  [bd369af6] Tables v0.2.11
  [5e47fb64] TestImages v0.5.1
  [e0df1984] TextParse v0.9.1
  [3bb67fe8] TranscodingStreams v0.9.5
  [81def892] VersionParsing v1.1.3
  [ea10d353] WeakRefStrings v0.6.1
  [efce3f68] WoodburyMatrices v0.4.1
  [a5390f91] ZipFile v0.8.3
  [2a0f44e3] Base64  [`@stdlib/Base64`]
  [ade2ca70] Dates  [`@stdlib/Dates`]
  [8bb1440f] DelimitedFiles  [`@stdlib/DelimitedFiles`]
  [8ba89e20] Distributed  [`@stdlib/Distributed`]
  [9fa8497b] Future  [`@stdlib/Future`]
  [b77e0a4c] InteractiveUtils  [`@stdlib/InteractiveUtils`]
  [76f85450] LibGit2  [`@stdlib/LibGit2`]
  [8f399da3] Libdl  [`@stdlib/Libdl`]
  [37e2e46d] LinearAlgebra  [`@stdlib/LinearAlgebra`]
  [56ddb016] Logging  [`@stdlib/Logging`]
  [d6f4376e] Markdown  [`@stdlib/Markdown`]
  [a63ad114] Mmap  [`@stdlib/Mmap`]
  [44cfe95a] Pkg  [`@stdlib/Pkg`]
  [de0858da] Printf  [`@stdlib/Printf`]
  [3fa0cd96] REPL  [`@stdlib/REPL`]
  [9a3f8284] Random  [`@stdlib/Random`]
  [ea8e919c] SHA  [`@stdlib/SHA`]
  [9e88b42a] Serialization  [`@stdlib/Serialization`]
  [1a1011a3] SharedArrays  [`@stdlib/SharedArrays`]
  [6462fe0b] Sockets  [`@stdlib/Sockets`]
  [2f01184e] SparseArrays  [`@stdlib/SparseArrays`]
  [10745b16] Statistics  [`@stdlib/Statistics`]
  [8dfed614] Test  [`@stdlib/Test`]
  [cf7118a7] UUIDs  [`@stdlib/UUIDs`]
  [4ec0a83e] Unicode  [`@stdlib/Unicode`]
[ Info: Nine tests should correctly report failure in the transcript (but not the test summary).
Skipping Base.active_repl
Skipping Base.active_repl_backend
Skipping Base.active_repl
Skipping Base.active_repl_backend
Test for "string1.txt" failed.
- DIFF ------------------------
"{-f-}{+intenti+}o{+nally wr+}o{-b-}{+ng to check that this mess+}a{+ge p+}r{+ints+}"
-------------------------------
Reference file for "wrong.txt" does not exist.
- NEW CONTENT -----------------
intentional error to check that this message prints
-------------------------------
Test for "string5.txt" failed.
- DIFF ------------------------
"""
- This is a
+ This is an incorrect
  multiline string that does not end with a new line."""
-------------------------------
Test for "ansii.txt" failed.
- REFERENCE -------------------
this should be blue
-------------------------------
- ACTUAL ----------------------
this should be red
-------------------------------
Reference file for "wrongfilename.png" does not exist.
- NEW CONTENT -----------------
eltype: Gray{Normed{UInt8,8}}
size: (64, 64)
thumbnail:
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
-------------------------------
┌ Warning: test fails because PSNR -15.415644645690918 < 25
└ @ ReferenceTests ~/.julia/packages/ReferenceTests/XNSR5/src/equality_metrics.jl:45
Test for "camera.png" failed.
- REFERENCE -------------------
eltype: RGB{Normed{UInt8,8}}
size: (64, 64)
thumbnail:
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
-------------------------------
- ACTUAL ----------------------
eltype: RGB{Normed{UInt8,8}}
size: (64, 64)
thumbnail:
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
-------------------------------
Test for "camera.png" failed.
┌ Warning: test fails because size(ref) (64, 64) != size(x) (512, 512)
└ @ ReferenceTests ~/.julia/packages/ReferenceTests/XNSR5/src/equality_metrics.jl:38
- REFERENCE -------------------
eltype: Gray{Normed{UInt8,8}}
size: (64, 64)
thumbnail:
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
-------------------------------
- ACTUAL ----------------------
eltype: Gray{Normed{UInt8,8}}
size: (512, 512)
thumbnail:
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
-------------------------------
Reference file for "wrongfilename.csv" does not exist.
- NEW CONTENT -----------------
3×2 DataFrame
│ Row │ v1    │ v2     │
│     │ Int64 │ String │
├─────┼───────┼────────┤
│ 1   │ 1     │ a      │
│ 2   │ 2     │ b      │
│ 3   │ 3     │ c      │
-------------------------------
Test for "dataframe.csv" failed.
- REFERENCE -------------------
3×2 DataFrame
│ Row │ v1    │ v2     │
│     │ Int64 │ String │
├─────┼───────┼────────┤
│ 1   │ 1     │ a      │
│ 2   │ 2     │ b      │
│ 3   │ 3     │ c      │
-------------------------------
- ACTUAL ----------------------
3×2 DataFrame
│ Row │ v1    │ v2     │
│     │ Int64 │ String │
├─────┼───────┼────────┤
│ 1   │ 1     │ c      │
│ 2   │ 2     │ b      │
│ 3   │ 3     │ c      │
-------------------------------
Test Summary:  | Pass  Total
ReferenceTests |   40     40
   Testing ReferenceTests tests passed 

Results with Julia v1.3.1-pre-7704df0a5a

Testing was successful. Last evaluation was ago and took 8 minutes, 40 seconds.

Click here to download the log file.

 Resolving package versions...
 Installed Ratios ──────────────────── v0.3.1
 Installed Graphics ────────────────── v0.4.0
 Installed Conda ───────────────────── v1.3.0
 Installed ColorTypes ──────────────── v0.8.0
 Installed ImageInTerminal ─────────── v0.4.1
 Installed ReferenceTests ──────────── v0.8.2
 Installed DataStructures ──────────── v0.17.6
 Installed Colors ──────────────────── v0.9.6
 Installed OpenSpecFun_jll ─────────── v0.5.3+1
 Installed NaNMath ─────────────────── v0.3.3
 Installed CoordinateTransformations ─ v0.5.0
 Installed SpecialFunctions ────────── v0.9.0
 Installed IdentityRanges ──────────── v0.3.0
 Installed Compat ──────────────────── v2.2.0
 Installed StaticArrays ────────────── v0.12.1
 Installed ImageCore ───────────────── v0.8.5
 Installed MappedArrays ────────────── v0.2.2
 Installed StatsBase ───────────────── v0.32.0
 Installed OffsetArrays ────────────── v0.11.2
 Installed AxisAlgorithms ──────────── v1.0.0
 Installed FixedPointNumbers ───────── v0.6.1
 Installed FileIO ──────────────────── v1.1.0
 Installed FFTW ────────────────────── v1.1.0
 Installed BinaryProvider ──────────── v0.5.8
 Installed Missings ────────────────── v0.4.3
 Installed AbstractFFTs ────────────── v0.5.0
 Installed Rotations ───────────────── v0.12.0
 Installed Crayons ─────────────────── v4.0.1
 Installed DeepDiffs ───────────────── v1.1.0
 Installed Distances ───────────────── v0.8.2
 Installed PaddedViews ─────────────── v0.4.2
 Installed Reexport ────────────────── v0.2.0
 Installed ColorVectorSpace ────────── v0.7.1
 Installed DataAPI ─────────────────── v1.1.0
 Installed WoodburyMatrices ────────── v0.4.1
 Installed VersionParsing ──────────── v1.1.3
 Installed OrderedCollections ──────── v1.1.0
 Installed JSON ────────────────────── v0.21.0
 Installed Interpolations ──────────── v0.12.5
 Installed Parsers ─────────────────── v0.3.10
 Installed SortingAlgorithms ───────── v0.3.1
 Installed ImageTransformations ────── v0.8.0
  Updating `~/.julia/environments/v1.3/Project.toml`
  [324d217c] + ReferenceTests v0.8.2
  Updating `~/.julia/environments/v1.3/Manifest.toml`
  [621f4979] + AbstractFFTs v0.5.0
  [13072b0f] + AxisAlgorithms v1.0.0
  [b99e7846] + BinaryProvider v0.5.8
  [3da002f7] + ColorTypes v0.8.0
  [c3611d14] + ColorVectorSpace v0.7.1
  [5ae59095] + Colors v0.9.6
  [34da2185] + Compat v2.2.0
  [8f4d0f93] + Conda v1.3.0
  [150eb455] + CoordinateTransformations v0.5.0
  [a8cc5b0e] + Crayons v4.0.1
  [9a962f9c] + DataAPI v1.1.0
  [864edb3b] + DataStructures v0.17.6
  [ab62b9b5] + DeepDiffs v1.1.0
  [b4f34e82] + Distances v0.8.2
  [7a1cc6ca] + FFTW v1.1.0
  [5789e2e9] + FileIO v1.1.0
  [53c48c17] + FixedPointNumbers v0.6.1
  [a2bd30eb] + Graphics v0.4.0
  [bbac6d45] + IdentityRanges v0.3.0
  [a09fc81d] + ImageCore v0.8.5
  [d8c32880] + ImageInTerminal v0.4.1
  [02fcd773] + ImageTransformations v0.8.0
  [a98d9a8b] + Interpolations v0.12.5
  [682c06a0] + JSON v0.21.0
  [dbb5928d] + MappedArrays v0.2.2
  [e1d29d7a] + Missings v0.4.3
  [77ba4419] + NaNMath v0.3.3
  [6fe1bfb0] + OffsetArrays v0.11.2
  [efe28fd5] + OpenSpecFun_jll v0.5.3+1
  [bac558e1] + OrderedCollections v1.1.0
  [5432bcbf] + PaddedViews v0.4.2
  [69de0a69] + Parsers v0.3.10
  [c84ed2f1] + Ratios v0.3.1
  [189a3867] + Reexport v0.2.0
  [324d217c] + ReferenceTests v0.8.2
  [6038ab10] + Rotations v0.12.0
  [a2af1166] + SortingAlgorithms v0.3.1
  [276daf66] + SpecialFunctions v0.9.0
  [90137ffa] + StaticArrays v0.12.1
  [2913bbd2] + StatsBase v0.32.0
  [81def892] + VersionParsing v1.1.3
  [efce3f68] + WoodburyMatrices v0.4.1
  [2a0f44e3] + Base64 
  [ade2ca70] + Dates 
  [8bb1440f] + DelimitedFiles 
  [8ba89e20] + Distributed 
  [b77e0a4c] + InteractiveUtils 
  [76f85450] + LibGit2 
  [8f399da3] + Libdl 
  [37e2e46d] + LinearAlgebra 
  [56ddb016] + Logging 
  [d6f4376e] + Markdown 
  [a63ad114] + Mmap 
  [44cfe95a] + Pkg 
  [de0858da] + Printf 
  [3fa0cd96] + REPL 
  [9a3f8284] + Random 
  [ea8e919c] + SHA 
  [9e88b42a] + Serialization 
  [1a1011a3] + SharedArrays 
  [6462fe0b] + Sockets 
  [2f01184e] + SparseArrays 
  [10745b16] + Statistics 
  [8dfed614] + Test 
  [cf7118a7] + UUIDs 
  [4ec0a83e] + Unicode 
  Building Conda → `~/.julia/packages/Conda/kLXeC/deps/build.log`
  Building FFTW ─→ `~/.julia/packages/FFTW/loJ3F/deps/build.log`
   Testing ReferenceTests
 Resolving package versions...
 Installed Tables ────────────────────── v0.2.11
 Installed DataValues ────────────────── v0.4.12
 Installed DataFrames ────────────────── v0.19.4
 Installed CSVFiles ──────────────────── v0.16.1
 Installed ImageMagick ───────────────── v0.7.5
 Installed WeakRefStrings ────────────── v0.6.1
 Installed TestImages ────────────────── v0.5.1
 Installed MbedTLS ───────────────────── v0.7.0
 Installed GenericSchur ──────────────── v0.3.0
 Installed Polynomials ───────────────── v0.6.0
 Installed CodecZlib ─────────────────── v0.6.0
 Installed Quadmath ──────────────────── v0.5.2
 Installed IterTools ─────────────────── v1.3.0
 Installed AxisArrays ────────────────── v0.3.3
 Installed TableTraits ───────────────── v1.0.0
 Installed HTTP ──────────────────────── v0.8.8
 Installed TranscodingStreams ────────── v0.9.5
 Installed ZipFile ───────────────────── v0.8.3
 Installed TableTraitsUtils ──────────── v1.0.1
 Installed PooledArrays ──────────────── v0.5.2
 Installed Requires ──────────────────── v0.5.2
 Installed InvertedIndices ───────────── v1.0.0
 Installed IntervalSets ──────────────── v0.3.2
 Installed TextParse ─────────────────── v0.9.1
 Installed GenericSVD ────────────────── v0.2.2
 Installed DataValueInterfaces ───────── v1.0.0
 Installed IniFile ───────────────────── v0.5.0
 Installed RangeArrays ───────────────── v0.3.1
 Installed IterableTables ────────────── v1.0.0
 Installed DoubleFloats ──────────────── v1.0.1
 Installed CategoricalArrays ─────────── v0.7.3
 Installed TableShowUtils ────────────── v0.2.5
 Installed IteratorInterfaceExtensions ─ v1.0.0
 Installed RecipesBase ───────────────── v0.7.0
 Installed Nullables ─────────────────── v1.0.0
  Building ImageMagick → `~/.julia/packages/ImageMagick/vMfoS/deps/build.log`
  Building ZipFile ────→ `~/.julia/packages/ZipFile/oD4uG/deps/build.log`
  Building TestImages ─→ `~/.julia/packages/TestImages/Aoq3X/deps/build.log`
  Building MbedTLS ────→ `~/.julia/packages/MbedTLS/a1JFn/deps/build.log`
  Building CodecZlib ──→ `~/.julia/packages/CodecZlib/5t9zO/deps/build.log`
    Status `/tmp/jl_9xfJyZ/Manifest.toml`
  [621f4979] AbstractFFTs v0.5.0
  [13072b0f] AxisAlgorithms v1.0.0
  [39de3d68] AxisArrays v0.3.3
  [b99e7846] BinaryProvider v0.5.8
  [5d742f6a] CSVFiles v0.16.1
  [324d7699] CategoricalArrays v0.7.3
  [944b1d66] CodecZlib v0.6.0
  [3da002f7] ColorTypes v0.8.0
  [c3611d14] ColorVectorSpace v0.7.1
  [5ae59095] Colors v0.9.6
  [34da2185] Compat v2.2.0
  [8f4d0f93] Conda v1.3.0
  [150eb455] CoordinateTransformations v0.5.0
  [a8cc5b0e] Crayons v4.0.1
  [9a962f9c] DataAPI v1.1.0
  [a93c6f00] DataFrames v0.19.4
  [864edb3b] DataStructures v0.17.6
  [e2d170a0] DataValueInterfaces v1.0.0
  [e7dc6d0d] DataValues v0.4.12
  [ab62b9b5] DeepDiffs v1.1.0
  [b4f34e82] Distances v0.8.2
  [497a8b3b] DoubleFloats v1.0.1
  [7a1cc6ca] FFTW v1.1.0
  [5789e2e9] FileIO v1.1.0
  [53c48c17] FixedPointNumbers v0.6.1
  [01680d73] GenericSVD v0.2.2
  [c145ed77] GenericSchur v0.3.0
  [a2bd30eb] Graphics v0.4.0
  [cd3eb016] HTTP v0.8.8
  [bbac6d45] IdentityRanges v0.3.0
  [a09fc81d] ImageCore v0.8.5
  [d8c32880] ImageInTerminal v0.4.1
  [6218d12a] ImageMagick v0.7.5
  [02fcd773] ImageTransformations v0.8.0
  [83e8ac13] IniFile v0.5.0
  [a98d9a8b] Interpolations v0.12.5
  [8197267c] IntervalSets v0.3.2
  [41ab1584] InvertedIndices v1.0.0
  [c8e1da08] IterTools v1.3.0
  [1c8ee90f] IterableTables v1.0.0
  [82899510] IteratorInterfaceExtensions v1.0.0
  [682c06a0] JSON v0.21.0
  [dbb5928d] MappedArrays v0.2.2
  [739be429] MbedTLS v0.7.0
  [e1d29d7a] Missings v0.4.3
  [77ba4419] NaNMath v0.3.3
  [4d1e1d77] Nullables v1.0.0
  [6fe1bfb0] OffsetArrays v0.11.2
  [efe28fd5] OpenSpecFun_jll v0.5.3+1
  [bac558e1] OrderedCollections v1.1.0
  [5432bcbf] PaddedViews v0.4.2
  [69de0a69] Parsers v0.3.10
  [f27b6e38] Polynomials v0.6.0
  [2dfb63ee] PooledArrays v0.5.2
  [be4d8f0f] Quadmath v0.5.2
  [b3c3ace0] RangeArrays v0.3.1
  [c84ed2f1] Ratios v0.3.1
  [3cdcf5f2] RecipesBase v0.7.0
  [189a3867] Reexport v0.2.0
  [324d217c] ReferenceTests v0.8.2
  [ae029012] Requires v0.5.2
  [6038ab10] Rotations v0.12.0
  [a2af1166] SortingAlgorithms v0.3.1
  [276daf66] SpecialFunctions v0.9.0
  [90137ffa] StaticArrays v0.12.1
  [2913bbd2] StatsBase v0.32.0
  [5e66a065] TableShowUtils v0.2.5
  [3783bdb8] TableTraits v1.0.0
  [382cd787] TableTraitsUtils v1.0.1
  [bd369af6] Tables v0.2.11
  [5e47fb64] TestImages v0.5.1
  [e0df1984] TextParse v0.9.1
  [3bb67fe8] TranscodingStreams v0.9.5
  [81def892] VersionParsing v1.1.3
  [ea10d353] WeakRefStrings v0.6.1
  [efce3f68] WoodburyMatrices v0.4.1
  [a5390f91] ZipFile v0.8.3
  [2a0f44e3] Base64  [`@stdlib/Base64`]
  [ade2ca70] Dates  [`@stdlib/Dates`]
  [8bb1440f] DelimitedFiles  [`@stdlib/DelimitedFiles`]
  [8ba89e20] Distributed  [`@stdlib/Distributed`]
  [9fa8497b] Future  [`@stdlib/Future`]
  [b77e0a4c] InteractiveUtils  [`@stdlib/InteractiveUtils`]
  [76f85450] LibGit2  [`@stdlib/LibGit2`]
  [8f399da3] Libdl  [`@stdlib/Libdl`]
  [37e2e46d] LinearAlgebra  [`@stdlib/LinearAlgebra`]
  [56ddb016] Logging  [`@stdlib/Logging`]
  [d6f4376e] Markdown  [`@stdlib/Markdown`]
  [a63ad114] Mmap  [`@stdlib/Mmap`]
  [44cfe95a] Pkg  [`@stdlib/Pkg`]
  [de0858da] Printf  [`@stdlib/Printf`]
  [3fa0cd96] REPL  [`@stdlib/REPL`]
  [9a3f8284] Random  [`@stdlib/Random`]
  [ea8e919c] SHA  [`@stdlib/SHA`]
  [9e88b42a] Serialization  [`@stdlib/Serialization`]
  [1a1011a3] SharedArrays  [`@stdlib/SharedArrays`]
  [6462fe0b] Sockets  [`@stdlib/Sockets`]
  [2f01184e] SparseArrays  [`@stdlib/SparseArrays`]
  [10745b16] Statistics  [`@stdlib/Statistics`]
  [8dfed614] Test  [`@stdlib/Test`]
  [cf7118a7] UUIDs  [`@stdlib/UUIDs`]
  [4ec0a83e] Unicode  [`@stdlib/Unicode`]
[ Info: Nine tests should correctly report failure in the transcript (but not the test summary).
Skipping Base.active_repl
Skipping Base.active_repl_backend
Skipping Base.active_repl
Skipping Base.active_repl_backend
Test for "string1.txt" failed.
- DIFF ------------------------
"{-f-}{+intenti+}o{+nally wr+}o{-b-}{+ng to check that this mess+}a{+ge p+}r{+ints+}"
-------------------------------
Reference file for "wrong.txt" does not exist.
- NEW CONTENT -----------------
intentional error to check that this message prints
-------------------------------
Test for "string5.txt" failed.
- DIFF ------------------------
"""
- This is a
+ This is an incorrect
  multiline string that does not end with a new line."""
-------------------------------
Test for "ansii.txt" failed.
- REFERENCE -------------------
this should be blue
-------------------------------
- ACTUAL ----------------------
this should be red
-------------------------------
Reference file for "wrongfilename.png" does not exist.
- NEW CONTENT -----------------
eltype: Gray{Normed{UInt8,8}}
size: (64, 64)
thumbnail:
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
-------------------------------
┌ Warning: test fails because PSNR -15.415644645690918 < 25
└ @ ReferenceTests ~/.julia/packages/ReferenceTests/XNSR5/src/equality_metrics.jl:45
Test for "camera.png" failed.
- REFERENCE -------------------
eltype: RGB{Normed{UInt8,8}}
size: (64, 64)
thumbnail:
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
-------------------------------
- ACTUAL ----------------------
eltype: RGB{Normed{UInt8,8}}
size: (64, 64)
thumbnail:
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
-------------------------------
┌ Warning: test fails because size(ref) (64, 64) != size(x) (512, 512)
└ @ ReferenceTests ~/.julia/packages/ReferenceTests/XNSR5/src/equality_metrics.jl:38
Test for "camera.png" failed.
- REFERENCE -------------------
eltype: Gray{Normed{UInt8,8}}
size: (64, 64)
thumbnail:
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
-------------------------------
- ACTUAL ----------------------
eltype: Gray{Normed{UInt8,8}}
size: (512, 512)
thumbnail:
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
-------------------------------
Reference file for "wrongfilename.csv" does not exist.
- NEW CONTENT -----------------
3×2 DataFrame
│ Row │ v1    │ v2     │
│     │ Int64 │ String │
├─────┼───────┼────────┤
│ 1   │ 1     │ a      │
│ 2   │ 2     │ b      │
│ 3   │ 3     │ c      │
-------------------------------
Test for "dataframe.csv" failed.
- REFERENCE -------------------
3×2 DataFrame
│ Row │ v1    │ v2     │
│     │ Int64 │ String │
├─────┼───────┼────────┤
│ 1   │ 1     │ a      │
│ 2   │ 2     │ b      │
│ 3   │ 3     │ c      │
-------------------------------
- ACTUAL ----------------------
3×2 DataFrame
│ Row │ v1    │ v2     │
│     │ Int64 │ String │
├─────┼───────┼────────┤
│ 1   │ 1     │ c      │
│ 2   │ 2     │ b      │
│ 3   │ 3     │ c      │
-------------------------------
Test Summary:  | Pass  Total
ReferenceTests |   40     40
   Testing ReferenceTests tests passed