Versions Compared

Old Version 3

changes.mady.by.user Trevor Lang

Saved on

compared with

New Version Current

changes.mady.by.user Trevor Lang

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

By improving the display of the collection search results, users will more effectively find their desired collection and will access data more efficiently.

Variants

NameOriginalMinimalThumbnail OnlyDescription Only
DescriptionIncludes both the thumbnail and the description.Thumbnails and descriptions are removed from the panel, in favor of displaying them in a panel, displayed when the user hovers a search result.The description is removed and the thumbnail is visible.The thumbnail is removed and the description is visible.
Screenshot

Image Modified

Image Modified

Image Modified

Image Modified


Results

Total Sessions22,451
Start Date

 

End Date


ResultsTakeaways
Data Access
Completion
(Goal 4)

Image Modified

  • Thumb Only variant showed a 60% probability to be the best, and a 79% probability to beat the original.
  • Thumb Only had a ~1.5% increased conversion rate
  • Thumb Only had the greatest modeled improvement at -7% to 19%
  • Description Only appeared to perform the worst with only a 10% probability to be the best

Thumb Only held up well against the Original variant, which displays both a thumbnail and description.

5 minute plus
session
(Goal 1)

Image Modified

  • Original showed the highest probability of leading to a 5-minute plus session, with a 41% probability to be the best
  • Description Only also appeared to lead to longer session times, with a 27% probability to be the best

The Original Variant appeared to consistently lead to longer sessions when compared to the other variants. 

Pageviews

Image Modified

  • Description Only lead to the largest increase in pageviews
  • Description Only had a 96% probability to be the best and a 99% probability to be best

In the context of this test, we see an increase in page views as a negative. Our hope would be that a variant leads to the quicker discovery of the desired data product, and therefore a decreased page count.


Summary

One interesting takeaway is that the Thumb Only variant appeared to perform best or nearly best in terms of increased data access and limiting pageviews and session length. It is an interesting finding and deserves a little more digging. A confirmation test will be run to see if we can replicate the result when comparing the Original and Thumb Only variants.

...

  •  Run a confirmation test with the Original and Thumbnail Only variants Trevor Lang