Measuring the Effect of User-Perceived Load Metrics on Conversion Rate in the Context of TransferWise
Name
Oliver Viljamaa
Abstract
The user experience of loading a web page can have an effect on business metrics. One of these metrics is conversion rate: the percentage of visitors performing a desired action when reaching a given state such as visiting a web page. The effect of the page load experience on conversion rate has been widely studied. However, the observed effects vary significantly across studies due to the use of different load metrics and due to differences in the populations. Therefore, to ensure reliable results, this effect should be measured for each site separately. The problem addressed by this work concerns TransferWise not having measured this effect and therefore lacking insights on whether or not to optimise page load experience, to what extent, and with respect to which metrics.
In this setting, the contributions of this work are threefold: (i) a precise definition of a set of user-perceived load metrics for TransferWise, together with a solution for collecting these metrics within TransferWise production environment; (ii) a dashboard application for measuring the effect of load metrics on conversion rate; and (iii) an initial analysis of the relations between load metrics and conversion rate for different acquisition channels.
The results of the analysis confirm the expected correlations between increase in load time and decrease in conversion rate, and show that the extent of this relation varies by load metric and by acquisition channel.
In this setting, the contributions of this work are threefold: (i) a precise definition of a set of user-perceived load metrics for TransferWise, together with a solution for collecting these metrics within TransferWise production environment; (ii) a dashboard application for measuring the effect of load metrics on conversion rate; and (iii) an initial analysis of the relations between load metrics and conversion rate for different acquisition channels.
The results of the analysis confirm the expected correlations between increase in load time and decrease in conversion rate, and show that the extent of this relation varies by load metric and by acquisition channel.
Graduation Thesis language
English
Graduation Thesis type
Bachelor - Computer Science
Supervisor(s)
Marlon Dumas, Mihkel Nõges
Defence year
2018