Category: ISDS

  • A/B Testing in Action: A Case Study of Company X

    Research
    companies and find an example where a company uses A/B testing.
    2.         Write a short paper on that company – at least four pages but no more than five single-spaced
    pages in total (not counting references), using Times New Roman font style and
    12 point font size – and include the following information:
    Components
    to be graded (total
    possible = 50 pts):
    1.         Was student’s name included? Were
    directions followed?
    At least four pages but no more than five single-spaced pages in total (not counting
    references), using Times New Roman font style, and 12 point font size (3 pts)
    2.         Name
    of the Company –
    was the name of the company given, including the industry? (2 pts)
    3.         Label
    the paper using the following parts:
    a.         Introduction
    – does the report include a description of the business and purpose of the business
    (example: does the company provide a product or service to customers, also
    define the target customer) as a background and introduction to why the company
    would be doing A/B testing. (10
    pts)
    b.         Purpose
    – is the purpose of A/B testing clearly defined? In other words, is the
    problem statement clearly defined? Is the objective of A/B testing defined? (10 pts)
    c.          Description
    of the A/B Testing – were details of the A/B testing adequately described so
    that the reader was clear on how the A/B testing/study was conducted? How was
    the study designed?  How many
    groups?  Define the treatment group?  What was the controlled group?  What was the variable under investigation; in
    other words, what was observed and recorded in the study and was that variable
    numerical or categorical?  For example,
    in a marketing study, you could measure sales (numerical variable) or number of
    customers who purchase (counting the number of Yes’s in a categorical
    variable).  Recall if we are looking at a
    treatment group and a controlled group, we could look at a numerical variable
    for each group by looking at bivariate histograms (covered on Test 1); when
    looking at a categorical variable, we looked at bivariate pie charts (also
    covered on Test 1).  Also after Test 3, we will cover the inferential
    approach to each of these through a pool-variance t-test and a chi-
    squared test of independence,
    respectively. (10 pts)
    d.         Results – were the results of the study and the subsequent
    decision(s) or conclusions of the company concisely given? (10 pts)
    e.         References
    – were adequate references given so that the reader could find additional
    information pertinent to the paper. (5 pts)