How can Email Interventions Increase Students' Completion of Online Homework? A Case Study Using A/B Comparisons
- Publisher:
- ACM
- Publication Type:
- Conference Proceeding
- Citation:
- LAK22: LAK22: 12th International Learning Analytics and Knowledge Conference, 2022, pp. 107-118
- Issue Date:
- 2022-03-21
Closed Access
| Filename | Description | Size | |||
|---|---|---|---|---|---|
| 3506860.3506874.pdf | Published version | 1.02 MB |
Copyright Clearance Process
- Recently Added
- In Progress
- Closed Access
This item is closed access and not available.
Email communication between instructors and students is ubiquitous, and it could be valuable to explore ways of testing out how to make email messages more impactful. This paper explores the design space of using emails to get students to plan and reflect on starting weekly homework earlier. We deployed a series of email reminders using randomized A/B comparisons to test alternative factors in the design of these emails, providing examples of an experimental paradigm and metrics for a broader range of interventions. We also surveyed and interviewed instructors and students to compare their predictions about the effectiveness of the reminders with their actual impact. We present our results on which seemingly obvious predictions about effective emails are not borne out, despite there being evidence for further exploring these interventions, as they can sometimes motivate students to attempt their homework more often. We also present qualitative evidence about student opinions and behaviours after receiving the emails, to guide further interventions. These findings provide insight into how to use randomized A/B comparisons in everyday channels such as emails, to provide empirical evidence to test our beliefs about the effectiveness of alternative design choices.
Please use this identifier to cite or link to this item: