Data analytics is applied to many fields of specialty, including higher education. Blackboard™ ULTRA, a learning management system used widely in higher education, provides non-complex data analytics which can help academics to identify problematic questions in their online assessments and to identify student learning difficulties that need to be addressed. The purpose of this study is to showcase special features within Blackboard™ ULTRA that can help academics to refine their online assessments and identify additional support that is required by their students to achieve academic success. An exploratory case study is used focusing on a compulsory first-year module at a university of technology. One special feature is called “student activity” where the number of single and multiple submissions are contrasted along with the mark distribution. Another feature is called “question analysis” that provides a discrimination index and difficulty level as experienced by the students in an assessment. It is recommended to create more awareness among academics of the importance of using data analytics to improve the quality of online assessments and to address student learning difficulties.