Case Studies
StoriesNewsEducation

Exploring how we understand data differently

Written by Bruce Tsuji

Bruce is comparing how experts and novices understand data for his PhD thesis.

 

Who used NVivo?

Bruce Tsuji, PhD student, Carleton University’s Department of Psychology, Ontario, Canada

What was the project?

For his PhD thesis, Bruce is comparing how experts and novices understand data – in particular, how they make sense of graphs and other kinds of visualizations.

As part of his research, Bruce asked members of Carleton University’s business and psychology faculty, to explain the content of a variety of graphs that were cast in either a business or a psychology context. Undergraduate students were asked to do the same. This helped Bruce to understand how it is that experts (for example, faculty professors) seem to be able to draw so much more information from graphs than university undergraduates.

The explanations were recorded and transcribed in order to identify the different components of the explanations provided.

The value of NVivo and how it was used

In his initial analyses, Bruce identified 23 different components to the explanations provided, and eventually settled on nine. NVivo helped him to identify those nine components and to subsequently understand how frequently they occurred and to determine the serial order in which they appeared in his participants’ explanations. This provided Bruce with clues about the strategies in use by novices and experts.

“When I first started working with NVivo I don’t mind admitting to a little fear and some scepticism. The fear had to do with how much time and effort learning another piece of software was going to cost me and the scepticism had to do with the fact that simply tabulating the components of my verbal transcripts was something that I could easily do with a spread sheet. I believe that a relatively small investment of effort will help determine if NVivo is the appropriate tool for you.”

“Queries was my favourite feature. After coding hour upon hour of verbal transcript data, the ability to quickly construct a query allowed me to step back and look at a bigger picture that often surprised me.”

“Apart from my dissertation, I often find myself producing small surveys of 10 or so multiple-choice or Likert scale questions along with one or two free response questions. I can readily imagine using NVivo 9 to get a better handle on those free responses. Similarly, I can foresee that an analysis of responses to the essay-type questions I produce in my university and college teaching could be helpful in understanding what students have acquired and what needs further work.”

Outcomes from using NVivo

By using NVivo, Bruce was able to get a “picture” of experts and novices completing the simple task of explaining a graph. As a result, this allowed him to identify the qualitative and quantitative differences amongst his experimental participants.

“I don’t think I would have been able to complete my analyses at all without NVivo. Obviously, I am aware of other competing qualitative analysis software packages but what I wanted was the lowest possible learning time. I also wanted to not lose sight of the transcript data itself. On both fronts, NVivo did the trick!”