Thoughts on developing a methodology

Last modified date

It’s been a challenging few weeks recently, as I’ve reached the business end of the MPhil progression time. I need to firm up the methodology and actually know what I’m going to do with data, not just what might need to be achieved, with a rough estimation of how to go about it. I need to know.

The battle has come between two things: deductive versus inductive methods (and methodologies), and how to select methodologies suitable for the type of data and for the purpose of analysis. There now seems like a solution on the horizon, even though I don’t think I’ve reached it yet. I can mix and match, it is allowed.

This is the core of the challenge: I have mixed data – literature and people data. Literature is partially quantitatively (initial selection criteria) and then qualitatively sourced, using a priori deductive categories, then further inductively categorised. All people data is inductively analysed. The two sets need to be combined later. I’m now focused on two methodologies to use: phenomenography and qualitative content analysis.

Data set 1 – Learning experience data, as reported by learners through interviews AND what is gleaned from reviewing their online digital interactions data. This is inductively categorised using a phenomenography approach for ‘outcome spaces’ (which can be areas of focus that are predetermined) which each have ‘variation categories’ (which arise from the data).

Data set 2 – Literature analysis ‘data’ – papers sourced through fixed (a priori) category faceted search in systematic search sets, selecting from highest number of citations. This means a deductive categorisation using an initial partially quantitative method of selection. The papers are then further analysed and categorised inductively for keyword contexts. This is done using qualitative content analysis, first deductive, then leading to an inductive method.

Data set 3 – A final frame work must be generated, consisting of the two sets of data combined and compared, to establish theoretical presence in literature in relation to experience characteristics of ‘learning effectiveness’. I think this is achieved by an inductively arrived at set of categories though again the areas of focus will already exist. But what is in them is inductively produced from the previous sets of analysis.

It is complicated, but actually I don’t see another way of doing this, apart from ditching the whole proposal and just going for simple learning experience effective measurement.

These key texts are what I’m basing these ideas on:

Phenomenography

Marton, F., & Booth, S. (1997). Learning and Awareness. Mahwah, NJ: Lawrence Erlbaum Associates – ch 6 especially
Yates, C, Partridge, H & Bruce, C, 2012, Exploring information experiences through phenomenography, Library and Information Research Volume 36 Number 11

Qualitative content analysis

Cho, J. Y., & Lee, E. (2014). Reducing Confusion about Grounded Theory and Qualitative Content Analysis: Similarities and Differences. The Qualitative Report, 19(32), 1-20. Retrieved from http://nsuworks.nova.edu/tqr/vol19/iss32/2
Elo, S., & Kyngäs, H. (2008). The qualitative content analysis process. Journal of Advanced Nursing 62(1), 107–115. doi: 10.1111/j.1365-2648.2007.04569.x
and
Thomas, D., R. (2006). A General Inductive Approach for Analyzing Qualitative Evaluation Data. American Journal of Evaluation 2006 27: 237 DOI: 10.1177/1098214005283748