How do you know if your qualitative analysis is good enough? Quality criteria to judge analytical work
One of the most uncomfortable parts of qualitative analysis is that nobody can give you a neat, reassuring answer to the question: “Is this right?”
That uncertainty unsettles a lot of capable PhD researchers.
You wonder if you should just start over and re-code everything from scratch. You doubt your themes. You worry they are too obvious, too broad, too descriptive, or somehow fundamentally wrong. You sit staring at your analysis wondering whether you are genuinely interpreting the data or simply making things up.
Over the last twenty years supporting qualitative PhD researchers, I have seen how many people reach this stage and fret that everybody else must feel far more certain than they do.
Usually, no one feels certain. They all have those nightmares in which their examiner says, shaking their head, “You just made all this up, didn’t you?”. Gulp.
I think learning to drive probably explains why this stage of qualitative analysis feels so difficult.
When you first start driving, you desperately want certainty. You want fixed rules for every situation - exactly when to pull out at a junction, exactly how much space you need.
Then somewhere between stalling at roundabouts and overthinking parallel parking, you realise experienced drivers are constantly making judgements rather than following perfect formulas.
They are reading the road, interpreting situations, anticipating behaviour, adjusting to conditions, and making decisions based on experience, context, and evidence available at that moment.
Qualitative analysis works rather similarly.
Why qualitative analysis feels so uncertain
A great many researchers approach qualitative analysis as though the data contains one hidden set of “correct” themes waiting to be discovered. If they fail to identify precisely the right interpretation, they assume they have somehow failed as researchers.
That expectation creates enormous anxiety because interpretive work rarely functions that way.
Qualitative analysis involves making thoughtful, evidence-based judgements about patterns, meanings, tensions, contradictions, experiences, relationships, and processes.
This means there may be more than one reasonable interpretation of the same dataset. Yes, another person could come along, look at your data and make a different call about it.
So, the more useful question is rarely: “Is this the correct answer?”
It is usually: “Is this a credible, coherent, well-supported interpretation?”
Why many researchers feel like they are “guessing”
One of the most common things qualitative PhD researchers say during analysis is: “I feel like I’m just guessing.”
Most of the time, they are not.
What is usually happening is that their analytical reasoning still exists largely inside their own head. They have noticed patterns, grouped ideas together, recognised tensions, and started forming interpretations, but they have not yet fully articulated the reasoning behind those decisions.
This is largely reasoning still feels partly intuitive and unfinished, the analysis can feel unstable.
There is also a second problem.
Many researchers have never actually been shown how to evaluate qualitative analysis properly.
Without clear evaluative criteria, we keep returning to that question: “Is this right?” - because that’s the only one we know how to use to judge the quality of analysis.
In qualitative research, that question becomes impossible to answer with complete certainty because interpretive research does not operate like a maths test with one correct solution waiting at the back of the textbook.
Five questions that strengthen qualitative analysis
One of the most helpful shifts qualitative researchers can make is moving towards clearer analytical criteria.
For example, imagine you are researching newly qualified teachers and their experiences of interacting with parents. After analysing your interviews, you develop a theme around: “Feeling constantly evaluated by parents.” How do you decide whether that theme is actually strong enough?
A useful starting point is asking: Can I clearly explain how I arrived here?
Are participants repeatedly discussing anxiety before meetings, pressure to respond quickly to emails, concerns about appearing inexperienced, feelings of being scrutinised?
If so, the interpretation is grounded in identifiable patterns within the data.
The next question is - Do my themes genuinely help answer the research questions?
A vague label like: “communication” may remain too broad and descriptive. A more interpretive theme such as, “constant parental demands blurred the boundaries of the teaching role”, starts moving beyond summary and towards explanation. It tells us something about meaning, tension, and experience rather than simply naming a topic.
This is often where qualitative analysis becomes stronger - themes usually become more compelling when they explain something rather than merely categorise it.
Why disagreement can improve your analysis
One of my favourite questions to ask researchers is - Could another intelligent person disagree with this interpretation?
People are often startled by that question because they assume disagreement would weaken the analysis. Very often, it strengthens it.
Imagine somebody responds to the earlier teacher example by saying:
“Is this really about parental judgement, or is it actually about professional insecurity as a newly qualified teacher?”
That alternative explanation forces you to think more carefully about what is actually happening analytically.
Perhaps the issue is not one or the other. Perhaps both processes are interacting together. That deeper exploration is where richer interpretation begins emerging.
Strong qualitative analysis is rarely about proving you have discovered the single objectively correct explanation, it is about demonstrating that your interpretation is thoughtful, coherent, reflexive, and grounded in the data.
What good qualitative analysis usually feels like
Many researchers expect good analysis to feel confident from the beginning. In reality, strong interpretation often feels uncertain while it is developing.
You circle around ideas, test possibilities, abandon weaker interpretations, return to transcriptsm, rethink earlier assumptions. Gradually, some interpretations begin holding together more convincingly than others.
That process can feel a tad uncomfortable because qualitative analysis requires tolerance for ambiguity. You often need to sit with unfinished thinking for a while before patterns become clearer.
Experienced qualitative researchers are not necessarily people who never feel uncertain, they are people who have learned not to panic immediately when uncertainty appears.
One final question worth asking yourself
When you look across your themes collectively, what kind of story do they tell?
Strong qualitative analysis has internal coherence. The themes connect meaningfully, illuminate different aspects of the phenomenon, and collectively help answer the research questions convincingly.
Certainty is rarely the real goal of qualitative interpretation.
Credibility, coherence, reflexivity, and thoughtful judgement matter much more.
Those things develop gradually through practice, reflection, and sustained engagement with the data.
A bit like driving, really.
If you want more structured support
If qualitative analysis currently feels more overwhelming than clarifying, my From Data to Analysis: Thinking, Methods and Meaning PhD Survival Guide was designed specifically for this stage of the doctorate.
It explores:
how to move from coding to stronger interpretation
how to evaluate themes more confidently
how to strengthen analytical depth
how to connect findings, meaning, and argument
and how to approach qualitative analysis with far more structure and trust in your own judgement
It’s here when you need it.
From “I’m not sure this makes sense” to a clear, defensible research design.
If your qualitative data analysis feels unclear, disconnected, or harder than it should, this guide will help you make sense of your decisions and explain them with confidence.
Many capable researchers reach the point where things stop feeling straightforward.
You may have data, but feel unsure what to do with it.
You may be writing your methodology chapter, but not know how to explain or justify your choices.
You may sense that parts of the project no longer fit together as clearly as they should.
That usually means you have reached the stage where qualitative research asks for coherence, judgement, and clarity - this guide is designed to help you through that stage.
Inside, I show you how to bring your research questions, methods, data collection, and analysis into a coherent whole, so that your project makes sense to you and can be clearly communicated to others.
You’ll learn how to:
align your research questions, methods, and data
understand what you are doing when you analyse qualitative material
make decisions you can justify with confidence
approach your methodology chapter with more clarity and structure
move forward without constantly doubting yourself
Whether you are refining your design, collecting data, analysing interviews or documents, or trying to write everything up clearly, this guide meets you where you are.
Across 12 carefully sequenced sections and practical worksheets, it helps you move from uncertainty and overthinking to clarity, coherence, and steady progress.
This is a digital download, so you’ll receive immediate access after purchase and can begin straight away.
Swipe through the images above to see what’s inside.
If you’d like one complete system for your qualitative PhD, you can also access all four PhD Survival Guides here.
If you have any questions, feel free to contact me. I’ll be happy to help.
By purchasing this product, you agree to our Terms & Conditions.