PSY1023 Chap.5 Qualitative Data Collection and Credibility
Qualitative Data Collection and Credibility
Week 4 of PSY1023 moves from planning a study to gathering its data, and it asks a question that runs through the rest of the unit: why should anyone believe what a qualitative study reports? Quantitative research answers with validity, reliability and objectivity.
The seminar shows that qualitative research has its own criteria, drawing on Guba (1981) as discussed by Shenton (2004), where credibility, transferability, dependability and confirmability take the place of the familiar quantitative terms.
Credibility gets the most attention because it is the criterion your group can influence most directly while collecting data.
The seminar places four practical strategies under the heading of groundedness. Prolonged engagement means immersing yourself in the setting and in the data instead of skimming a transcript once.
Persistent observation is about the number of observations rather than the hours spent, so that changes over time are not missed; a single snapshot taken at one stressful moment can misrepresent an experience that shifts across a semester. Triangulation combines different data sources, methods, theories or investigators.
Member checking returns transcripts or early analysis to participants so misunderstandings can be corrected.
The chapter also covers the practical side of collection.
The unit distinguishes individual methods such as interviews from group methods such as focus groups, and it links method choice to methodological integrity: your data should capture the diversity that matters for the question, your own perspective should be managed during collection and analysis, and the findings should stay grounded in the evidence.
Published student-experience studies from the unit's reading lists show what these ideas look like on the page, from two rounds of interviews across a first year to a survey followed by focus groups. Reading these designs side by side trains you to see sample size, timing and method as choices with consequences, rather than as details to copy from a template.
It also shows how differently published teams combine their credibility moves.
Finally, the chapter turns these ideas into decisions for your own project. With short interviews in Week 8, some strategies are easy to claim and others are not, and a constructivist analysis reports credibility differently from a post-positivist one.
You will practise spotting strategies in described studies, weighing several evidence types against a single question, and writing method-section sentences that name each strategy together with the action that put it into practice.
What this chapter covers
- 01
Guba's qualitative counterparts to validity, reliability and objectivity
- 02
Credibility and the idea of groundedness
- 03
Prolonged engagement, persistent observation, triangulation and member checking
- 04
Individual versus group methods of data collection
- 05
Reading published method sections for credibility moves
- 06
Planning credibility for a short interview project
Worked example · free
Repair the credibility case in a small interview study
- 2Weakness one: a single read-through by a single coder gives no prolonged engagement with the data and only one interpretive viewpoint, so the themes may reflect one person's assumptions.
- 1Fix one: have every team member read each transcript several times before coding, then compare interpretations in discussion, which adds investigator triangulation.
- 1Weakness two: an interrater agreement figure belongs to a post-positivist logic and does not fit a constructivist analysis, which instead reports what the researchers brought to the data.
- 1Fix two: replace the statistic with a reflexive account of each analyst's perspective and, if time allows, share a summary of early themes with participants as a form of member checking.
Key terms
- Credibility
- Confidence that a qualitative account is grounded in the data, supported by strategies such as prolonged engagement, triangulation and member checking.
- Prolonged Engagement
- Extended immersion in the research setting and in the data, including repeated readings of transcripts, that supports context-informed interpretation.
- Persistent Observation
- A credibility strategy defined by the number of observations made rather than time spent, allowing changes across time to show up.
- Triangulation
- Combining several data sources, methods, theories or investigators so that a conclusion is cross-checked from more than one direction.
- Member Checking
- Sharing transcripts or initial analysis with participants so they can correct errors and misunderstandings in how their accounts were read.
Qualitative Data Collection and Credibility FAQ
Is credibility just another word for validity in qualitative research?
It is the qualitative counterpart of internal validity in the mapping the unit takes from Guba (1981) via Shenton (2004). Transferability, dependability and confirmability correspond to generalisability, reliability and objectivity, so credibility covers only one of those four concerns.
Does triangulation always mean mixing qualitative and quantitative data?
No. Combining methods is one form, but the seminar also lists using different data sources and using several researchers to interpret the same data. A group of students coding the same transcripts and debating interpretations is already a form of triangulation.
Why would a qualitative study avoid reporting interrater reliability?
The Week 3 seminar contrasts post-positivist work, which may report training and interrater reliability, with constructivist work, which instead describes what researchers brought into the analysis. Reflexive thematic analysis sits in the second camp, so an agreement statistic sends a mixed signal.
What is the difference between an individual and a group method?
Individual methods such as interviews collect one person's account at a time, while group methods such as focus groups gather several participants who respond to one another. Each suits different questions, and the choice is part of matching method to aim.
Can we cite the starting-reference studies in our report?
The unit presents them as background reading for each sub-topic and advises against relying on them in the assessment tasks. They are useful as design examples, but the literature in your report should come from your own search of recent peer-reviewed articles.
Assessment move
Learn credibility as a set of actions rather than definitions. Make a table with the four groundedness strategies down the side and three columns across: what the researcher does, what threat it guards against, and whether your own project can realistically use it. Fill the third column with your actual Week 8 arrangements in mind, since each participant gives one short interview and your whole group can read the transcripts.
Then practise recognition. Take the method section of any qualitative or mixed-methods paper on student life and highlight every sentence that shows a credibility action, even if the authors never use the word. Note repeated contact over time, several interviewers or coders, mixed data sources, consultation with outsiders, and any return of findings to participants.
Write one line on what each action adds and one on what is still missing. Next, work through a triangulation case of your own invention: one research question, three short evidence summaries of different kinds, and a conclusion drawn first from one source and then from all three. Check any numbers for how they were defined before you interpret them, and treat a contradiction between sources as something to explain.
Finally, draft the credibility sentences for your group's method section early. Each sentence should name a strategy and the concrete step behind it. Avoid importing agreement statistics into a reflexive thematic analysis, and keep credibility separate from claims about how far your findings might transfer to other settings.
Working through Qualitative Data Collection and Credibility in PSY1023? Sia is AskSia’s AI Psychology tutor — ask any PSY1023 Qualitative Data Collection and Credibility question and get a clear, step-by-step explanation grounded in how PSY1023 is taught and assessed. Read this chapter free, then take your hardest questions to Sia.
