SOAD2021 Research Methods and Evaluation in Social Work
SOAD2021 Overview
- Flinders University
- Semester 2 2026
- 8 chapters
- Three staged MERL plan sections
What this topic asks you to do
Research Methods and Evaluation in Social Work develops a connected way of reasoning from a social or service problem to a defensible monitoring, evaluation, research and learning plan.
- Design coherence Research design begins with a coherent relationship between assumptions, questions, evidence and method.
- MERL alignment A MERL plan becomes credible when its theory of change, indicators, data sources and interpretation limits align.
- Ethical practice Ethics and cultural responsiveness shape every design decision rather than appearing as a final compliance step.
How SOAD2021 is assessed
| Component | Weight | Format |
|---|---|---|
| Assessment 1: Monitoring, Evaluation, Research, and Learning (MERL) Plan Section One (MSW) | 30% | Due 26 August 2026 |
| Assessment 2: Monitoring Evaluation Research and Learning (MERL) Plan Section Two (MSW) | 30% | Due 30 September 2026 |
| Assessment 3: Monitoring, Evaluation, Research and Learning (MERL) Plan Section 3 (MSW) | 40% | Due 16 October 2026 |
The current Semester 2 2026 calendar publishes these three tasks at 30, 30 and 40 percent. The assessment overview states that students must make a reasonable attempt at every assignment task, including any designated hurdle task, and achieve at least 50 percent overall; it does not identify a particular task as a hurdle. The task titles retain the published MSW label even though the shared site names SOAD2021 and SOAD9230, so confirm stream-specific instructions in the current Handbook and FLO pages.
Current SOAD2021 dates
| Date | Item | Control |
|---|---|---|
| 26 August 2026 | Assessment 1 due | |
| 30 September 2026 | Assessment 2 due | |
| 16 October 2026 | Assessment 3 due |
Dates are as published in the current course materials. Confirm exact deadlines and submission settings in the live LMS.
What SOAD2021 covers
Eight chapters follow the published learning sequence from ways of knowing and desk-based review to program logic, qualitative and quantitative design, ethical governance and participatory evaluation.
Research Philosophy and Social Work Inquiry
ontology, epistemology and methodology; connect assumptions about reality and knowledge to a defensible inquiry designResearch philosophy is practical design work.
- Ontology
- Epistemology
- Methodology
- Positionality
- Indigenous knowledges
- Design coherence
Desk-based Review and Evidence Searching
review questions, search concepts, databases, grey literature and transparent evidence selectionA desk-based review turns a broad concern into a transparent evidence search. Begin by defining purpose, population or setting, focal concept and intended decision.
- Review purpose
- Search concepts
- Boolean logic
- Database selection
- Grey literature
- Search ledger
Data Literacy and Public Data
data provenance, measures, denominators, comparison, uncertainty and responsible interpretation of public datasetsData literacy means more than reading a number. It requires knowing who or what was counted, how concepts were operationalised, when data were collected, what denominator was used and which people or events are absent.
- Data provenance
- Metadata
- Counts and rates
- Denominators
- Missing data
- Comparison
Program Evaluation and Theory of Change
implementation, theory of change, program logic, indicators, assumptions and risks in an evaluable MERL planProgram evaluation asks systematic questions about implementation, outputs, outcomes and value.
- Program evaluation
- Implementation science
- Theory of change
- Program logic
- Indicators
- Assumptions
Qualitative Research and Evaluation
interviews, focus groups, observation and coding; match qualitative methods to meaning, experience and process questionsQualitative inquiry examines meaning, experience, practice and process in context. A strong design begins with a question that needs participants' accounts, interactions, documents or observed settings rather than treating interviews as a default.
- Qualitative questions
- Semi-structured interviews
- Focus groups
- Observation
- Purposive sampling
- Coding
Quantitative Design and Analysis
variables, sampling, surveys, descriptive summaries, hypothesis testing and cautious statistical interpretationQuantitative design translates concepts into variables that can be measured across defined units. Begin with a precise question, population, outcome, comparison and time frame.
- Operational definition
- Variables
- Sampling
- Survey design
- Descriptive statistics
- Hypothesis testing
Ethics, Power and Cultural Responsiveness
ethical principles, risk, consent, power, cultural responsiveness and Indigenous research governanceEthical research and evaluation are relational practices, not a form completed after design. The purpose, anticipated benefit, burden, consent process, privacy protections, cultural authority and governance arrangements must be considered together.
- Ethical purpose
- Consent
- Risk and benefit
- Power
- Cultural responsiveness
- Indigenous governance
Participatory and Inductive Evaluation
participation, empowerment evaluation, Most Significant Change and Outcome Harvesting as learning-oriented approachesParticipatory evaluation redistributes parts of evaluation decision-making to people affected by a program. Participation is not achieved simply by asking for views.
- Participation
- Shared governance
- Empowerment evaluation
- Most Significant Change
- Outcome Harvesting
- Contribution
The published learning sequence starts with ontology, epistemology and methodology because every inquiry rests on assumptions about what is real, whose knowledge counts and how a claim can be justified.
Those assumptions then meet practical tools: desk-based review, database searching, public data, theory of change, program logic, qualitative inquiry, quantitative design, ethical governance and participatory evaluation.
The central discipline is alignment. A broad concern such as improving access to a family support program is not yet a researchable question.
It must be translated into a bounded purpose, a population or setting, an outcome or experience of interest, and a feasible form of evidence. An outcome question may require indicators and repeated numerical measures. A process question may call for interviews, observation or document analysis. A learning question may be served by a participatory or inductive approach.
Method choice follows the question and the decision the evidence must support.
How the course fits together
Desk-based review establishes what is already known and makes search decisions visible. Data literacy helps you inspect definitions, provenance, denominators, missingness and uncertainty before using a public statistic.
Program evaluation connects activities to outputs and outcomes through a theory of change, then tests that logic with indicators and data sources. Qualitative research examines meaning, experience and process, while quantitative research describes patterns and tests carefully specified relationships.
Ethical practice asks who benefits, who bears risk, who controls interpretation and how cultural authority is respected.
The three published assessment tasks are staged sections of a MERL plan. Treat them as one developing design rather than three unrelated submissions: preserve the same program logic, define every key term consistently, and record changes prompted by evidence or feedback.
The joint course site labels the task titles with MSW while also naming both SOAD2021 and SOAD9230. This guide therefore reproduces the published titles exactly and treats the current Handbook and FLO task pages as the operational authority for stream-specific requirements.
Worked example · free
Turn a service concern into an aligned evaluation design
- 2State the decision and question: name the decision the agency must make, then ask a bounded question about timeliness and the client experience of the pathway.
- 2Match measures to concepts: define timely access, use elapsed days as one indicator, then use interviews to explore barriers, enabling conditions and unintended effects.
- 2Bound the claim: inspect missing records and variation, then report what the evidence supports without claiming that the pathway alone caused every observed change.
Key terms
- Ontology
- Ontology is a set of assumptions about the nature of reality. It influences what a researcher treats as a phenomenon that can be studied.
- Epistemology
- Epistemology is a set of assumptions about knowledge and justified knowing. It directs attention to evidence, standpoint and authority.
- Methodology
- Methodology is the rationale connecting a research question, philosophical position and strategy of inquiry. It is broader than a single data collection method.
- Desk-based review
- A desk-based review is a structured examination of existing research, policy, program and administrative material. Its credibility depends on a transparent question and search process.
- Grey literature
- Grey literature is material produced outside conventional commercial academic publishing. Government reports, practice guidance and organisational evaluations may offer valuable contextual evidence.
- Data literacy
- Data literacy is the capacity to find, understand, evaluate, analyse and communicate data responsibly. It includes asking how data were produced and what they cannot show.
- Theory of change
- A theory of change is an explanation of how and why activities are expected to contribute to desired change within stated conditions. It makes causal assumptions available for testing.
- Program logic
- A program logic is a concise representation of relationships among inputs, activities, outputs and outcomes. It helps align evaluation questions and indicators.
- Key performance indicator
- A key performance indicator is a specified measure used to track an important aspect of performance. A useful indicator has a definition, source, frequency and interpretive purpose.
- Semi-structured interview
- A semi-structured interview is a guided conversation using planned topics with scope for probing. It supports consistency while allowing participants to explain meaning and context.
- Statistical significance
- Statistical significance is a model-based assessment of how compatible observed data are with a specified null hypothesis. It does not by itself establish practical importance or causation.
- Cultural responsiveness
- Cultural responsiveness is an ongoing practice of recognising cultural authority, relationships, histories and consequences in design and interpretation. It cannot be reduced to demographic representation.
- Outcome Harvesting
- Outcome Harvesting is an evaluation approach that begins with observed changes and works backward to examine contribution. It is useful when outcomes and pathways are emergent.
SOAD2021 FAQ
How do the three assessments relate to one another?
The published tasks are three sections of a MERL plan, so the safest approach is to maintain one design record across the semester. Keep definitions, program logic, intended users and evaluation purpose consistent. When feedback changes an earlier choice, note the revision and check every downstream indicator, method and ethical safeguard for alignment.
What are the published passing conditions?
The current assessment overview requires a reasonable attempt at every assignment task, including any task designated as a hurdle, and at least 50 percent overall. It does not name a particular task as a hurdle. Use the live Handbook and FLO pages to confirm any later operational change affecting your enrolment.
Why start with ontology and epistemology?
They make the assumptions beneath a method visible. If you treat experience as situated and knowledge as co-produced, that affects whose accounts matter and how findings are interpreted. If you seek measurable regularities, you must still justify definitions, instruments and comparison. The point is coherence, not attaching a fashionable label.
How should I choose between qualitative and quantitative methods?
Start with the question and intended decision. Questions about prevalence, amount or change in a defined measure often need quantitative evidence. Questions about meaning, process or experience often need qualitative evidence. A mixed design is justified only when each component answers a distinct part and the findings can be integrated.
Does a significant result prove that a program worked?
No single test carries that conclusion. Statistical significance is conditional on a model, sample and null hypothesis. Program claims also require attention to effect size, measurement quality, design, missing data, alternative explanations and practical importance. Connect the numerical result to the program logic and state the limit of the inference.
Where does ethics enter an evaluation plan?
Ethics enters when the purpose, relationships and governance are negotiated, before data collection begins. It affects participant burden, consent, privacy, cultural authority, ownership, interpretation and return of findings. A strong plan identifies foreseeable risks, explains who decides, and shows how participants and communities can influence the process.
How can I keep the MERL plan manageable?
Use a one-page alignment table with columns for question, indicator or construct, source, collection method, timing, responsibility, analysis and intended use. Limit the plan to evidence that can inform a real decision. Then test feasibility, participant burden and ethics before adding more measures or methods.
Questions students ask in each SOAD2021 chapter
- Do I need to choose one philosophical label?
- Use labels only when they clarify an assumption and its consequence. A defensible response can acknowledge tensions or draw on compatible ideas, provided it explains how the resulting question, relationship, method and interpretation fit together. Chapter 01 · Research Philosophy and Social Work Inquiry
- How narrow should the first search be?
- Start broad enough to learn the language used in the field, then narrow through concept combinations and justified limits. A very narrow first query can hide relevant terminology, while an unbounded final query produces an evidence set that cannot be screened transparently. Chapter 02 · Desk-based Review and Evidence Searching
- Why can a count and rate move in opposite directions?
- A count can increase because the underlying population or opportunity for events increased, while the rate decreases because the event grew more slowly than its denominator. Report both when they answer relevant questions, and never compare percentages without naming their denominators. Chapter 03 · Data Literacy and Public Data
- What is the difference between program logic and theory of change?
- A program logic is usually a compact representation of resources, actions and results. A theory of change explains the mechanisms, assumptions and context that make those links plausible. They support each other, but a sequence of boxes alone is not a complete causal explanation. Chapter 04 · Program Evaluation and Theory of Change
- How many interviews are enough?
- There is no universal number. Adequacy depends on the question, sample specificity, variation sought, depth of accounts, analytic approach and available resources. Justify why the material can illuminate the claim, and report limits instead of using a numerical rule as a substitute for design reasoning. Chapter 05 · Qualitative Research and Evaluation
- What is the difference between a sample and population?
- A population is the full set of units to which a question refers, while a sample is the observed subset. Generalisation depends on how the sample was reached, who did not participate, measurement quality and whether the target population matches the sampling frame. Chapter 06 · Quantitative Design and Analysis
- Is signed consent always sufficient?
- No. A signature records a moment, but ethical consent also requires understanding, voluntariness, capacity, accessible communication and continuing choice. Power differences, service dependency and changing procedures can undermine consent even when a form has been signed. Chapter 07 · Ethics, Power and Cultural Responsiveness
- Does consultation count as participatory evaluation?
- Consultation is one form of participation, but it may leave the agenda, interpretation and decisions unchanged. Describe the exact decision rights at each stage. A limited but honest role is more useful than calling an extractive process participatory. Chapter 08 · Participatory and Inductive Evaluation
How to prepare for the assessments
Build one living design ledger from the first module. For each major concept, record a plain-language definition, the decision it supports, one example from your chosen case and one limitation. Add a separate alignment table connecting your problem statement, theory of change, evaluation questions, indicators or qualitative constructs, data sources, analysis and use.
After each module, audit one column rather than rewriting the whole plan. For quantitative content, practise interpreting a small table before using software: identify the unit, denominator, missing values, comparison and uncertainty. For qualitative content, write a sample question, a probe and a short coding memo. For ethics, add a risk and governance note to every proposed method.
Review by explaining the complete evidence chain aloud without slides. If you cannot move cleanly from purpose to claim, locate the missing definition or unsupported assumption before polishing prose.