How Country Experts Evaluate the Quality of Sources in Asylum Country Conditions Research

Why Source Evaluation Matters in Country Conditions Research

Country conditions can be complex and may vary between regions, communities and periods of time. Different sources may also describe the same issue from different perspectives.

For this reason, a country expert may assess sources individually rather than assuming that every publication has the same relevance or evidentiary value.

Source evaluation may involve considering:

• Whether the source is relevant to the research question
• When the information was collected or published
• How the information was obtained
• Whether the methodology is explained
• Whether the source has a clear geographical or subject-matter scope
• Whether other relevant sources support or qualify the information
• What limitations may affect the use of the source

The purpose is generally to develop a reasoned understanding of the available material rather than relying on a single source without considering its context.

What Factors Can Affect the Usefulness of a Source?

There is no single characteristic that necessarily determines whether a source is useful. Several factors may need to be considered together.

Relevance to the Research Question

A source may be credible and well researched but still have limited relevance to a particular question.

For example, a report concerning national political developments may provide useful background information without directly addressing conditions affecting a particular region or population group.

Country conditions research may therefore begin by identifying the specific issue that the research is intended to address. The expert can then consider whether individual sources provide information relevant to that issue.

Date and Currency

Country conditions may change over time. Political developments, legislation, conflict, institutional practices and social circumstances can affect the information available about a country.

The publication date may therefore be relevant when assessing a source.

An older source can still provide useful historical context, particularly where the research concerns developments over a longer period. However, it may have less relevance to current conditions if significant developments have occurred since publication.

A country expert may therefore distinguish between historical information and more recent material rather than treating all sources as describing present conditions.

Methodology

The way information was collected can help an expert understand its strengths and limitations.

Where available, an expert may consider:

• How information was collected
• Who conducted the research
• What population or geographic area was considered
• What period was covered
• How sources were selected
• Whether interviews or other primary research were undertaken
• How information was checked or corroborated

A clearly described methodology may make it easier to assess the scope of the findings. Where methodology is unclear, additional caution may be appropriate.

For information about the broader approach and areas of expertise associated with country expert work, see About the Institute.

Expertise and Institutional Background

The identity and expertise of the organisation or individual producing a source may also be relevant.

Depending on the subject, potentially useful material may come from:

• Academic institutions
• Government departments
• International organisations
• Non-governmental organisations
• Research institutes
• Human rights organisations
• Specialist local organisations
• Journalists or news organisations with relevant expertise

The identity of a publisher does not by itself determine the reliability or relevance of every statement in a publication. The subject matter, research methods, evidence base and limitations of the particular source may also need to be considered.

Primary and Secondary Sources

Country conditions research may involve both primary and secondary sources. Neither category is necessarily appropriate for every research question.

Primary Sources

Primary sources may include material that provides direct or first-hand information about an issue.

Examples can include:

• Legislation and official legal documents
• Government records
• Court decisions
• Official statistics
• Direct interview material
• Statements from relevant institutions
• Original research data

The usefulness of a primary source depends on what it actually establishes. For example, an official document may provide information about the existence of a law or policy without necessarily showing how that law or policy operates in every location or circumstance.

Secondary Sources

Secondary sources analyse, interpret or report information obtained from other material.

Examples can include:

• Academic articles
• Research reports
• Human rights reports
• Policy analysis
• Specialist publications
• Investigative journalism

Secondary sources may provide valuable analysis and context. Their methodology, sourcing, publication date and scope may still need to be considered.

Why Multiple Sources May Be Considered

A country conditions analysis may benefit from considering different types of sources because each may provide different information.

For example, an academic study may provide detailed analysis, while an official publication may provide information about legislation or government policy. A local organisation may provide information concerning a particular community or region.

Comparing relevant sources may help identify:

• Areas of agreement
• Differences between sources
• Gaps in available information
• Changes over time
• Regional variations
• Different interpretations of events

This process is sometimes referred to as source triangulation. It involves considering information from multiple sources when assessing a particular issue.

Triangulation does not require every source to reach the same conclusion. Differences between sources may themselves be relevant to understanding the available evidence.

Assessing Conflicting Information

Country conditions sources may not always agree. Differences can arise because sources:

• Cover different periods
• Examine different geographic areas
• Use different research methods
• Focus on different population groups
• Apply different definitions
• Examine different aspects of the same issue

When sources appear to conflict, it may be useful to examine why they differ rather than simply selecting one source without further consideration.

Identifying the Nature of the Difference

The first step may be to identify precisely what the sources disagree about.

For example, one source may describe a formal government policy while another examines how that policy is applied in practice. Those sources may provide different information without necessarily addressing exactly the same question.

Considering the Underlying Evidence

An expert may also consider the evidence supporting each source's findings.

Relevant questions may include:

• Does the source identify its underlying evidence?
• Is the methodology explained?
• Can relevant information be independently checked?
• Is the geographic and subject-matter scope clear?
• Are limitations acknowledged?

These considerations may help place apparently conflicting information in context.

Evaluating Local and Regional Sources

National-level sources may not always provide detailed information about every part of a country.

Local and regional sources may provide more specific information about particular areas, communities or institutions. Depending on the research question, these sources may include:

• Local civil society organisations
• Regional research organisations
• Local media
• Academic researchers
• Community-based organisations
• Local legal or professional bodies

Local sources may also require careful evaluation. An expert may consider the source's expertise, methodology, independence, geographic coverage and the basis for its information.

The relevance of a local source may depend particularly on whether the research question concerns conditions in a specific area.

Evaluating News Reports

News reporting can provide information about recent events and developments.

However, news reports can differ considerably in their level of detail and sourcing. An expert may consider:

• Who reported the information
• Whether the report identifies its sources
• Whether the information has been independently corroborated
• How recent the report is
• Whether the report concerns a particular incident or a broader pattern
• Whether subsequent reporting provides additional context

A single news report may provide information about a reported event without necessarily establishing that the same circumstances exist more broadly.

Evaluating Academic Research

Academic research may provide useful information about political, social, cultural, economic or historical conditions.

When reviewing an academic source, an expert may consider:

• The author's relevant area of expertise
• The research question
• The methodology
• The sources of data
• The publication date
• The geographical and subject-matter scope
• Whether the research has undergone academic review
• Any limitations identified by the researchers

Academic research can provide detailed analysis, but its relevance still depends on the particular question being examined.

Recognising the Limits of Individual Sources

Even a well-established source can have limitations.

A report may cover only one region. A study may examine a particular population group. An official publication may describe formal policy without addressing its practical implementation. A news report may focus on a single event.

Recognising these limitations does not necessarily make a source unsuitable. Instead, it can help clarify what the source can reasonably support.

Country conditions research should therefore avoid extending a source beyond the evidence and scope it actually provides.

Distinguishing Evidence From Expert Analysis

Source evaluation also involves distinguishing information contained in a source from an expert's analysis of that information.

For example, a source may document a particular law, incident or policy. The expert may then assess how that information relates to the research question.

Keeping these stages distinct can help clarify:

1. What the source states
2. What evidence supports the statement
3. What limitations apply
4. What analysis the expert draws from the available material

This distinction can contribute to a more transparent country expert report.

Keeping the Research Question in Focus

Source quality cannot be assessed entirely separately from the purpose of the research.

A source that is highly relevant to one question may have limited value for another.

For example, historical academic research may be useful when examining long-term developments, while more recent official, academic or local material may be more relevant to a question concerning current conditions.

The research question can therefore provide an important framework for deciding which sources warrant closer consideration.

This type of research might be relevant to different instructing parties, including legal aid practices, pro bono clinics, strategic litigation organisations and private immigration counsel. More information is available on the Who We Serve page.

A Practical Source Evaluation Framework

A country expert reviewing material may find it useful to consider a consistent set of questions.

1. What Is the Source?

Identify the author, organisation, publication and type of material.

2. What Does It Address?

Determine the issue, population, geographic area and period covered.

3. How Was the Information Obtained?

Review the methodology, evidence base and research process where this information is available.

4. How Current Is It?

Consider the publication date and whether subsequent developments may affect its relevance.

5. Can the Information Be Corroborated?

Consider whether other relevant sources support, qualify or provide context for the information.

6. What Are the Limitations?

Identify gaps, restrictions in scope, methodological limitations or other qualifications.

7. Does It Address the Research Question?

Consider whether the source supports the specific proposition for which it is being used.

This framework is not a mechanical test for determining whether a source is reliable. It is a structured way of considering the available evidence in light of the particular research question.

Why Transparency Matters in Country Conditions Research

Transparent sourcing can help readers understand the basis of an expert's analysis.

Depending on the circumstances, a well-documented research process may make it easier to identify:

• The sources considered
• The date of the information
• The scope of the research
• The basis for factual statements
• Areas of uncertainty
• Relevant limitations
• The distinction between source material and expert analysis

These considerations may be particularly relevant where country conditions are complex or where available sources provide different perspectives.

Further information about the organisation's approach and areas of expertise is available through the Institute's publications and reports.

Conclusion

Evaluating sources is an important consideration in country conditions research. A country expert may examine factors such as relevance, currency, methodology, provenance, corroboration, geographic scope and limitations when reviewing available material.

Different sources can provide different types of information. Academic research, official material, local sources, reports and news coverage may each contribute to an understanding of country conditions, depending on the research question.

The key consideration is whether the available material is appropriate for the specific issue being examined and whether its scope and limitations are understood.

A structured approach to source evaluation can help keep country conditions research transparent, appropriately scoped and grounded in the available evidence.

For general enquiries, further information is available through the Contact page.