Comparison
Testimony vs Expertise: What to Check When Sources Disagree
Separate what a source reports from its domain competence. Use a worked disagreement record to compare questions, evidence, independence and remaining uncertainty.
Updated
A report and a competence claim do different work
Testimony is information communicated by another person. Expertise concerns competence in a relevant domain. An expert's report can be expert testimony, but a person's status in one domain does not automatically establish every claim they make.
If two apparent experts disagree, first check whether they answer the same question. Then ask what evidence, methods and assumptions each uses, and what supports treating them as comparably competent on this matter. Disagreement is a reason to examine the case, not a formula proving both claims false.
An invented disagreement record
Two specialists discuss whether a proposed library search system improves retrieval. The example contains no real product test.
| Check | Report A | Report B | Next question |
|---|---|---|---|
| Claim | It finds more relevant items in a fixed test set. | It may not improve a reader's whole search session. | These are not yet contradictory propositions. |
| Evidence | Reported test-set results. | Reported usability observations. | What records and methods support each report? |
| Domain | Retrieval evaluation. | Reader interaction. | Which competence bears on the precise question? |
| Scope | This test set and metric. | This user task and context. | What must be checked before generalizing? |
The table does not demonstrate that the system works. It shows how an apparent conflict can arise from different questions or measures. If both reports instead make incompatible claims about the same recorded result, that disagreement needs a different investigation.
When the disagreement is genuine
Philosophers debate what a person should do on discovering disagreement with an epistemic peer—someone comparably positioned to judge the matter. Conciliatory views require some adjustment of confidence; other views emphasize what the total evidence supports. The Stanford discussion presents competing arguments, not one universally accepted averaging rule.
Do not assume equal expertise merely because two people have impressive titles. Domain, access to the evidence and the question being answered matter. Nor does counting reports establish independence: several writers repeating one source are not automatically several separately obtained findings.
These are questions for judging reliance, not a substitute for all specialist work. A non-expert may be unable to settle the technical issue directly while still checking scope, source provenance, methods and the presence of an actual disagreement.
Five questions to take to the sources
- What exact proposition does each source assert?
- Are they discussing the same domain, conditions and time?
- What supports their relevant competence and access to evidence?
- Are their reasons independently obtained or inherited from the same report?
- What evidence could resolve or narrow the remaining difference?
Record the conclusion at the level the evidence warrants: “the sources answer different questions,” “the disagreement remains unresolved,” or “this record supports one claim under these conditions.” “Experts disagree, so nothing can be known” is a much stronger claim.
Read testimony for questions about receiving information and expertise for domain-specific authority. The knowledge, evidence and trust topic connects them with justification and disagreement.
Choose the question that matches your confusion.
When two experts disagree, what philosophical questions should I ask?
A retrieval test and a whole-session usability report can answer different questions.
Relevant competence must be checked against the exact question, not inferred from status alone.
Sources and further reading
- Stanford Encyclopedia of Philosophy — Social Epistemology
Sections3.1 and3.2 on testimony and peer disagreement, section5.1 on expert authority, and the discussion of epistemic trespassing. The source presents competing views.