How Oldspeak works
Every outlet's headline on the same event, side by side, and a reproducible score for single articles.
How scoring works
A model answers the seven questions below from 0 to 3 for one article, citing evidence for each. Code then turns the answers into a score from 1 to 10.
- SAdd up questions 2 to 7S runs from 0 to 18. Question 1, the reporter's own voice, is kept apart because it decides the worst band on its own.
- DEditorialising in its own voiceQuestion 1 is 2 or more: the narration itself takes a side. Score 8 to 10.
- COne-sided, no editorial voiceQuestion 3 is 2 or more, and question 2, 5 or 6 is too. Score 6 or 7.
- AStraight reportingQuestion 1 is 0 and S is at most 1. Score 1 or 2.
- BLocalised faultsAnything else. Score 3 to 5, by S.
Method. Bias types follow the Table of Media Bias Elements and the Media Bias Taxonomy (both CC BY 4.0). The impartiality rules follow the BBC Editorial Guidelines and the Ofcom Broadcasting Code. The score is calculated from the seven answers, never generated.
What this is not. No outlet gets a standing bias rating, and there is no left/right axis, because that axis does not describe Bangladeshi politics. Each analysis covers one article about one event. Members' analytics count how each outlet's headlines were labelled over a chosen period, with the number of headlines behind every share, and also show the average score of an outlet's scored articles: that average describes those articles (mostly each story's lead), not the outlet, and outlets are never ranked by it or by any share.
Known limits. Headlines are grouped into stories automatically, so an unrelated headline sometimes slips in; it is shown faded rather than hidden. Where outlets carry the same wire copy, the comparison has little to show. Human annotators agree on bias in Bangla news only moderately (κ = 0.574 at best), which limits what any automated score can claim.
The seven questions
Rubric 1.0.0. Each answer is the level that fits the article, from 0 to 3.
- G1Reporter's own voice
- Narration is descriptive throughout.
- One isolated evaluative word in the reporter's voice.
- Recurring evaluative language in the reporter's voice.
- The narration itself argues or attacks.
- G2Headline
- Reports the event or the speech act; contested claims are attributed.
- Compresses or intensifies, but the claim stays attributed.
- Asserts a contested claim in the paper's voice.
- Asserts a contested claim and adds the paper's own evaluative words.
- G3Other side missing
- Every party involved responds substantively.
- The other side is present, but only as a token line.
- The other side is absent, but the article says a response was sought.
- The other side is absent, with no sign a response was sought.
- G4Weight of the unanswered allegation
- No allegation against an identifiable party.
- Policy criticism or disagreement.
- Allegation of misconduct, bad faith or incompetence.
- Allegation of crime, violence or grave moral fault.
- G5Loaded quotes
- Quotes are informational.
- Some evaluative words in quotes, in proportion to the event.
- Quoted invective carries most of the article's judgement.
- Quoted invective is also lifted into the headline or pull-quote.
- G6Unattributed claims
- Every disputable claim is attributed.
- One or two disputable claims are unattributed.
- Several disputable claims are unattributed.
- One side's claims are narrated as background fact.
- G7Missing context
- Necessary background is present.
- Minor context is missing.
- Missing context materially changes the reading.
- The omission is the article's central defect.
Reading a roundup
Each headline on a story is labelled one of three ways. A roundup shows the earliest headline of each kind side by side, with the judging words marked.
- NeutralReports what happened or who said what.
- Stated as factPuts a judgement in the outlet's own voice, such as calling a bill “weak”.
- In quotation marksCarries a judgement inside quotation marks, attributed to someone else.
Labels describe the headline only, not the article or the outlet.