Encore
Ask the evidenceThe ArchiveAbout Encore
Sign in
Encore by Whitelabel, with Culture NextCities in the network: sign in for your workspace

SDG 18: a candidate set of culture indicators

If culture had its own Sustainable Development Goal, which indicators could cities actually report? This set is derived from what 173 cities promised in their bid books and what 41 evaluation and monitoring reports found. It is offered for debate, not adopted.

Version v1-full · published 11 Sept 2026 · a fixed snapshot: the numbers only change when a new run is published.

Annex (PDF) Slide
Measures found0across 208 documents · 88% verified verbatim

Every measure named in 167 bid books and 41 evaluation and monitoring reports, quoted with its page and checked against the source.

Grouped into
2,647 concepts
Reviewed by a person
152 concepts decided
Verified verbatim
51,786 quotes
Promised, then reported0%429 of 1,478 measures · 14 cities

Roughly one in three of a winning city's own promised measures is reported against by its own evaluation.

Across 14 winning cities holding both their own bid book and their own evaluation, 429 of 1478 promised measures (29%) were reported against.

Corpus-wide, 27.3% of concepts promised in any bid book appear in any outcome document — a looser figure that also counts cities that never won.

15 indicators, ranked by evidence

Bid books show what a city intended; evaluation and monitoring reports show what happened. Open a card for the documents and the quoted passages behind its numbers.

Cross-check

The Lab's 26 indicators vs the Archive

  • 18 Strong
  • 5 Present
  • 0 Thin
  • 3 Absent
#ThemeLab indicatorVerdictBest match in the Archive
1.1EconomicCultural Budget - TotalStrongbudget allocation· 146 bids · 25 outcome
1.2EconomicCultural Budget - AdministrationPresentwages, overheads and administration expenditure· 115 bids · 14 outcome
1.3EconomicCultural Budget - MarketingStrongpromotion and marketing expenditure· 133 bids · 22 outcome
1.4EconomicCultural Budget - Cultural ProgrammingStrongprogramme expenditure· 134 bids · 23 outcome
1.5EconomicCultural Budget - CapitalStrongcultural infrastructure budget spending· 91 bids · 26 outcome
1.6EconomicCultural Budget - EvaluationPresentevaluation budget allocation· 61 bids · 10 outcome
1.7EconomicValue of investment into culture - Local governmentStrongcity funding· 92 bids · 23 outcome
1.8EconomicValue of investment into culture - Regional governmentPresentregion funding· 54 bids · 6 outcome
1.9EconomicValue of investment into culture - National GovernmentStrongnational government funding· 127 bids · 16 outcome
1.10EconomicValue of investment into culture - EUStrongevents with eu co-funding· 60 bids · 20 outcome
1.11EconomicValue of investment into culture - Private sectorStrongFunding — private sponsor· 137 bids · 25 outcome
1.12EconomicValue of investment into culture - Revenue GeneratedPresentmerchandise sales· 17 bids · 13 outcome
1.13EconomicTotal funding (€) to Cultural & Creative Industries in cityStrongworkplace units in dcms creative industries· 83 bids · 18 outcome
1.14EconomicFunding for cultural sector per capitaAbsent—
2.1SocialAverage participant satisfaction levelsStrongsatisfaction levels· 16 bids · 21 outcome
2.2SocialNumber of social media followersStrongtwitter followers· 40 bids · 18 outcome
2.3SocialNumber of attendeesStrongEvent attendance· 141 bids · 34 outcome
2.4SocialNumber of participantsStrongevent attendance/participation count· 62 bids · 28 outcome
3.1GovernanceBudget Spent on specific cultural intervention (ECoC / other) - Administration / Marketing / Programming / Capital / Evaluation / TotalStrongprogramme expenditure· 134 bids · 23 outcome
3.2GovernanceHours dedicated to the evaluation and monitoring of our cultural programmeAbsent—
4.1InfrastructureValue of investment in cultural infrastructure and facilities (€)Strongcultural infrastructure budget spending· 91 bids · 26 outcome
5.1Cultural VibrancyNumber of businesses working in the cultural sectorPresentnumber of enterprises· 13 bids · 5 outcome
5.2Cultural VibrancyNumber of activities - cultural projects / cultural programmesStrongnumber of cultural events· 113 bids · 31 outcome
5.3Cultural VibrancyNumber of cultural actorsStrongnumber of artists· 78 bids · 19 outcome
6.1Image and PerceptionsPercentage of attendees who rated artistic content as high or very high - qualityAbsent—
6.2Image and PerceptionsPercentage of positive media coverageStrongmedia coverage· 49 bids · 27 outcome
Where the Lab and the Archive agree

The Lab's list lines up with what evaluations already count — budgets, attendance, activities, media. 18 of 26 are strongly reported against.

Where they diverge

Participant satisfaction is evaluated more often than it is promised — the reverse of the Archive-wide pattern. Wellbeing, inclusion and legacy are promised often and evaluated rarely, and do not appear on the Lab's list at all.

What the Archive cannot answer

Funding for cultural sector per capita; Hours dedicated to the evaluation and monitoring of our cultural programme; Percentage of attendees who rated artistic content as high or very high - quality

In plain English

How this was made

What we asked

Should there be an 18th Sustainable Development Goal, for culture? Honestly, we don't know. But if there were one, it would need indicators — things you can actually measure. So we asked a simpler, answerable question: what do European Capitals of Culture already promise to measure, and what do their evaluations actually measure?

What we read

167 bid books with readable text — the documents cities write when they apply for the title, full of promises — and 41 evaluation and monitoring reports — the documents written afterwards, about what actually happened. All of them are public. 6 further documents were left out because they were scanned images or had lost their text; we name them.

What the AI did

It read every page and copied out, word for word, every sentence where a city named something it would measure or an evaluator reported a result — 58,775 of them. For each one it recorded which city, which year, which document, and whether an actual number was attached or just an intention. We checked its work: on a random sample of 500, it had copied the original wording correctly 90 times out of 100; the rest were paraphrases, which we flag and never use as quotes.

What it did not do

It did not judge, rank, or recommend. It did not decide what counts as a cultural indicator. It grouped similar sentences together — "visitor numbers" with "audience figures" — and then stopped. A human expert reviewed those groupings, merging, splitting and discarding, before anything was counted.

How the numbers work

For each indicator we count three things: how many of the 167 bid books mention it (a promise), how many of the 41 evaluations report on it (a result), and how many mentions come with real data. The indicators shown here are chosen by a written rule that favours indicators cities actually evaluate over ones they merely promise, and insists on a spread across themes and countries. Change the rule and the list changes — we show the rule so you can argue with it.

The one finding we'd stand behind

For the 14 cities where we hold both their bid book and their own evaluation, roughly one in three of the measures they promised (29%) was ever reported against. Every number on this page can be traced back to the document it came from. Click any of them and read the original.

What this is not

It is not a verdict on any city. It is not a proposal for what an 18th goal should say. It is a starting point, derived from the record — a cause for debate.

Method

How the set was selected

Score = 0.4·delivery (outcome docs/41) + 0.25·prevalence (bid books/167) + 0.15·data presence + 0.2·spread (countries/34); eligible if ≥3 outcome docs, ≥3 countries, ≥1 bid books and not excluded by review; at least 2 per Lab theme, then by score, to 15. Derived from the corpus, offered for debate.

Parameters
scoring.pairing.mode
same-title
scoring.pairing.yearTolerance
1
scoring.pairing.includeJointOutcomeDocs
false
scoring.examplesPerConcept
8
scoring.detailMinOutcomeDocs
3
weights.data
0.15
weights.spread
0.2
weights.delivery
0.4
weights.prevalence
0.25
targetSize
15
minBidBooks
1
perThemeMin
2
minCountries
3
minOutcomeDocs
3
Documents read
  • 167 bid books — intent
  • 41 outcome documents — 32 evaluations + 9 monitoring reports
  • Span precision 89.8% on a 500-occurrence stratified re-check
Excluded (6)
  • Đakovo 2020 — Pre-selection
  • Prešov 2026 — Pre-selection
  • Nicosia 2017 — Pre-selection
  • Nicosia 2017 — Final selection
  • L'Aquila 2019 — Pre-selection
  • Plzeň (Pilsen) 2015
Caveats
  • Derived from the ECoC corpus by machine extraction and clustering, then human review; offered for debate, not adopted.
  • Intent is never outcome: bid-book figures are what cities promised; evaluation and monitoring figures are what was found afterwards.
  • Extraction precision 89.8% verbatim on a 500-occurrence sample; only span-verified quotes are shown.
  • Concept clustering is a machine pass corrected by reviewer decisions; merges change ranks, not the headline direction.
  • Existing-SDG mappings are indicative keyword mappings, not an authoritative concordance.
  • Country spread uses a normalisation map applied at query time; joint titles count for every member country.
  • Occurrence-level 'has a figure' rates read high because extraction favours quantified statements; the honest data-presence figure is the concept-level share reported against.
  • 6 of 173 bid books excluded — no machine-readable text: Đakovo 2020 — Pre-selection, Prešov 2026 — Pre-selection, Nicosia 2017 — Pre-selection, Nicosia 2017 — Final selection, L'Aquila 2019 — Pre-selection, Plzeň (Pilsen) 2015.
  • Matched-pair figure pairs each city's own bid book with its own outcome document(s) for the same title (14 cities); small n — quote as a pre-review lower bound.
  • Reviewer-confirmed mapping share at scoring time: 61.5%.

Pinned run v1-full · promoted 11 Sept 2026 · run id 1252c32e-9e63-4644-aef6-a8f6685f0a4b. Every number above traces to specific documents in this run; re-running the pipeline produces a new versioned run, never a silent change here.