Venues in full (raw24)
Authoritative source, reproduced unchanged. Exact Markdown · Agent copy with resolved links · The files: data/raw24/. These instructions govern research runs, not checkpoint interviews. They keep the run's own words: a room is a community, a mark an artwork, the analyst the aggregator, the case lead the community coder and the global model the population model.
One file per subreddit: every post and comment by anyone, 2017-03-24
16:00 to 2017-04-17 17:00 UTC (24 days), sorted by time, with
<sub>.manifest.json: counts per day, the span, what
was dropped and why. The coders' rooms are cut from these files. The
study holds 24,093 venues, about 51 GB (its notes of 27 August
2026).
Build it:
python3 raw24/venue_list.py: fromvenues-placers/, every subreddit with a placer's record while the canvas was open, intoraw24/venues.txt.python3 raw24/12_collect_subreddits.py --list raw24/venues.txt --out raw24/_collected: one continuous fetch per venue, split by period. A venue over 60,000 records is set aside in_capped.jsonlrather than truncated. Resumable. Days.python3 raw24/flatten_to_raw24.py --from-dir raw24/_collected --out raw24: one sorted file and manifest per venue.
How the study's copy was made: in two parts,
disjoint. The 740 venues the atlas names (9.8 GB) were collected by an
earlier collector, collect_v6, one period at a time, and
assembled by a step whose script has not been identified. The other
23,367 (41.2 GB) came through the route above. Both share this format,
so one reader reads both.
Tested 2026-09-26: r/KarabakhConflict collected and assembled: 884 records (335 before, 139 during, 410 after), no gaps, none outside the span.
Tested again 2026-09-26, against a coded room:
r/thenetherlands collected in 6 minutes: 36,867 records (13,277 before,
4,419 during, 19,171 after), no gaps. The yard's
build_room.py then built its room: the 97-hour window's
5,865 items, 511 threads and 928,592 characters equal the room the
coders read. Outside the window, five context comments by one account
are no longer served, so the week before holds 13,277 items, not 13,285.
A rebuild loses what Reddit or the archive has since dropped.
Codebook
Every text record is one Reddit item as the arctic-shift archive holds it, unprojected. The fields the study reads:
| Field | Meaning |
|---|---|
kind |
post or comment, added at collection |
id, name |
the item's id, and the same with its type prefix (t3_
post, t1_ comment) |
created_utc |
seconds since 1970, UTC |
author |
the account name; [deleted] when the account was gone
before the archive took the item |
subreddit, subreddit_id |
where it was written |
title, selftext |
a post's title and text |
body |
a comment's text |
link_id, parent_id |
a comment's thread and the item it answers |
score, ups, gilded,
stickied, distinguished,
edited |
as Reddit reported them when the archive took the item |
retrieved_on |
when the archive took it |
The other fields (flair, media, flags) are kept as served and not read.
<sub>.manifest.json: sub;
after, before (the 24-day span, UTC seconds);
n_records, n_posts, n_comments;
first_utc, last_utc; per_day
(counts per day); complete_span;
records_outside_span and outside_examples;
sources_used, sources_missing,
assembled_from, assembled_at;
window_revision (the version of
_lib/rplace_window.py used).