Kind of page: how-to: getting each data store.
Where the data is, how to get all of it, which scripts built each
store, and on what terms it is shared. The instructions and scripts are
in data/, one folder per
store; the folder holds no data: each script downloads or builds its
store in place.
| Store | Folder | Size in the study | Used for |
|---|---|---|---|
| the pixel record | data/pixels | 16,559,897 placements | canvas facts at aggregation; never given to a coder |
| the atlas | data/atlas | 1,473 artworks | pointers and neighbours only; its descriptions never enter coding |
| the placer accounts | data/users | 1,101,801 accounts, about 14 GB | building the venues from placer writing; placer counts |
| venues, placers only | data/venues-placers | 50,936 venues, 13.6 GB | screening: which venues carried r/place action |
| venues in full (raw24) | data/raw24 | 24,093 venues, about 51 GB | coding: every room is cut from its raw24 file |
| pixels per artwork | data/pixels-per-artwork | 23,058,857 rows, 1.1 GB with the panel | who built where, and when; the aggregator's
artworks.jsonl |
| hourly pixels per community | data/pixels-hourly | 67,907 rows | the aggregator's pixels.csv and stage D4's activity
table |
raw24 or venues from placers? They answer different questions. raw24 holds the whole community, so it is what a coder reads and what a replication of the coding needs. The placer-only store holds what the canvas's participants wrote, wherever they wrote it, so its denominator is right for any placer-side count, and it reaches venues no community sweep touched.
data/README.md gives the order, seven
steps from the public sources to every store, with the command for each.
Each store's folder says how the study's own copy was made where it
differs, and LINK.md says where that copy is: the atlas
venues' raw24 is on the Drive;
the other stores are to be added. Every step was run end to end on a
small sample on 2026-09-26, with the results in each README; the full
collections, which take days, and the tile dump's download were not.
Every text record came through one archive, arctic-shift
(arctic-shift.photon-reddit.com/api), which serves Reddit's
record as it was ingested at the time, not Reddit's current record with
years of deletions applied. Venues were walked uncapped over the 24-day
span; placer accounts were walked by author. The event window is fixed
in one module, rplace_window.py: the canvas
opened 2017-03-31 16:00 UTC and froze 2017-04-03 17:00 UTC; the coders'
window adds one day after.
archive/instrument-history.tar.gz:
one file, 11.3 MB, 622 files: Layer A's 10_instrument (the
coder contract's earlier versions) and 60_aggregator (the
aggregator's), instruments only. HISTORY-MANIFEST.tsv lists
every file and why any was skipped. Built once on 2026-09-25 by bundle_history.py and
frozen. Earlier aggregator runs are not shipped.
Everything here is open, and using it requires citing the study (see CITATION.cff).
.py and .sh):
the MIT licence. It asks that the copyright
notice travel with the code.Please, as a matter of research ethics rather than licence:
This page is not legal advice.