Exporting Results¶
Exports are available from the project view in the Admin Dashboard.
Disentanglement — JSON¶
Each annotator's labels for each room are exported as a JSON file.
Trigger: Open the project → click Export.
Output: A ZIP archive containing one JSON file per annotator per room.
{
"project": "My Project",
"room": "room-01",
"annotator": "alice",
"annotations": [
{ "turn_id": "T001", "thread_id": "A" },
{ "turn_id": "T002", "thread_id": "A" },
{ "turn_id": "T003", "thread_id": "B" }
]
}
Adjacency Pairs — ZIP¶
Each annotator's links for each room are exported as a plain-text file, one directed edge per line.
Trigger: Open the project → click Export.
Output: A ZIP archive containing one .txt file per annotator per room.
Format: <from_turn_id>,<to_turn_id>,<relation_type> — one directed edge per line, no header row.
This format is the same as the import format, so exported files can be re-imported directly.
IAA Matrix¶
The inter-annotator agreement matrix can be viewed in the IAA tab of the project and is included in the export package.
| Metric | Annotation type | Description |
|---|---|---|
| Per-message accuracy (o2o) | Disentanglement | Fraction of messages consistent under the optimal thread alignment (Hungarian algorithm), following Elsner & Charniak (2008) |
| α × LinkF1 + (1−α) × TypeAcc | Adjacency pairs | Linear interpolation between structural (LinkF1) and label (TypeAcc) agreement; α=1 → LinkF1, α=0 → TypeAcc; α configurable per project |
See Architecture — IAA for the formal definitions.