Skip to content

Annotator Walkthrough

This guide covers the annotator workflow from logging in to marking a room as complete.


1. Log in

Navigate to the LACE frontend (default: http://localhost:3721) and log in with your credentials.

Your home screen lists all projects and chat rooms you have been assigned to, along with their completion status.

Session length

A session lasts 1 hour from login (configurable by the administrator via SESSION_EXPIRE_MINUTES), whether or not you are active. Two minutes before it ends, a banner counts down to the sign-out:

  • Click Renew session to continue for another full hour.
  • Otherwise, your pending work is saved — including a turn label you are still typing — and you are signed out shortly before the session ends. Log in again to continue.
  • A thread name typed but not yet confirmed with Enter is not an assignment yet and is not saved.

2. Open a Room

Click on a room name to open the annotation interface. The view differs depending on the project's annotation type.


3. Disentanglement Mode

Turns are displayed chronologically. Each turn shows the author, text, and its current thread colour.

Disentanglement interface

Assigning a turn to a thread:

  • Click a colour swatch in the right-hand panel to assign the selected turn to that thread.
  • Type a thread label directly to assign or create a thread on the fly.
  • Press N to create a new thread instantly.

Keyboard shortcuts:

Key Action
↑ / ↓ Navigate between turns
N Create a new thread
1–9 Assign to thread by position in the swatch panel

Tip

Annotations are saved automatically after every change — no explicit save button is needed.


4. Adjacency Pairs Mode

Turns are displayed chronologically with colour-coded SVG arcs overlaid for each existing link.

Adjacency Pairs interface

Creating a link:

  1. Click a source turn to select it (it highlights).
  2. Click the target turn — a dialog appears to choose the relation type.
  3. Confirm to create the directed link. The arc is rendered immediately.

Deleting a link:

  • Click the arc and confirm removal in the dialog.

Marking turns as read:

Each turn has a read/unread toggle. Mark a turn as read once you have reviewed it and decided whether links need to be created. You can also use Mark all as read to bulk-mark all turns at once. Read status is saved to the server and is visible to the admin in the room view.

Note

If the corpus CSV included a reply_to_turn column, suggested links are shown as dashed arcs. Confirm or dismiss each suggestion as you work through the room.


5. Agreement Analysis Mode

Each turn is a collapsible card; click it (or Expand all) to open its panel. Open Rubric for the quick reference (full rubric). Judge each turn from its own wording only.

Marking a turn:

  1. Choose Agreement-form or Disagreement-form.
  2. Pick the triggering marker — one rubric check of that polarity (examples are shown next to each).
  3. Cite the span: type it in Cited span, or select the words in the turn and click Use selected text.
  4. Tick Borderline if the form itself is partial or ambiguous, and Also question-form if the turn also carries question-form.

Every choice is saved immediately; the cited span is saved when you leave the field. A marked turn without its check or cited span shows Incomplete.

Finishing the room: you only need to mark the agreement/disagreement-form turns. Click Finish room to save every turn left without a decision as Not marked and mark the room as finished (complete any Incomplete turns first). Reopen lets you change your decisions afterwards; use Clear on a turn to remove its decision.


6. Mark as Complete

In Disentanglement, Adjacency Pairs and Question Analysis rooms, when you have finished annotating all turns, click Mark as Complete at the top of the interface (Agreement Analysis rooms use Finish room instead).

This records your completion in the database and signals to the admin that your annotations for this room are ready for IAA computation. You can unmark a room if you need to make further changes.