Skip to content

v1.5.0
Compare
Choose a tag to compare
@meta-paul meta-paul released this 26 Sep 16:13
· 30 commits to main since this release
v1.5.0
641994a
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

Overview

This release introduces a couple of key features, and a number of smaller improvements.

Video Annotator

VideoAnnotator is a new Task Generator for convenient and functional video annotation.

Key features:

  • Worker can indicate multiple video segments along multiple tracks, and annotate each one
  • For each segment, you can specify (via JSON config) desired annotation input (as a list of standard form fields)
  • VideoAnnotator JSON config works similar to FormComposer (including pre-signed S3 URLs, and support for custom JS triggers)
  • Workers inputs are downloadable in JSON
  • When viewing a completed unit, worker inputs are also available in WebVTT format

InHouse provider

The new InHouse provider enables using Mephisto with your own "in-house" crowd - and basically crowdsourcing your task to people you know. (This used to be "mock" provider last year, but now we're using "mock" only for testing).

The initial implementation is quite simple: a worker navigates to your Task page, types in their worker nickname, and proceeds to the next available Task unit (if any). Afterwards you can review their results and take notes or grant qualifications, just like you do that with the 3rd party workers.

Future roadmap for InHouse provider would include: proper worker authorization; allowing workers to view researcher notes; restricting worker acces based on their qualification.

Feature improvements

TaskReview app

  • Visualized selection-based response stats in Task Review
  • Added ability to view completed task units, without assessing them

DataPorter feature

  • Now you can port only granted worker qualifications (without all other data), to easily build pool of known workers collaboratively

FormComposer

  • Enabled CSS insertions in FormComposer

Grafana

  • Updated Grafana dockerized deployment and docs
  • Added access to Grafana dashboard from TaskReview app

General housekeeping

  • Updated and added missing architecture diagrams in Mephisto docs
  • Refactored increasingly nested CLI commands, and updated their Help strings
  • Add example of GoldUnit and Worker Onboarding
  • upgraded NodeJS to v20

Included PRs

Full Changelog: v1.4.0...v1.5.0

Contributors

JackUrb, dependabot, and meta-paul
Assets 2
Loading