Skip to content

Evaluator

Mark Wilkinson edited this page Jul 17, 2020 · 6 revisions

The Evaluator

The FAIR Evaluator is a Ruby on Rails application that acts as:

  1. a registry of FAIR MI Tests (only "Generation 2" - automatable - tests)
  2. an editor for "Collections" of tests, that make-up the workflow of a full Evaluation
  3. the workflow orchestration engine itself that executes all tests in a Collection.

Interface definition

The Evaluator interface is published as an openAPI/Swagger v3 document, and can be retrieved by calling the base URL of the Evaluator deployment, followed by /interface. This is the interface for the publicly-accessible Evaluator. The interface is also registered in the smartAPI Registry for easy exploration.

Evaluator API Documentation

The full API of the evaluator is described on its GitHub page, together with runnable code examples.

Public Deployment

There is a publicly accessible deployment of the FAIR Evaluator hosted by the Dumontier Lab at the University of Maastricht Institute of Data Science, with a Front-end in React, designed by Dominique Batista, and served by FAIRsharing that gives easy access to all functionality.

A commercial fork of The Evaluator is available from FAIR Data Systems, Madrid, Spain.

Clone this wiki locally