lists.dev has inconsistent counts and items on pages

[adam-collins]

lists.dev has inconsistent display of items on the list search page.

I suspect this is because mongodb and elasticsearch are not maintained as expected when repeated admin migrations take place. i.e. duplicates are created. Additional migrations are necessary when changes are made to the source data or source application services used by migration or species-lists migration code changes.

Requirements

• Migration need to be robust.
• Migration is cumbersome due to the lack of UI feedback forcing tailing of logs.

Tasks

• Remove the need to monitor logs.
• Prevent migrate from creating duplicates.

Suggestion

• Have a one-button migration. This is instead of the 3-button that also requires log monitoring.
• Disable migration when data already exists.