Kitodo.Production 3.5.1

This is a patch release that restores database compatibility with MySQL 5.7 databases and includes several security fixes. Please note that even though Kitodo.Production 3.5.1 is compatible with MySQL 5.7 databases we still recommend using MySQL 8 for increased performance. No changes were made to the configuration files or database schema.

What's Changed

• Update to latest chrome version by @solth in #5736
• Catch correct exception when using MySQL 5.7 by @solth in #5738
• fix: pom.xml to reduce vulnerabilities by @solth in #5739
• Bump org.codehaus.plexus:plexus-archiver from 4.1.0 to 4.8.0 by @solth in #5740
• Change version 'org.apache.xmlgraphics' to '2.8' and add removed depe… by @IkramMaalej in #5742
• Update retrieval of Chrome driver by @solth in #5766
• Change version to 3.5.1 by @solth in #5767

Full Changelog: kitodo-production-3.5.0...kitodo-production-3.5.1

Kitodo.Production 3.5.0

This release contains all changes from 3.5.0-beta1 as well as bugfixes related to features from that release.

What's new

Import Configurations

The new ImportConfiguration class replaces catalogue configurations in the kitodo_opac.xml configuration file. (the file itself is still required for other legacy uses, but the section with "catalogue" configurations is now covered by the import configurations) This allows users with the corresponding permissions to add and edit import configurations via the Kitodo frontend without the need to have acces to the file system of the Kitodo server. Those permissions are not assigned to any role by default, so this has to be done before the feature an be used.
A converter allows transforming catalogue configurations from existing kitodo_opac.xml files into new ImportConfiguration entities semiautomatically.
See https://github.com/kitodo/kitodo-production/wiki/Projektauswahl-und-Katalogsuche for details.

Spanish translation

A full Spanish translation of the Kitodo.Production GUI has been added (thanks to @joergleh for this valuable contribution!)

Support for includes in rulesets

Rulesets can now be split into multiple files to make individual parts reusable in multiple rulesets which prevents code duplication and improves maintainability (see #4596 for details)

Sortable lists

All list views have been made sortable by (nearly) all columns as part of the "Usibility improvement" project of the "Kitodo Development fund"

Import of additional metadata

When creating new processes via catalogue searches, metadata imported during initial import can now be augmented with metadata from a separate import (see #4705 and linked issue for details)

Database changes

There have been multiple changes to the database schema of Kitodo.Production since the last release. Please use the attached files to migrate your database to the current schema:

• migration_3-4-3_to_3-5-0.sql to migrate your database from Kitodo.Production 3.4.3 to Kitodo.Production 3.5.0 OR
• migration_3-5-0-beta1_to_3-5-0.sql to migrate your database from Kitodo.Production 3.5.0-beta1 to Kitodo.Production 3.5.0

Important: Kitodo.Production 3.5.0 does not support MySQL 5.7 anymore and requires MySQL 8 instead!

Ruleset changes

Functional metadata of type recordIdentifier is now mandatory for all document types. This means all divisions in the ruleset that have a processTitle attribute must be configured to allow for at least one metadata with attribute use="recordIdentifier". In the example ruleset ruleset_default.xml this has been added to the metadata CatalogIDDigital, which has traditionally been used for this purpose.

Configuration file and shell skript line endings

The line endings of the following configuration files have been changed:
In kitodo_3-5-0_config_modules/config the files

• kitodo_fileFormats.xml
• kitodo_loginBlacklist.txt
• kitodo_opac.xml
• kitodo_projects.xml

and all *.sh files in kitodo_3-5-0_config_modules/scripts have been converted to unix style line endings. *.bat files in kitodo_3-5-0_config_modules/scripts retain their Windows style line endings.

What's Changed ("**" denotes updates since the last beta release 3.5.0-beta1)

• ** Add required LoC resources to repository by @solth in #5461
• ** Replace ConfigurationException with FileNotFoundException by @henning-gerhardt in #5433
• ** Add help text by @IkramMaalej in #5426
• ** Fix multi view state warning when searching by @thomaslow in #5445
• ** Aligned the English messages with the German messages by @joergleh in #5468
• ** Joergleh-2022-12-01 by @joergleh in #5471
• ** Update Chrome driver version to 108 by @solth in #5483
• ** Bump commons-net from 3.8.0 to 3.9.0 by @dependabot in #5474
• ** Fix 'skiplist' method for FTP interfaces by @solth in #5488
• ** Danilop-2022-12-14 by @danilopenagos in #5490
• ** Remove 'Identifier metadata' field from import configuration class by @solth in #5495
• ** Show default import depth for all opac search import configurations by @solth in #5498
• ** Bug import additional field twice by @markusweigelt in #5500
• ** Fix mapping other metadata formats and parent mapping file by @solth in #5497
• ** Activate 'Search' button when search field and term are not empty by @solth in #5486
• ** Fix the search for linkable children by @BartChris in #5514
• ** Remove unused 'parentElementType' property from import configurations by @solth in #5516
• ** Fix hierarchical mass import by @solth in #5513
• ** Hide 'parent id' search field for custom interfaces by @solth in #5521
• ** Fix creation of query URL for custom interfaces without url parameters by @solth in #5522
• ** Fix import of files from FTP servers by @solth in #5524
• ** Change version to 3.5.0 by @solth in #5529
• Fix wrong and missing brackets by @henning-gerhardt in #5198
• Support includes in ruleset by @matthias-ronge in #4969
• Add task action to quickly add correction message by @thomaslow in #5194
• Fix NPE when using navigation shortcuts in gallery panel by @thomaslow in #5197
• Fix action to remove symbolic links from home directory for selected processes by @thomaslow in #5195
• Additional import by @markusweigelt in #4705
• Update Chrome driver to latest version by @solth in #5211
• Fix validation for metadata groups by @BartChris in #5200
• Various layout and design improvements by @oliver-stoehr in #5203
• Update template tasks on a wokflow update by @BartChris in #5206
• Fix checkstyle violations and lower number of allowed violations by @henning-gerhardt in #5218
• Import Configurations by @solth in #5038
• Added Spanish translation files of the messages by @joergleh in #5214
• Export completed children on parent export by @matthias-ronge in #4888
• Fix new checkstyle violation and lower amount of allowed violations by @henning-gerhardt in #5222
• Add missing translations for import configuration related permissions by @solth in #5223
• Allow parent process's process title as prefix in child title generation by @matthias-ronge in #5080
• Allow automatic adding the counting for a child process by @matthias-ronge in #5081
• Add amount of meta data to index to improve performance by @henning-gerhardt in #5233
• Update messages_es.properties by @joergleh in #5226
• Update bug_report.md by @solth in #5227
• Add input field for identifier prefix by @solth in #5231
• Save mapping file order for import configurations by @solth in #5232
• Fix update of "ID parameter of parent record" in ImportConfiguration by @pontus-osterdahl in #5250
• Fix error with file upload import configurations by @solth in #5247
• Show only regular files in list of available xslts for mapping file by @solth in #5254
• Enable file format select menu and restrict available formats to XML by @solth in #5252
• Update mapping file list after removing list entry by @solth in #5256
• Add edit button for search fields of ImportConfigurations by @solth in #5253
• Refactor CSS rule for scrolling in popup dialogs by @solth in #5277
• Add field 'identifier_metadata' to ImportConfigurations by @solth in #5279
• Fix update thumbnails-overlay after paginating by @IkramMaalej in #5276
• Import dialog fix by @solth in https://github.com/kitodo/kitodo-production/...

Kitodo.Production 3.5.0 beta 1

This is a pre-release intended for testing but not for use in production!

What's new

Import Configurations

The new ImportConfiguration class replaces catalogue configurations in the kitodo_opac.xml configuration file. (the file itself is still required for other legacy uses, but the section with "catalogue" configurations is now covered by the import configurations) This allows users with the corresponding permissions to add and edit import configurations via the Kitodo frontend without the need to have acces to the file system of the Kitodo server. Those permissions are not assigned to any role by default, so this has to be done before the feature an be used.
A converter allows transforming catalogue configurations from existing kitodo_opac.xml files into new ImportConfiguration entities semiautomatically.
See https://github.com/kitodo/kitodo-production/wiki/Projektauswahl-und-Katalogsuche for details.

Spanish translation

A full Spanish translation of the Kitodo.Production GUI has been added (thanks to @joergleh for this valuable contribution!)

Support for includes in rulesets

Rulesets can now be split into multiple files to make individual parts reusable in multiple rulesets which prevents code duplication and improves maintainability (see #4596 for details)

Sortable lists

All list views have been made sortable by (nearly) all columns as part of the "Usibility improvement" project of the "Kitodo Development fund"

Import of additional metadata

When creating new processes via catalogue searches, metadata imported during initial import can now be augmented with metadata from a separate import (see #4705 and linked issue for details)

Changelog

• Fix wrong and missing brackets by @henning-gerhardt in #5198
• Support includes in ruleset by @matthias-ronge in #4969
• Add task action to quickly add correction message by @thomaslow in #5194
• Fix NPE when using navigation shortcuts in gallery panel by @thomaslow in #5197
• Fix action to remove symbolic links from home directory for selected processes by @thomaslow in #5195
• Additional import by @markusweigelt in #4705
• Update Chrome driver to latest version by @solth in #5211
• Fix validation for metadata groups by @BartChris in #5200
• Various layout and design improvements by @oliver-stoehr in #5203
• Update template tasks on a wokflow update by @BartChris in #5206
• Fix checkstyle violations and lower number of allowed violations by @henning-gerhardt in #5218
• Import Configurations by @solth in #5038
• Added Spanish translation files of the messages by @joergleh in #5214
• Export completed children on parent export by @matthias-ronge in #4888
• Fix new checkstyle violation and lower amount of allowed violations by @henning-gerhardt in #5222
• Add missing translations for import configuration related permissions by @solth in #5223
• Allow parent process's process title as prefix in child title generation by @matthias-ronge in #5080
• Allow automatic adding the counting for a child process by @matthias-ronge in #5081
• Add amount of meta data to index to improve performance by @henning-gerhardt in #5233
• Update messages_es.properties by @joergleh in #5226
• Update bug_report.md by @solth in #5227
• Add input field for identifier prefix by @solth in #5231
• Save mapping file order for import configurations by @solth in #5232
• Fix update of "ID parameter of parent record" in ImportConfiguration by @pontus-osterdahl in #5250
• Fix error with file upload import configurations by @solth in #5247
• Show only regular files in list of available xslts for mapping file by @solth in #5254
• Enable file format select menu and restrict available formats to XML by @solth in #5252
• Update mapping file list after removing list entry by @solth in #5256
• Add edit button for search fields of ImportConfigurations by @solth in #5253
• Refactor CSS rule for scrolling in popup dialogs by @solth in #5277
• Add field 'identifier_metadata' to ImportConfigurations by @solth in #5279
• Fix update thumbnails-overlay after paginating by @IkramMaalej in #5276
• Import dialog fix by @solth in #5283
• Update checkstyle to version 10.3.2 including needed checkstyle fixes by @henning-gerhardt in #5284
• Add 'prestructured import' flag to MappingFile class by @solth in #5290
• Fix tsl asl by @markusweigelt in #5239
• Use search delimiter even on hierachy search by @henning-gerhardt in #5287
• Avoid duplicated links in the exported METS by using a LinkedHashSet by @BartChris in #5288
• Add message keys for tooltips by @solth in #5291
• Directly import OAI records and skip redundant query by @solth in #5307
• Unused 'parentElementXpath' field by @solth in #5302
• Record Identifier by @solth in #5293
• Enable parentMappingFile configuration for catalog search configurations by @solth in #5310
• Fix bug when importing child records by @solth in #5304
• Show SearchInterface type specific error messages in mass import results by @solth in #5312
• Update messages_es.properties by @joergleh in #5316
• Update Chrome driver to latest version 104 by @solth in #5327
• Prevent NPE during mass import by updating records table in time by @solth in #5326
• Enable automatic closing of task with type typeAcceptClose by @BartChris in #5301
• Update messages_es.properties, esp. add tooltips by @joergleh in #5325
• Explicitly load Saxon, without incurring any side impacts on the JVM by @matthias-ronge in #5109
• Disallow creating child process if doc type is not allowed by @matthias-ronge in #5338
• Replace org.apache.commons.lang with org.apache.commons.lang3 by @henning-gerhardt in #5335
• Replace jdom with jdom2 by @henning-gerhardt in #5344
• Deactivate SQL safe mode to fix migration file by @solth in #5333
• Fix automatic setting of child count by @matthias-ronge in #5340
• Tsl mass import by @markusweigelt in #5329
• Fix update of metadata table after doctype is changed by @markusweigelt in #5355
• Fix process comments being indexed without a spacing by @thomaslow in #5364
• Upgrade selenium chrome driver to 106 by @thomaslow in #5374
• Fix missing user column in task table by @thomaslow in #5362
• Catalog config importer by @solth in #5313
• Default record xpaths in import configurations by @solth in #5356
• Fix unreliable SeleniumTest causes failed builds by @thomaslow in #5380
• Add bottom margin to metadata occluding plus button by @solth in #5359
• Tsl children processes by @markusweigelt in #5337
• Incorporate changes until Oct 6, 2022 by @joergleh in #5377
• Delete existing data editor settings for tasks of a changed workflow by @BartChris in #5292
• Remember sort order and p...

Kitodo.Production 3.4.3

Release Notes

This release contains changes from the development fund for #4322

Further Changes:

• improved performance in indexing, loading, editing in metadataeditor, creation of newspaper issues
• a lot of dependency versions have been increased
• sub-folders can be added to project
• pom refactoring
• improve excel generation
• allow editing of active workflows
• enable dependent value restrictions in ruleset

there is no database change since release 3.4.0 so no migration.sql is needed

Kitodo.Production 3.4.2

This is a security hotfix release

security vulnerabilitys for springframework has been fixed.
Version are changed to:
spring-security: 5.6.2
spring-core: 5.3.18
spring-expression: 5.3.17
spring-beans: 5.3.18

Kitodo.Production 3.3.3

This is a security hotfix release

security vulnerabilitys for springframework has been fixed.
Version are changed to:
spring-security: 5.6.2
spring-core: 5.3.18
spring-expression: 5.3.17
spring-beans: 5.3.18

Kitodo.Production 3.4.1

This is a security hotfix release

security vulnerabilites of the log4j framework has been fixed in Version 2.17.0
see https://logging.apache.org/log4j/2.x/security.html

Kitodo.Production 3.4.0

Release Notes

This release contains the changes from the developmentfund
Especially:
#4204
#4208

So the Java version is updated to 11 and elasticsearch runs on 7.10
In consequence the tomcat version was changed to 9.

Please check, that your system fullfills these new requirements.
See also Installation guide here.

Further changes

• enable adding and deleting images in metadataeditor
• enable prestructured import
• enable "all process"-selection on process page
• some bugfixes in migrating newspaper
• some performance enhancements

Kitodo.Production 3.3.1

Release Notes

• Improve pagination
• Enable advanced pagination
• Improve performance on a lot of places
• Improve migration of serials and newspapers
• Cleanup frontend - fix design issues
• raise version of bpmn editor
• fix a lot of issues in metadata editor
• improve and speed up initial indexing

Kitodo.Production 3.3

Release Notes – 3.3

Ruleset

• Enable option for a presetted date

Import

• Enable Import from ftp
• Add https as protocol
• Add option to apply multiple xslt files
• Enable import from file, including files with hierarchies

Migration

• Improve newspaper migration
• Fix bugs in creation of hirarchical processes while migrating
• Improve migration performance

Workflow

• Enable task conditions depending on VariableReplacer

Search

• Enable search by process properties
• Improve wildcardsearch

Metadatascript

• implement metadatascripts for add, delete and copy
• Add metadatascripts for hierarchical processes

Metadataeditor

• Add option to save and load the current layout of the metadata editor
• Improve pagination in function and layout
• Fix creation of structural elements
• Allow linking pages to multiple structure elements

Other

• Fill generated excel and pdf file with correct values
• Enable the unassignment of tasks from a specific user
• Add PDF to ImageFileFormats that can be created with ImageMagick
• Check password constraints when resetting a password
• Link workflow image in process task list to workflow editor
• Add path support for elastic search
• Remove the need for digitalcollections.xml