EPIC: Migrate isaw.web to Plone 5.1, Plone 5.2, Python 3

[paregorios]

Related tickets

Just look for the Plone 5.1 and Plone 5.2 labels.

High-level plan

• Upgrade custom code to work with Plone 5.1
• Remove unnecessary add-ons
• Upgrade necessary add-ons (including profiles)
• Migrate custom content types to Dexterity (profiles)
• Migrate core content types to Dexterity
• Remove Archetypes
• Migrate site to Plone 5.1 - migration server
• Test and bugfix
• Repeat 5.1 migration steps on production
• Upgrade custom code to work with Python 3
• Migrate site to Plone 5.2/Python 3 - migration server
• Test and bugfix
• Repeat Python 3 migration steps on production
• Declare victory

Migration Checklist

• Upgrade custom code, including theme, to work on Plone 5.1
  • verify readiness for Plone 5: NYU ISAW Theme 0.4  #507
  • upgrade/migrate for Plone 5 if needed: isaw.policy 1.0.dev0 #523
  • "Description" of isaw-home page field appears twice in homepage #538
  • Event view #539
  • Missing lead image in events listing view #540
  • Wrong Event lead image presentation style #541
  • replace vcal and ical links with up-to-date ICS on events #542
  • https://isaw-migration.jazkarta.com/people/students/alumni gives 404 #543
  • Missing Title as image caption in Page template #544
  • Summary view shows author/last modified info #545
  • Publication list template messed up #547
  • Page template renders Alt text for images / images showing unwanted bordeaux border #548
  • Portlet Events Calendar: Test the search by day  #554
  • Migration 4.3.20 missing images on about > facilities > history #560
  • Exibition checklist /exhibition-checklist broken in plone5.1 #561
  • plone.app.layout.viewlets.document_byline.pt Plone51 changes #562
  • Templates Overrides. should they stay or should they go ♪♫ #564
  • view folder_contents broken if contains any item with image field filled #565
• Review and remove unnecessary add-ons
  • verify no need and remove addon: Data grid field for z3c.form 1.1  #484
  • verify no need and remove addon: Dropdown menu 2.3.1 #485
  • verify no need and remove addon: OpenID Authentication Support 2.0.4 #486
  • verify no need and remove addon: Plone Classic Theme 1.5.1 #487
  • verify no need and remove addon: SAML2 1.0 #488
  • verify no need and remove addon: collective.navigationtoggle 1.0.2  #489
  • verify no need and remove addon: contentratings 1.1 #490
  • verify no need and remove addon: ftw.upgrade 2.12.2 #491
  • verify no need and remove addon: ftw.zipextract default 1.1.1 #492
  • verify no need and remove addon: jarn.jsi18n 1.1 #493
  • verify no need and remove addon: plone.formwidget.geolocation map install 1.4 #494
  • deactivate, eliminate dependencies and remove addon: AddThis addon for Plone 1.3.3 #495
  • what is purpose of active addon Autocomplete widget 1.4.0  #496
  • what is purpose of active addon: Content tree widget 1.2.0 #498
  • remove addon: Plone Quick Upload 1.5.8 #509
  • upgrade/replace addon for Plone 5: WebServerAuth 1.7  #516
  • remove active addon: collective.embedly 2.3 #520
  • remove active addon: collective.z3cform.datetimewidget 1.2.9 #521
  • get rid of "Pressroom" cruft #530
  • Get rid of collective.easytemplate? #557
  • Get rid of webcouturier.dropdownmenu? #558
  • Get rid of collective.portlet.relateditems #559
  • isaw.theme.feature Portlet is still used? #563
• Decide what to do about homepage slider and implement on production, including accessibility work
  • 5.1: replace collective.easyslider with collective.behavior.banner #519
• Manually migrate old-style collections - upgrade/replace/refactor for Plone 5: Collection/Topic types and addons #524
• Upgrade necessary add-ons (includes testing and new pins):
  • verify no need and remove addon: plone.formwidget.geolocation map install 1.4 #494
  • check views after migration: ISAW Exhibitions 0.1 (isaw.exhibitions.object) #504
  • upgrade/replace for Plone 5: Link validity checking and reporting tools 1.6.dev0 #505
  • Migrate/upgrade for 5.1: Plone Keyword Manager 2.1.1  #508
  • verify no need and remove addon: Products.Maps 3.3 #510
• Enhance collective.person for ISAW profile use case - split this from 483, see David's assessment for details
• Migrate ISAW profiles to collective.person - pre-5.2: replace isaw.facultycv archetypes functionality with collective.person and customizations #483
• Migrate core content types to Dexterity - migrate core types from archetypes to dexterity #482
• Remove Archetypes completely - needs ticket
• Migrate site to Plone 5.1 - migration server - needs a checklist ticket
• Manual fixes for Plone 5.1, probably should be part of the checklist - include:
  • Configure Plone event calendar portlet during/after the 5.1 migration, see discussion on Event view #539 - needs a ticket
  • remove addon after migration: wildcard.foldercontents 2.0b4 #527
• Test and bugfix
• Production 5.1 migration
• Upgrade custom code to work with Python 3:
  • 5.2: migrate/update active addon: RedirectionTool 1.4.1 #511
• Migrate site to Plone 5.2/Python 3 - migration server - needs a checklist ticket
• Manual fixes for Plone 5.2/Python 3, probably should be part of the checklist - include:
  • 5.2: migrate/enable custom image alt text behavior #528
• Test and bugfix
• Production 5.2/Python 3 migration

[sauzher]

I have this kind of erros on three Images that prevent some things going on (like access the object, or purge historystorage...) after migration

2024-12-18 06:32:35 ERROR ZODB.Connection Couldn't load state for plone.app.contenttypes.content.Image 0x352f26
Traceback (most recent call last):
  File "/mnt/hdd3/projects/isaw4/isaw.web51/eggs/ZODB-5.3.0-py2.7.egg/ZODB/Connection.py", line 800, in setstate
    self._reader.setGhostState(obj, p)
  File "/mnt/hdd3/projects/isaw4/isaw.web51/eggs/ZODB-5.3.0-py2.7.egg/ZODB/serialize.py", line 622, in setGhostState
    state = self.getState(pickle)
  File "/mnt/hdd3/projects/isaw4/isaw.web51/eggs/ZODB-5.3.0-py2.7.egg/ZODB/serialize.py", line 615, in getState
    return unpickler.load()
  File "/mnt/hdd3/projects/isaw4/isaw.web51/eggs/ZODB-5.3.0-py2.7.egg/ZODB/serialize.py", line 481, in _persistent_load
    return self.load_persistent(*reference)
  File "/mnt/hdd3/projects/isaw4/isaw.web51/eggs/ZODB-5.3.0-py2.7.egg/ZODB/serialize.py", line 523, in load_persistent
    self._cache.new_ghost(oid, obj)
TypeError: Cache values must be persistent objects.
2024-12-18 06:32:35 ERROR ZODB.Connection Couldn't load state for plone.app.contenttypes.content.Image 0x352f26
Traceback (most recent call last):
  File "/mnt/hdd3/projects/isaw4/isaw.web51/eggs/ZODB-5.3.0-py2.7.egg/ZODB/Connection.py", line 800, in setstate
    self._reader.setGhostState(obj, p)
  File "/mnt/hdd3/projects/isaw4/isaw.web51/eggs/ZODB-5.3.0-py2.7.egg/ZODB/serialize.py", line 622, in setGhostState
    state = self.getState(pickle)
  File "/mnt/hdd3/projects/isaw4/isaw.web51/eggs/ZODB-5.3.0-py2.7.egg/ZODB/serialize.py", line 615, in getState
    return unpickler.load()
  File "/mnt/hdd3/projects/isaw4/isaw.web51/eggs/ZODB-5.3.0-py2.7.egg/ZODB/serialize.py", line 481, in _persistent_load
    return self.load_persistent(*reference)
  File "/mnt/hdd3/projects/isaw4/isaw.web51/eggs/ZODB-5.3.0-py2.7.egg/ZODB/serialize.py", line 523, in load_persistent
    self._cache.new_ghost(oid, obj)
TypeError: Cache values must be persistent objects.

ERROR purging /isaw/about/pictureofaspeakeratISAW.jpeg (Image)
ERROR purging /isaw/graduate-studies/AinelGedida.JPG (Image)
ERROR purging /isaw/graduate-studies/ISAW_Foyer.tiff (Image)

the objects are also undeletable: folder._delOb(id) returns same traceback

@alecpm any suggestion about it?

[paregorios]

@sauzher all three of those images are very old content and are not being used in any pages or other contexts anywhere on the site. I have just successfully deleted all three of them through-the-plone on production.

[sauzher]

I deleted them on isaw-migration.jazkarta.com too. Thanks!