Feasibility of Filesystem as a source/target

[courtzzz]

Describe your issue:

My objective is to run a migration from source (devops online) to filesystem. I realise I am using the v2 infrastructure and that it is in alpha but trying to understand what would need to be done in order to enable this.

I have the following config setup (attached):

{
  "Version": "0.0",
  "LogLevel": "Verbose",  
  "Endpoints": {
    "FileSystemWorkItemEndpoints": [
      {
        "Name": "Target",
        "FileStore": "c:\\temp\\wi"
      }
    ],
    "TfsWorkItemEndpoints": [
      {
        "Name": "Source",
        "AccessToken": "xxxxxxxxxxxxxxxxxxxxxxxxx",
        "Query": {
          "Query": "SELECT [System.Id], [System.Tags] FROM WorkItems WHERE [System.TeamProject] = @TeamProject AND [System.WorkItemType] NOT IN ('Test Suite', 'Test Plan') ORDER BY [System.ChangedDate] desc",
          "Parameters": {
            "TeamProject": "xxxxxxxxxxxxxxxx"
          }
        },
        "Organisation": "https://dev.azure.com/xxxxxxxxxxxxxxx",
        "Project": "xxxxxxxxxxxxxx",
        "ReflectedWorkItemIdField": "Custom.ReflectedWorkItemId",
        "AuthenticationMode": "AccessToken",
        "AllowCrossProjectLinking": false,
        "LanguageMaps": {
          "AreaPath": "Area",
          "IterationPath": "Iteration"
        }
      }
    ]
  },
  "Source": {
    "$type": "TfsTeamProjectConfig",
    "Collection": "https://dev.azure.com/xxxxxxxxxxxxx/",
    "Project": "xxxxxxxxxxxxxxxxx",
    "ReflectedWorkItemIDFieldName": "Custom.ReflectedWorkItemId",
    "AllowCrossProjectLinking": false,
    "AuthenticationMode": "AccessToken",
    "PersonalAccessToken": "xxxxxxxxxxxx",
    "PersonalAccessTokenVariableName": "",
    "LanguageMaps": {
      "AreaPath": "Area",
      "IterationPath": "Iteration"
    }
  },
  "Target": {
    "$type": "TfsTeamProjectConfig",
    "Collection": "https://dev.azure.com/xxxxxxxxxxxxxxxxx/",
    "Project": "Transfer",
    "ReflectedWorkItemIDFieldName": "Custom.ReflectedWorkItemId",
    "AllowCrossProjectLinking": false,
    "AuthenticationMode": "AccessToken",
    "PersonalAccessToken": "xxxxxxxxxxxxxx",
    "PersonalAccessTokenVariableName": "",
    "LanguageMaps": {
      "AreaPath": "Area",
      "IterationPath": "Iteration"
    }
  },
  "Processors": [
    {
      "$type": "WorkItemTrackingProcessorOptions",
      "Enabled": true,
      "ReplayRevisions": true,
      "PrefixProjectToNodes": false,
      "CollapseRevisions": false,
      "WorkItemCreateRetryLimit": 5,
      "Enrichers": [
        {
          "$type": "PauseAfterEachItemOptions",
          "Enabled": true
        },
        {
          "$type": "FilterWorkItemsThatAlreadyExistInTargetOptions",
          "Enabled": true,
          "Query": {
            "WhereBit": "AND [System.WorkItemType] NOT IN ('Test Suite', 'Test Plan')",
            "OrderBit": "[System.ChangedDate] desc"
          }
        },
        {
          "$type": "AppendMigrationToolSignatureFooterOptions",
          "Enabled": false
        },
        {
          "$type": "SkipToFinalRevisedWorkItemTypeOptions",
          "Enabled": false
        }
      ],
      "SourceName": "Source",
      "TargetName": "Target",
      "Endpoints": [
        {
          "$type": "TfsWorkItemEndPointOptions",
          "Direction": "Source",
          "AccessToken": "xxxxxxxxxxxxxxxx",
          "Query": {
            "Query": "SELECT [System.Id], [System.Tags] FROM WorkItems WHERE [System.TeamProject] = @TeamProject AND [System.WorkItemType] NOT IN ('Test Suite', 'Test Plan') ORDER BY [System.ChangedDate] desc"
          },
          "Enrichers": [
            {
              "$type": "TfsWorkItemAttachmentEnricherOptions",
              "Enabled": true,
              "AttachmentWorkingPath": "c:\\temp\\WorkItemAttachmentWorkingFolder\\",
              "AttachmentMaxSize": 480000000
            },
            {
              "$type": "TfsWorkItemEmbedEnricherOptions",
              "Enabled": true,
              "AttachmentWorkingPath": "c:\\temp\\WorkItemAttachmentWorkingFolder\\"
            },
            {
              "$type": "TfsWorkItemLinkEnricherOptions",
              "Enabled": true,
              "LinkMigrationSaveEachAsAdded": true
            },
            {
              "$type": "TfsWorkItemCreatedEnricherOptions",
              "Enabled": true,
              "UpdateCreatedDate": true,
              "UpdateCreatedBy": true
            },
            {
              "$type": "TfsWorkItemFieldTableEnricherOptions",
              "Enabled": true
            }
          ]
        },
        {
          "$type": "FileSystemWorkItemEndpointOptions",
          "Direction": "Target",
          "FileStore": "c:\\temp\\wi",
          "Query": {
            "WhereBit": "AND [System.WorkItemType] NOT IN ('Test Suite', 'Test Plan')",
            "OrderBit": "[System.ChangedDate] desc"
          },
          "Enrichers": [
            {
              "$type": "FileSystemWorkItemAttachmentEnricherOptions",
              "Enabled": true,
              "AttachmentWorkingPath": "c:\\temp\\WorkItemAttachmentWorkingFolder\\",
              "AttachmentMaxSize": 480000000
            }
          ]
        }

      ]
    },
    {
      "$type": "TfsAreaAndIterationProcessorOptions",
      "Enabled": false,
      "PrefixProjectToNodes": false,
      "SourceName": "Source",
      "TargetName": "Target"
    }
  ]
}

I also enabled the AddMigrationToolServicesForClientFileSystem and added the endpoints.

public static partial class ServiceCollectionExtensions
    {
        public static void AddMigrationToolServicesForClientFileSystem(this IServiceCollection context, IConfiguration configuration)
        {
            context.AddEndPoints<FileSystemWorkItemEndpointOptions, FileSystemWorkItemEndpoint>(configuration, "FileSystemWorkItemEndpoints");
        }
    }

Describe any Exceptions:

It runs fine, but gets to

private void ProcessWorkItem(WorkItemData workItem, int workItemCreateRetryLimit)
        {
            Log.LogInformation("Processor::ProcessWorkItem::TheWork");
            // Stuff to really do
        }.

And does nothing of course.

Is that because this just hasn't been built out? Or am i just doing it wrong? And if it hasnt been built out, could we do it? if so, what are next steps?

[MrHinsh]

The current new v2 WorkItemMigration tooling is not yet built out. :(

[courtzzz]

Thanks for quick reply @MrHinsh. Let me chat to my team - we potentially would want to look into building this out if at all possible. Best to contact you via email?

[MrHinsh]

Yes... martin [a-t] nkdagility [d-ot] com

I take it that your TFS server is offline? If you want to chat you can use https://nkdagility.com/book-online to book a call!