Missing Parameters in Deploy/Kubernetes/Cassandra Pipeline

[Munishdev97]

Hi @santhosh-tg @gandham-santhosh

In Deploy Pipeline (Deploy/Kubernetes/Cassandra Pipeline) The following parameters are missing
script_repo, script_repo_branch_or_tag,

Please let us know the values to be provided.

https://github.com/project-sunbird/sunbird-devops/blob/21012240112345547d49184e8bec265e319f577d/pipelines/deploy/cassandra-deploy/Jenkinsfile#L34C47-L34C47 (line no:34)

Error:

[santhosh-tg]

Hi @Munishdev97 can you share the screenshot of Build with Parameters for this job ?

[Munishdev97]

Hi @santhosh-tg,
We have updated the job with the new config.xml and the string parameters are added.
When we run the job with cassandra_keyspace_to_migrate as sunbird, we are getting the following error,

TASK [cassandra-deploy : Check the migraion status] ****************************
fatal: [10.0.6.7]: FAILED! => {
    "changed": false
}
MSG:
Failed migration: ['Migration started at ==1701413706639', 'Cassandra Migration 0.0.1-SNAPSHOT by Contrast Security', 'Connected to cluster: Test Cluster', 'Data center: datacenter1; Host: /10.0.6.7', 'Current version of keyspace sunbird: 1.1', 'Migrating keyspace sunbird to version 1.2 - cassandra', 'ERROR: Migration of keyspace sunbird to version 1.2 failed! Please restore backups and roll back database and code!', 'Migration Completed at ==1701413709564']

Already in Provision pipeline**(Provision/Core/Cassandra)** We are getting the following error

FYI, it showed the migration status to 1.2 as failed in STDERR but the job passed.

TASK [cassandra-cql-update : Run the application] ******************************
changed: [10.0.6.7] => {
    "changed": true,
    "cmd": [
        "java",
        "-cp",
        "cassandra-migration-0.0.1-SNAPSHOT-jar-with-dependencies.jar",
        "com.contrastsecurity.cassandra.migration.utils.MigrationScriptEntryPoint"
    ],
    "delta": "0:00:03.902732",
    "end": "2023-12-01 10:58:18.307026",
    "rc": 0,
    "start": "2023-12-01 10:58:14.404294"
}

STDOUT:

Migration started at ==1701428294449
Cassandra Migration 0.0.1-SNAPSHOT by Contrast Security
Connected to cluster: Test Cluster
Data center: datacenter1; Host: /10.0.6.7
Current version of keyspace sunbird: 1.2
Migration Completed at ==1701428297301


STDERR:

SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
com.contrastsecurity.cassandra.migration.CassandraMigrationException: **Keyspace sunbird contains a failed migration to version 1.2 !**
	at com.contrastsecurity.cassandra.migration.action.Migrate.run(Migrate.java:100)
	at com.contrastsecurity.cassandra.migration.CassandraMigration$1.execute(CassandraMigration.java:88)
	at com.contrastsecurity.cassandra.migration.CassandraMigration$1.execute(CassandraMigration.java:72)
	at com.contrastsecurity.cassandra.migration.CassandraMigration.execute(CassandraMigration.java:201)
	at com.contrastsecurity.cassandra.migration.CassandraMigration.migrate(CassandraMigration.java:71)
	at com.contrastsecurity.cassandra.migration.utils.MigrationScriptEntryPoint.main(MigrationScriptEntryPoint.java:40)

PLAY [es] **********************************************************************

PLAY [postgresql-master] *******************************************************

PLAY RECAP *********************************************************************
10.0.6.7                   : ok=29   changed=10   unreachable=0    failed=0    skipped=3    rescued=0    ignored=2   

[Pipeline] }
[Pipeline] // stage
[Pipeline] }

[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // stage
[Pipeline] }

[Pipeline] // ansiColor
[Pipeline] ansiColor
[Pipeline] {

[Pipeline] sh
+ echo Provision/dev/Core/Cassandra
[Pipeline] sh
+ echo Provision/dev/Core/Cassandra
[Pipeline] sh
+ echo Provision/dev/Core/Cassandra
[Pipeline] sh
+ echo Provision/dev/Core/Cassandra
[Pipeline] stage
[Pipeline] { (Write data)
[Pipeline] sh
+ mkdir -p /var/lib/jenkins/summary/dev
+ touch -a /var/lib/jenkins/summary/dev/summary.txt
[Pipeline] sh
+ [ -f metadata.json ]
+ echo null
[Pipeline] sh
+ [ -f metadata.json ]
+ echo null
[Pipeline] sh
+ echo Provision/dev/Core/Cassandra, imagetag: null, artifact_version: null, privatebranch: release-6.0.0, publicbranch: release-6.0.0
[Pipeline] }
[Pipeline] // stage
[Pipeline] }

[Pipeline] // ansiColor
[Pipeline] ansiColor
[Pipeline] {

[Pipeline] stage
[Pipeline] { (slack_notify)
[Pipeline] echo
testing
[Pipeline] echo
6
[Pipeline] echo
testing2
[Pipeline] echo
6
[Pipeline] sh
+ git rev-parse --short HEAD
[Pipeline] sh
+ git name-rev --name-only HEAD
+ cut -d / -f1
+ rev
+ rev
[Pipeline] sh
+ echo Provision/dev/Core/Cassandra
[Pipeline] echo
Could not find env specific Slack channel. Check for global slack channel..
[Pipeline] echo
Could not find slack environment variable. Skipping slack notification..
[Pipeline] }
[Pipeline] // stage
[Pipeline] }

[Pipeline] // ansiColor
[Pipeline] ansiColor
[Pipeline] {

[Pipeline] stage
[Pipeline] { (email_notify)
[Pipeline] sh
+ echo Provision/dev/Core/Cassandra
[Pipeline] echo
Could not find env specific email group. Check for global email group..
[Pipeline] echo
Could not find global email group variable. Skipping email notification..
[Pipeline] }
[Pipeline] // stage
[Pipeline] }

[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // node
[Pipeline] End of Pipeline
Finished: SUCCESS

[santhosh-tg]

Hi @AmiableAnil any inputs here ?

[AmiableAnil]

@Munishdev97 Can you please share the build tag which is used to build Cassandra job?

cc: @santhosh-tg

[Munishdev97]

@AmiableAnil

Build tag we used is release-4.10.0_RC1

[AmiableAnil]

@Munishdev97 please use the latest tag for build as well.

[Munishdev97]

@AmiableAnil

After Running the Build pipeline using latest tags

Build/Core/Cassandra : release-5.3.0_RC1
Build/Core/CassandraTrigger : release-5.3.0_RC1
Build/KnowledgePlatform/CassandraTrigger: release-5.6.0_RC2

we are getting the below error on same task. Can you share which latest tag you have used.

TASK [cassandra-deploy : Check the migraion status] ****************************
fatal: [10.0.6.7]: FAILED! => {
    "changed": false
}

MSG:

Failed migration: ['Migration started at ==1701757439938', 'Cassandra Migration 0.0.1-SNAPSHOT by Contrast Security', 'Connected to cluster: Test Cluster', 'Data center: datacenter1; Host: /10.0.6.7', 'Current version of keyspace sunbird: 1.12', 'Migrating keyspace sunbird to version 1.13 - cassandra', 'ERROR: Migration of keyspace sunbird to version 1.13 failed! Please restore backups and roll back database and code!', 'Migration Completed at ==1701757443534']

[Munishdev97]

@AmiableAnil

For cassandra_keyspace_to_migrate, only Sunbird is failing with above mentioned error.
Rest of the them (sunbird courses, sunbird_groups, sunbird notifications, qmzbm_form_service, sunbird_programs) are passing.

[AmiableAnil]

@Munishdev97 Please share the response of below query
select * from sunbird.cassandra_migration_version;

[Munishdev97]

@AmiableAnil

FYI

[AmiableAnil]

@Munishdev97 Please run this below query on cassandra
update sunbird.cassandra_migration_version set success= true where version = '1.13';
and then re-run the migration job. This will resolve the issue.

[Munishdev97]

@AmiableAnil
This resolved the issue. Thank you