Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
title
Tip
Excerpt
hiddentrue
nameMigration to RY 3.0

Frequently asked questions about migrating to RY 3.0.

Info

Troubleshooting

As highlighted in Release 3.0 – Estimates, we had to migrate the data for Requirement Yogi 3.0. In theory, you shouldn't need to refer to this page. In practice, if there is any issue, we will mention it here.

...

Can I still edit pages during the migration?

Yes, but we are not helping you insert new requirements, because we wouldn't be able to generate a unique key.

If a page you save contains a new requirement (which can happen, if you are importing from elsewhere for example), we will simply reindex the page after the migration.

How long is the migration?

In our experiments, the generally observed speed is 1000 to 5000 requirements migrated every time the background task executesper minute. We execute the task every minute, for 30s only.

So, if you have 100.000 active requirements and 2 million requirements in baselines, the migration would take 33 hours.

If you have 2000 requirements, the migration will take 2 minutes.Phase 1 migrates the current requirements. The UI of Requirement Yogi is mostly disabled.

Phase 2 migrates the requirements in baselines. The UI of Requirement Yogi is enabled, but baselines are disabled.

Number of requirements

Estimated duration of phase 1

(RY disabled)

Estimated duration of phase 2

(Baselines disabled)

2.000 requirements

2 minutes


100.000 requirements

1.30 hrs


100.000 requirements

+ 200 baselines of 10.000 requirements

1.30 hrs

33 hours (for 2m requirements)

During the migration:

  • You can still save pages with requirements on them,

  • We disable the entire UI of Requirement Yogi and replace it with the progress bar.

  • Once the progress bar indicates "100%", the UI of Requirement Yogi reactivates.

...

What is the reason for this data migration?

None of this information should be useful, unless you are meeting a problem.

We've changed the database model for the following reasons:

  • Tables were limited to 2 billion records, which was a (distant but uncertain) risk for our most notable customers, especially with the table of properties. Our new tables support IDs up to 9,223,372,036,854,775,807 records (inclusive).

  • We've greatly improved the tracking of dependencies across baselines. We are extremely proud of this, hoping that the new behaviour will be invisible to the untrained eye.

  • We've made it possible to add external properties to requirements, which we are demonstrating with the "Estimates" feature, and which we are going to expand with other features in the future.

Therefore, it was necessary to transfer all data from the older to the newer tables.

How

...

does the migration process work?

  • We are copying data from AO_32F7CE_AO* tables into AO_32F7CE_DB* tables.

  • When some data is migrated, we put a timestamp in "MIGRATIONDATE", and we never look at it again. Destroy it if you want! You can look into the "MIGRATIONMESSAGE" to see whether there was an issue.

  • If a migration wasn't successful for a record, you can restart the migration, for all or for this record. We have designed so that the migration is only updates the target data, instead of deleting-and-recreating it, so, if you have already modified the target data, this is not a problem.

In Jira, it is similar, the background task executes every 3 minutes and there are fewer records, so we expect the migration to be even faster. During the migration, the queue is disabled.

The tables:

Old table

New table

Observations

AO_32F7CE_AOREQUIREMENT

AO_32F7CE_DBREQUIREMENT

Requirements.

 Columns

 Columns have been cleaned up

AO_32F7CE_AOREQUIREMENT_LINK

AO_32F7CE_DBLINK

Links to requirements. Types are cleaned up.

AO_32F7CE_AODEPENDENCY

AO_32F7CE_DBDEPENDENCY

Dependencies. Much better cross-baseline management

AO_32F7CE_AOPROPERTY

AO_32F7CE_DBPROPERTY
AO_32F7CE_DBPROPERTYNAME

Properties. Added the implementation of the External Properties

AO_32F7CE_AOINTEGRATION
AO_32F7CE_AOINTEGRATION_QUEUE

AO_32F7CE_DBAPPLINK
AO_32F7CE_DBAPPLINKQUEUE

The queue and the descriptor.

AO_32F7CE_AOBASELINE

AO_32F7CE_DBBASELINE

The baseline descriptors.

AO_32F7CE_AOISSUE_TEMPLATE

AO_32F7CE_DBISSUE_TEMPLATE

Templates for the Jira Bulk Issue Creation.

AO_32F7CE_AOTRACEABILITYMATRIX

AO_32F7CE_DBTRACEABILITYMATRIX

Traceability matrixes.

AO_32F7CE_AOSETTINGS

AO_32F7CE_DBSETTINGS

Settings.

In Jira

AO_42D05A_REMOTEREQUIREMENT
AO_42D05A_ISSUELINK



AOIssueOperationjob

AORemoteRequirement
AOTask

AO_42D05A_DBREMOTEREQUIREMENT
AO_42D05A_DBISSUELINK

The requirements and their associations with Jira issues.

AO_42D05A_RYAUDITTRAIL

AO_42D05A_DBAUDITTRAIL

The history of requirements (large table).

AO_42D05A_INTEGRATION
AO_42D05A_AOQUEUE_MESSAGE

AO_42D05A_DBINTEGRATION
AO_42D05A_AOQUEUEMESSAGE

The queue and the descriptor.

AO_42D05A_ISSUE_OPERATION_JOB

AO_42D05A_DBOPERATIONJOB

The Jira Bulk Issue Creation jobs, while they are executing.

AO_42D05A_TASK

We keep the old table.

Status of the background migration tasks.

...

There are error messages, what should I do?

If we display an error message, that means we have tried to think about all possible ways a migration would fail (and we seriously did an awesome ensuring we handled every case) and we still couldn't guess what your data meant. Therefore, there is no way of fixing it through the UI.

  • Look at the requirements which met an error.

  • (tick) If they can be recreated, just dismiss the error, go to the page and reindex the page. This is often the best outcome.

  • If those are requirements in baselines which are important for you, then you will have to intervene using SQL on the database, after discussing the issue with us. After modifying the records, you can try re-migrating a specific record.

The migration is done, but the UI wasn't reactivated

This is strange:

  • Please check the page /admin/plugins/com.playsql.requirementyogi/migration-admin.action on your instance.

  • Click on "Display control panel" to see the error messages.

  • Deal with the errors,

  • Click on "Relaunch the migration" - It will restart the job, see that there is no record to migrate, and reactivate the plugin.

If the plugin still isn't migrated, you can also reactivate the UI yourself:

  • This is not what we recommend, but if you reactivate the UI in the middle of the migration and start working on requirements, RY should still succeed at migrating the remaining records and merging them with the new ones.

  • To reactivate the plugin, go to the Confluence administration → "Manage apps" → Requirement Yogi → Click on "174 of 177 modules enabled" (whatever the numbers are), and:

    • Disable

      :xwork

      all *-during-migration

    • requirement-rte-during-migration
    • requirement-view-during-migration

      modules,

    • Enable:

      • All xwork modules,

      • rest

      • requirement-rte

      • requirement-view

    • But next time the migration runs (...in 1 minute), it will certainly reset this, as long as there are records with MIGRATIONDATE IS NULL.

Can I delete the old tables?

...