Jetstream Testing Email

Edit 0 2 …
Click here to return to top level Code Management page.

Subject: Jetstream Testing

Hi Everyone,

The recent Jetstream merging activities are now complete. Check out a summary of the latest changes here:

http://utoronto-comp-aero.wikispaces.com/October+2012+Merge+Notes

The mergers are currently adding descriptions of their changes to this page so keep checking over the next few days.

Now it’s time to begin the testing phase of the monthly Jetstream code synchronization. The following procedure describes the steps required to perform your testing task:

  1. If you are a member of the current merge group, please disregard steps 2 - 4 that describe creating a new branch for testing. Instead, start at step 5 and use your merge branch as the testing branch, i.e. pull one more time from the sync staging area to the branch you just used for merging. This will avoid you having to redo any conflict resolution that you may have already done. You may still encounter conflicts depending on commits made to the sync staging area after your pull during the merge process.
  2. Commit any pending changes to your master branch before beginning the testing process:
    • git checkout master
    • git commit -a
  3. Create a branch for testing:
    • git branch <your_testing_branch_name>
  4. Switch to the testing branch so that your local master branch is not affected during testing/debugging:
    • git checkout <your_testing_branch_name>
  5. Pull from the Jetstream sync staging area:
    • git pull /home/z/zingg/hbuckley/jetstream_sync_staging_yyyymmdd
  6. Resolve conflicts
  7. Execute the following script to compile Jetstream:
  • ./make_jetstream
  1. Find out what test case(s) you are running:
    • Go to the ‘Test Case Details’ tab on Jetstream Test Suite Google Doc spreadsheet. The spreadsheet can be found __here__.
    • Look for your name under the ‘Test Case Owner’ column and note the corresponding test case number(s)
  2. Copy the test case folder(s) from the Jetstream Test Suite directory on Scinet to your working directory:
    • cp -d -r /project/z/zingg/jetstream_testSuite/### /scratch/z/zingg/your_name/###
    • ***NOTE: the ‘-d’ in the above cp command is required to copy only the symbolic links to the grid files and not the actual grid files
  3. Run the test case by submitting the script contained in the test case folder to the Scinet queue:
    • qsub sciSubmit
  4. After the test case has run, compare the results to the benchmark values for your test case found in the corresponding tab on the Jetstream Test Suite Google Doc spreadsheet:
    • Look for the tabs at the bottom of the spreadsheet named JSTS ### Benchmarks
  5. Update the ‘Test Case Details’ tab on Jetstream Test Suite Google Doc spreadsheet:
    • Update the ‘Test Case Run Date’ column
    • Update the ‘PASS/FAIL’ column
    • If the test case passed, then your testing task is complete. Otherwise, commence debugging
  6. Debug test case as required:
    • Commit bug fixes to your jsts_testing branch
    • Push bug fixes to the Jetstream sync staging area:
      • git push /home/z/zingg/hbuckley/jetstream_sync_staging_yyyymmdd <your_testing_branch_name>:master
  7. Send me an email when you are finished testing.

Please let me know if you have any questions.

Thanks for your help,

<Gatekeeper>