Skip to content

4.3.0 Release Testing Procedure

Veronique Archambault-Leger requested to merge release/4.3.0 into master
  • Update to Android 11.
  • Implement configurable WAHTS shutdown time. Option is available in the Configuration pane of the Admin View.
  • Add GAP Training GUI.

Enhancements

  • Update built-in developer protocols for software and WAHTS testing.
  • Refactor DPOAE exam.
  • Add option to review multiple-input forms without the input text boxes before submitting. Option is defined in the protocol.
  • Add checkbox to multipleInputResponseArea.
  • Add translations.
  • Deprecate chaThreeDigit maxSNR and maxLevel parameters.
  • Alert users that chaTAT, audiometry-list, chaCRM, chaSoundRecognition and freeformResponseArea will be fully deprecated in 4.4.0.

Bug Fixes

  • Set volume correctly.
  • Fix protocol highlighting of the loaded protocol.
  • Fix collapsed welcome screen on OS 6.0.1.
  • Fix hideExamProperties so that response areas correctly display the properties based on the protocol.
  • Update chaHINT schema to match specification.
  • Fix chaMLD button appearance issue.
  • Small UI fixes.

Getting the release

Install the dev release from https://crearellc.sharepoint.com/sites/AuralRehab/Shared%20Documents/TabSINT/Testing/4.3.0/universal-532f5176.apk.

Pre-work @hgeithner

  • Update built-in developer protocols for software and WAHTS testing.
    • Confirm all your updates are live.
  • Add checkbox to multipleInputResponseArea.
  • Add option to review multiple-input forms without the input text boxes before submitting. Option is defined in the protocol.
  • Confirm that the test suite will test the following. Anything that is not in the test suite does not need to be added, but we'll need to work with Alison to test these for 4.3.0. Anything not in the test suite is listed below under Custom Test Plan.
    • Export to CSV (test procedures PDF)
    • Export json results and upload json results to Gitlab and tabsint server
    • Results view PDF (test procedures PDF)
    • export QR code
    • protocol validation
    • Firmware updating
    • adding and loading protocols from the device storage, gitlab and tabsint server
    • Custom protocols (loading and proceeding correctly) (test procedures PDF)
    • synch repo to cha

Regression Testing

TabSINT_Test_Procedures_v0.15.0.pdf

  • Complete TabSINT Test Procedures v0.15.0
    • Complete section 1 (Software Testing: TabSINT Only) @PDMitchell
    • Complete sections 2 and 3 (Software Testing: WAHTS FDA and Development) @AMV-Creare
      • Use the release branch "automated-testing-v4.3.0"
  • Make sure you fill out the tablet/headset information on the second page
  • Make note of any issues in the PDF and save to \OLYMPUS\Projects\1010409-AURAL-REHAB-V\Technical Work\Testing\Test Plans\TabSINT v4.3.0 Release Testing

Custom Test Plan

You will need an Android 11 tablet (likely Tab A7 Lite) and an older tablet (likely Android 8-10). Please perform all tasks on both tablets.

Features, Enhancements, and Bug Fixes

@PDMitchell

  • Update to Android 11.
    • Complete the test suite with both new and old tablets.
    • In addition to the usual test suite, confirm that the volume is set accurately (as usual). You don't get alerts regarding volume.
  • Implement configurable WAHTS shutdown time. Option is available in the Configuration pane of the Admin View.
    • Connect to a WAHTS. Locate the Auto Shutdown Time in the WAHTS section of the Configuration Pane in Admin view and confirm it is 60 mins. Leave your headset idle for 60 minutes and confirm it shuts down after 60 minutes.
    • Under Preferences a little lower, edit the Auto Shutdown Time to 5 minutes. Confirm the value is changed in the WAHTS section above and confirm that the WAHTS will shut down after being idle for 5 minutes.
  • Updates to Multiple Input response area
    • Load the protocol and verify the multi-dropdown input feature is functioning (page 1). Verify you are able to review the responses and then make edits (page 2).
  • Redo the TabA7 Lite testing (https://gitlab.com/creare-com/tabsint/-/issues/656#note_850390819) and confirm that the sound level on the tab A7 Lite is the same as on the other tablets.

@AMV-Creare

  • Deprecate chaThreeDigit maxSNR and maxLevel parameters.

    • @hgeithner Provide @AMV-Creare with protocol that contains these parameters.
      • Confirm the protocol alerts the user that these parameters are no longer used. Protocol should still proceed.

  • Alert users that chaTAT, audiometry-list, chaCRM, chaSoundRecognition and freeformResponseArea will be fully deprecated in 4.4.0.

    • Android 9
    • Android 11
    • Load a protocol (cha-sandbox) that contains these exams from the built-in protocols and confirm that you get an alert. You can still run the exams. If any of these are not available from the built-in protocols, ask @hgeithner to provide you with a protocol.
    • Use this protocol to test freeformResponseArea. The rest are in cha- sandbox.
      • Android 9
      • Android 11

  • Fix protocol highlighting of the loaded protocol.

    • Confirm that if a protocol is loaded, it is highlighted in the Admin View Protocols table. This persists after closing and re-opening TabSINT.
    • Android 9
    • Android 11

  • Fix collapsed welcome screen on OS 6.0.1.

  • Fix hideExamProperties so that response areas correctly display the properties based on the protocol.

  • Fix chaMLD button appearance issue.

  • Results

    • Confirm that the version of Android is logged in the exam results.
      • Android 9
      • Android 11

  • Firmware versioning:.

@hgeithner

Admin View

@PDMitchell

  • Uninstall any previous version of TabSINT from a device. Install the test apk of TabSINT on the device. Confirm:
    • Navigate to the Admin View and confirm internet symbol is "connected".
    • Navigate to the Admin View -> Setup, select "Show Advanced Settings" in the TabSINT pane. Confirm that "Results Mode" is set to "Upload Only"
    • Select "Show Advanced Settings" in the WAHTS pane. Confirm "Disable Audio Streaming" is checked.
    • Confirm that "Ignore Firmware Update Message" is unchecked.
    • From the Admin View -> Setup page, scroll down to the Svantek pane. Connect to a Svantek 104A dosimeter and Disconnect successfully. Connect and press "cancel". Make sure the application handles correctly.
    • From the Admin View -> Setup page, scroll down to Application Log. Press "upload" and make sure log message upload successfully. Press "Export" and make sure logs export successfully. Press display and make sure you can view tablet logs.
    • Change settings/preferences in Admin View on the Setup tab. Under Advanced Settings, generate a QR code. Verify the QR code is saved to internal storage under tabsint-configurations. Reset the configuration (verify defaults) and then scan the QR code saved to the tablet. Verify the settings/preferences update to what was previously set (not defaults).

WAHTS

@PDMitchell

  • Check the box next to "Ignore Firmware Update Message" in the advanced settings. Verify the headset has firmware older than 2022-02-11_yak_4 or install older firmware. Connect to the headset and confirm that you do not see a pop-up telling you to update the firmware on your headset.
  • In TabSINT, install 2022-02-11_yak_4. Make sure that firmware installs successfully without any error messages.
  • Connect to any headset. Make sure it has the latest firmware. Confirm that the all tones under Test play correctly through the headset.

@hgeithner

  • In Admin Mode, run the Media Update through TabSINT. Navigate to Protocols tab. Under gitlab set the group to "cha-media" and enter your gitlab token. Navigate to Setup tab. Under WAHTS Advanced Settings select the checkbox next to "Enable Headset Media Management". Enter the repository "protected-media". Click "+Add". The repository should begin to download (this can take a while). Connect to a WAHTS and select the version for the list. Select "Update to Headset".

Device Storage/Storage Permissions

@hgeithner

  • Plug tablet into a computer via USB and Copy "tabsint-test" protocol from TabSINT repository to the tabsint-protocols folder on the SD card of a tablet. From the Admin View -> Protocols tab, select "Device Storage" under "Source". Press + Add under and select the directory of the protocol you just copied. Make sure this protocol is added to the list successfully. Select the protocol row in the table and press Load. Verify the protocol is valid. Switch to Exam View and run through each page of the exam protocol. Once done, navigate to Admin View -> Results and select the result you just finished and press Export. Open the tablet device storage from your computer and make sure that result you just exported is available in the tabsint-results directory of the tablet.
  • Remove "tabsint-test" from the list. Under "Source", type "tabsint-test" and press + Add. Make sure this protocol is added to the list successfully and that you can verify and load the protocol.
  • On a tablet running Android 11, check that when TabSINT is first opened there is a pop-up notification informing the user about the new device storage procedure.

GitLab

@hgeithner

  • Using your GitLab credentials (token), enter a group name and protocol repository into the appropriate fields. Verify the protocol is downloaded successfully and validates when you load the protocol. Complete the protocol and upload the results.

TabSINT Server

@hgeithner

  • Use the following credentials to load a protocol from the hffd server.
  • Choose a site to load a protocol. Verify the protocol downloads successfully and validates.

Results Analysis

@hgeithner

  • Download the "wahts-software-test" results from creare-com/tabsint-protocols group and import using TabSINT Results MATLAB script. Export to CSV using MATLAB and visually inspect that the CSV output reflect the same result as the JSON file.

Things to troubleshoot/fix

  • Can't connect the WAHTS is the FW is not a match
    • @AMV-Creare will determine for which version firmware this started to happen. It looks like it happened on Vicuna 2, but not on Yak_x.
    • @val-creare will determine if it's a TabSINT issue, and if so fix it. Fixed.
  • @val-creare
    • probe and pre-Yak issue connecting
    • likeRT emoticons broken
    • Tab A7 Lite gain not getting applied to Anna's tablet (https://gitlab.com/creare-com/tabsint/-/issues/656#note_857716199)
    • cat protocol not loading via Qr code
    • pdf, csv and qr code don't save on Android <= 8. All the same issue related to $cordovaFile.createDir. Is the new path not backward compatible?
    • chaMedia.syncMediaToCha recurse may not transfer .dat files
  • Ray
    • Fix de-bundling and CI job
  • @BAyotte
Edited by Peter Mitchell

Merge request reports