TestAssure Platform Release Notes

TestAssure Platform release notes provide information on the features and improvements in each release. This page includes release notes for platform releases and bug fix releases.

May 27, 2020 – Sprint 20.7/8 (Build 14464)

Features:

1. Scenario Editor is now a editable and saved as a single form, where previously changes were updated with inline saving.

Bug Fixes and Enhancements

1. Zalenium services are enabled for all tenants.
2. Selecting an Action low on the Actions list the page refreshes with the list scrolled to top.
3. MTR: File download icon is not displayed for all the actions in the BDD card.
4. Count CRT row executions as individual scenario executions.
5. Broken image links in tenants.
6. Unable to duplicate test suite.
7. Clean up styling of Scenario tile around data tables.
8. Persona import improperly maps IDs for scenario templates.
9. Scenario data tables context menu’s delete row is deleting everything else except the selected.
10. Unable to copy and paste in scenario data tables.
11. Duplicating Test Suite: Copy folder is not copying scenarios.
12. Unable to download file from a duplicated scenario.
13. Enable tool tips for scenario data table cells.
14. Newly added mandatory columns from Action Sync are throwing “Internal server error”.
15. Reporting API enhancement – filter by Folder.
16. Change scenario data table cell error highlighting.

May 4, 2020 – Sprint 20.6 (Build 13617)

Features:

1. Support for automated Systems Integration Testing and CRT files.
2. Updated Automated Tests Tab with Scenario Folder Tree table.
3. Automated Tests tab now shows an abbreviated Reason for test failures.

Bug Fixes and Enhancements

1. Parameter IDs are displayed instead of parameters in Action Library tab.
2. Unable to duplicate a scenario with actions that have file attachments.
3. Selecting an Action low on the Actions list the page refreshes with the list scrolled to top.
4. Standardize text colors and not use theme colors for readable texts.

April 13, 2020 – Sprint 20.5 (Build 13167)

Features:

1. Branding logos in Tenant Selection page.

Bug Fixes and Enhancements

1. Updated scenario automation check to be consistent across platform.
2. Cannot edit an action to update the custom label.
3. Issues with uploading Persona images.
4. Duplicated folder with variants is not showing the variant number.
5. Ability to Select All for all pages in Automated Tests table.

March 20, 2020 – Sprint 20.4 (Build 12333)

Features:

1. Spreadsheet-like functionality for Scenario Variant tables.
2. Spreadsheet-like functionality for Scenario step tables.

Bug Fixes and Enhancements

1. Updated Test Suites tree to be one tier for all types.
2. Fix bugs in Find and Replace.

March 5, 2020 – Sprint 20.3 (Build 11900)

Features:

1. Ability to attach a file to an Action as a parameter.

Bug Fixes and Enhancements

1. Unable to upload image to Test Suite.
2. Tenants are extremely slow to load scenarios.
3. Zalenium videos experiencing intermittent timeout failures.
4. Find and replace searching for exact match with a dash returns no results.

February 25, 2020 – Sprint 20.2 (Build 11823)

Features:

1. Display a unique ID beside Scenario Variants in the Automated Tests tab to identify and differentiate variants with the same parent scenario name.

Bug Fixes and Enhancements

1. Save the sort order in the Automated Tests table as a user setting.
2. Fix bug where Action Sync to add a new step table column may result in that column to be disabled.
3. Fix bug when dragging an action into a folder, the folder and action disappear until the page is refreshed.
4. Updated verticals for Persona Import Wizard.
5. Count mismatch between the Test Plan draft scenario count on the Test Plan listing page and the Test Plan create page.

February 7, 2020 – Sprint 26+20.1 (Build 11540)

Features:

1. New listing view to organize Test Suites by types of testing.

Bug Fixes and Enhancements

1. MTR – Updating Resource name in RAP does not update it automatically in scenario tables
2. MTR – Unable to edit Resource Name in RAP
3. MTR – Unable to add new resource to RAP in Execution Phase
4. MTR – NullPointerException – recalculate test plan
5. Error while executing 1400 tests in Delaware North
6. Styling for Referenced Scenarios in Actions tile is incorrect
7. Historical execution counts (test-engine api) has gone down
8. Automated Tests tab BDD card is missing parameters on some scenarios
9. Automated Tests tab BDD card not showing step parameter properly
10. Automated Tests tab BDD cards do not handle wide data table cells
11. Automated Tests tab does not show selection highlight
12. Automated Tests tab do not show BDD cards for some test plans
13. Automated Tests tab included checkboxes selections get overwritten when switching pages or selecting another row
14. Automated Tests tab multiple Issues with check boxes
15. When trying to create a new action, pressing enter does not work with the “Request New Action” input
16. Test plans stuck with 500 Error after changing selections
17. For a test plan that is committed, user should be able to update schedule and resources section
18. Default Scenario Library to Folder view
19. UpdateTestPlan: A blank page is displayed when a test plan is updated
20. Actions tab ingress routing missing
21. Duplicate table column fields in action library
22. Action Sync failure in DN
23. 25 items per page seems to be default every time
24. Failed Automated tests do not show employee ID for troubleshooting
25. When executing a subset of automated scenarios, all scenarios are marked with the blue hour glass.
26. Add “(UTC)” to column header for date/times that are shown in UTC
27. Scenario list is not showing in DN and Meijer
28. Automation check fail from Bad table data, but can not edit table
29. Creating/editing test plans does not show any scenarios for some projects that have quotes in the folder name
30. Test Results are not showing in the automated tests page for some scenarios

January 3, 2020 – Sprint 23-25 (Build 10830)

Features:

1. Improved speed of loading Automated Tests tab in Test Plans.
2. Improved speed of Find and Replace by paginating results.
3. Ability to duplicate a Test Suite (Personas, Actions, Scenarios, settings) in Test Suite Settings.
4. Ability to restrict user access with Roles and Permissions.

Bug Fixes and Enhancements

1. Fixed Find and Replace issue where text containing special characters could not be found.
2. Fixed stability issues in Jenkins.
3. Fixed bug where TestEngine does not respond to callback from Jenkins with 500 error.
4. Fixed bug where Jenkins exceeds memory limits and resulting in test run failures.
5. Fixed bug where Automated Tests tab sometimes does not update status after Jenkins job completes.
6. Fixed bug where Execute Automated Scenario button disappears if there are no selections in the Automated Tests tab.
7. Fixed bug where clicking Update Test Plan quickly when editing a Test Plan will add duplicate scenarios to the Test Plan.
8. Fixed bug where Action page not displaying “Referenced in Scenarios” count.
9. Improved performance of Action page loading when there are a large number of referenced Scenarios – list is truncated to 100 items.
10. Fixed bug where Create/Edit Test Plan UI displays different stats if there are no automated scenarios.
11. Pagination controls wrapping under Automated Tests table.
12. Find and Replace for hyphenated string returns improper results.
13. MTR – After committing a test plan into execution, the assigned resources do not display in the Test Queue Tab.
14. Actions not displaying “Referenced in Scenarios” count.
15. Action Details custom `Parameters` change throws validation error.
16. BDD card shows “null” values after Action Sync adds new columns.
17. Unable to see text on button in Automated Test Queue page.
18. TestEngine callback fails with 500 error.
19. Attempt to delete a user from Staging throws error.
20. TSC Create New Test Plan jumps straight to created plan, no scenario selection.
21. Jenkins hitting memory limits and causing test run failures.
22. Create/Edit Test Plan UI behaves differently if there are no automated scenarios.
23. Test Plan Dashboard shows pending Automated Scenarios when plan contains all manual scenarios.
24. Editing test plan unable to expand tree.
25. Manual Test Queue does not load after updating Test Plan.
26. Automation (problems) tooltip not showing.
27. Creating an action from the Inline Action Creator will make the new action automated.
28. TestEngine does not send a hydrated test run object for client notifications.
29. Server Render Pages missing Google Tag Manager snippet.
30. 405 error when trying to delete “Test” Persona from Meijer tenant.
31. 404 error when displaying automated test plans tab on meijer.
32. Find and Replace result doesn’t display “->” properly.

November 15, 2019 – Sprint 22 (Build 10105)

Features:

1. New Automated Test Queue page, accessible from the Automated Tests tab under Test Plans. This page shows the past history of automated runs as well as what’s currently running and queued.

Bug fixes and enhancements:

1. Fixed multiple performance issues when loading large Test Plans.
2. Improved reliability with Jenkins test execution and responses back to the TestAssure app.
3. Fixed Find and Replace UI bugs.
4. Fixed bug where step table value of 12 AM is executed as 24:00.
5. Fixed bug where create Persona fails on KTL tenant.
6. Fixed bug where Find and Replace can not be launched when folder path contains special characters.
7. Fixed bug where Update Test Plan can be clicked multiple times to add duplicate scenarios.
8. Resolved Zalenium server crashing.

October 25, 2019 – Sprint 21 (Build 9782)

Features:

1. Added new fields for the WFD test target to allow entries for SFTP Host, Username, Password, Port, and PGP Public Key.
2. Improved handshake with Jenkins to prevent missed callback events.

Bug fixes and enhancements:

1. Fixed bug where Scenario Template Variants were being tested multiple times.
2. Fixed memory spike when loading Test Plan Dashboard page.
3. Fixed server resource allocation on DN to improve server stability.
4. Increased field size of step table to allow long text.
5. More cleanup of Actions in Demo tenant.
6. Fixed bug where some scenarios show as automated even if they are not.

October 18, 2019 – Sprint 19+20 (Build 9691)

Features:

1. New Plan Summary widgets in the Test Plan Dashboard.
2. Updated table columns in the Test Plans listing page, with progress bars to show % progress, % status, and % automation.
3. Added new fields for the WFC test target to allow entries for Host, Username, and Password.
4. Added properly style error pages (400- & 500-type errors) to some areas of the app.
5. Reporting API for automated executions, scenarios created, and scenarios deleted within a date range.
6. There are known issues with the automated executions report which will be addressed in an upcoming sprint.

Bug fixes and enhancements:

1. Improved the efficiency at which TA generates the test run spec for Jenkins.
2. Fixed bug where Template variants run multiple times in Automated tests
3. Cleaned up actions with duplicate UUIDs in all tenants, and also imposed a database constraint which prevents duplicates in the future.
4. Fixed multiple issues with Action Sync.
5. Fixed bug where TestEngine appears to be missing Jenkins callback events when a test run completes.
6. Fixed bug where deleting an action referenced by a scenario breaks the scenario. The scenario now loads properly displaying a tip about the missing action.
7. Fixed bug where loading a large Test Plan causes a large spike in memory usage and destabilizes a backend service.
8. Fixed bug where some pages in the app (server rendered pages) do not display the tenant’s branding images.
9. Fixed bug where WFC Software incorrectly point to the WFD action definition when trying to create a WFC Test Suite.
10. Fixed bug where a Persona page may not load.
11. Fixed bug where the delete icon is missing from the Personas page.
12. Fixed bug where the name entered in the “Create New Persona” field does not save.

September 12, 2019 – Sprint 18 (Build 9319)

Features:

1. Burn-up Chart in the Manual Testing of the Test Plan Dashboard
2. Test Author role and Permissions

Bug fixes and enhancements:

1. Fixed bug where some Automated scenarios are treated as Manual tests when added to a Test Plan
2. Fixed bug for when the last action in a block gets removed from an Action Sync, the block becomes inaccessible to add new steps
3. Fixed bug where Find and Replace not following folder tree selection when navigating back or re-opening tool
4. Fixed bug where Template variants run multiple times in Automated tests
5. Fixed bug for time entry issue with 12:15p
6. Fixed issue with TA-API pod restarts
7. Various layout and visual improvements in the testing screens

August 29, 2019 – Sprint 17 (Build 9187)

Features:

1. New Automated Executions charts and data in the Test Plan Dashboard.
2. Ability to display the BDD card for an Automated Test prior to its first execution.
3. The Time datatype for action parameters and data-table values now properly translate to 12am/pm when entered.
4. All of the UI in Personas tab and Persona Import Wizard are rendered and served from the server-side, as opposed to that being rendered from the client browser.

Bug fixes and enhancements:

1. Layout and styling fixes in the Test Plan pages.
2. Updated text in various tool tips and icon touchups.
3. Fix bug where action sync may overwhelm the server and cause 405 & 500 errors.
4. Fix bug where duplicating a template required a hard refresh to display variants.
5. Fix bug where hamburger menu does not respond when clicked from the Test Suite’s Summary Page.
6. Fix bug where some MTR actions (set Passed, Failed, or Blocked) do not update the table and required a hard refresh.
7. Fix bug where the Automation icon do not show the problems tool-tip.

Other:

1. Created new tenant for Meijer; added Zalenium server to Meijer stack.
2. Increased memory allocation to the TA-API service for stability.

August 15, 2019 – Sprint 16 (Build 8950)

Features:

1. Ability to create and assign Review role to a user for read-only access to the Scenario Library.
2. Show the last executed time for an Automated Test.

Bug fixes and enhancements:

1. Fix Scenario Tree jumping-selection loop bug.
2. Restored the UI notification when an Automated Test run is completed.
3. Fix Find and Replace bug where symbols (minus, color, and etc) do not return results.
4. Fix folder expansion when loading folder or scenario from URL.
5. Fix Scenario Template Variant input table data entry bug.
6. Fix Automated Test execution status.
7. Fixed iconography to be consistent fill and padding.
8. Fix user selection dropdown display in Resource Availability planner.
9. Fix Automated test notifications’ labels and links.
10. Performance improvements in Scenario editor’s automation indicator check.
11. Fix Find and Replace layout issues.

July 31, 2019 – Sprint 15 (Build 8765)

Features:

1. Update Edit Test Plan page to use tree selection.
2. Add additional metrics to Create and Edit Test Plan pages: count of Automated Tests, Manual Tests, and estimated manual testing hours.

Bug fixes and enhancements:

1. Fix performance and load issue with large test plans.
2. Fix Scenario PDF Export bug not working with greater-than and less-than symbols.
3. Fix Scenario Template Variant display bug.
4. Fix Scenario Template Variant input table data entry bug.
5. Fix Scenario Activity Log entry for drag-and-drop reordering of steps.
6. Fix Automated Tests’ notification link to its Test Plan.
7. Updated Test Plan theme to adhere to custom color scheme.
8. Add missing tooltips to Scenario Editor icons.