This page contains the year's release notes and new features, primarily for Oceans 2.0 / DMAS, as well as any applications created/maintained by the ONC software engineering group, including mobile Apps and desktop/PC applications. In progress project status may be presented as well. The information below is written in plain language as much as possible. Detailed release notes are available on internal confluence pages (requires login).

December 20, 2021

Minor release: Bug fix for SeaTube V3 annotation export

Tickets Released: Oceans 2.0: 21.11.001 (accessible to internal users only). Total: 1.

December 6, 2021

Major release

Maintenance

  • Bug fixes, in these areas: Data Preview, Plotting Utility, Device Console,  Reprocess Console
  • Support  for sensorattributes and deployment of a new LDAP server
  • Update map in SeaTube Pro for compatibility 
  • Bug and testing fixes for DriverSchedule UI page

Annotation UI

  • Support table updates after annotation created or updated
  • Support deep-link to annotations which includes the filter and selected annotation
  • Add accordion filter behaviour to minimise vertical space used
  • Add annotation export 
  • Update Annotation Entry behaviour so only uses resource and resource type are defaulted
  • Other bug fixes

CIOOS: Marine Gazetteer Support

  • Added fields to Taxonomies and Taxons  to support vocabulary fields
  • Added support for upload of Taxons to a taxonomy 
  • Added support for mapping Taxons to Resources to allow Marine Gazetteer terms to be associated with search tree nodes

CIOOS: ERDDAP

  • Ensure datasets.xml is compatible with ERDDAP 2.14

SeaTube

  • Chat log story book in Demo server
  • Time code development
  • Many automated UI tests added
  • Bug fixes

Community Fishers

  • Refactored out cast definition out of the comment field into its own
  • Added email notification if a cast ingestion failed
  • Added millisecond precision when gathering parameters for cast detection
  • Fixed missing deployments out of .COR files

Acoustic Instruments Data Viewer

  • Added time range selection for daily and weekly
  • Created some MBeans for Matlab as as service monitoring

Data Products

  • Bug fixes: IOS hydrophone post-process, hydrophone calibration order, profile product and track plot search failures, Nortek daily time range and a few more
  • CODAR typos and data rescue
  • Several in-progress features and fixes/updates (sensor-level data ratings, BioSonics plots, HydroCal updates)

Instruments

  • EEW: two new jobs to automate and replace manual earthquake quality checks. First job compares earthquake detections to NRCan and USGS detections, second job that keeps the USGS/NRcan detections up to date. Working on a webpage to display the results.
  • Multi-queue: final testing with live data into QA, bug to fix before going live
  • Rayfin camera and minor bug fixes

Tickets Released: Oceans 2.0: 21.11.000 (accessible to internal users only). Total: 121.

Bug

  • [DMAS-53914] - Metadata XML report for State of Ocean/Env searches randomly picks sensors to report on, messes up search automation
  • [DMAS-66369] - The no cast break option on cast scalar profile data product will always return no data
  • [DMAS-66742] - "Get Dashboard URL" not showing on State of the Ocean preview plots
  • [DMAS-66834] - Video player breaks in SeaTube dashboard after adjusting video quality
  • [DMAS-67019] - quarantine column background color on Device Console page failed to change to yellow when device is quarantined
  • [DMAS-67023] - New Calibration formulas are not taking effect (QAQC Dependencies)
  • [DMAS-67030] - Unable to get IOOS category for some sensors when generating datasets.xml
  • [DMAS-67047] - Pagination has issues after sorting and changing page size
  • [DMAS-67084] - Fix typos in CODAR Matlab data product for totals
  • [DMAS-67089] - Checkstyle error causing some packages to not build
  • [DMAS-67094] - IOS hydrophone postprocessor creating FLAC files without file_state T tag and minor fixes
  • [DMAS-67142] - Fix bug blocking reprocessing due to qaqc results pkey
  • [DMAS-67146] - Handle millisecond precision on datefrom when getting cast detection attributes across epochs
  • [DMAS-67158] - Cannot mint a DOI for 2 of 8 MMI piggybacks
  • [DMAS-67161] - CF .cor data product not including all deployments when dowloading by location
  • [DMAS-67167] - Data Player timeline is incorrect
  • [DMAS-67187] - DMAS Search Failed Notification: 19-Nov-2021 03:27:04 UTC, Dease Strait-Cape Colborne, Track Plot, SearchHdrId 10793186, UserId 2851
  • [DMAS-67208] - Integration testing fails to deploy to QA2 hosts
  • [DMAS-67229] - Annotation Entry has display issues
  • [DMAS-67238] - DMAS Search Failed Notification: 25-Nov-2021 08:06:11 UTC, SubC Imaging Rayfin SN 21017, MP4 Video UHD, SearchHdrId 11038861, UserId 15223
  • [DMAS-67245] - Table does not fetch new annotations after creating an annotation
  • [DMAS-67246] - Fields are not reflecting the selected sources in AnnotationSearchFilters
  • [DMAS-67266] - Fix small bugs in annotation table
  • [DMAS-67292] - Bnd is failing to load its repositories in Eclipse
  • [DMAS-67300] - A non-admin/non-logger user is unable to update their own annotations
  • [DMAS-67304] - DMAS Search Failed Notification: 02-Dec-2021 10:24:52 UTC, Inshore Profiling System-Profiling Instrument Package, Time Series Scalar Profile Plot and Gridded Data, SearchHdrId 11103692, UserId 2993
  • [DMAS-67308] - Manual version of job Cast Data (4) Ingestion Postprocess Job (JobId 424) does not have email parameter
  • [DMAS-67309] - Can't load Taxonomy CSV Upload because of a difference in react versions
  • [DMAS-67314] - qaonshore1 failing to send forgotten password email
  • [DMAS-67320] - Chips not showing on Date Filter
  • [DMAS-67328] - Complex data plots are trimmed
  • [DMAS-67329] - Fix page TaxonResource not loading
  • [DMAS-67345] - Fix no taxonomyid passed to taxonomy editor
  • [DMAS-67346] - Disabled Autocompletes aren't actually being disabled

User Story

  • [DMAS-58143] - Find annotations related to a resource type, optionally, a specific resource using the Topology hierarchy if requested
  • [DMAS-58146] - Find annotations created at a specified source
  • [DMAS-58147] - Find annotations with a specified owner
  • [DMAS-58161] - Save an annotation to a specified resourcetype and resource id with a default value and a date range
  • [DMAS-64214] - As an annotation creator I want to edit existing annotations
  • [DMAS-65455] - As a developer I want the sitedevicesubset comment containing cast definitions to be refactored into its own database field
  • [DMAS-66779] - As a software developer, I want to collect a heap dump automatically when performance degrades
  • [DMAS-66860] - Save vocabulary data into Taxonomy tables using Taxonomy UI
  • [DMAS-66863] - Add Marine Gazetteer terms to ISO 19115 metadata
  • [DMAS-67106] - As a data specialist, I would like to be e-mailed if the ingestion of aligned and depth binned data failed

Task

  • [DMAS-51445] - Add time range option to hydrophone data search UI
  • [DMAS-55759] - As a data steward, I would like to have some declarative parser related table cleanup/clarifications
  • [DMAS-64774] - Install ERDDAP 2.14 in QA and fix fixed value strings for timeseries_id
  • [DMAS-66961] - Replace default Map in SeaTube Pro
  • [DMAS-67026] - Split ExpeditionTree's render methods into separate small components
  • [DMAS-67044] - Primary sensor map marker does not load in datasearch sporadically, add logging to log the SearchTreePrimarySensor that's causing it
  • [DMAS-67077] - Add a loading bar to the Annotations Search table
  • [DMAS-67111] - Add Javadocs to explain how to run tests for tests in onc-test
  • [DMAS-67112] - Refactor annotation search page to better use props and state
  • [DMAS-67122] - LDAP - Invalid Attribute Syntax - gecos: value #0 invalid per syntax for new ldap server
  • [DMAS-67155] - Disable Add Annotation and My Annotations filter when not signed in
  • [DMAS-67157] - Change wording in new time offset in Plotting Utility
  • [DMAS-67180] - Deactivate duplicate search creation checking for wera ftp job
  • [DMAS-67194] - Add "Get Dashboard URL" to latest preview plots
  • [DMAS-67214] - Make AnnotationFilters save vertical space by only opening one accordion at a time
  • [DMAS-67218] - Reword Topology checkbox text to what it is in the existing Search
  • [DMAS-67219] - Add UTC to Date filter title
  • [DMAS-67223] - Move Source filter above Fields and have both Oceans 2 and Hydrophone selected by default
  • [DMAS-67233] - Handle varying order of hydrophone calibration device attributes
  • [DMAS-67250] - Improve dateTo in filename restoration option in accessADfiles
  • [DMAS-67258] - Setup a bitbucket repository for onc-jdbc driver
  • [DMAS-67280] - Annotation Entry will need to support scroll some how
  • [DMAS-67296] - Insert a sensorAttribute for QAQC attribute for PVCS test

Requirement

Design

  • [DMAS-67056] - Update deployment design
  • [DMAS-67211] - Design MBean accessable via JMX to provide metrics for Matlab-as-a-service

Implementation

  • [DMAS-64725] - Create UI for editing and display of Taxon Resources
  • [DMAS-65466] - Create CSV upload code for uploading taxons
  • [DMAS-65540] - Update front end code for CSV upload
  • [DMAS-66229] - Make sitedevicesubset comment field required
  • [DMAS-66242] - Add code to backend for new columns in tx_taxon and tx_taxonomy
  • [DMAS-66418] - Remove VersionNumber column from Database
  • [DMAS-66658] - needs a trx table for driverScheduler
  • [DMAS-66661] - Upgrade Geotools to the latest version
  • [DMAS-66757] - Implement services for drop downs when adding taxon resources
  • [DMAS-66914] - Add a link to annotation Id which will open the annotation editor
  • [DMAS-66985] - Multiqueue Testing Utilities
  • [DMAS-67034] - Create a Scheduled Job that generates an earthquake report for internal users when we detect an earthquake
  • [DMAS-67054] - Deploy a static build of the storybook
  • [DMAS-67057] - Deploy the storybook to the production demo server
  • [DMAS-67067] - Support field entry based on resource type
  • [DMAS-67092] - Add taxon resource for searchtreenode to keywords
  • [DMAS-67107] - Add e-mail Parameter to Externally Derived Data Ingester Job
  • [DMAS-67108] - Send an e-mail if an exception occurs in Externally Derived Data Ingester Job
  • [DMAS-67115] - Refactor sitedevicesubset backend to store cast definitions in cast definition database field
  • [DMAS-67116] - Refactor dataproducts to retrieve cast information from cast definition field of SiteDeviceSubset table
  • [DMAS-67117] - Create new cast definition table and cast definition hist table
  • [DMAS-67120] - Update Oceans 2 Google Checks config based on changes made in ui-testing
  • [DMAS-67127] - Create TaxonResource servlet and add to web.xml
  • [DMAS-67137] - Create dialog window for annotation export
  • [DMAS-67148] - Fix ESLint warnings that will be added by upgrading Storybook & dependencies
  • [DMAS-67151] - Shore station inter process message publishing
  • [DMAS-67171] - Small updates to EEW report job
  • [DMAS-67174] - Add a bit of description to the storybook deployment parameters to explain that QA is deployed to automatically
  • [DMAS-67176] - Update URL with filter parameters when a search is made in AnnotationSearch
  • [DMAS-67184] - Add Monitoring to check for missing scalar data in Cassandra during reprocessing
  • [DMAS-67209] - Allow url parameters in web.xml for AnnotationsV2
  • [DMAS-67210] - Create MBeans to provide metrics for MatlabInstanceManagerLoop and each MatlabInstance
  • [DMAS-67215] - Log what Cassandra Hosts DMAS is connected to During Reprocessing
  • [DMAS-67221] - Default all Entry fields when New Annotation is selected
  • [DMAS-67222] - Default Time to 00:00:00 if empty and new date selected
  • [DMAS-67224] - Add Delete button to Entry
  • [DMAS-67247] - Create a job for keeping USGS and NRCAN detections up to date
  • [DMAS-67261] - Change map to use leaflet js library
  • [DMAS-67265] - Create a Task to re-post-process a list of siteDeviceSubsetIds.
  • [DMAS-67290] - Add a link icon to get annotation deep-link
  • [DMAS-67298] - Write SQL Scripts for cast re-post-processing job

Test

  • [DMAS-66323] - Create React Tests for Driver Schedule

Bug (ST)

  • [DMAS-66903] - The date filter cypress tests are failing for me
  • [DMAS-67153] - Code change to make device console table cell change yellow
  • [DMAS-67160] - Oceans Next build fails because of skipping the stage "Link to node_modules"
  • [DMAS-67226] - Figure not closing for dataproductformat 230
  • [DMAS-67283] - Driver Schedule enabled field always setting to false
  • [DMAS-67324] - Driver Schedule end date not saving and appearing
  • [DMAS-67332] - Correct CSS import in QA

Investigation

  • [DMAS-67040] - Test the new version of Wowza with timecode support

Documentation

  • [DMAS-67203] - Update all relevant ISO 19115 related documentation


November 23, 2021

Minor release: Bug fix for API

Tickets Released: Oceans 2.0: 21.10.004 (accessible to internal users only). Total: 1.

November 18, 2021

Minor release: Rayfin camera feature

Tickets Released: Oceans 2.0: 21.10.003 (accessible to internal users only). Total: 1.

Implementation

  • [DMAS-66923] - Implement StartRecording and StopRecording for Rayfin camera driver

November 17, 2021

Minor release: Latest Preview fix for CODAR

Tickets Released: Oceans 2.0: 21.10.002 (accessible to internal users only). Total: 2.

Bug

  • [DMAS-67152] - No latest preview searches created for CODAR since 21.10.001 deployed

Task

  • [DMAS-67104] - Recover CODAR files diverted to DEV/QA

November 14, 2021

Minor release: various fixes for Community Fishers, Latest Preview, API, etc.

Tickets Released: Oceans 2.0: 21.10.001 (accessible to internal users only). Total: 16.

Bug

  • [DMAS-57219] - CF Node Locations not valid using external web services
  • [DMAS-64787] - AID Viewer create too many search requests
  • [DMAS-66543] - Unexpected NaNs in COR file
  • [DMAS-66698] - Caching for the acoustic dataviewer does not return results if previous request was made by another user
  • [DMAS-67079] - Unreadable file errors on CODAR FTP job after latest preview feature added
  • [DMAS-67080] - DMAS Search Failed Notification: 04-Nov-2021 02:38:50 UTC, Insite Pacific Zeus Plus HD Camera on Hercules ROV, MP4 Video, SearchHdrId 10755970, UserId 2603
  • [DMAS-67087] - CODARDownloadTask is creating searches for wrong dataproductformat
  • [DMAS-67088] - The incorrect url for ERDDAP datasets is showing up on ckan
  • [DMAS-67093] - Fix compile error in DateFilter.spec.tsx
  • [DMAS-67098] - Replace occurances of "datasetsLandgingPage" with proper spelling
  • [DMAS-67143] - scalarDataManager.countScalarData() does not return accurate count in QA
  • [DMAS-67147] - DataProductDeliveryService returning errorCode 71 incorrectly in QA
  • [DMAS-67150] - dataProductDelivery download method throws null pointer in QA

Task

  • [DMAS-64431] - Re-running searches disables the search complete notification emails
  • [DMAS-67029] - Change Acoustic Date Viewer Front End to only Cache DataProductDelivery Request method
  • [DMAS-67059] - Write script to delete all existing im_iso19115datasetrecord rows

November 3, 2021

Major release

Maintenance

  • Update Community pages on ONC website (quick plot and State of Ocean/Environment plots)
  • Bug fixes (e.g., qaqc detail page, SMB postprocessor, data search email, DOI, device action, qaqcreprocess, Latest Data Preview)
  • Small features (e.g., API related, header of CSV data search, items on Oceans 2.0 menu)

Sea Tube

  • Performance improvements for Oceans 2 backend
  • Bug fixes for SeaTube

Instruments

  • Extensive update to the Camera pages and controls, including improved integration with SeaScript and drivers, better light and strobe controls, new custom function button
  • Support for video recording to internal memory, particularly for Rayfin cameras
  • For internal users, more details here: Release Notes - Cameras

Data Products

  • Added colourmap options to ASL echosounder plots + bug fixes on those plots
  • Minor improvements for CODARs: MAT file structure + performance
  • Bug fixes + minor improvements, including: Nortek ADCP MAT file structure, SOO plot extent and comment

Annotations UI Upgrade

  • Search
    • all search filters supported including field filters
    • sorting done in back-end so all annotations are sorted (same as existing Annotation Search)
    • can sort by resource type
  • Entry
    • Can add an annotation
      • resource type and resource defaulted to values specified in the filter
      • note that this supports standard fields such as Comments, Data Assessment, etc.

CIOOS

  • CODAR on ERDDAP prototype:
    • ERDDAP Management page supports creating a CODAR netCDF dataset
    • datasets.xml generation supports CODAR datasets (preliminary)
    • netCDF files generated by job for CODAR datasets
  • Maintenance note history: Supported for CKAN ISO 19115 XML
  • Can get ISO 19115 XML for non-ERDDAP datasets

Community Fishers

AID Viewer

  • bug fix: bad formfieldid
  • updated data product to use camel case

Tickets Released: Oceans 2.0: 21.10.000 (accessible to internal users only). Total: 110 + 22 automated testing tickets.

Bug

  • [DMAS-53933] - Time ticks on echograms (ASL) do not line up with ticks on sun elevation plot
  • [DMAS-54311] - Data product - AZFP data product is missing the RGB subplot and has a y-axis scaling issue
  • [DMAS-64345] - After yesterday's update, device actions in Oceans2.0 cannot be saved
  • [DMAS-65404] - data search property filter is not screening out the CF station searchtreenodes
  • [DMAS-66223] - Slow memory leak in Oceans 2
  • [DMAS-66687] - Cannot delete SiteDeviceSubset from SiteDevice Maintenance Page
  • [DMAS-66709] - SMB postprocessor is creating files with time/dates for the day before
  • [DMAS-66813] - DOIs are not being generated for sitedevices at China Creek 2021-09
  • [DMAS-66865] - Creator and Modifier are not corrected when a dive is selected
  • [DMAS-66881] - Latest Preview search generation is not consistently making searches
  • [DMAS-66888] - SeaTube Pro only plays demo video for users in China
  • [DMAS-66891] - Get error when using sourceId=6 in FormService
  • [DMAS-66928] - Archived flag sensorattribute changes to false without checking future connections in topology
  • [DMAS-66939] - State of Ocean plots for offline SoG Central are not visible
  • [DMAS-66954] - DMAS Search Failed Notification: 21-Oct-2021 16:44:45 UTC, AML-6 LGR A60015, Aligned and Depth-Binned Profile Data (On-Demand), SearchHdrId 10458509, UserId 49940
  • [DMAS-66956] - Matlab service should not be run on onship machine
  • [DMAS-66964] - Error occurs downloading iso 19115 metadata from Dataset Landing Page
  • [DMAS-66969] - DMAS Search Failed Notification: 24-Oct-2021 03:00:17 UTC, Endeavour-Endeavour East, Seismometer Data, SearchHdrId 10467263, UserId 15356
  • [DMAS-66971] - Skip time period info is missing in the zoom bar from ST V3 video player
  • [DMAS-66983] - Cannot get Hydrophone Data In Acoustic DataViewer
  • [DMAS-67020] - Tons of INFO messages for Titan devices in dmas.log of mtcshore1.dc.onc
  • [DMAS-67025] - SeaTube - switching to Historical mode results in blank page
  • [DMAS-67050] - Correct null pointer in CODARDownloadTask
  • [DMAS-67051] - After zooming on datasearch map the Drifters search tree node does not display after clicking Display Drifters until map is zoomed again
  • [DMAS-67058] - Sea Tube filtering is not working for date range

User Story

  • [DMAS-22725] - As a data specialist, I would like to be notified when a cast is uploaded via the PSF app so that I can promptly assess and process the data
  • [DMAS-33861] - As a software engineer, I would like to reduce the deployment time
  • [DMAS-64698] - As a user, I would like to see a menu link from Oceans 2.0 to the API documentation
  • [DMAS-66506] - As a software developer, I want to resolve the Hibernate n + 1 problem throughout Oceans 2 so that system performance isn't catastrophically affected by load
  • [DMAS-66747] - Update Axis Camera Driver to support optical zoom
  • [DMAS-67011] - As a user, I would like to replace projects with Science Hub from our dmas menu

Task

  • [DMAS-53692] - rename externally-derived in the SensorListing UI to be more semantically correct
  • [DMAS-56819] - As a Data Specialist I would like the ability to modify the datefrom of a QAQC test attribute through the UI
  • [DMAS-57175] - Update CSV/JSON product to ignore the specialcitation_deprecated text for the attribute/acknowledgement
  • [DMAS-57937] - Integrate complex dataviewer spectrogram dataproduct with normal spectrogram generation.
  • [DMAS-58178] - Add colour map options for ASL echosounder plots
  • [DMAS-64402] - Scalardata service method getByDevice has no sensorCategoryCodes parameter
  • [DMAS-64474] - As a data steward, I would like to extend the data acquisition system for AML Metrecs to use the newer xml format
  • [DMAS-64518] - Design UI options for adding vocab terms or just creating a relation between a vocab term and STNs
  • [DMAS-65496] - Improve performance of CODAR QC products
  • [DMAS-66395] - Refactor "Trigger Re-Post-Processing" code to remove side effects
  • [DMAS-66502] - As a DataSearch user, I would like improved emails for searches with no data found
  • [DMAS-66651] - Apply checkstyle rules from Google Checks
  • [DMAS-66724] - Support a non-default set of resource types in resource selector
  • [DMAS-66733] - As an API user, I'd like a button to copy my token to my clipboard
  • [DMAS-66768] - Update dataviewer to set Spectrogram Concatenation from option selected on configure screen
  • [DMAS-66771] - CI builds that require the controller node ("master") should run on an "integration" node instead
  • [DMAS-66845] - Improve modified HFRProgs loadRDLFile.m function so the ruv header is parsed in our MATLAB data product
  • [DMAS-66847] - Include samplePeriod info in Nortek MAT file meta structure
  • [DMAS-66880] - Fix typo in CODAR RADIALstruct.m
  • [DMAS-66887] - Update FilterGroup so it has state that manages contained Filters
  • [DMAS-66898] - CODAR Total clean matlab DP - add parameters about DomainName and CreationInfo when using makeTotals
  • [DMAS-66901] - Investigate the recent teleseismic event detection
  • [DMAS-66902] - Fill out acknowledgement text in MAT file Attribution struct
  • [DMAS-66945] - Use virtualized autocomplete for resource selector
  • [DMAS-66959] - Modify the data quality comment for SOO plots
  • [DMAS-66960] - Implement server side sorting on Annotation Table
  • [DMAS-66994] - Update data product option to use camel case in request
  • [DMAS-66998] - Adjust annotation backend to allow sorting on more columns
  • [DMAS-67008] - As a ST user, I would like to see the expedition tree is expended into organization level by default.
  • [DMAS-67024] - Handle overlapping sourcefiles when concatenating audio data
  • [DMAS-67043] - SOO/Env plots shouldn't extend beyond active deployments

Implementation

  • [DMAS-65464] - Create dal layer for TaxonResource
  • [DMAS-66663] - integrate date filter component to filter on search
  • [DMAS-66665] - Create Field Filter Component
  • [DMAS-66669] - Integrate source filter into annotationSearchFilter
  • [DMAS-66683] - Remove the ability to modify the StartTime and EndDate/time for QAQC test
  • [DMAS-66719] - Add all historic maintenance notes into datasets
  • [DMAS-66736] - Create backend services for TaxonResource
  • [DMAS-66751] - Integrate resource dropdown with AnnotationServiceV3
  • [DMAS-66752] - Integrate owner filter into annotationsearchfilter and table
  • [DMAS-66758] - Implement first version of CODAR ERDDAP support in Erddap Management
  • [DMAS-66764] - Integrate filter with Annotations search
  • [DMAS-66770] - Add summary view to the Resource filter along with an appropriate icon
  • [DMAS-66777] - Write component tests for resource filter
  • [DMAS-66781] - Improve performance of Device & Sensor cache loading
  • [DMAS-66782] - Use more threads to load the SitePosition cache
  • [DMAS-66839] - Improve performance of Observatory, Site, SiteDevice caches
  • [DMAS-66842] - Update FormService to accept multiple sources
  • [DMAS-66846] - Clean up PlaylistManagementService unit tests
  • [DMAS-66854] - Close inactive anonymous HTTP sessions
  • [DMAS-66867] - Support custom queries in TypedBaseDAO.getAll
  • [DMAS-66871] - Deploy Oceans Next from the integration node
  • [DMAS-66875] - Add datasetidstring list parameter to the CKAN job
  • [DMAS-66894] - Implement Matlab code to allow direct production of CODAR NetCDF files
  • [DMAS-66895] - Create scheduled job to produce CODAR NetCDF for ERDDAP
  • [DMAS-66896] - Implement Java class to produce CODAR NetCDF files based off of ERDDAP dataset
  • [DMAS-66913] - Include a Topology checkbox in the Resource Filter
  • [DMAS-66918] - Make annotation entry functional
  • [DMAS-66920] - Cast Ingestion Job should only send e-mail if casts were detected
  • [DMAS-66931] - Publish cache reload messages when reloading a device or sensor
  • [DMAS-66944] - Implement generation of dataset.xml for CODAR combiner datasets
  • [DMAS-66955] - Disable building on the controller node
  • [DMAS-66965] - Java change to add checking for missed archivefiles
  • [DMAS-66967] - Change DatastaxScalarDataDAO.delete to use LOCAL_QUORUM consistency
  • [DMAS-66968] - Update Oceans Next input step description
  • [DMAS-66973] - Remove unused methods of TypedBaseDAO
  • [DMAS-66975] - Use varargs in TypedBaseDAO.executeNamedQuery
  • [DMAS-66977] - Support entering field values when creating annotations
  • [DMAS-66980] - add menu link for API doc
  • [DMAS-66988] - Upgrade Checkstyle to 9.0.1
  • [DMAS-67009] - Use Google Checks in SeaTube-related modules
  • [DMAS-67012] - implement Oceans 2.0 code to replace projects with Science Hub from dmas menu
  • [DMAS-67017] - Use Google Checks where possible outside onc-core
  • [DMAS-67021] - Add EDDTableFromMultidimNcFiles to erddapdatasettype
  • [DMAS-67022] - Enable Add Annotation button to bring up Annotation Entry

Test

Bug (ST)

  • [DMAS-15117] - Loading the Hibernate cache slows down hugely on links with (even small bits of) latency
  • [DMAS-66919] - When a search is run the annotations table isn't switching to the first page

Investigation

  • [DMAS-64506] - Investigate steps needed to add Marine Gazetteer metadata to ISO 19115 metadata


October 18, 2021

Minor release: various fixes, primarily for multi-queue feature

Tickets Released: Oceans 2.0: 21.09.001 (accessible to internal users only). Total: 10.

Bug

Task

  • [DMAS-66843] - Remove existing rows from im_iso19115datasetrecord

Implementation

  • [DMAS-64854] - Change metadata tracking to be task based
  • [DMAS-66822] - Use multi queue components even when no queues defined.
  • [DMAS-66852] - load shorestation multiqueue cache from the database if the shorestation has a database connection
  • [DMAS-66855] - pass information to front end whether multiqueue is enabled or disabled
  • [DMAS-66882] - Multiqueue Front End bugs and changes
  • [DMAS-66923] - Implement StartRecording and StopRecording for Rayfin camera driver
  • [DMAS-66940] - Add logging to help determine issue in latest preview process

Investigation

  • [DMAS-66744] - Record live video to timestamped files

October 6, 2021

Major release

Maintenance Sprints

  • Finish leftover tickets on Latest Data Preview
  • QAQC related tickets (on-going)
  • ONC website updates
  • Other tickets

Annotations

  • Added owner filter (not available from search yet)

CIOOS

  • Marine Gazetteer - database / data model updates
  • ISO19115:
    • some UUID work needed to support overall maintenance note functionality
    • maintenance note with most recent change

Dashboards

  • bug fix - can now embed a widget while in full screen
  • bug fix - don't attempt to save dashboard if RO access

Sea Tube

  • deck log support
  • chat log ingestion
  • CAPSTONE ingestion for one expedition
  • WOWZA timecode integration
  • 2nd QA integration testing support
  • bug fixes

Community Fishers

  • delete a cast
  • auto delete cast binned data and QAQC flags when cast deleted
  • mod'd QAQC archiver to handle late CF data merge
  • merged QAQC flags when late CF data ingested
  • added millisecond input to subsite maintenance page
  • forced repostprocessing if reference lat/lon or start/end date values changed

AID Viewer

  • removed spinner on initial config dialog load
  • fixed toolbox not updating when switching between ADCPs

Data Products

  • Fixes for Nortek time scaling/averaging + Sig55 measurement interval
  • Fix for Kongsberg rotary plot not detecting the sweep properly
  • Bug fixes: near live hydrophone searches, improved logging for broken files in AD, cast detection edge case, plotting edge case
  • Nortek netCDF modernize and add ancillary data ← featured on the ONC Science Hub: https://community.oceannetworks.ca/posts/updates-to-netcdf-data-products-for-adcps

Tickets Released: Oceans 2.0: 21.09.000 (accessible to internal users only). Total: 83 + 17 automated testing tickets.

Bug

  • [DMAS-53639] - Time Axis Issues in Nortek Signature 55 ADCP Data Products
  • [DMAS-57390] - When in fullscreen, widgets' embed button does not produce an embed window
  • [DMAS-57627] - Data Availability Chart does not show availability for a piggy-back
  • [DMAS-64778] - Many simultaneous calls to DataPreviewService from GeospatialMap
  • [DMAS-66234] - DMAS Search Failed Notification: 19-Jul-2021 07:48:25 UTC, Barkley Canyon Upper Slope-Upper Slope Vertical Profiler, Time Series Scalar Profile Plot and Gridded Data, SearchHdrId 8883869, UserId 106680
  • [DMAS-66488] - what is the difference between SearchTreeNodeUI and SearchTreeNodeUIs caches?
  • [DMAS-66521] - Error occurs trying to save layout with RO access
  • [DMAS-66528] - qaqcreprocess failed for DI 24119 on date 20200401
  • [DMAS-66529] - deviceId and deviceName are not shown in email for qaqcreprocess
  • [DMAS-66530] - status of qaqcreprocess task should be completed_with_error if there is error message during process
  • [DMAS-66582] - Viewing a larger image from the Image Widget doesn't work when dashboard is full screen
  • [DMAS-66606] - Unauthorized users can view the Create Dive form, but can't save it
  • [DMAS-66607] - DMAS Search Failed Notification: 05-Sep-2021 02:05:29 UTC, Vancouver Island-Strathcona Park, Time Series Scalar Plot, SearchHdrId 9669183, UserId 15356
  • [DMAS-66638] - Data Player is not functioning for RDI ADCPs
  • [DMAS-66656] - DMAS Search Failed Notification: 10-Sep-2021 14:44:06 UTC, IOS3 Hydrophone Array 01, Hydrophone Spectral Data, SearchHdrId 9697317, UserId 107900
  • [DMAS-66692] - Nortek Signature plots seem to be averaging too much
  • [DMAS-66699] - Acoustic dataviewer toolbox does not update when changing from Nortek ADCP to RDI ADCP
  • [DMAS-66716] - Unable to edit certain other users' annotations
  • [DMAS-66726] - DMAS Search Failed Notification: 21-Sep-2021 17:15:49 UTC, JASCO M36-V35-100 Hydrophone D001022, Hydrophone Spectral Data, SearchHdrId 9746618, UserId 42732
  • [DMAS-66750] - can't filter by property in Plotting Utility
  • [DMAS-66812] - failure reprocessing EEW Titan log files
  • [DMAS-66853] - CODAR netCDF pulls lon data for geospatial_lat_min field

User Story

  • [DMAS-54234] - As a DataViewer user I want matlab to be provided as a service.
  • [DMAS-55065] - As a software developer, I would like to automatically deploy a given feature with backend, frontend, and UI test code to the QA environment so UI tests can be run on it before merge
  • [DMAS-64627] - QAQC result should merge with existing result when CF late data merge
  • [DMAS-65449] - As a Data Specialist, I would like the ability to delete a sitedevicesubset from the UI
  • [DMAS-66244] - As a Data Specialist, I would like an option in SiteDeviceSubset Maintenance to use reference lat/long when repostprocessing without edits, and repostprocessing should be forced on reference lat long or start end date change

Task

  • [DMAS-58059] - As a Data Steward, I would like the columns in Task Monitor to be sortable
  • [DMAS-66288] - Leverage the option to set instrument clock in driver initialization for Pro-Oceanus CO2-Pro CV devices
  • [DMAS-66338] - When editing sitedevicesubsets (for CF), the UI should have the option to input milliseconds for start/end time
  • [DMAS-66557] - As a data steward, I would like the dive chief drop-down in the dive metadata UI to be alphabetically by last name
  • [DMAS-66615] - Hide initial data available loading image
  • [DMAS-66617] - Display the circular progress image while waiting for the cast image to be posted
  • [DMAS-66673] - Disable CORs in cypress browser, update cypress commands
  • [DMAS-66682] - Support material-ui 4.12 and higher in oceans next
  • [DMAS-66710] - Improve Kongsberg rotary plotting so that it doesn't plot a single ping in a new sweep
  • [DMAS-66732] - Allow lists of search tree node codes in the event definition json
  • [DMAS-66738] - Improve production build time for Oceans Next
  • [DMAS-66762] - Move Annotation Table pagination bar to top

Design

  • [DMAS-66431] - Create UI design for using Ref Lat Long when reprocessing without changes on SiteDeviceSubsetMaintenance UI
  • [DMAS-66454] - Design UI to require repostprocessing of cast if altered in SiteDeviceSubestMaintenance

Implementation

  • [DMAS-54233] - Implement Matlab always running (Matlab as a service)
  • [DMAS-58181] - Add ancillary data to Nortek netCDF data product- correlation, error, percent good, etc and boost compression and format for RDI/Nortek netCDF
  • [DMAS-64208] - Create Owner Filter for Annotation Search
  • [DMAS-64671] - Impement Multi Queue UI
  • [DMAS-64790] - Don't call DataPreviewService so many times in GeospatialMap
  • [DMAS-65381] - create script to get heapdump from qaweb2 when webservice performance slows down
  • [DMAS-65465] - Create TaxonResource table
  • [DMAS-66430] - Create new option on SiteDeviceSubsetMaintenance UI to use Ref Lat Lon when Reprocessing without changes, also force repostprocessing if Ref Lat Lon, or Start End date is altered
  • [DMAS-66432] - Update Matlab castdatacorrection code to use ref lat long when reprocessing a cast without changes when flag is encountered
  • [DMAS-66433] - Modify SiteDeviceSubset service to allow for repostprocessing a cast without changes but use ref lat lon
  • [DMAS-66472] - Add new operation to SiteDeviceSubsetService to get SiteDeviceSubsetTypes that are casts
  • [DMAS-66485] - Add faster service call to get annotationId and timestamp for a dive
  • [DMAS-66548] - clean up multiqueue code
  • [DMAS-66556] - Modify SiteDeviceSubsetService DELETE operation to be Functional
  • [DMAS-66572] - Set the names of threads used by the cache loader
  • [DMAS-66579] - Add Delete Button to SiteDeviceSubsetMaintenance Page
  • [DMAS-66580] - Delete Aligned and Depth Binned Data and QAQC Flags when a cast is deleted
  • [DMAS-66588] - handle disconnects while processing device moves
  • [DMAS-66635] - Back end for video export restrictions
  • [DMAS-66639] - Re-add appropriate columns to taxonomy and taxon tables for vocabularies and vocabulary terms
  • [DMAS-66641] - Modify QAQCArchiver to handle Late CF Data Correctly
  • [DMAS-66644] - add mbeans for multiqueue classes
  • [DMAS-66657] - Front end for video export restrictions
  • [DMAS-66675] - support moving deviceTypes and remove assignDevice, AssignDefaultQueue messages
  • [DMAS-66689] - Write video timestamps to HLS chunklist headers as a proof of concept
  • [DMAS-66739] - Plotting Utility to display the time axis with Time Offset
  • [DMAS-66748] - Axis camera optical zoom
  • [DMAS-66761] - Add the label "integration" to the Jenkins controller node
  • [DMAS-66778] - handle moving queues for a device when it already has a devicetype mapping
  • [DMAS-66819] - add button to enable/disable multiqueue

Test

Bug (ST)

  • [DMAS-66500] - ISO19115 XML records UUID does not match Database record for im_iso19115datasetrecord
  • [DMAS-66512] - Update task management table for sorting by column
  • [DMAS-66541] - Can't create users in qa2
  • [DMAS-66542] - Several qa2 machines don't seem to start up on deployment
  • [DMAS-66723] - Camera web page - various bug fixes
  • [DMAS-66763] - Switching from parser.q to the multiqueue default doesn't work

Investigation

  • [DMAS-55877] - Investigate JWPlayer
  • [DMAS-57455] - Investigate write code to add m3u tag in Wowza stream for JWPlayer
  • [DMAS-66522] - Identify queries that appear to be performing poorly

September 21, 2021

Minor release: MATLAB-as-a-service feature release, rayfin driver (no downtime)

Tickets Released: Oceans 2.0: 21.08.002 (accessible to internal users only). Total: 2.

Implementation

  • [DMAS-54233] - Implement Matlab always running (Matlab as a service)
  • [DMAS-66637] - Rayfin driver - light and strobe support

September 20, 2021

Minor release: various fixes, primarily for latest preview generation

Tickets Released: Oceans 2.0: 21.08.001 (accessible to internal users only). Total: 14.

Usability

  • [DMAS-66587] - CKAN API call is generating random UUIDs for Citation Identifiers (AKA DOIs) for CKAN records - even when there are DOIs associated

Bug

  • [DMAS-64777] - Data Preview searches are no longer tasktypeid 16 "Data Product Preview Search"
  • [DMAS-66640] - AnnotationList doesn't scroll to the correct annotation when parameters are provided in the SeaTube url
  • [DMAS-66659] - Site Device Subset edit bug for CF126-4082
  • [DMAS-66672] - Check to see if device is Community fishers device does not function if device was decommissioned and search range ends before decommission date or location based search
  • [DMAS-66685] - CODAR latest preview searches not finding recently acquired files
  • [DMAS-66708] - TaxonomyService fails with "IllegalStateException: Use the other version of this method to delete from both caches" on updating a taxon

Task

  • [DMAS-66550] - Latest Data Preview searches should have their own tasktypeid
  • [DMAS-66677] - Dive Annotations not showing in SeaTubev3 (with Chrome)

Implementation

  • [DMAS-66315] - Add trx tables for tables related to taxonomy attributes
  • [DMAS-66633] - Java code for latest preview task type id
  • [DMAS-66634] - SQL change for latest preview task type id
  • [DMAS-66694] - Change annotation list's displayed annotations

Investigation

  • [DMAS-66361] - investigation-getPNG failures for 16 to 47 month plots of sensors deployed to Campbell River

September 13, 2021

Major release (delayed due to maintenance expedition)

Maintenance and Production Developer

  • qaqc UI bug fixes and improvements
  • CODAR/WERA latest data preview
  • ONC website for ONC cruise
  • Prod bugs
  • other small improvements (e.g., search feature on FileManagement and ReprocessConsole pages)

SeaTube

  • ONC Annotation List performance improvements
  • NOAA Chat Log support
  • Each organization manages their own dives
  • System admins can delete their own annotations
  • Bug fix

Data Products

  • Bug fixes: Nortek plots (data rating), ASL memory use reduction, ASL pressure sensor, Kongsberg rotary search failure, state of ocean CSV fix
  • Latest preview: data product code now prepares and puts PNGs/GIFs on /ftp/pub/latest/<STNid>/<DCid> for display in the latest tab in Data Preview
  • File archiving and management configuration changes and a new instance to reduce latency (for latest preview generation)
  • Device attribute "manager" now fills in DateTos with subsequent DateFroms (the java code already does this, this makes the two behave the same)
  • Search automation improvements - status graph accuracy and coverage

Dashboards

  • Bug fixes:
    • Non-English characters show correctly in Text Widget (and everywhere else)
    • Chart widget correctly shows Y-axis
  • Can show larger image by clicking in Image and Data Preview widgets
  • Anonymous users can access dashboards
  • User tokens and dashboard tokens are used in scalardata, archivefiles and devices public services

CIOOS

  • Logging reduced to debug for missing translations
  • Handle issue with some mobile datasets not getting uploaded to CKAN - CF names are longer than supported

Instruments

  • Driver machines subscribing to reprocess queue. Only needs deployment to data centre
  • Refactor - removal of version number in parser definition
  • Refactor - removal of unused fields in device table
  • Bugfix for handling file state in DataProductUploadService - not consistent with FileArchiverService
  • Fix for RBRLogger3 driver. Driver initialization now turns on logging to serial port. Change does not need to be deployed.
  • Fix for Seabird Seacat CTD driver. Fixes problem where driver required a restart every time the device was powered down.

Community Fishers

Acoustic Instruments Data Viewer

  • added search by location to device selection component

Tickets Released: Oceans 2.0: 21.08.000 (accessible to internal users only). Total: 130.

Bug

  • [DMAS-13571] - Unicode characters are not correct during/after registration
  • [DMAS-58383] - Unable to upload metadata to CKAN for some mobilesurface datasets
  • [DMAS-64119] - Investigate funky cast (CF015-4240)
  • [DMAS-64151] - Cast detection for CF004-4263 resulted in buggy incorrect start time
  • [DMAS-64479] - DeviceActionServiceTest fails occasionally in Jenkins
  • [DMAS-64672] - Nortek plotting data products code not using the DMAS data rating - plots are very gappy
  • [DMAS-64678] - Incorrect start times in cast detection: please investigate
  • [DMAS-66299] - UI tests are failing with "Attempt to reopen Postgres connection"
  • [DMAS-66305] - Fix failing UI test in geospatial map
  • [DMAS-66358] - Task machines log Velocity ResourceNotFoundExceptions if DmasServiceManager starts before VelocityLifecycleManager
  • [DMAS-66380] - SeaTubeV3: Certain dive hangs Firefox
  • [DMAS-66382] - Chart Widget not displaying Y-axis, displays time instead
  • [DMAS-66384] - SeaTube and Oceans 2.0 very slow, logging is a problem
  • [DMAS-66398] - Additional delete buttons appear after saving on a dive page
  • [DMAS-66414] - misleading message during Oceans-next deployment
  • [DMAS-66439] - UI test suite failed with "Error forwarding the new session Empty pool of VM for setup Capabilities"
  • [DMAS-66514] - Latest Preview searches are not being created on .ruv/.tuv file acquisition by the CODAR FTP task
  • [DMAS-66519] - EventSerializerShallowTest fails randomly on unrelated feature branches
  • [DMAS-66531] - Data Search - files should be continuous in time when download includes multiple files
  • [DMAS-66534] - Latest Preview search generation is creating duplicate searches
  • [DMAS-66535] - Unicode characters entered in the UI are incorrectly encoded in QA and production
  • [DMAS-66536] - Driver for Sea-Bird Microcat SBE37SIP on wally stops collecting data periodically
  • [DMAS-66538] - Latest Preview search generation is creating searches with erroneous dates
  • [DMAS-66553] - Database post-refresh scripts can't be run in psql because of non-standard comments
  • [DMAS-66561] - Make the Dashboard and Widget embed URLs anonymous
  • [DMAS-66563] - Device autocomplete showing all devices not just those for specified category
  • [DMAS-66566] - Investigate QA crash from Sep 1 1:22 UTC
  • [DMAS-66567] - EventDetectionService failing in QA
  • [DMAS-66568] - Geospatial Map does not display Community Fishers Annotations
  • [DMAS-66589] - DMAS Search Failed Notification: 02-Sep-2021 22:48:50 UTC, AML-6 LGR A60015, Aligned and Depth-Binned Profile Data (On-Demand), SearchHdrId 9666758, UserId 3162
  • [DMAS-66595] - There are two sets of zoom in./out buttons in ST Map widget
  • [DMAS-66598] - Taxonomy sync function are not working in QA
  • [DMAS-66599] - TaxonomyMatrixManager logs NPE trying to publish cache reload messages
  • [DMAS-66604] - failed to create a new dive in QA
  • [DMAS-66611] - Adding a sensor calibration does not add a trigger task to the selected batch
  • [DMAS-66630] - Annotation List "Copy Link" option doesn't maintain it's value between page loads

User Story

  • [DMAS-33640] - As a user, I would like to allow annotations to be created and displayed in a foreign language
  • [DMAS-57784] - As a scientist, I would like data acquisition for the cabled sonardyne fetch instrumentation planned for Barkley Upper Slope 2021
  • [DMAS-64762] - As a hydrophone data steward, I would like to be able to update sensitivity vector device attributes by uploading a .m file
  • [DMAS-65457] - As a Data Specialist, I need the ability to create a sitedevicesubset and have it generate corrected cast data
  • [DMAS-66282] - As a CODAR/WERA user, I would like to see the latest data in Data Preview as close to live as possible -- matlab part
  • [DMAS-66459] - As a Data Specialist, I would like some sort of warning system to prevent me from deleting sitedevicesubsets as a result of user error

Task

  • [DMAS-46744] - Update the CAP signature to use RSA SHA 256
  • [DMAS-64470] - As logger admins, we would like manage dives for our own organization
  • [DMAS-64679] - Add select by location to the Configure Data Player dialogue
  • [DMAS-65384] - As a ST user, I would like to keep more ST configs after refresh the page.
  • [DMAS-65417] - Enable FILE_STATE_P flag in file names in DataProductUploadService and related tasks
  • [DMAS-66300] - As a data steward, I would like the PI and owner fields removed from the device table
  • [DMAS-66355] - please change one description line for Oceans-next deployment in Jenkins
  • [DMAS-66362] - As a release person, I would like to check pattern of fix version of ticket before code is merged
  • [DMAS-66366] - SeaTube V3 is forcing us to select a camera before many of the functionality will work
  • [DMAS-66388] - Allow a bigger version of the image shown in either the image or preview widgets to be displayed
  • [DMAS-66420] - Update the dateTo of the deviceAttribute with the dateFrom of the next one (in the matlab function)
  • [DMAS-66421] - As a Data Specialist, I would like the ability to query File Management or ReprocessConsole using a device id
  • [DMAS-66435] - Make an OSGi service whose properties let us control whether other services are started
  • [DMAS-66438] - Add search automation test cases for new device category + data product format combinations that aren't covered
  • [DMAS-66440] - Replace the deprecated JCenter Maven repository used by Oceans 2
  • [DMAS-66448] - Clean up minor coding issues found in DMAS-66444
  • [DMAS-66503] - Update hydrophone file compression job to accept .oct and LPF/HPF files
  • [DMAS-66504] - Update file archiving to better support near-live data access
  • [DMAS-66508] - RBRLogger3 driver - turn on streaming to serial durint driver initialization
  • [DMAS-66518] - Modify fileArchiverService to sort files by date, newest to oldest
  • [DMAS-66523] - "Data Preview Latest Generator" searches should use a new queue, not search or search.preview queue
  • [DMAS-66526] - update name and description for job 342 "wera-file-download"
  • [DMAS-66551] - Ensure all devices service calls made from a dashboard use api not apiproxy
  • [DMAS-66552] - Remove old Oceans Next stashes and UI Testing screenshots from Jenkins, to save space
  • [DMAS-66562] - Add consumer thread for search latest tasks + small date fix
  • [DMAS-66583] - Add logging to ExternallyDerivedSensorDataIngester to log when a NaN value is found within a dataline
  • [DMAS-66585] - Consider emty return for chat log service if the user doesn't have read permission
  • [DMAS-66597] - Add property to limit latest preview queue to 1 thread
  • [DMAS-66602] - Remove some sql scripts in 21.08.000 release

Design

  • [DMAS-58377] - Design a system to put near-live / latest data on Data Preview

Implementation

  • [DMAS-58392] - DAF Routing Component
  • [DMAS-64536] - Update the file clean up configuration to support latest data preview
  • [DMAS-64731] - Update code to use sy_token instead of dmasuser.token
  • [DMAS-64736] - Update backend to support application tokens
  • [DMAS-64737] - Backfill sy_token with tokens for existing dashboards and users without tokens
  • [DMAS-64738] - Generate a token when a dashboard is created
  • [DMAS-64739] - Add the token for the currently active dashboard to an external service call
  • [DMAS-64855] - Change common dataset generation logging messages to be debug
  • [DMAS-65495] - Add appropriate columns to taxonomy and taxon tables for vocabularies and vocabulary terms
  • [DMAS-66224] - Add Option to create Cast Data On SiteDeviceSubset Maintenance UI
  • [DMAS-66227] - Modify SiteDeviceSubset service to create cast file on siteDeviceSubset creation
  • [DMAS-66262] - Initial Parser for Cable Fetch devices
  • [DMAS-66283] - Create service for multi queue page
  • [DMAS-66297] - Oceans Next autodeployment should lock qa2.oceannetworks.ca, not qa.oceannetworks.ca
  • [DMAS-66315] - Add trx tables for tables related to taxonomy attributes
  • [DMAS-66356] - Write a script to plot the size of each cache over time
  • [DMAS-66371] - Add front end support for displaying chat logs in the Annotation List
  • [DMAS-66377] - Add feedback when failed token service call
  • [DMAS-66379] - add support for primary and non primary shorestations
  • [DMAS-66385] - Update the multiqueue service to send messages over the multiqueue topic
  • [DMAS-66400] - Database table(s) for chat logs
  • [DMAS-66405] - implementation: update sensitivity vector attributes by uploading a m file
  • [DMAS-66410] - DAL for chat logs
  • [DMAS-66413] - get ShorestationDafQueueCache to startup correctly
  • [DMAS-66415] - Remove VersionNumber column from Java Code
  • [DMAS-66416] - The DafProcessingService needs to start up an activator for each queue running the shorestation
  • [DMAS-66427] - Update backend to allow annotation deletion for system admins
  • [DMAS-66428] - Update frontend to use V3 deletion call
  • [DMAS-66444] - Remove calls to ServiceUtil in loops
  • [DMAS-66445] - Add a Taxon cache
  • [DMAS-66449] - Support deploying Oceans 2.0 through a proxy
  • [DMAS-66451] - Web service(s) for chat logs
  • [DMAS-66452] - if multi queue is enabled only the routing component should subscribe to the parser queue
  • [DMAS-66453] - Drop number of Data Search Threads down from 6 to 5 on qa tsks
  • [DMAS-66455] - Calculate device dependencies when moving between queues
  • [DMAS-66473] - Add Dashboards and Widgets urls to allowed anonymous paths
  • [DMAS-66476] - Create Service call that returns casts that will be deleted
  • [DMAS-66480] - Update Rayfin camera driver to add dateto to still image filenames
  • [DMAS-66496] - Improve the performance of querying the database for dive annotations
  • [DMAS-66497] - Remove the test sourceset from chatlog.api
  • [DMAS-66499] - add/support da_multiQueueMove table
  • [DMAS-66515] - Improve file archive queue wait for near-live matlab searches
  • [DMAS-66517] - Implement Alert box displaying SiteDeviceSubsets about to be deleted on save
  • [DMAS-66520] - Add iFileLocationConfig for new file archiver
  • [DMAS-66524] - Set device ID list as a parameter in the query ArchiveFileState.paged
  • [DMAS-66537] - Clean up Hibernate query statistics
  • [DMAS-66600] - Drop trigger "tx_taxonomy_trx"
  • [DMAS-66614] - Allow anonymous users in SeaTubeChatLogService

Test

  • [DMAS-66469] - Test latest preview generation - matlab part

Bug (ST)

  • [DMAS-66422] - ecarc1 logs errors on startup
  • [DMAS-66423] - Fix back end error when token invalid
  • [DMAS-66463] - Fix null pointer error in update method for tokens
  • [DMAS-66507] - Integration testing build is triggering stages of Oceans Next that should only be run in QA
  • [DMAS-66509] - SessionMonitoringCommand fails with an NPE if there are sessions without a user attribute
  • [DMAS-66545] - In QA, the annotation service return empty records.
  • [DMAS-66560] - DeviceConsole not loading in QA on release branch
  • [DMAS-66573] - typo in latest preview matlab code

Investigation

  • [DMAS-66446] - Investigate where operation 1 of SeaTubeV3AnnotationService is spending its time

August 16, 2021

Minor release: various fixes and upates

Tickets Released: Oceans 2.0: 21.07.003 (accessible to internal users only). Total: 32.

Bug

  • [DMAS-55035] - Driver machines are subscribing to too many queues
  • [DMAS-65339] - update sensorattribute values for qaqc test somehow change archivedflag value to 0.0 for the same sensor
  • [DMAS-66312] - QAQC Auto Test Details page does not display correct modification information
  • [DMAS-66319] - DMAS Search Failed Notification: 30-Jul-2021 17:30:04 UTC, Kongsberg Mesotech Rotary Sonar 1171 (1206086), Kongsberg Sweep Data Product, SearchHdrId 8974913, UserId 27378
  • [DMAS-66364] - Minimum values in State of Ocean CSV are the same as the Maximum
  • [DMAS-66383] - Correct failing data preview tests
  • [DMAS-66386] - Production web server is performing many sequential scans on annotationline_attribute during the Nautilus cruise
  • [DMAS-66434] - Some annotations not editable
  • [DMAS-66441] - DataCite DOIs not versioning correctly

User Story

  • [DMAS-51326] - As a CODAR/WERA user, I would like to see the latest data in Data Preview as close to live as possible -- java part
  • [DMAS-58259] - As ST admin, I would like to promote ST V3

Task

  • [DMAS-66337] - Update pressure sensor info and NaN the data for ASL echosounders
  • [DMAS-66409] - Add latest preview search creation functionality to WERA download task
  • [DMAS-66411] - Reduce ASL echosounder data product matlab memory use

Requirement

  • [DMAS-64130] - Create requirements for promoting from ST Pro to STV3

Implementation

  • [DMAS-64529] - Produce the latest preview products in matlab searches created by an acquisition task
  • [DMAS-66329] - Set the name of threads used by services & servlets
  • [DMAS-66336] - Add an OSGi command to allow us to see what sessions are being retained
  • [DMAS-66354] - Make initial Menu changes for SeaTube transition
  • [DMAS-66365] - Remove the close all/clear at the end of the matlab search function in RW mode
  • [DMAS-66387] - Add Regex file matching to the CODARDownload task
  • [DMAS-66389] - Database script to add regex to CODARDownloadTask
  • [DMAS-66396] - Create searchdtl for each latest search
  • [DMAS-66397] - Limit search creation to files from the last 24 hours
  • [DMAS-66401] - Only display image files in latest directory
  • [DMAS-66402] - Add Permalink and Data Search link
  • [DMAS-66419] - Set studyareaid to searchtreenodeid for created searches
  • [DMAS-66436] - Add latest search creation to the WERA ftp task
  • [DMAS-66437] - Database script to add latest search creation to WERA job

Bug (ST)

  • [DMAS-66470] - Links and view of latest preview products are not quite right
  • [DMAS-66471] - Searches created by CODAR download task do not run, aren't formed as expected
  • [DMAS-66479] - Searches created by CODAR download task should have dateto = datefrom

August 6, 2021

Minor release: annotation fix

Tickets Released: Oceans 2.0: 21.07.002 (accessible to internal users only). Total: 1.

Bug

  • [DMAS-66346] - After save the annotation, the resource type doesn't use the setting in the st config table.

August 5, 2021

Minor release: various issues

Tickets Released: Oceans 2.0: 21.07.001 (accessible to internal users only). Total: 11.

Bug

  • [DMAS-66241] - SiteDeviceSubsetMaintenance UI Uses 0 for default location metadata on UI
  • [DMAS-66280] - No dive marker displayed after loading Expedition Management page
  • [DMAS-66318] - Latest tab won't load images in newly created directories
  • [DMAS-66320] - QA: "CRUD for taxon" inconsistently appears on particular annotations
  • [DMAS-66342] - SeaTubeConfiguration page allows multiple saves during a creation
  • [DMAS-66345] - Error message when select a taxon in QA

Task

  • [DMAS-66313] - Need add a unique constrain in st_config table for ownertype, ownwer, category and name
  • [DMAS-66328] - Correct Resource Type not loading when using buttons based on Imported Taxonomies

Implementation

  • [DMAS-66339] - Change latest tab to use FTP and device category id

Bug (ST)

  • [DMAS-66306] - DriverSchedule UI - Fix some outlying issues
  • [DMAS-66333] - CODARDownloadTask has numberformatexception

July 30, 2021

Major release

Maintenance and Production Developer

  • Various bugs and fixes
  • QAQC related features and bug fixes
  • CODAR data preview (in progress)
  • WTA website
  • driver schedule UI page (in progress)

SeaTube

  • Annotation Link
  • Live mode improvement
  • Organization customized Resource Type configuration and selection
  • Auto-save improvement
  • Memory usage monitoring
  • 2nd QA server deployment
  • bug fixes

Dashboards

  • archivefile and scalardata service calls now use api instead of apiproxy and use the current user's token
  • backend support for new sy_token table

CIOOS

  • set the ISO 19115 XML maintenanceNote to include the most recent dataset change

Community Fishers

  • continuing work on testing Matlab as as service (no prod impact)
  • pipeline bug fixes and small improvements for re-post-processing

Data Products & Search Automation

  • Performance improvements and congestion in PROD
  • bug fixes
  • Search automation status graph, performance / completion time

Instruments

  • Sonardyne Cabled Fetch drivers complete
  • Initial parsers for cabled fetch complete
  • RBR Zero driver complete
  • Mclane RAS & Phytoplankton - Take sample button added to these driver types.
  • Multi-queue (in progress)

Tickets Released: Oceans 2.0: 21.07.000 (accessible to internal users only). Total: 94.

Bug

  • [DMAS-51309] - Search automation metrics report a different number (more) of comparison failures than what the report shows
  • [DMAS-58058] - Stopping task machines when reprocessing cancels running tasks
  • [DMAS-64146] - When UI tests are run manually through Jenkins on a feature branch, all tests are run regardless of the package selected by the user
  • [DMAS-64153] - The volume slider is difficult/impossible to adjust in SeaTube V3
  • [DMAS-64202] - Deployment sometimes fails to resolve the javax.ejb and javax.transaction APIs
  • [DMAS-64577] - Tests failing in SensorAttributesTest
  • [DMAS-64580] - Test failing in UserReplication
  • [DMAS-64609] - If a code deployment fails before equinox is stopped, then the verify operation reports success
  • [DMAS-64715] - Fix Metrics' 'Status' graph
  • [DMAS-64756] - DMAS Search Failed Notification: 17-Jun-2021 19:38:54 UTC, Nortek Aquadopp Profiler AQP2963 AQD5109, Nortek Time Series, SearchHdrId 8701887, UserId 27378
  • [DMAS-64785] - WAV data being returned as 16-bit
  • [DMAS-64786] - Data products 'By Location' not downloading using Data Search for cast data
  • [DMAS-64805] - Some data products are missing in Data Preview
  • [DMAS-65226] - Tests failing in CruiseManagement
  • [DMAS-65386] - Please investigate why casts are going to unassigned location for casts taken on 29-Jun-2021 with DI: 28000
  • [DMAS-65405] - Organization logo is not appearing in the Dive Details dialog
  • [DMAS-65412] - Reset ONC base map back to GMRT but have the CF map default to Open Street
  • [DMAS-65474] - DMAS Search Failed Notification: 15-Jul-2021 16:10:29 UTC, Turner Cyclops-7 Fluorometer (S/N 2103861), Aligned and Depth-Binned Profile Data (On-Demand), SearchHdrId 8877157, UserId 49940
  • [DMAS-65489] - Oceans Next builds sometimes freeze while running tests
  • [DMAS-65503] - Cast Ingestion Job 4 (Job 340 and Job 424) showing error
  • [DMAS-66237] - Sea Tube filter/search doesn't work for null value search
  • [DMAS-66245] - Taxonomy attribute value inconsistency between null and empty
  • [DMAS-66259] - Scrollbar for annotation list in SeaTubeV3 isn't working properly with mouse dragging
  • [DMAS-66269] - UI test daily suite sometimes fails with "WebDriverException: unknown error: cannot find Chrome binary"
  • [DMAS-66270] - Sharing an annotation incorrectly uses the timestamp parameter instead of time
  • [DMAS-66271] - Fix failing test in datapreview generation
  • [DMAS-66274] - Fix broken Pager bar on DeviceSearch
  • [DMAS-66277] - Expedition Management displays a 403 error when an anonymous user tries to view fixed cameras
  • [DMAS-66281] - Clicking an annotation during a live video does not seek to the time of the annotation
  • [DMAS-66285] - SeaTubeConfiguration page doesn't allow saving a second time unless the page is reloaded
  • [DMAS-66290] - SeaTubeConfigurationService requires login, but is called by SeaTubeV3 for non-logged-in users
  • [DMAS-66293] - Community fishers annotation display on geospatial map jitters around
  • [DMAS-66298] - Investigate sync issue for ST config values
  • [DMAS-66301] - Admins cant view some resources

User Story

  • [DMAS-51326] - As a CODAR/WERA user, I would like to see the latest data in Data Preview as close to live as possible -- java part

Task

  • [DMAS-58170] - Links to specific annotations needed in Annotation List and SeaTube Search
  • [DMAS-64177] - Seatube v3 video widget should not autoplay for Active dives to prevent timestamp mismatch
  • [DMAS-64741] - As a dive logger, I would like to be aware the Sea Tube mode while a dive is in progress
  • [DMAS-64746] - Test and support new GPU based task machine
  • [DMAS-64748] - uploading .pcf to Nortek Aquadopp Current Meter Attributes should create a new entry regardless if values change
  • [DMAS-64833] - provide a dml SQL script for system to sync archivefile table from data center to dive logger database in QA
  • [DMAS-65362] - Update deployment infrastructure to support differing number of threads in the pool per task machine
  • [DMAS-65379] - As a users, I would like to see support of multiple deviceids in qaqcreprocess job
  • [DMAS-65471] - create a dataproduct wiki page for dataproductid = 126
  • [DMAS-65496] - Improve performance of CODAR QC products
  • [DMAS-66238] - Recommit the live dive UI update
  • [DMAS-66264] - Null value (no selection) should be allowed for Taxonomy field in Annotation Entry widget
  • [DMAS-66287] - Hide the SeaTubeConfiguration page from anonymous users
  • [DMAS-66296] - Attributes need to be sorted when editing an existing annotation

Design

  • [DMAS-64793] - Create mockups for each autosaving management page with Save button changes

Implementation

  • [DMAS-13786] - develop UI for driverschedule changes
  • [DMAS-56629] - Log Oceans Next version hourly, if deployed
  • [DMAS-64116] - Support running against either QA or QA2 in Eclipse
  • [DMAS-64128] - Support deploying ONC Data Products to QA2
  • [DMAS-64193] - UI test implementation for Attribute Management
  • [DMAS-64478] - Add logic to check records generated and create XML
  • [DMAS-64508] - Update CODAR FTP Task to Trigger MATLAB
  • [DMAS-64509] - Write Database scripts for CODAR ftp job
  • [DMAS-64730] - create sy_token table & populate it with user tokens
  • [DMAS-64735] - Get current user's token when making an external service call
  • [DMAS-64791] - Create latest tab with latest generated images
  • [DMAS-64840] - Update public service calls made only from dashboards to use WebRequestWithToken
  • [DMAS-64848] - Try to add cancellable request method to WebRequestWithToken
  • [DMAS-64856] - Make the maintenanceNote in datasets autogenerate what part of the dataset has changed
  • [DMAS-64857] - Update automated UI tests for SiteDeviceSubsetMaintenance Page
  • [DMAS-65357] - Attempt to fix cancelSearch and filterSections tests
  • [DMAS-65361] - Create the public interface and a dummy implementation for a memory monitor
  • [DMAS-65364] - Implement a memory monitor that just counts the number of objects created
  • [DMAS-65367] - Instrument sources that read from Cassandra
  • [DMAS-65368] - Instrument sources that read from Postgres
  • [DMAS-65369] - Instrument MetricsServlet
  • [DMAS-65372] - Create SeaTube Configuration Page
  • [DMAS-65378] - Add base components and layout to SeaTube Configuration page
  • [DMAS-65387] - Create SeaTube configuration table(s)
  • [DMAS-65395] - Data access for SeaTube configurations
  • [DMAS-65398] - Add DAL layer for sy_token
  • [DMAS-65406] - Convert Hibernate wrapper classes to decorators
  • [DMAS-65454] - Support running against either QA or QA2 from Gradle
  • [DMAS-65476] - Figure out which field of DeviceActionForUI doesn't match
  • [DMAS-65488] - Support deploying Oceans Next to QA2
  • [DMAS-65576] - Write a Wowza module to parse & log timestamps from low-resolution live-streamed video metadata
  • [DMAS-66220] - Service to get organization info from a dive
  • [DMAS-66230] - Load the default Resource Type and Resource values from an organizations saved configuration
  • [DMAS-66232] - Return JSON in payload as JSON
  • [DMAS-66246] - Database: Use null attribute values instead of empty string
  • [DMAS-66247] - Back end: Adjust attribute value logic to favour null over empty string
  • [DMAS-66248] - Front end: Adjust attribute value logic to favour null over empty string
  • [DMAS-66251] - Increase the reporting threshold on threads that have already reported
  • [DMAS-66261] - Sort the loaded attributes in Manual Entry in alphabetical order
  • [DMAS-66268] - Add Seatube Configuration page to the nav menu under SeaTubeV3
  • [DMAS-66272] - Sort "User Directory" in the More menu

Bug (ST)

  • [DMAS-65497] - QA2 connects to the wrong LDAP server after running database post-refresh scripts
  • [DMAS-66256] - Correct CODARDownloadTask Imports
  • [DMAS-66291] - Correct UserFileService in qa

July 22, 2021

Minor release: various issues related to the upcoming maintenance expeditions (no downtime)

Tickets Released: Oceans 2.0: 21.06.004 (accessible to internal users only). Total: 3.

Bug

  • [DMAS-66236] - Millions of logs from Matlab on task machines in very short time

Implementation

  • [DMAS-66263] - Cabled Fetch driver - increase idle timeout trigger

Bug (ST)

  • [DMAS-66252] - RBRZero driver sends two valve calibration commands on startup

July 21, 2021

Minor release: various issues related to the upcoming maintenance expeditions

Tickets Released: Oceans 2.0: 21.06.003 (accessible to internal users only). Total: 15.

Bug

  • [DMAS-65620] - Fix SubCImagingCam driver to send correct commands from flashTime and flashDelay functions

User Story

  • [DMAS-58369] - As a data specialist, I would like modify a SiteDeviceSubsets's referenceLat and/or referenceLon and re-postprocess the data
  • [DMAS-58372] - As a data specialist, I would like modify a SiteDeviceSubsets's startDate and/or endDate and re-postprocess the data
  • [DMAS-64851] - As a Data Specialist, I would like an automated geofencing QAQC test
  • [DMAS-65458] - As a data specialist, I would like to be able to post-process a cast from the sitedevicesubset maintenance page WITHOUT making any changes to reference data

Task

  • [DMAS-64696] - Update McLane Phytoplankton Sampler driver to accommodate changes in adaptive sampling commands
  • [DMAS-65493] - After editing site device subsets, the reference depth should display the End depth, not the Start depth
  • [DMAS-66228] - sql to insert a sensorAttribute for QAQC attribute for PVCS test

Implementation

  • [DMAS-64828] - Remove autosave from Button Set Config
  • [DMAS-64853] - script to add a new formula
  • [DMAS-65461] - Trigger Re-Post-Processing Even If no reference data has been changed
  • [DMAS-65481] - Make './deploy_data_products --env' backwards-compatible with 21.06.000
  • [DMAS-66217] - Remove autosave from Attribute Management

Bug (ST)

  • [DMAS-65418] - re-post-processing code will not work with CTDs that do not have 'Not Derived' depth sensors
  • [DMAS-65447] - Fix bug with empty cast plots.

July 15, 2021

Minor release: bug fix for SeaTube Annotation export (no downtime)

Tickets Released: Oceans 2.0: 21.06.002 (accessible to internal users only). Total: 1.

Bug

  • [DMAS-65411] - DMAS Search Failed Notification: 13-Jul-2021 18:11:49 UTC, null, SeaTube Annotation Export, SearchHdrId 8858261, UserId 105730

July 13, 2021

Minor release: various issues related to the upcoming maintenance expeditions

Tickets Released: Oceans 2.0: 21.06.001 (accessible to internal users only). Total: 19.

Bug

  • [DMAS-64859] - dctsk04 - DMAS' log - Failed to send DataSyncMessage to MQ. Shutting down and writing to file instead

Task

  • [DMAS-64658] - As a dive logger, I would like ST validates the annotation date within the dive range
  • [DMAS-65382] - Remove unnecessary error snackbars, or update their messages to be more informative
  • [DMAS-65385] - As a NOAA ST user, I would like to keep my last selected taxonomy after an annotation is saved
  • [DMAS-65400] - Extend manual trigger of samples for McLane Phytoplankton Sampler (devicetype: 341)
  • [DMAS-65401] - TaskManagement page task table queries too many tasks

Implementation

  • [DMAS-64779] - Cast Data Ingestion should ingest empty versions of EDS files before versions with data and check for aligned and depth binned data between castdata files before merging them
  • [DMAS-64800] - Track the number of cached objects over time
  • [DMAS-64836] - Update service call and check service to prevent nulls
  • [DMAS-65097] - Modify Nortek Signature 55 driver to recover when device stops
  • [DMAS-65333] - Cabled Fetch driver - modifications for AZA
  • [DMAS-65355] - Re-post-process casts when their reference latitudes and/or longitudes are modified
  • [DMAS-65374] - Interpolate navigation data from cast file when reprocessing flag encounted
  • [DMAS-65391] - Handle varying number of values in sitedevicesubset comment

Bug (ST)

  • [DMAS-64588] - Pamguard PGDF files are not going into FTP on PROD
  • [DMAS-65375] - Only the old CTD scalardata is being deleted, not the piggybacks and tablet scalardata
  • [DMAS-65388] - Ingesting new casts creates duplicate sitedevicesubsets
  • [DMAS-65390] - Error injecting constructor, java.lang.NullPointerException when start driver of BPRZero in QA
  • [DMAS-65396] - IllegalArgumentException

July 6, 2021

Major release

Maintenance and Production Developer

  • Bug / Production Developer tickets
  • QAQCresult overlap
  • Expedition websites
  • Add end dates to driver-start annotations

Instruments

  • Multiple queues project (almost ready, not deployed)
  • Driver / parser bug fixes and support
  • New BPR driver
  • Nortek Signature 55 driver bug (in-progress)
  • PAMguard bug fixes

Earthquake Early Warning

  • OSGi modularization: eventdetection in separate module, shorestation metrics  (in-progress)

Data Products

  • CODAR documentation and minor updates
  • Search automation improvements: test coverage at 100% with new metrics that include sensor level mappings, fix for reprocessing automation
  • Commission the first of a new generation of task machine - now online!

Data Player

  • Caching and performance (in-progress)

Community Fishers Phase 2

  • Facility to manually edit or add cast detections, including lat/lon (sitedevicesubsets), which then triggers re-post-processing of aligned/binned data (in-progress)

SeaTubeV3

  • Dive logger can play historical videos
  • Customization support - store layout in cookies
  • changes to the live video page
  • investigating memory issues (root cause found - fix in next minor release)
  • Bug fixes

Annotations & Dashboards

  • Initial new annotation search in limited release
  • Transition to public services instead of internal services: now using archivefiles service instead of internal service in audio widget
  • Application token design

CIOOS

  • Versioning of CIOOS datasets
  • Marine Gazetter vocabulary

Tickets Released: Oceans 2.0: 21.06.000 (accessible to internal users only). Total: 83.

Usability

  • [DMAS-57859] - In Seatube V3, save layout on refresh in current session

Bug

  • [DMAS-56771] - auto reprocess tool does not work anymore after new feature added in DMAS-53889
  • [DMAS-57951] - taxon name not visible for saved annotation entries sometimes
  • [DMAS-64154] - When an annotation's taxon is changed, both old and new attributes are displayed
  • [DMAS-64164] - ADV Re-renders images multiple times when switching device while another device is loading data
  • [DMAS-64258] - Test failing in CruiseManagement
  • [DMAS-64552] - SeaTubeVideoService logs parameter errors unnecessarily
  • [DMAS-64600] - Fix failing GroupsDataProductPermissionFilters tests
  • [DMAS-64614] - Fix multiple DeviceAndSensor failing tests
  • [DMAS-64657] - All QA hosts logged errors while loading the DafTest cache after deployment with release/21.05.000
  • [DMAS-64670] - DmasGroupManager calls ServiceUtil too often
  • [DMAS-64689] - Task machines running 21.05.000 can't deserialize EventDetectedContainer, sent in messages on the archiver topic from an archiver running on master
  • [DMAS-64710] - Failed to generate a DeviceService response: java.lang.NullPointerException
  • [DMAS-64714] - PA Shorestation logging ERRORs that it can't handle an ActiveMQ object - java.lang.ClassNotFoundException
  • [DMAS-64740] - Can't see Batch tasks in TaskManagement in Prod
  • [DMAS-64750] - NOAA EX2103 expedition and dives are using ONC logo.
  • [DMAS-64775] - "Error: Invalid Parameter: liveStream1DeviceId. Invalid Integer format" on saving a cruise in QA
  • [DMAS-64782] - update coverage to exclude untestable functional component packages
  • [DMAS-64825] - Cannot update any cruise on Expedition Maintenance page
  • [DMAS-64829] - Master Branch build failing
  • [DMAS-64845] - Webpack build failing
  • [DMAS-64849] - Class not found exceptions on shore station
  • [DMAS-64850] - Data messages dropped at shore station
  • [DMAS-65337] - Error reloading eventdefinition caches
  • [DMAS-65338] - Ocean Next release branch build failing due to DateUtils unit test failing
  • [DMAS-65341] - Fixing failing UI test in geospatial map

User Story

  • [DMAS-19427] - Provide Annotation End Date for Starting and Stopping Driver
  • [DMAS-64851] - As a Data Specialist, I would like an automated geofencing QAQC test

Task

  • [DMAS-58071] - batch reprocess group task seems to add files in reverse order to the queue instead of chronological
  • [DMAS-58097] - divelogger machines should not be showing in Reprocess Console
  • [DMAS-64147] - Upgrade gradle in the UI Testing repository to the latest stable version
  • [DMAS-64168] - Replace the deprecated JCenter Maven repository used by UI Testing
  • [DMAS-64438] - As an AIS user, I would like a filter in the data search
  • [DMAS-64510] - Add typescript files to test:( coverFile, lint, pretty-code)
  • [DMAS-64527] - Put the limit value into the hover message in the latest readings widget
  • [DMAS-64590] - Update post refresh script to remove whacky characters from attribution test cases
  • [DMAS-64652] - Remove DmasLoginServlet
  • [DMAS-64676] - update suggested list of hostname to include new machines in Oceans-next deployment
  • [DMAS-64693] - Create tests for objects serialized over mq
  • [DMAS-64716] - Change default values for WebParameter.getParameter methods to have the correct type
  • [DMAS-64717] - add deviceid in the nullpointerexception in getPortNumberFromSensor method
  • [DMAS-64718] - Extend manual trigger of samples for RAS Water Sampler (devicetype: 368)
  • [DMAS-64742] - Don't display "Default attributes removed for selected taxon" when a user change a taxon which doesn't have any attribute
  • [DMAS-64760] - Remove redundant serialization/deserialization from ExpeditionTreeService
  • [DMAS-64783] - Add an index to tm_task to improve performance of finding queued searches
  • [DMAS-64796] - Update QaDeviceTests for 21.06.000
  • [DMAS-64834] - Revert but keep the change for switch the live/historical video mode
  • [DMAS-64847] - Merge failed from 21.05.000 to master

Implementation

  • [DMAS-57153] - implement automated geofencing QAQC test
  • [DMAS-64092] - Create Annotations Search Table
  • [DMAS-64194] - Create Resource Type Filter component prototype
  • [DMAS-64201] - Add support for selecting page size
  • [DMAS-64220] - Create skeleton code for Annotation Entry
  • [DMAS-64411] - Implement annotation search using new filter component
  • [DMAS-64452] - Add Search functionality
  • [DMAS-64476] - Implement Database Changes
  • [DMAS-64477] - Create ORM code
  • [DMAS-64483] - Extract EventReactor into a separate osgi bundle
  • [DMAS-64492] - Update Java code for endDate on Device Annotations created in DeviceConsole
  • [DMAS-64493] - Update existing Device annotations to add EndDate in database
  • [DMAS-64511] - Make new Annotations Search page available in Oceans 2
  • [DMAS-64530] - extract ArchiveFileManager to a new osgi bundle
  • [DMAS-64531] - Move EventDetector and dependencies into ca.uvic.dmas.extension.eventdetection.api
  • [DMAS-64532] - create event detection impl bundle
  • [DMAS-64533] - Implement BPRZero driver
  • [DMAS-64655] - Driver for Cabled Fetch
  • [DMAS-64663] - RBRZero simulator
  • [DMAS-64664] - Add platform_name variable to index radial data in combiner netCDF to their origin
  • [DMAS-64680] - Add logic in SiteDeviceSubset Service to inject EDS and cast files to ncdata
  • [DMAS-64682] - Modify ExternallyDerivedSensorDataPostProcessor to allow ingestion of empty EDS files
  • [DMAS-64691] - Modify Audio Widget Service Calls to use External API
  • [DMAS-64692] - add driverschedule manager/service
  • [DMAS-64734] - Create a WebRequestWithToken (or similar)
  • [DMAS-64749] - Add re-postprocess option on SiteDeviceSubsetMaintenance UI
  • [DMAS-64755] - Pass back user token from UserDetailsService and add to window.DMAS.Config
  • [DMAS-64761] - Delete Overlapping casts and Check if cast is in new Geospatial Area
  • [DMAS-64801] - Set the referenceSiteDeviceSubsetId field for the SiteDeviceSubsets being deleted
  • [DMAS-64803] - batch reprocess group task reverse order correction
  • [DMAS-64853] - script to add a new formula

Bug (ST)

  • [DMAS-64703] - Resolve automatic merge conflicts
  • [DMAS-64753] - Incompatible argument type in AnnotationService
  • [DMAS-65336] - Cannot Save new SiteDeviceSubsets on SiteDeviceSubsetMaintenance page

Documentation

June 29, 2021

Minor release: SeaTube updates and fixes

Tickets Released: Oceans 2.0: 21.05.005 (accessible to internal users only). Total: 4.

Task

  • [DMAS-64806] - Synchronize archive file objects to the divelogger jvm
  • [DMAS-64832] - Need a dml SQL script to sync archivelocationtype and archivelocation table from prod to dive logger database

Implementation

Bug (ST)

  • [DMAS-64721] - Select attribute filtering does not find selected values

June 25, 2021

Minor release: CO2 driver fix (no downtime)

Tickets Released: Oceans 2.0: 21.05.004 (accessible to internal users only). Total: 1.

Bug

  • [DMAS-64726] - Can't start driver for Pro-Oceanus CO2 on Queen of Alberni

June 14, 2021

Minor release: new drivers and bug fixes

Tickets Released: Oceans 2.0: 21.05.003 (accessible to internal users only). Total: 10.

Bug

  • [DMAS-64666] - Clicking on the "Click Image to Enlarge" link in preview just shows a spinner
  • [DMAS-64705] - NullPointerException when trying to view onc-internal user group
  • [DMAS-64707] - 2,800 + ERROR messages on eewshore1 per day - failure to connect

Task

  • [DMAS-57987] - Change DataProductDelivery service calls to AcousticDataViewerImage in Acoustic Data Viewer
  • [DMAS-64709] - DataProductPermissionService logging debug info at INFO level

Implementation

  • [DMAS-64459] - Back-end support for attribute value filtering
  • [DMAS-64640] - Basic Driver for ONC Profiling Winch
  • [DMAS-64700] - Rollback batch task reprocessing code in QA
  • [DMAS-64702] - Please, remove CODAR netCDF data product for radials from Data Search (temporarily)

Bug (ST)

  • [DMAS-64234] - Timestamps for PAMGUARD files not correct

June 9, 2021

Minor release: derived sensor cache bug (shorestation and task only - no downtime)

Tickets Released: Oceans 2.0: 21.05.002 (accessible to internal users only). Total: 1.

Bug

  • [DMAS-64673] - sensorPeriodMap always empty in DataEnrichmentCacheModuleImpl

June 8, 2021

Minor release: SeaTube auto-save bug fixes and improved logging

Tickets Released: Oceans 2.0: 21.05.001 (accessible to internal users only). Total: 5.

Bug

  • [DMAS-64368] - Shorestation ERROR logs without device IDs
  • [DMAS-64628] - Auto Save feature is not working in live mode
  • [DMAS-64654] - capture time stops working in live onship mode
  • [DMAS-64665] - Auto Save feature in live mode wtih onship layout creates annotations with the same timestamp

Implementation

  • [DMAS-64631] - Log more information during video export

June 2, 2021

Major release

Maintenance and Production Developer

  • Bug / Production Developer tickets, including QAQC bug fixes
  • Search tree and Data Search map loading performance improvements
  • DFO expedition page on ONC website
  • Data preview update to keep SOO plots indefinitely
  • Disable emails for data searches from anonymous users

Instruments

  • Multiple queues project (significant progress, not deployed)
  • Driver / parser bug fixes and support

Earthquake Early Warning

  • OSGi modularization (in-progress)
  • Python version of EEW end user software

Data Products

  • State of Ocean data products: added a levelled pressure externally derived sensor, fix for CSV column headers
  • Search automation improvements: update metrics to consider sensor-level mappings, fix metrics discrepancy, add test cases

Data Player

  • Bug fixes

Community Fishers Phase 2

  • See CF app version CF.3.2.6
  • Bug fixes + support

SeaTubeV3

  • DFO expedition support
  • NOAA Capstone annotation ingestion (in-progress)
  • ONC Sea Tube search by attribute values
  • Bug fixes

Annotations & Geospatial Search

  • Updated resources service to support hierarchical structure
  • Base components for annotation filters and filter groups, specific filters, etc (in-progress)

CIOOS

  • Prevent inactive datasets from being ingested by CKAN
  • CODAR/complex data support and marine gazetter design (in-progress)

Tickets Released: Oceans 2.0: 21.05.000 (accessible to internal users only). Total: 82.

Bug

  • [DMAS-41962] - Logout redirect makes next login unsuccessful if not logged in yet
  • [DMAS-51309] - Search automation metrics report a different number (more) of comparison failures than what the report shows
  • [DMAS-54353] - Fix broken tests in checkPortStatus of SCUAcquisition
  • [DMAS-55504] - State of oceans climatology CSV product header / data order messed up
  • [DMAS-58153] - STRAW timeout issue causing some data to be logged as command responses
  • [DMAS-64103] - Fix failing UI tests in Geospatial Map
  • [DMAS-64180] - Playlist Sharing link does not work
  • [DMAS-64205] - Pro-Oceanus CO2-Pro CV pCO2 driver randomly leaves idle state
  • [DMAS-64289] - Fix failing ui tests on DeviceDetails because of bad xpaths
  • [DMAS-64293] - Fix failing FileManagement.checkFileArchiverService() failing (manual pass FM.TC.119)
  • [DMAS-64302] - "Add User defined Taxonomy" is visible to anonymous users
  • [DMAS-64335] - When a UI test suite finishes, an empty Chrome window with the URL "data;," is left open
  • [DMAS-64346] - Inactive ERDDAP dataset metadata should not be ingested to CKAN and CIOOS portals
  • [DMAS-64429] - PSF data (IS-stations) not plotting in Geospatial Map (May 11th)
  • [DMAS-64475] - fix failing tests in TaskDefinition
  • [DMAS-64486] - Data Preview Links covering State of Ocean plots
  • [DMAS-64539] - DMAS Search Failed Notification: 26-May-2021 19:25:44 UTC, AML CTD Plus X 50334, Aligned and Depth-Binned Profile Data (On-Demand), SearchHdrId 8677842, UserId 48660
  • [DMAS-64543] - NOAA Logger - Admin (df21) does not have write permission to Attribute Management Page
  • [DMAS-64547] - Add the DFO station and JVM to the database
  • [DMAS-64576] - Acoustic Data Viewer ADCP Toolbox Options onSubmit not working
  • [DMAS-64578] - qaeewshore1 fails to start on release branch
  • [DMAS-64579] - NoaaDeviceTests cannot log in
  • [DMAS-64584] - Fix Topology bug when device is disconnected before setup starts
  • [DMAS-64585] - dfo topices missed in mq.properties
  • [DMAS-64586] - cruiseId not being passed to DeviceAction Maintenance page
  • [DMAS-64587] - connection service is null for qadivelogger3.onc.uvic.ca
  • [DMAS-64589] - Buttons not inheriting taxon information in DEMO
  • [DMAS-64591] - QA Device Console doesn't show device uptime or last reading date
  • [DMAS-64594] - Device console quick plot doesnt load in QA
  • [DMAS-64601] - A running search cannot be cancelled from a Cart in prod or QA
  • [DMAS-64613] - Casts detected in QA but not PROD. Please investigate
  • [DMAS-64626] - df20 cannot make annotations on dive 234

User Story

  • [DMAS-53404] - As a data player user, I want to know where data is available for devices
  • [DMAS-58049] - As a DMAS request admin, I would like to categorize the requests

Task

  • [DMAS-46744] - Update the CAP signature to use RSA SHA 256
  • [DMAS-54048] - Add "pressure-leveled" derived sensor to State of the Oceans matlab file
  • [DMAS-57870] - Enable hovertext showing full label for Buttons
  • [DMAS-64250] - Update QaDeviceTests for 2021-04-30
  • [DMAS-64256] - Write Regression Tests for Data Availability Component in ADV
  • [DMAS-64259] - Write SQL for androidlog and annotation file FTP changes in DMAS-58045
  • [DMAS-64314] - Modify Data Preview search tree trimming to keep SOO plots in data preview indefinitely
  • [DMAS-64374] - Create Python version of the EEW end user software
  • [DMAS-64395] - remove eew bamfield devices from qa post refresh script
  • [DMAS-64419] - Clean up parsing of SystemProperty.Location
  • [DMAS-64434] - Add Missing Test Cases for Data Product Formats
  • [DMAS-64442] - Cast Preview Plots should fallback to searchresult with searchresultstatusid 4 if 2 cannot be found
  • [DMAS-64444] - Improve logging in the correlator
  • [DMAS-64496] - Update Search Automation metrics to include sensor mappings
  • [DMAS-64517] - Redirect STV2 to Expedition Management
  • [DMAS-64550] - Improve logging for outdated RDI file generation
  • [DMAS-64553] - Upgrade ChromeDriver to version 91

Implementation

  • [DMAS-57239] - Extract DeclarativeDevice into a separate osgi bundle
  • [DMAS-57744] - Split ca.uvic.dmas.core.calculation.jep.api into an API/Impl pair
  • [DMAS-64107] - Implement sending EEW notifications over activemq
  • [DMAS-64138] - merge mq management code into master
  • [DMAS-64203] - Update ResourceService to return hierarchically structured resource data
  • [DMAS-64204] - Implement Data Availability Component in DataPlayerForm
  • [DMAS-64207] - Create a Date Filter component
  • [DMAS-64216] - Create Source Filter for Annotation Search
  • [DMAS-64376] - Create DFO logger and logger admin groups using SQL
  • [DMAS-64377] - Support DFO organization in Expedition Maintenance
  • [DMAS-64378] - Allow DFO logger admins to have Read Write privilege for Attribute and Taxonomy pages
  • [DMAS-64379] - Allow DFO loggers and DFO logger admins to have RW privilege for Quick Button page
  • [DMAS-64380] - Create a separate tree node for DFO in Expedition Management page to hold all DFO expeditions
  • [DMAS-64381] - Support same permission / configuration with ONC for SeaTube annotation CRUD operations
  • [DMAS-64382] - Allow DFO logger admins to have Read Write privilege for Bathymetry page
  • [DMAS-64383] - Support DFO onship server ST related data synchronization
  • [DMAS-64396] - Set up DFO test users
  • [DMAS-64436] - Front end changes for dive deletion
  • [DMAS-64441] - Allow DFO logger admin to manage DFO loggers
  • [DMAS-64445] - Update front-end to handle DFO organization details
  • [DMAS-64472] - Extract references to logger and logger admin groups to an enum
  • [DMAS-64480] - Add a toString to DeviceActionForUI
  • [DMAS-64482] - refactor EventReactionFactory to get reactions as prototypes
  • [DMAS-64534] - BPRZero parser

Test

Bug (ST)

  • [DMAS-64186] - Data Search tests cause Out of Memory errors in Chrome
  • [DMAS-64198] - UI tests sometimes fail to log in
  • [DMAS-64233] - Unexpected response from TicketManagerService creates a snackbar with "{}"
  • [DMAS-64435] - Fix DiveListingService's delete method
  • [DMAS-64468] - Different page content for different user.
  • [DMAS-64469] - DFO loggs can't create annotations

May 25, 2021

Minor release: search tree maintenance and device console bug fixes

Tickets Released: Oceans 2.0: 21.04.003 (accessible to internal users only). Total: 4.

Bug

  • [DMAS-64315] - Extremely slow loading times for Data Search and Plotting Utility preventing access
  • [DMAS-64499] - Site device tab in the Searchtree mainteanance page of Oceans 2.0 doesn't show any datefrom of sitedevices
  • [DMAS-64504] - device console is quite slow in prod with 21.04.002
  • [DMAS-64505] - Search Hydrophone Page isn't loading

May 20, 2021

Citizen Scientist Android version CF.3.2.5 for Community Fishers Project

Improved backup to Google Drive, support for Android 10 and new tablets, improved date and GPS handling, release note viewing and update notifications, bug fixes

Tickets Released: CF.3.2.5 (accessible to internal users only). Total: 17.

Bug

  • [DMAS-57748] - Community Fisher Tablet outputs future date in commandData
  • [DMAS-57840] - AML-6 Data not downloading - :error data not found"
  • [DMAS-64457] - GPS Date Comparison Dialog box inconsistent bolding of date in message
  • [DMAS-64460] - CF App Google Account Sign is not working

User Story

  • [DMAS-23434] - As a Pacific Salmon foundation person, I would like to have enhanced data security
  • [DMAS-57262] - As a Citizen Scientist, I would like to have a notification when the app is ready to be updated, and be able to view release notes

Task

  • [DMAS-57839] - AML-6 Powering Off - connections
  • [DMAS-58045] - Send Annotation files and Androidlog files to different directories In FTP server
  • [DMAS-64104] - As a Community Fishers user, I would like a tablet model of SM-T500 to be registered with the CF app
  • [DMAS-64109] - Please update the CF app so that it supports Android 10
  • [DMAS-64211] - CF App needs to mitigate users from sampling with incorrect tablet dates
  • [DMAS-64443] - Release Community Fisher App Version CF.3.2.6
  • [DMAS-64491] - Use Release Google API Keys in release APK for CF Android App

Implementation

  • [DMAS-57316] - Streamline process of uploading backed up data to Google Drive
  • [DMAS-57817] - Show notification if the app has an available update
  • [DMAS-57828] - Display Release Notes Inside of App
  • [DMAS-57872] - Update API Keys Using New ONC Dev Google account


May 19, 2021

Minor release: further performance improvements for search trees, add loading indicators, bug fixes for task management, SeaTube, Community Fishers

Tickets Released: Oceans 2.0: 21.04.002 (accessible to internal users only). Total: 19.

Bug

  • [DMAS-58255] - Can't edit some annotations in SeaTubeV3
  • [DMAS-58256] - Some button sets in Annotation Entry dropdown correspond to wrong button set
  • [DMAS-64341] - Job #337 failing to generate DOIs for piggyback devices
  • [DMAS-64347] - Error adding data products to cart in Data Search by Location for piggybacks
  • [DMAS-64365] - Task management paging is broken, not showing all of the tasks
  • [DMAS-64387] - Add a spinner for the loading of the Search Tree
  • [DMAS-64388] - Anonymous searches creating failing search complete emails - disable emails for anonymous users
  • [DMAS-64417] - Shorestations failed to start in QA with release/21.04.000
  • [DMAS-64426] - DMAS Search Failed Notification: 12-May-2021 04:00:24 UTC, Conception Bay-Holyrood Bay Underwater Network, Nortek Daily Currents Plot, SearchHdrId 8580952, UserId 15356
  • [DMAS-64427] - Start Date displayed on Qaqc Auto Test Details page shows current date, not start date of test
  • [DMAS-64446] - Request Support link throws an error

Task

  • [DMAS-64298] - Please investigate why the scheduled job 340 (Cast Ingestion) is throwing up an error once it was enabled to run on schedule yesterday
  • [DMAS-64336] - Return searchresultstatusid 4 when providing matlab-generated products in the case of no data found

Requirement

  • [DMAS-64089] - Create requirements for no-video annotation user choices

Design

  • [DMAS-64090] - Design dialog for no-video annotation user options

Implementation

  • [DMAS-64389] - Reduce the data overhead in the searchtree by excluding non-searchable nodes/data
  • [DMAS-64394] - Reduce the data overhead in the searchtree by excluding unused metadata
  • [DMAS-64425] - Improve DeviceService Instruments by Category loading time by eliminating excess cache iteration
  • [DMAS-64440] - Improve ONCKmlService search tree loading time by eliminating excess cache iteration

May 11, 2021

Minor release: performance improvements for search trees (Data Search and Plotting Utility), instrument search failures, permissions fix for geospatial map and more

Tickets Released: Oceans 2.0: 21.04.001 (accessible to internal users only). Total: 20.

Bug

  • [DMAS-64118] - Search Tree on Plotting Utility is verrry slow to load
  • [DMAS-64238] - miss or overlap qaqcresult for deviceid=1003 and qaqcid=1301 after qaqcreprocess
  • [DMAS-64254] - QaqcAutotestDetails endDate is 1970-01-01 in QA
  • [DMAS-64257] - Tests failing in UserReplication
  • [DMAS-64303] - DMAS Search Failed Notification: 05-May-2021 21:25:41 UTC, SeaBird 43 Oxygen (S/N 1807), Time Series Scalar Plot, SearchHdrId 8572042, UserId 94080
  • [DMAS-64324] - The timestamp line of multi sensors chart in ST stop working
  • [DMAS-64342] - SensorPlot in SeaTubeV3 keeps resetting the view of the graph when zooming / panning
  • [DMAS-64384] - ONSHORE1 failing to synchronize some annotations

User Story

  • [DMAS-64232] - As a Community Fisher user, I want cast data previews to respect data agreements.

Task

  • [DMAS-64240] - As a data steward, I would like to be able to see more than 5 cables in the pagination

Implementation

  • [DMAS-64093] - Implement Filter and FilterGroup components
  • [DMAS-64149] - Update the backend to accept issue categories
  • [DMAS-64150] - Add issue categories to the UI
  • [DMAS-64271] - Update UI tests
  • [DMAS-64283] - Add permissions check for cast operation in DataPreviewService
  • [DMAS-64323] - Do Not Display Error snackbar if DataPreviewService returns an error
  • [DMAS-64390] - Improve searchtree loading time by eliminating excess manager startup
  • [DMAS-64393] - Improve search tree filter loading time by eliminating excessive cache iteration

Bug (ST)

  • [DMAS-64269] - Ingester does not set creation and modification information with the identifier's
  • [DMAS-64340] - Ingester test sometimes fails on Jenkins

May 5, 2021

Major release

Maintenance and Production Developer

  • Email notification for Data Search
  • QAQC related tickets
  • Bug / Production Developer tickets
  • Migration of several pages/UI to modern REACT framework

Instruments

  • Multiple queues project (significant progress, not deployed)
  • PAMguard features: batching, external user access, improvement performance

Earthquake Early Warning

  • Added a second protocol for EEW client and other improvements for modularization

Data Products

  • Nortek current plot ensemble averaging - fixes a number of recently detected issues with the plots
  • FLAC support in PAMguard pre-processor
  • CODAR improvements: mercator projection, plot limits and titles
  • CF support: multiple deployment bug, descriptive attributes, crossing midnight, re-arrange of cor file columns and labels
  • Search automation related improvements: fix out of memory errors for disjoint scalar data, very slow plotting for min/max plots, support for 2nd QA, exclusion list for devicecategories

Data Player

  • Changes to persist Toolbox Options between mods
  • Changes to update Toolbox Options after device change
  • Caching (in-progress)
  • Testing and operationalizing Matlab as a service (in-progress)

Community Fishers (Now in Phase 2)

  • Clock issues in Android tablets
  • Remove auto-generation of tickets for bad or unassigned casts
  • Allow map polygons be id-able for testing
  • Tweek cast endpoints in cast detection MATLAB code
  • Data restrictions (in-progress)
  • Bug fixes + support

SeaTubeV3

  • Oceans 2.0 / SeaTube Help Desk improvements
  • Capstone annotation ingestion
  • Video play choice dialog for missing video
  • Bug fixes 

API & Annotations & Dashboards

  • External API improvements
  • TypeScript pilot project in REACT framework
  • Migrate and build a new & improved annotations search page in REACT (in-progress)
  • Automated UI test improvements/experiments with Cypress
  • Dashboards bug fixes

CIOOS

  • Greatly improve performance of ERDDAP Management
  • Synchronous service for Data Products (a one-call alternative to dataproductdelivery) (in-progress)
  • ERDDAP service as a source (in-progress)
  • Fix issues with French text

Tickets Released: Oceans 2.0: 21.04.000 (accessible to internal users only). Total: 124.

Bug

  • [DMAS-57594] - sort by feature in IP tab of Device Details page is broken
  • [DMAS-57614] - All Screenshot UI tests are Failing
  • [DMAS-57680] - ErddapManagement page is taking a long time to change datasets.xml
  • [DMAS-57735] - Certain regular expression verifications in web service tests can block the automation server from running new tests
  • [DMAS-57815] - Powerable Status = Never not working correctly in DeviceConsole
  • [DMAS-57820] - the sort feature under reprocess group in batches isn't actually sorting properly by status
  • [DMAS-57918] - Investigate possible inaccurate data rating on TEMPO-MINI causing search failures
  • [DMAS-58084] - fix automatic merge failure from release to master
  • [DMAS-58104] - UI tests haven't completed since March 10
  • [DMAS-58109] - ISO French Abstracts showing corrupt characters due to encoding errors
  • [DMAS-58113] - DMAS Search Failed Notification: 22-Mar-2021 19:27:01 UTC, JASCO M36-V35-100 Hydrophone E000029, Hydrophone Spectral Data, SearchHdrId 8273649, UserId 42732
  • [DMAS-58131] - As an engineer, I am struggling to use the new Device Search interface
  • [DMAS-58142] - Buggy save behaviour in Demo sometimes causing page to hang
  • [DMAS-58204] - In SeaTubeV3, annotations that aren't within a video file can be clicked, but clicking doesn't do anything except highlight the annotation
  • [DMAS-58211] - Test failing in CruiseManagement
  • [DMAS-58212] - Test failing in DiveManagement
  • [DMAS-58214] - UI Tests Failing in GeospatialMap
  • [DMAS-58220] - Fix failing SearchTreeMaintenance UI tests
  • [DMAS-58230] - Fix failing test in dataPreviewManagement
  • [DMAS-58267] - DataViewer UI Tests Failing
  • [DMAS-58274] - ADV Hydrophone Form Not Selecting Radio Button Before Images are loaded
  • [DMAS-58378] - Acoustic Data Viewer not Persisting Toolbox Options
  • [DMAS-58384] - When powering J10 on JB-18, DMAS sets the gf_breaker_limit to 0 and 0, causing it to fault
  • [DMAS-58397] - ADV ADCP Form reset handler not resetting Form Fields to defaults
  • [DMAS-64078] - Toolbox does not update between devices without being closed and reopened
  • [DMAS-64098] - Deleting an Item doesnt work from cables page
  • [DMAS-64110] - DMAS Search Failed Notification: 16-Apr-2021 15:54:31 UTC, null, SeaTube Annotation Export, SearchHdrId 8543030, UserId 44142
  • [DMAS-64120] - Fix electrical rating not displaying in the ui after updating
  • [DMAS-64132] - Fix failing tests in DeviceDetailsTest
  • [DMAS-64134] - why sourcesensorid is null after qaqcreprocess for DI 22777
  • [DMAS-64137] - Applied QAQC tab on sensor maintenance not displaying any values
  • [DMAS-64166] - DMAS - "User Directory" redirects to ftp.neptunecanada.ca, instead of ftp.oceannetworks.ca
  • [DMAS-64174] - Build failed when deploying to QA
  • [DMAS-64187] - Investigate sporadic search failures in QA search automation with high volume min/max data
  • [DMAS-64210] - Fix failing ui tests on sensor maintenance
  • [DMAS-64217] - Fix failing ui tests in SiteDeviceMaintenanceTest
  • [DMAS-64224] - Data Search for COR files By Location not working, even though these data are populating geospatial map
  • [DMAS-64241] - Fix failing UI tests in Plotting Utility
  • [DMAS-64243] - Error when generating multiple data products
  • [DMAS-64249] - Internal Users in QA are not able to create annotations
  • [DMAS-64253] - Bug in videoFileQAQC job caused by new code for 2nd QA
  • [DMAS-64255] - Test failing in SearchTreeMaintenance
  • [DMAS-64260] - Fix failing tests in generationAndDisplay
  • [DMAS-64288] - Can't add derived sensor definition if none exist

User Story

  • [DMAS-25060] - As a Nortek daily current plot user, I would like the plots to be resampled properly to prevent errors in data gaps, backscatter averaging and anti-aliasing
  • [DMAS-56819] - As a Data Specialist I would like the ability to modify the datefrom of a QAQC test attribute through the UI
  • [DMAS-57154] - As a Data Specialist, I would like an automated PVCS QAQC test
  • [DMAS-57343] - As a user from NOAA, I would like to easily report and keep track issues found in Ocean's 2.0
  • [DMAS-57761] - As a data specialist, I would like to Improve the maintainability of the correlator event expression
  • [DMAS-57819] - As a Data Search user, I would like an email notifying me when my searches are complete
  • [DMAS-57822] - Keep files in /ftp/pub folder 21 days, instead of 14 days
  • [DMAS-57970] - As a software developer i'd like the tabs on Sensor Maintenance to be updated to React

Task

  • [DMAS-45798] - Remove debugging code.
  • [DMAS-46372] - As a User Management User, add a obvious way to add/delete user groups
  • [DMAS-50167] - Formsections for hydrophones spectrograms and spectral MAT files
  • [DMAS-54948] - Add plot type to CODAR plot titles
  • [DMAS-57558] - Test and support the WAV to FLAC source file transition
  • [DMAS-58026] - Add ui test to check IP link on device console page
  • [DMAS-58059] - As a Data Steward, I would like the columns in Task Monitor to be sortable
  • [DMAS-58062] - Remove residual budget pages
  • [DMAS-58125] - provide details of algorithm used to give positional coordinates for SeaTube V3 annotations
  • [DMAS-58141] - Mockup Annotation Search
  • [DMAS-58157] - Reorganize oceans next menu so there are groups of items
  • [DMAS-58191] - Change date logic regarding cruises and topology entries
  • [DMAS-58199] - Define Filter component "interface"
  • [DMAS-58236] - Fix and update broken links on oceannetworks.ca to State of Ocean plots
  • [DMAS-58246] - Sort Cruise Name dropdown list alphabetically in DeviceAction Maintenance page
  • [DMAS-58251] - Why executing time is far behind of createddate of loading cache command in prod?
  • [DMAS-58254] - Create skeleton for annotations search page
  • [DMAS-58262] - Improve Automated Testing Documentation
  • [DMAS-58268] - Add Typescript to the Oceans-Next project
  • [DMAS-64083] - Add ui test to verify cruise dropdown is sorted correctly
  • [DMAS-64084] - Write UI tests for Cables page
  • [DMAS-64101] - Improve links under PNGs in Data Preview
  • [DMAS-64102] - Change CODAR plot projection to Mercator
  • [DMAS-64124] - Change Jenkinsfile to run jacoco coverage on onc-web
  • [DMAS-64126] - Change the default login/logout pages to not use the former CAS server
  • [DMAS-64140] - make ONCMatlab code in qa2 work
  • [DMAS-64142] - Change the data column names for lat and lon in the .cor data product
  • [DMAS-64145] - Change "Patrol name" to "Location" in the .cor file data product
  • [DMAS-64165] - Add an exclusion list of devicecategories to search automation metrics
  • [DMAS-64197] - Use the Search Tree Maintenance page object in Data Search tests
  • [DMAS-64209] - Update descriptions of CF pipeline device attributes to be ...descriptive

Requirement

  • [DMAS-58087] - Gather requirements
  • [DMAS-58247] - Create requirements for a video-focused predefined layout

Design

Implementation

  • [DMAS-57578] - Support FLAC as a source file for PAMguard
  • [DMAS-57950] - Add UI tests
  • [DMAS-57971] - Write tabs in react
  • [DMAS-57997] - Update UI to allow user to change date from
  • [DMAS-57998] - Update QaqcTestDetailService to accept datefrom
  • [DMAS-57999] - Update backend to use react version of tabs
  • [DMAS-58030] - Write sensor maintenance pages in react
  • [DMAS-58031] - Update backend for sensor maintenance pages
  • [DMAS-58164] - Implement Persistence handlers for the DafQueueServiceActivator
  • [DMAS-58168] - Update ui tests for sensor listing tabs and maintenance pages
  • [DMAS-58175] - Implement DAF Processing
  • [DMAS-58179] - script to insert qaqcformula and attributes
  • [DMAS-58180] - Add PVCS qaqc
  • [DMAS-58190] - Update taxonomy attribute management page to use FK violation information in error message
  • [DMAS-58226] - Update device action link on Cruise page
  • [DMAS-58237] - Clean up page model of SearchTreeMaintenance tests
  • [DMAS-58238] - Put updated search tree nodes directly in the cache without waiting for a full reload
  • [DMAS-58239] - Fix tests broken due to metadata changes
  • [DMAS-58240] - Update SearchTreeService access control to be based on AccessControlledWebService
  • [DMAS-58269] - Update oceans next code
  • [DMAS-58271] - Update UI tests for DeviceSearch
  • [DMAS-58272] - Update cables service create methods to return new id in payload
  • [DMAS-58282] - Write logic for Capstone annotation ingestion
  • [DMAS-64075] - Add/Update UI tests for Dashboard Management when Sharing RW permission
  • [DMAS-64087] - Code change for data search email notification
  • [DMAS-64097] - Write database scripts for email notification
  • [DMAS-64144] - Create service call to check other video resolutions given a timestamp
  • [DMAS-64170] - Implement automatic averaging for Nortek current plots
  • [DMAS-64172] - Update backend for Sensor Maintenance
  • [DMAS-64173] - Update oceans next code
  • [DMAS-64221] - Update documentation
  • [DMAS-64268] - Improvements on search complete email

Test

Bug (ST)

  • [DMAS-64135] - Complex Data Product Issues on Nortek 1 MHz Profiler at DDL
  • [DMAS-64158] - Potential infinite loops in Dashboards
  • [DMAS-64171] - Infinite recursive loop in DashboardDisplay when not logged in
  • [DMAS-64252] - handle the case of a single ensemble for Nortek plots

Documentation

  • [DMAS-58096] - Make sure the main page of documentation is up-to-date

April 28,29, 2021

Minor release: MATLAB fixes for Community Fishers (no downtime)

Tickets Released: Oceans 2.0: 21.03.003,21.03.004 (accessible to internal users only). Total: 1,1.

Task

  • [DMAS-64212] - Please investigate why aren't casts being detected for pipeline PROD run: data from 23 Apr 2021
  • [DMAS-64219] - Please investigate why no corrected data were generated from Job 339 for detected Pacheedaht casts

April 21, 2021

Minor release: ERDDAP datasets fix, SeaTube video resolution, dashboard and PAMguard fixes

Tickets Released: Oceans 2.0: 21.03.002 (accessible to internal users only). Total: 5.

Bug

  • [DMAS-58260] - Switching resolution in some SeaTube videos doesn't do anything
  • [DMAS-58278] - Can only change video resolution once, then Settings are not available
  • [DMAS-58394] - Share Dialog in dashboard table not sharing RW

Task

  • [DMAS-58028] - Attempt to generate or view the ERDDAP datasets.xml returns a maintenance page

Implementation

April 14, 2021

Minor release: various fixes and features including: Data Preview GIF player improvement, SeaTubeV3 layout, Community Fishers fixes

Tickets Released: Oceans 2.0: 21.03.001 (accessible to internal users only). Total: 19.

Bug

  • [DMAS-58241] - CODAR GIFs are bi-daily not daily as intended
  • [DMAS-58244] - Getting resource Id for devices that are currently deployed is failing.
  • [DMAS-58249] - In ST Multi sensor chart is using local time, we need UTC timestamp
  • [DMAS-58253] - Fix QaqcTestDetails so that values can be saved properly
  • [DMAS-58257] - DMAS Search Failed Notification: 08-Apr-2021 20:23:42 UTC, Inshore Profiling System-Profiling Instrument Package, Cast Scalar Multi-Profile Plot, SearchHdrId 8536199, UserId 22446
  • [DMAS-58263] - Fail to add DateTo information for existing IP
  • [DMAS-58273] - DMAS Search Failed Notification: 09-Apr-2021 16:46:17 UTC, AML CTD Plus X 50241, Aligned and Depth-Binned Profile Data (On-Demand), SearchHdrId 8536670, UserId 94330
  • [DMAS-58276] - Video files at the start of dives are not played in SeaTubeV3

User Story

  • [DMAS-58233] - As a DFO CODAR Data Preview user, I would like to load lower resolution gifs for faster load times
  • [DMAS-58245] - As a dive logger, I would like a ST layout to display larger video.

Task

  • [DMAS-58196] - Create locations for DMAS + ActiveMQ for new ferries
  • [DMAS-58242] - Add small GIFs for Data Preview to work with the new GIF player
  • [DMAS-58393] - As a Data Steward, I would like to stop the automatic generation of JIRA tickets for Unassigned and Bad casts

Design

  • [DMAS-58264] - Create design for a video-focused predefined layout

Implementation

  • [DMAS-58248] - Add new video-focused predefined layout into STV3
  • [DMAS-58252] - Front-end code change for gif player to use smaller sized gifs

Test

  • [DMAS-57976] - Add web service tests to cover resampling changes
  • [DMAS-58207] - Create regression test for Gif Player

Bug (ST)

  • [DMAS-58221] - Update styling and functionality following testing

April 7, 2021

Major release

Maintenance and Production Developer

  • Bug fixes including QAQC inheritance
  • ONC website support, including Wiring The Abyss updates for the maintenance expedition
  • Migration of several pages/UI to modern REACT framework: extension + item pages
  • State of Ocean/Environment/Climate plots now configurable
  • Animated GIF player and image tiling for Data Preview

Instruments

  • Minor modifications to straw drivers and parsers.
  • Fine tuning new compass feature on Kongsberg driver to work with data products.
  • Minor modification to ASL MUD driver, check and turn off verbose mode.
  • Cancel blocked processing on shore station: Systems can now cancel blocked processes on the shore station such as the parsing routine blocking. This applies to all processes after a message is dequeued and before it is queued to the archiver.
  • Minor improvement to logging at shore station.
  • New features for binary parsers. Used in ASL MUD. Binary parsers now work with variable length records and allow specifying sensor positions relative to the payload instead of the packet. Changes wrt to ASL Mud documented here Parsing Binary Data With Dynamic Packet Size, general documentation for declarative parsers updated: Declarative Data Parser Definition File Format (internal links)
  • Improved logging on shore station event detection routine.
  • Multiple queues project (in-progress)
  • Users can now create PAMguard batches through the task management screen, Batch section.

Earthquake Early Warning

  • Correlator event expression simplification.  EEW event detection expression now uses a more generalized device selector expression.
  • Titan driver modified so build date can be parsed. This feature requires deployment to all titan locations, not sure of the priority for deployment.

Data Products

  • NEW CODAR netCDF products for Combiner + Radial stations
  • RDI fix for correlation screen option being less than onboard correlation screen
  • ASL mud improvements: .01a files to use DMAS time not device time, handle varied orientation, improve handling of non-standard data, improve logging
  • Search automated testing improvements (internal use only)
  • Bug fixes + support

Data Player

  • No longer uses archived hydrophone images on initial load (to avoid old incompatible images)
  • Toolbox now programmatically gets dataproduct options for a given device
  • Fixed bug: plot times on ADCP current plot do not align with timeline in dataviewer
  • Initial changes in place for image caching (will work with Systems to activate in April)
  • Testing and operationalizing Matlab as a service (in-progress)

Community Fishers

  • Pipeline now triggered to run cast detections by raw data ingestion (not activated)
  • Data products to use search tree node name for station name instead of search tree node code
  • Geospatial Map returns most recently completed cast preview data products, not the most recent
  • Only generates Cast Preview Plots if older than three days or new cast is at SearchTreeNode
  • Fixed bug: automated creation of JIRA tickets by job #341
  • Androidlog files are no longer being archived
  • Pipeline now sends e-mail when a bad file is encountered

SeaTubeV3

  • ONC SeaTube support
  • Oceans 2 Help Desk improvements
  • Sensor plot now uses the dashboard plotting widget with support for plotting multiple sensors at the same time
  • Bug fixes 

Dashboards

  • Fixed bug where it wasn't possible to select a run folder in a User Defined Task Widget
  • Can share a Dashboard to a user with Edit permissions
  • Correct title in Latest Readings Widget

API & CIOOS

  • Fixed bug where an incorrect end date was put in a CKAN record
  • Return data set Id from the ErddapManagementService create operation

Tickets Released: Oceans 2.0: 21.03.000 (accessible to internal users only). Total: 158.

Bug

  • [DMAS-50249] - Search automation falsely reports failure for AquaTec CSV data product
  • [DMAS-54242] - EEW Test Notification service logging error
  • [DMAS-56636] - failed export json format with image in QA
  • [DMAS-56757] - Search automation report shows data product .json expected files in the result.json column
  • [DMAS-57319] - CKAN record Temporal Extent End dates are inaccurate
  • [DMAS-57337] - jobid link on CameraControl page should be linked to taskmanagement page, not schedulerconsole
  • [DMAS-57340] - In some cases, QAQC reprocessing fixes incorrect QAQC flags for all sensors but Density and Sound Speed
  • [DMAS-57534] - How do we delete qaqcResult dateTo is beginning of next date in reprocess or qaqcreprocess?
  • [DMAS-57546] - qaqcreprocess does not handle "duplicate" qaqcresults correctly
  • [DMAS-57555] - question about how qaqcreprocess handle overlap for station level qaqc
  • [DMAS-57638] - User defined task widget doesn't show list of runs
  • [DMAS-57724] - Test automation is logging lots of vague NullPointerExceptions in GetWebServiceMetricsMVCResourceCommand
  • [DMAS-57734] - When running automation tests, the tool prints a number that is implied to be the number of pending tasks, but is actually the total of historical + pending tasks
  • [DMAS-57790] - need support for millisecond while request the video stream
  • [DMAS-57795] - Cache load of event definitions throwing null pointer
  • [DMAS-57800] - The automation tool fails to deploy and logs a hard-to-understand exception if it can't connect to qapgsql
  • [DMAS-57802] - Fix logging of configuration change ASL data products
  • [DMAS-57830] - Need update dateto of current ip when add a new ip for the same device
  • [DMAS-57833] - should not allow one ip active for mutliple devices
  • [DMAS-57868] - Changes to a Taxon cause its children to vanish from the taxonomy tree until the page is refreshed
  • [DMAS-57891] - Parser clogged with straw
  • [DMAS-57895] - Latest readings widget config title incorrect
  • [DMAS-57900] - Many DA Tests for device control failing seemingly due to hardcoded values
  • [DMAS-57942] - Data Search "Data Product Selection" tab is greyed out when it shouldn't be
  • [DMAS-57965] - When an anonymous user navigates to a page that doesn't exist, ServletUtil logs a NullPointerException
  • [DMAS-57979] - ADCP plot scrolling mechanism is not working
  • [DMAS-58015] - Button Sets no longer seem to work when using Autosave Feature in v3
  • [DMAS-58033] - All QA hosts log error "NoCacheConfigException: Cache ErddapSensorAttribute is not defined in ehcache.xml" on startup
  • [DMAS-58053] - QA: Error on Taxonomy page when clicking taxonomy root node
  • [DMAS-58068] - DMAS Search Failed Notification: 17-Mar-2021 08:52:19 UTC, Geosense Short Period Seismometer 118, Seismometer Data, SearchHdrId 8189321, UserId 42732
  • [DMAS-58075] - speed_over_ground QAQC test for Ferries are failing since Mar 12 00:00 UTC
  • [DMAS-58082] - Updating a taxon name doesn't work unless there is something in the "Common Names" field
  • [DMAS-58083] - Cannot delete an attribute in Attribute Management if it is a "Select" type containing options
  • [DMAS-58091] - When I open a SeaTube dive as an anonymous user, I see an error snackbar "Error: Network error"
  • [DMAS-58112] - Host with role TASK_USER_DEFINED logs an error while starting batch tasks during system startup
  • [DMAS-58116] - Fix AndroidUploadTest MQ URLs
  • [DMAS-58118] - CacheLoaderConfig.dependencies has misleading documentation
  • [DMAS-58122] - Site Device Subset CF005-3953 has no corresponding aligned and depth-binned data
  • [DMAS-58139] - Error in Thomson Detided product with multiple deployments
  • [DMAS-58152] - Video timestamp is not match the annotation timestamp
  • [DMAS-58153] - STRAW timeout issue causing some data to be logged as command responses
  • [DMAS-58163] - ST V2 manual entry is not working
  • [DMAS-58166] - Taxonomy Deletion is displaying an error message even though the delete was successful
  • [DMAS-58171] - Data Viewer Screenshot Comparisons Failing
  • [DMAS-58177] - VPS Base driver caused pa shorestation to stop parsing data
  • [DMAS-58215] - Some Sea Tube related objects are not synced in QA between servers
  • [DMAS-58219] - Quick button page becomes blank while selecting Attribute as button type in QA
  • [DMAS-58231] - Fixing failing UI tests in DataPreview.GenreationAndDisplay
  • [DMAS-58243] - Stop infinite render loop if resource id not found in dataplayer

User Story

  • [DMAS-46363] - As a Dev, I would like to move or rewrite cables (Extensions and Items) to Infrastructure Management
  • [DMAS-52090] - As a Data Preview operator, I would like to add or remove State of Ocean/Env plots from various locations
  • [DMAS-53931] - As a DFO CODAR Data Preview user, improve the viewing of animated GIFs, particularly monthly plots
  • [DMAS-57231] - As a software developer, I'd like the /DeviceSearch page updated to React
  • [DMAS-57620] - As a software developer, I'd like the /DeviceActions page updated to React
  • [DMAS-57838] - Upgrade CF pipeline to ONLY run cast detections once all of the raw data has been ingested
  • [DMAS-57926] - Different Save behavior for adding a taxon in Taxonomy page and adding an attribute in Attribute Management page
  • [DMAS-58086] - As a System Admin, I do not want to archive androidlog files
  • [DMAS-58222] - As a NOAA admin, I would like to show a deprecation warning message to ST V2 users

Task

  • [DMAS-47462] - Implement improvement and document ErddapManagementService
  • [DMAS-48295] - Update the titan accelerometer to parse the build date as a device attribute
  • [DMAS-48611] - Property "serializable" on the CacheLoaderConfig annotation is unclear
  • [DMAS-51849] - Expand number of characters for Expedition Name
  • [DMAS-56055] - Activate NGinx caching for Hydrophone/Acoustic Data Viewer
  • [DMAS-57307] - Support using the Seatube demo server as a backend for Oceans Next in development
  • [DMAS-57313] - Write UI tests for the Help & Support feature
  • [DMAS-57333] - Refactor dashboard widget config in UI Testing
  • [DMAS-57423] - Add missing test cases for Data Product Formats
  • [DMAS-57518] - Fix failing GeospatialMap Jenkins UI Test Results
  • [DMAS-57527] - Refactor DataProductDeliveryServiceHelper to no longer use the aws jar
  • [DMAS-57570] - Add an exclusion list of dataproductformatids to search automation metrics
  • [DMAS-57629] - Make ADCP and Aquadopp device data available to the AID Viewer
  • [DMAS-57775] - Handle varied orientation per transducer and other issues for ASL MUD prototype in echosouder data products
  • [DMAS-57787] - Support dynamic naming and placement of State of Ocean/Env/Climate plots for Data Preview
  • [DMAS-57803] - Replace ASL echosounder internal time in .01a data products with DMAS time
  • [DMAS-57848] - Programmatically get dataproduct options for a given device in data viewer
  • [DMAS-57876] - Possible code refactoring for qaqc results deletion scheduled job
  • [DMAS-57902] - Excessive Logging by Parsers
  • [DMAS-57905] - update "Mail default recipient" in dmas.log
  • [DMAS-57925] - Need Taxonomy Attribute Group information while select an attribute in the multi attribute quick button
  • [DMAS-57936] - Update Community Fishers data products to use search tree node name for station name instead of search tree node code
  • [DMAS-57956] - As a dive logger, I want to see the full text of a taxon in the Annotation Entry pane
  • [DMAS-57969] - Return Most Recently completed Cast Preview DataProducts, not the most recent
  • [DMAS-57974] - Web service and servlets shouldn't call ServiceUtil inside loops
  • [DMAS-57977] - Only generate Cast Preview Plots if older than three days or new cast is at SearchTreeNode
  • [DMAS-58002] - Alphabetize button sets in the Quick Entry dropdown list
  • [DMAS-58011] - Update the FTP directory link the in Oceans2 menu to point to the new "FTP" location
  • [DMAS-58022] - Do not use archived hydrophone images on initial load
  • [DMAS-58025] - Upgrade ChromeDriver to version 89
  • [DMAS-58042] - Update RDI products to reflect that correlation screening is not effective below instrument WC value
  • [DMAS-58043] - make DatePerformed column in deviceaction database table not nullable
  • [DMAS-58046] - Send e-mail If an error Occurs During AndroidLog FTP job
  • [DMAS-58081] - ADV Hydrophone Options - Only use one set of radio buttons for custom or default options
  • [DMAS-58102] - Delete the code behind the YUI-based Site Device Listing page
  • [DMAS-58114] - Update UI Tests for ADV Hydrophone Toolbox radio button change
  • [DMAS-58124] - Provide more useful FK violation information to the front-end
  • [DMAS-58126] - Update STRAW B driver start sequence
  • [DMAS-58128] - please make auto UI test running starting at 12 noon localtime
  • [DMAS-58138] - Repackage QAQC Auto Test UI test page objects
  • [DMAS-58193] - Add UI Tests for DataViewer that Test scrolling forwards and backwards
  • [DMAS-58201] - CF Processing code is applying medfilt1(x,25) incorrectly at the endpoints, causing an underestimation of signal values

Requirement

  • [DMAS-46366] - Clarify requirements for moving part of Budget module into IM
  • [DMAS-58156] - Add requirements for the new chart

Implementation

  • [DMAS-28469] - Driver for ASL Acoustic Scintillation Device
  • [DMAS-48078] - Add instrument report page in dmas menu with appropriate permission check
  • [DMAS-56854] - Date Format Readings in Pamguard File Process
  • [DMAS-57206] - Batch Monitoring Page - Modify Add Batch function
  • [DMAS-57590] - Add additional TaxonomyMatrixAttributeService JUnit tests
  • [DMAS-57601] - Add the page affiliation to the support request
  • [DMAS-57645] - Write new React page for Device Actions
  • [DMAS-57646] - update backend for Device Actions
  • [DMAS-57674] - Update UI tests for DeviceActions
  • [DMAS-57706] - Update backend code for Cables component
  • [DMAS-57708] - Update frontend code for Cables component
  • [DMAS-57753] - Implementation for Idea #1 Widget Tiling
  • [DMAS-57763] - add support for new correlator event expression
  • [DMAS-57764] - Code Change to SOO Plot Job to allow targeting search tree nodes
  • [DMAS-57799] - Write database scripts for extension listing and item tables
  • [DMAS-57801] - Implementation for GIF Player
  • [DMAS-57843] - Add file attachments to the issue collector
  • [DMAS-57847] - add event definition json field to the event maintenance page
  • [DMAS-57856] - Limit the logging for DataPrevewGenerator errors
  • [DMAS-57858] - Implement netCDF format for CODAR QC data product
  • [DMAS-57916] - Schedule Cast Detection Job From ReceiverMessageServiceActivator
  • [DMAS-57927] - Make cast detection job non-singleton
  • [DMAS-57943] - String SEARCH_METRIC_QUERY_COVERED in MetricsQueries.java is poorly named
  • [DMAS-57961] - Fix Potential Race Condition In CastDetectionJob
  • [DMAS-57962] - Code change to update jobid on CameraControl page
  • [DMAS-57984] - Front-end changes for taxonomy deletion
  • [DMAS-58013] - Replace the "help" icon in the Jira formatting link with the text "Formatting help"
  • [DMAS-58032] - Variable length binary parser unit test
  • [DMAS-58036] - Link to the support request form from the status 500 servlet (the Kaboooom) page
  • [DMAS-58038] - Add an Edit option when sharing a Dashboard
  • [DMAS-58040] - dateperformed for deviceaction should not allow null
  • [DMAS-58054] - update UI test to cover dateperformed cannot be null
  • [DMAS-58060] - update UI test for related change in this user story
  • [DMAS-58064] - Write Task That Sends e-mail when a bad file is encountered
  • [DMAS-58065] - Write SQL to update Androidlog file FTP job
  • [DMAS-58066] - Clean up Velocity context and global javascript config
  • [DMAS-58105] - Increase the timeout of the daily test suite
  • [DMAS-58111] - Override default LayoutService permissions to support edit on dashboard...
  • [DMAS-58115] - Add startup script to Matlab codebase
  • [DMAS-58120] - Create temporary directory in /ncdata/shared for androidlog files
  • [DMAS-58121] - Write SQL to add 'local.destination.folder.name' parameter to Androidlog FTP job
  • [DMAS-58130] - Update references to ExtensionManager by Topology pages to reference and use new CableExtensionManaager
  • [DMAS-58132] - Implement multi-sensor chart into SeaTube
  • [DMAS-58155] - Support disabling cruise synchronization through the server startup script
  • [DMAS-58194] - Create servlet for page
  • [DMAS-58202] - Map CODAR netCDF
  • [DMAS-58209] - Remove/de-activate CF Cast Detection Triggering Feature from Release
  • [DMAS-58224] - Add deprecation dialog on STV2 page load with link to Expedition Management

Test

  • [DMAS-57960] - Update Event Maintenance page UI test

Bug (ST)

  • [DMAS-57710] - Search failure emails reporting the wrong URL for QA/dev Jira
  • [DMAS-58095] - Fix unit tests failing in the release branch
  • [DMAS-58099] - Taxonomy deletion should be atomic
  • [DMAS-58107] - Code change to restrict access for non read write users
  • [DMAS-58195] - Add formatting check to data preview
  • [DMAS-58235] - CODAR QC DP file naming issues detected by search automation

Documentation

  • [DMAS-46365] - Update documentation for Extensions in IM Module

March 26, 2021

Minor release: disable synchronization on demo.oceannetworks.ca

Tickets Released: Oceans 2.0: 21.02.007 (accessible to internal users only). Total: 1.

March 24, 2021

Minor release: bugfix for SeaTube taxon selection

Tickets Released: Oceans 2.0: 21.02.006 (accessible to internal users only). Total: 1.

March 19, 2021

Minor release: bugfix for SeaTube synchronization

Tickets Released: Oceans 2.0: 21.02.005 (accessible to internal users only). Total: 1.

March 18, 2021

Minor release: bugfix for SeaTube null value attributes in annotations

Tickets Released: Oceans 2.0: 21.02.004 (accessible to internal users only). Total: 1.

March 17, 2021

Minor release: SeaTube dive logging features for upcoming maintenance expedition

Tickets Released: Oceans 2.0: 21.02.003 (accessible to internal users only). Total: 22.

Bug

  • [DMAS-57675] - bug on device port editing interface for the in/out direction
  • [DMAS-57890] - Changing taxonomy should wipe out the selected taxon
  • [DMAS-57938] - Unable to Edit an annotation when it contains an attribute with "Select" values
  • [DMAS-57968] - Password field in Task Management not displaying values
  • [DMAS-57973] - Attempting to delete an "empty" taxon button freezes the page
  • [DMAS-57986] - TaxonButtonSetConfig page is mostly blank
  • [DMAS-57991] - IP link broken in DeviceConsole in QA/PROD
  • [DMAS-57994] - Button Set cloning isn't working
  • [DMAS-58012] - Error when closing annotations
  • [DMAS-58017] - tx_taxonomymatrixattribute_trx is empty
  • [DMAS-58029] - Job 341 Not Creating JIRA Tickets
  • [DMAS-58056] - QA: Attribute and group information blank

Task

  • [DMAS-57636] - Excluded matrix attribute displayed as local if not inherited
  • [DMAS-58004] - Set Resource Type and Resource to default after save an annotation
  • [DMAS-58023] - Validate a TTC when saving an annotation in the backend
  • [DMAS-58078] - Clean up extras in database from duplicate script run

Implementation

  • [DMAS-57206] - Batch Monitoring Page - Modify Add Batch function
  • [DMAS-57852] - Improve how TaxonomyAttributeLineService's get() method handles the operation parameter
  • [DMAS-57871] - Include the id in the response of the create method for TaxonomyAttributeService
  • [DMAS-57985] - Front-end changes for taxon button set deletion
  • [DMAS-58006] - Have TaxonomyAttributeService return groupId instead of groupName
  • [DMAS-58014] - Update Taxon Attribute Management page to use changed groupId parameter

March 15, 2021

Minor release: Driver and calibration features

Tickets Released: Oceans 2.0: 21.02.002 (accessible to internal users only). Total: 5.

User Story

  • [DMAS-20667] - As a scientist, I would like to have compass data acquired from Kongsberg Rotary sonars

Implementation

  • [DMAS-28469] - Driver for ASL Acoustic Scintillation Device
  • [DMAS-57981] - Implement additional binary parsing features in declarative parser.
  • [DMAS-57990] - Switch the heading tuple to magnetic heading
  • [DMAS-58005] - Modify ASL MUD driver to turn off verbose mode on driver start

March 10, 2021

Minor release: SeaTube features and various fixes

Tickets Released: Oceans 2.0: 21.02.001 (accessible to internal users only). Total: 20.

Bug

  • [DMAS-57864] - In Taxonomy UI, selecting the root taxonomy causes screen to go blank
  • [DMAS-57866] - Equipment Requirements attribute not selectable
  • [DMAS-57924] - Special attributes are in the wrong places while using the quick button
  • [DMAS-57930] - The attribute detail widget should be empty if a new group is created.
  • [DMAS-57954] - Since deployment 2021-03-04, eewshore1 will not send metrics

Task

  • [DMAS-57342] - Parse the Kongsberg SMB headings tuple
  • [DMAS-57923] - Need more data type while create a taxonomy attribute.

Implementation

  • [DMAS-57939] - Update foreign keys
  • [DMAS-57940] - Back-end changes to support taxonomy delete functionality
  • [DMAS-57941] - Back-end changes to support taxon button set delete functionality
  • [DMAS-57978] - get SitePosition from database only when cacheloading

Bug (ST)

  • [DMAS-57634] - Editable inherited comment attribute always saves on focus loss
  • [DMAS-57947] - Logging in redirects to /domain/Apps/theme/colors.css instead of the home page
  • [DMAS-57949] - Can't create issues from the new issue collector when not logged in
  • [DMAS-57957] - Not getting good compass heading values in new SMB files

March 4, 2021

Major release

Maintenance and Production Developer

  • Bug fixes including QAQC reprocessing, QAQC inheritance
  • ONC website support
  • Migration of several pages/UI to modern REACT framework (DeviceAction, new page Cables) (on-going)
  • Several other small improvements/features (in-progress)

Instruments

  • Wally - driver modified to match devices telemetry change in motor logging
  • Rayfin - take picture function in seascript now available
  • Straw - new status commands added, refinements to parsing.
  • Pro Oceanus - Burst mode enhanced to be more reliable
  • Seabird CTD with O2 piggyback - Driver enhanced to handle piggyback problems better
  • RBR Concerto Tilt Meter - Additional start up setting
  • BPR - Driver now support binary mode
  • AIS Source bug resolved
  • New syntax in calibration formulas where sensors can be referenced by sensor code and device attributes can be referenced by attribute code, instead of by sensorid and attributeid
  • New screen for uploading PAMguard configuration files
  • PAMguard batches are automatically scheduled, system will limit the number of concurrent PAMguard tasks

Earthquake Early Warning

  • jep refactored as a separate bundle. This is an optimization for EEW deployments and moves us closer to exposing the jep code publicly
  • Shore station - device being processed can be viewed through jconsole. Allows for quicker troubleshooting when the shore station is blocked
  • Improvements to PGD algorithm
  • Shore station threading and cache load issues

Data Products

  • Search automation improvements (in-progress)
  • Added ancillary data to RDI netCDF plus improvements
  • Kongsberg compass support
  • Support for ASL mud variant + overall AZFP improvements

Data Player

  • Fixed misalignment between image and timeline
  • Add more instruments to selection dropdown
  • Testing Matlab as a service (in-progress)

Community Fishers

  • ALM-6 with AMLx formatting
  • Help button with wiki links in Geospatial Map
  • Now able to save data off tablet to Google drive
  • Geospatial Map now uses Open Street Map tiles as default
  • Updated data search to handle multiple casts for .COR file data product
  • Multiple minor changes to Android Tablet App

SeaTubeV3

  • support adding multi attributes in a single quick button, Taxonomy Attribute Management page.
  • NOAA help desk rewrites in React and adding auto fill for names/email and organization information
  • Bug fixes

Dashboards

  • permissions:
    • don't allow display of dashboard using a URL if don't have permission
    • only allow access to Dashboards if logged in
    • only allow access to embed if logged in
  • only auto-refresh if tab is active, only refresh every 30s
  • fix issue with playing video play lists

API & CIOOS

  • adcpdata service - add getByLocation
  • scalardata service - check for resample period
  • archivefiles service - support download of compressed
  • CIOOS support: bug fixes, documentation, refactoring

Tickets Released: Oceans 2.0: 21.02.000 (accessible to internal users only). Total: 132.

Bug
[DMAS-32109] - Step 2 of data search providing incorrect link to IRIS.
[DMAS-38396] - Send Help Request from search results shows "undefined
[DMAS-46794] - DeviceActionForUI class has a misspelled variable (EnginneringListId)
[DMAS-48286] - Can't create a Device Action for Devices that aren't on the Observatory
[DMAS-56546] - Tests failing in UserReplication
[DMAS-57350] - QA hosts with DATACENTRE role become unresponsive after launching too many threads
[DMAS-57442] - sitedevices are not being saved
[DMAS-57533] - qaqcreprocess does not handle qaqc inheritance correctly
[DMAS-57610] - Fix failing UI tests in DataViewer
[DMAS-57619] - AML6 Cor dataproduct sometimes has turbidity column for cast in cor dataproduct
[DMAS-57631] - Prevent a dashboard from being viewed if the user has not been given permission
[DMAS-57644] - Using latest in Audio widget doesn't get the most recent file
[DMAS-57657] - CKAN data records link to DataSearch but the name suggests they link to ERDDAP
[DMAS-57671] - Permissions for data specialists editing device attributes not working
[DMAS-57672] - Error when starting a fitlet on the latest branch
[DMAS-57676] - update PGD and PD algorithms to use most recent displacement values
[DMAS-57697] - Some automatic cache reloads over JMS dont work
[DMAS-57725] - Search automation detected a change in header metadata for CSV products on the VPS - related to siteposition?
[DMAS-57727] - the device action table doesn't show all columns within the width of page if the comment is long and no scroll bar
[DMAS-57737] - BundleUtil Cannot Find DataEnrichmentCacheModule
[DMAS-57743] - AIS Source driver is not outputting anything
[DMAS-57760] - qaweb is unable to find sos.properties
[DMAS-57771] - Requests for dashboards 115 and 137 causing significant load on web server
[DMAS-57778] - Could not get french translation for device category description. Will not generate French abstract
[DMAS-57792] - Latest Readings Widget isn't using the correct sensor when using location source
[DMAS-57798] - Cast Scalar Profile Plot is unable to find cast location for device level searches
[DMAS-57811] - 404 error caused by references to qaqc in neptune_header_light.vm
[DMAS-57812] - Playlist data source in Video Widget does not select a playlist
[DMAS-57831] - Plot times on ADCP current plot do not align with timeline in dataviewer.
[DMAS-57834] - Error Running tests in onc-web
[DMAS-57836] - master branch of Oceans 2.0 build failed
[DMAS-57877] - I can't rename a customized taxon name
[DMAS-57880] - hydrophoneCalibration.txt file missing from FLAC search result
[DMAS-57881] - SystemConsole in QA with release/21.02.000 is broken
[DMAS-57885] - Unable to create new searches with DataSearch.
[DMAS-57886] - Bug causing DiveServlet not to load properly
[DMAS-57894] - Fix TypeError when adding a Properties by Location data product to cart
[DMAS-57898] - error saving ServiceLogState on qa web
[DMAS-57899] - clicking either of the root nodes on the tree in Taxonomy crashes page
[DMAS-57901] - Fix Create.instrumentsByCategory failure
[DMAS-57913] - Task reference name is unknown until finishing and cant cancel running task
[DMAS-57921] - Map is not loading in QA data search. Also, card pop out when selecting a device is not occurring.
[DMAS-57922] - Can't delete attribute and attribute group in Taxonomy Attribute management page
User Story
[DMAS-45728] - Passwords can be read using inspect element in Task Management
[DMAS-56773] - As a dev, I would like to see qaqc auto tests finder page rewritten in react
[DMAS-56775] - As a dev, I would like to see qaqc auto test details page rewritten in react
[DMAS-56889] - As a Data Search user, I would like to be able to cancel any running of my running or pending searches
[DMAS-57230] - As a software developer, I'd like the /DeviceStatus page updated to React
[DMAS-57379] - Cloning a device also clones the serial number of the sensors in the additional attributes tab
Task
[DMAS-52454] - Search Automation failing comparison on new .cor files: add to text comparator and skip 'ProcessingDate'
[DMAS-56007] - New driver attribute for Nanometrics titan (350) and tiltmeter (430) for controlling sample rate
[DMAS-57116] - Add DOI Attributes to ERDDAP records through dataset.xml
[DMAS-57400] - Update UI tests for /FileUpload
[DMAS-57449] - Make "Data Availability" title look the same as the other config titles
[DMAS-57456] - simplify PPP calibration formulas
[DMAS-57459] - Add UI component tests for the DataAvailabilityChart
[DMAS-57512] - Add ancillary data to RDI netCDF data product- correlation, error, percent good
[DMAS-57543] - Change DatasetAttributeService from using hard coded versions of the organization statement abstracts and move them to GlobalProperties
[DMAS-57630] - Only allow Embed Dashboard and Widget when user signed in
[DMAS-57698] - As a Task Management user, I would like the windows for the job parameters to be expandable
[DMAS-57738] - Update kalman filter to use the accelerometer's sample rate attribute
[DMAS-57739] - Correct code for creating default values of "Expected search failures" field in search automation configuration
[DMAS-57751] - change the default sorting of the Cruise Listing to be reverse datefrom chronologically
[DMAS-57766] - As ONC who doesn't have anonymous API access I want to ensure only logged in users can access Dashboards management and dashboard pages
[DMAS-57789] - Write FTP Job to Transfer androidlog files from FTP directory to ArchiverlowPriority
[DMAS-57844] - new item "System Status" on dmas menu
[DMAS-57849] - Change 'No Data' to 'No Records Found' for React Tables
Requirement
[DMAS-57223] - Gather requirements
[DMAS-57327] - Document general requirements for Java 9+ support
[DMAS-57402] - Document requirements
Design
[DMAS-57224] - Design the system for associating a set of bundles to a DMAS host
[DMAS-57477] - Design the new support request UI
[DMAS-57816] - Need a story book mock up
Implementation
[DMAS-28469] - Driver for ASL Acoustic Scintillation Device
[DMAS-43988] - Move the web layer to a new bundle
[DMAS-56280] - Add a new react page for user defined classifiers in PAMGuard
[DMAS-56860] - Write QAQC Finder front end in React
[DMAS-56914] - Update QAQC Finder back end for updating to React
[DMAS-57015] - Write QAQC Details front end in React
[DMAS-57016] - Update QAQC Details back end for updating to React
[DMAS-57024] - Automatic scheduling of Pamguard batch jobs
[DMAS-57100] - When a user cancels a search they should be linked to the data search help page
[DMAS-57240] - Extract JepCache into its own OSGi bundle
[DMAS-57258] - Update services for use with react page of DeviceListing
[DMAS-57259] - Write new React page for /DeviceListing
[DMAS-57310] - Create Help button in Geospatial Map
[DMAS-57347] - Do compass check in kongsberg rotary SCAN mode
[DMAS-57348] - Use the compass data in the SMB post-processor heading calculation
[DMAS-57403] - Use an alternate issue collector in Dev/QA
[DMAS-57436] - Update backend for /DeviceStatus
[DMAS-57439] - Support both Java 8 and 11 in UI tests
[DMAS-57447] - Add AvailabilityChart cypress test
[DMAS-57470] - Update ui tests for /DeviceStatus
[DMAS-57508] - Create an issue collector form
[DMAS-57510] - Update backend for DeviceSearch
[DMAS-57511] - Write new react page for DeviceSearch
[DMAS-57528] - Update selenium scripts for QAQC Details change to React
[DMAS-57535] - Add functionality to getByDevice
[DMAS-57536] - Add functionality to getByLocation
[DMAS-57544] - Creating database scripts
[DMAS-57572] - Update UI tests for DeviceSearch
[DMAS-57623] - Update TaxonButtonSetService to handle multiple attributes for a single button
[DMAS-57637] - Modify archiveFile service to accept compression parameter for accessing compressed files
[DMAS-57654] - Update new Taxon Button Set Config and Manual Entry pages to handle service call changes
[DMAS-57682] - Create page in the front end for Taxonomy Attribute Management
[DMAS-57688] - Add getByLocation method
[DMAS-57696] - Change DeviceCloner code to not clone sensorattribute values
[DMAS-57700] - Add unimplemented CRUD operations to TaxonomyAttributeService
[DMAS-57701] - Add method to get list of devices at a location with date ranges
[DMAS-57702] - Create a taxonomy attribute group service
[DMAS-57741] - Create a taxonomy attribute line service
[DMAS-57752] - implement react code
[DMAS-57755] - Increase Equinox's framework start level
[DMAS-57765] - Update ui tests
[DMAS-57773] - Add french and english organization statements for abstract to database
[DMAS-57774] - Change code to use config property organization statement in creating Dataset object
[DMAS-57794] - rollback java code to recover those two columns
[DMAS-57810] - Refactor camera take picture driver file transfer
[DMAS-57825] - Display all devices in the title and e-mail subject
[DMAS-57826] - code change to make Cruise Listing be reverse datefrom chronologically sorted by default
[DMAS-57854] - Update text following demo meeting
[DMAS-57912] - Add page to the SeaTube menu in the navigation
[DMAS-57914] - Add Attribute Management page to entry.jsx
[DMAS-57920] - Allow nullable attributes for ONC expedition loggers and data stewardship
Bug (ST)
[DMAS-57732] - Fix misspellings in the back end code
[DMAS-57733] - Fix misspellings in the React code
[DMAS-57740] - master branch with Revision: 0010036539 in Oceans 2.0 deploy failed in QA
[DMAS-57749] - No web pages are visible after qaweb2 finishes starting
[DMAS-57772] - Any logged-in user can access TaxonomyMatrixAttributeService's POST operations
[DMAS-57904] - Some OceanNext features are not working in QA
Documentation
[DMAS-57329] - Update development environment installation documentation

February 17, 2021

Minor release: FLAC file transfer support, SeaTube and Community Fishers improvements.

Tickets Released: Oceans 2.0: 21.01.003(accessible to internal users only). Total: 17.

Bug

  • [DMAS-57683] - Currently selected button getting reset when being updated in TaxonButtonSetConfig
  • [DMAS-57699] - Cannot add device actions to 2 Lufft Met station devices, receiving error
  • [DMAS-57711] - Exception ocurred executing query FROM TaxonomyAttributeLineState ca.uvic.dmas.core.datastorage.DAOException: executeHQL: TaxonomyAttributeLineState
  • [DMAS-57712] - DMAS Search Failed Notification: 10-Feb-2021 11:15:08 UTC, Satlantic Downwelling Radiometer HOCR-ICSW (SN 301), Satlantic Radiometer Time Series, SearchHdrId 7878873, UserId 15223
  • [DMAS-57722] - Blank buttons are being added to the DB from the Taxon Button Set Config page
  • [DMAS-57729] - Taxonomy dropdown should be alphabetized
  • [DMAS-57750] - Handle unequal number of samples per sensor on AML6
  • [DMAS-57759] - Cast Ingestion Job Assigning SiteDeviceSubset to wrong SiteDevice

Task

  • [DMAS-56848] - Attribution should be given to data owners on geospatial map data products
  • [DMAS-57579] - Make Open Street map the default tile set for the CF Geospatial Map
  • [DMAS-57648] - Add or modify a job to move hydrophone FLAC files into the file archiver directory
  • [DMAS-57684] - JMX Bean to show current ddm being processed
  • [DMAS-57728] - Display and allow the user to click empty buttons in TaxonButtonSetConfigNew
  • [DMAS-57736] - Add a permanent directory for the hydrophone compression job and update its regex

Implementation

  • [DMAS-57662] - Database changes for new group table
  • [DMAS-57663] - Back-end changes for new group table

Bug (ST)

  • [DMAS-57717] - Manual entry's attribute toggle was not enabled upon TTC selection

February 8, 2021

Minor release: SeaTube features

Tickets Released: Oceans 2.0: 21.01.002 (accessible to internal users only). Total: 20.

Bug

  • [DMAS-51949] - Sea-Bird CTD O2 piggyback drivers often disconnect. Current issue at Baynes Sound
  • [DMAS-57625] - Cannot see formula in QAQC Auto Test Details page
  • [DMAS-57647] - QAQCEvaluatorTest failing in Jenkins
  • [DMAS-57667] - Taxon autocomplete displays error snackbar and does not load the taxon list in the new ButtonSetConfig
  • [DMAS-57673] - Quick taxon button doesn't trigger attributes even there are default attributes for that taxon
  • [DMAS-57677] - Button Set List isn't updating the ButtonSet data until a page refresh occurs

User Story

  • [DMAS-44282] - As an ONC Dive Logger I would like to add default (permanent) attributes to Taxons

Task

  • [DMAS-57633] - Add servlet for new TaxonButtonSetConfig page
  • [DMAS-57641] - Handle location searches with multiple casts and multiple devices better for Cor dataproduct
  • [DMAS-57670] - Convert ButtonSet to use the material ui ButtonGroup

Implementation

  • [DMAS-57406] - Taxon attribute database changes
  • [DMAS-57413] - Update front-end to support default attributes
  • [DMAS-57441] - Add taxonomy entries, change taxonomymatrix roots' parents to their taxonomy
  • [DMAS-57617] - Write script to update constraint on taxonbuttonsetline table
  • [DMAS-57635] - Update ManualEntry logic for newly-determined resource-related attribute values
  • [DMAS-57640] - Straw drivers - query various states periodically
  • [DMAS-57649] - Add values for Select datatype resource attributes to database

Bug (ST)

  • [DMAS-57639] - Deleting an ancestor matrix with an attributed descendant results in an orphan
  • [DMAS-57660] - Driver changes for Pro-Oceanus Pro-CV burst mode do not support driver-initiated re-zeroings
  • [DMAS-57664] - NPE when a taxonomy exists without a taxonomy matrix representation

February 5 2021

Citizen Scientist Android version CF.3.2.5 for Community Fishers Project

Bug

  • [DMAS-57650] - No Tank Data from AML6 DI: 53240 (S/N A60009)

Task

  • [DMAS-57665] - Release Community Fisher App Version 3.2.5


February 2, 2021

Minor release: driver logging improvement

Tickets Released: Oceans 2.0: 21.01.001 (accessible to internal users only). Total: 1.

Task

  • [DMAS-57615] - Modify driver to filter out redundant motor log values

February 1, 2021

Major release

Maintenance and Production Developer

  • Bug fixes including siteposition cache, live instrument testing
  • Migration of several pages/UI to modern REACT framework (QAQC AutoTest, DeviceListing) (on-going)
  • QAQC reprocessing tool

Instruments & EEW

  • Driver/parser maintenance issues (STRAW, BPR)
  • Kongsberg imaging rotary sonar SMB postprocessor support for compass
  • PAMGuard Phase 2 (in-progress)
  • DAF multiqueue design
  • Modularization (OSGi-ification): support for customized builds (in-progress)

Data Products

  • Fixes for RDI ADCPs in high tilt deployments
  • FLAC as source for hydrophones
  • CODAR bug fix
  • Automated testing improvements

Data Player

  • MATLAB as a service ready for testing, not deployed (in-progress)

Community Fishers

  • bug fixes for cast pipeline and geospatial maps
  • AML-6 Integration with Oceans 2.0 (new AMLX parser)
  • Implemented QAQC flags for EDS data

SeaTubeV3

  • Attributes for taxonomy and taxons
  • Help desk

Dashboards, API & CIOOS

  • Fixing up Dashboard issues (Plotting Utility, Firefox, single file and time-lapse video)
  • API improvements (design phase, in-progress)
  • CIOOS support: bug fixes with the XML, ERDDAP work with combining DOIs and links to CKAN, data partner attributions

Tickets Released: Oceans 2.0: 21.01.000 (accessible to internal users only). Total: 100.

Bug

  • [DMAS-36280] - QAQC Auto Test Finder Page - Find button doesn't show no result found
  • [DMAS-56570] - Automatic cache reload requests are getting sent to too many JVMs
  • [DMAS-56578] - Correct failing ui test - AnnotationsTest
  • [DMAS-57058] - Oceans 2 menu bar doesn't display correctly when there is a plot widget
  • [DMAS-57070] - parser of devicetypeid 901 need be revisited
  • [DMAS-57090] - SitePosition cache issue caused pashore1 parsing messages slowly, falling behind
  • [DMAS-57104] - L22 vocabulary term metadata missing from CKAN ISO 19115 record
  • [DMAS-57213] - New widgets are hidden on fullscreen dashboard
  • [DMAS-57245] - Job 366 is pushing metadata for inactive ERDDAP datasets to CKAN server
  • [DMAS-57297] - Data availability different between audio config and selector
  • [DMAS-57362] - Unit tests are failing in Oceans 2 master branch
  • [DMAS-57376] - Previously duplicated sitedevicesubset found after DB refresh
  • [DMAS-57380] - Fix failing UI test in CloneDevice
  • [DMAS-57395] - Fix failing test in dataPreviewGeneration
  • [DMAS-57415] - The datacite abstract is adding unwanted French content to the end of the abtract
  • [DMAS-57418] - CKAN ISO 19115 records not downloading
  • [DMAS-57422] - DevicePort Maintenance page has an error when trying to get newly added port
  • [DMAS-57465] - Link from siteDevice page to ERDDAP record is broken
  • [DMAS-57472] - Error occurred trying to reprocess qaqc results on dateRange DateRange [Mon Jan 14 00:00:00 UTC 2019 to Tue Jan 15 00:00:00 UTC 2019] for deviceId506
  • [DMAS-57480] - memory leaking from qaqcreprocess job
  • [DMAS-57491] - DMAS Search Failed Notification: 19-Jan-2021 19:47:19 UTC, Hecate Strait-Hecate Strait CODAR System, CODAR Quality Controlled Surface Currents, SearchHdrId 7806433, UserId 48690
  • [DMAS-57524] - Latest readings showing invalid simple dates in Firefox
  • [DMAS-57531] - master branch of Oceans 2.0 build failed in qamon
  • [DMAS-57551] - Time lapse video not playing using continuous player
  • [DMAS-57560] - DMAS Search Failed Notification: 24-Jan-2021 12:30:27 UTC, Patricia Bay-Saanich Inlet VENUS Instrument Platform, Time Series Scalar Plot, SearchHdrId 7817881, UserId 40000
  • [DMAS-57581] - Failed to load SitePositionjava.lang.RuntimeException: Couldn't build site position cache
  • [DMAS-57583] - Data Availability no longer showing Video widget when device is selected
  • [DMAS-57584] - Fix Environment.js getStaticResourcePath() method's regex
  • [DMAS-57587] - Cast Correction Matlab Script Failing on AML-6 Data
  • [DMAS-57598] - Unable to edit batch tasks
  • [DMAS-57607] - Community Fishers CDOM sensor processing is outputting non median filtered data

User Story

  • [DMAS-23848] - As a scientist, I would like data acquisition for the ASL Acoustic Scintillation device
  • [DMAS-37130] - As a data steward, I would like the data team to have UI where they can delete qaqcresults
  • [DMAS-56396] - As a Citizen Scientist, I would like the Community Fishers app and data acquisition system extended to support the new AML-6 instrument
  • [DMAS-57233] - As a software developer, I'd like the /FileUpload page updated to React
  • [DMAS-57345] - As an RDI ADCP data user I would like the Cassandra data to default to no bin-mapping when the instrument tilt exceeds 20 degrees
  • [DMAS-57483] - Should updating JunctionBox Alarm settings for SCUv2 (Baynes) reset the ports?

Task

  • [DMAS-48748] - As a third party, I would like to be properly attributed in ERDDAP datasets
  • [DMAS-56661] - Fix Dataset Landing Pages Abstract hardcoding
  • [DMAS-56699] - Update auto UI test on calibration page for feature implemented in DMAS-56140
  • [DMAS-57113] - Update auto UI test on JB alram page for new feature added in DMAS-56971
  • [DMAS-57196] - Update UI tests for changes made to physical characteristic tab ui
  • [DMAS-57298] - When the data availability is shown is inconsistent between configs
  • [DMAS-57339] - Implement QAQC flags for CF Aligned and depth-binned sensor data
  • [DMAS-57360] - NRCAN BPR 21501 output changed to binary format -needs driver and parser development
  • [DMAS-57378] - Automate testing of dive CSV export
  • [DMAS-57394] - scripts to update password in QA and DEV affected by DMAS-56408
  • [DMAS-57409] - public wiki documentation is needed for dataproductid 183 introduced for Community Fishers androids
  • [DMAS-57410] - make minor fixes to forms for edit device details pages rewritten in react
  • [DMAS-57411] - Change quarantine column background color on Device Console page
  • [DMAS-57424] - Add label prop to data source and change chart widget config DS labels
  • [DMAS-57448] - Move TaxonButtonSetConfig into Oceans Next
  • [DMAS-57517] - Create Aligned and Depth Binned Navigation data even if insufficient raw data present to interpolate
  • [DMAS-57547] - add camera of devicetype 373 in the dropdown list of cameras in dmas menu
  • [DMAS-57549] - AMLx parser validator rejects 'rogue' data lines
  • [DMAS-57552] - Switch service used by Video widget when source is Device to archivefiles
  • [DMAS-57575] - Add new Qaqc Id for use with community fishers EDS data
  • [DMAS-57585] - change minimum port from 4 to 1 on JB viewer for mini JB devices
  • [DMAS-57596] - Fixing failing UI tests in DataPreview.GenreationAndDisplay
  • [DMAS-57604] - Remove Data Player from widgets menu

Requirement

  • [DMAS-57210] - Write requirement for one-letter search auto-completions on User Defined Taxonomies

Implementation

  • [DMAS-14611] - Kongsberg Driver - Add Support for Compass
  • [DMAS-17210] - In the FileUpload page allow more space to display the entire filename
  • [DMAS-30667] - As as File Upload user, make it clear that the page only accepts .an files
  • [DMAS-56804] - Add UI tests for Sandbox widget
  • [DMAS-56983] - Code Implementation for qaqcresult Deletion Job
  • [DMAS-57180] - Create SQL Scripts for QAQC Deletion Job
  • [DMAS-57353] - Write new React page for /FileUpload
  • [DMAS-57354] - Update backend for /FileUpload
  • [DMAS-57355] - extend declarative parser capabilities to converter type of output strings
  • [DMAS-57368] - Update UI Testing builds to fail on static analysis failure
  • [DMAS-57386] - dmas.log include raw data?
  • [DMAS-57407] - Add service, manager, assembler, and state for TaxonomyMatrixAttribute
  • [DMAS-57430] - Add number of output arguments parameter to Matlab post process jobs
  • [DMAS-57431] - Implement code change for background color of quarantine column on Device Console page
  • [DMAS-57433] - Create domain object that does not extend TreeNodeUI
  • [DMAS-57435] - Write new React page for /DeviceStatus
  • [DMAS-57438] - Ensure cypress component testing ready to use in oceans next
  • [DMAS-57460] - Update taxonomy matrix parent logic for new parent representation
  • [DMAS-57471] - Fix compiler warnings exposed in Java 11
  • [DMAS-57478] - Update backend to add ERDDAP_URL in NeptuneVelocityServlet so it's accessible by React
  • [DMAS-57479] - Update Environment.js to get the correct Erddap URL
  • [DMAS-57482] - Create a TaxonomyMatrixAttribute cache
  • [DMAS-57487] - Add groupname to TaxonomyAttribute classes
  • [DMAS-57521] - Modify RDI matlab code to accept higher tilts and improve plot for high currents
  • [DMAS-57522] - Modify RDI java complex parser to accept higher tilts
  • [DMAS-57537] - Add and update TaxonomyMatrixAttributeService logic
  • [DMAS-57548] - Add TaxonomyMatrixAttribute synchronization logic
  • [DMAS-57557] - Update ADCP plotting options
  • [DMAS-57568] - Upgrade geckodriver to 0.29.0 for UI testing
  • [DMAS-57597] - Update ID for QAQC Results Deletion Job

Bug (ST)

  • [DMAS-57364] - Fix unit test failures in seatube
  • [DMAS-57365] - Fix unit test failures in scalar data
  • [DMAS-57414] - Fix test failures in quarantine and calibration
  • [DMAS-57417] - Verification failed with "bad array subscript"
  • [DMAS-57532] - Chart Widget data availability 'box select' reversing start/end dates in Firefox
  • [DMAS-57580] - Lidar sdaq status issue
  • [DMAS-57591] - Cache update does not remove old object
  • [DMAS-57593] - Assigning a regular matrix attribute does not delete from descendants

Documentation

  • [DMAS-56984] - Documentation for qaqcresult Deletion Job

January 29, 2021

Citizen Scientist Android version CF.3.2.4 for Community Fishers Project

Bug

  • [DMAS-57467] - Unexpected AML-6 data causes 'View Data' to crash in app
  • [DMAS-57530] - As a user of the CF app, I would like the data download UI to timeout if there is an error

Task

  • [DMAS-57582] - Increase ActiveMQ Timeout in Community Fisher App
  • [DMAS-57595] - Release Community Fisher App Version CF.3.2.4

January 20, 2021

Citizen Scientist Android version CF.3.2.3 for Community Fishers Project

Bug

Task

January 19, 2020

Minor release: Pro-Oceanus driver bug fix

Tickets Released: Oceans 2.0: 20.12.001 (accessible to internal users only). Total: 1.

Bug

  • [DMAS-57445] - The Pro-Oceanus on SCUv2 #8 has faulted (over current) and there have been no alerts.

January 15, 2021

Citizen Scientist Android version CF.3.2.2 for Community Fishers Project

Bug

  • [DMAS-57408] - Community Fisher App not downloading data off of instruments

Task

Implementation

  • [DMAS-56747] - Modify AML-6 Driver to use AMLx Format

January 7, 2021

Major release

Maintenance and Production Developer

  • Bug fixes
  • Sensor-level data ratings applied to CSV/JSON data products
  • Encrypted password deviceattribute in database and raw file
  • Migration of several pages/UI to modern REACT framework (more tabs on device details pages converted) (on-going)

Earthquake Early Warning (EEW) Commissioning:

  • project initiation, requirements gathering and planning (in-progress)
  • Modularization (OSGi-ification): support for customized builds (in-progress)

Instruments

  • Driver maintenance issues
  • Acoustic scintillations driver (in-progress)
  • Kongsberg imaging rotary sonar driver now queries for compass heading
  • Support for getting files from a device with low-latency (in-progress)

Data Products

  • Bug fixes, particularly issues around piggyback devices

Data Player

  • MATLAB as a service (in-progress)
  • Small change to device selection component
  • Bioacoustic annotations (in-progress)

Community Fishers

  • bug fixes for cast pipeline and geospatial maps
  • Android app: improve reliability for bluetooth (app updates will now have their own releases)

SeaTubeV3

  • Broad search now supporting organizations
  • One character autocomplete for taxons in user-defined taxonomies

Dashboards - CANARIE

  • Project completion: most features release in December minor releases
  • Dashboards in More menu in Oceans 2.0
  • Can unzip products from User Defined tasks

API & CIOOS

  • API project initiation
  • CIOOS API support

Tickets Released: Oceans 2.0: 20.12.000 (accessible to internal users only). Total: 86.

Bug

  • [DMAS-56276] - The French support in CKAN doesn't seem to be working
  • [DMAS-56372] - password values for at least some devicetypes are showing in the log files
  • [DMAS-56545] - Tests failing in DeviceAttributes
  • [DMAS-56588] - Oceans 2.0 OSGi tests failed with unresolved bundles after "error in opening zip file"
  • [DMAS-56670] - fix bug in the algorithm used to get the publication year for DataCite metadata
  • [DMAS-56891] - Oceans 2 deployment fails with a cryptic error if /var/run/gemini.pid exists
  • [DMAS-57085] - Fix failing UI test in CloneDevice
  • [DMAS-57095] - CKAN ISO 19115 record missing data partner attributions
  • [DMAS-57097] - French Abstract missing from CKAN ISO 19115 record
  • [DMAS-57098] - Typo in CKAN ISO 19115 records
  • [DMAS-57123] - Fix failing UI tests in ExpeditionManagement
  • [DMAS-57124] - Fix failing UI tests in SeaTubeSearchTest
  • [DMAS-57171] - Dataplayer device does not clear after switching device category
  • [DMAS-57214] - Automatic merge failure in Oceans Next
  • [DMAS-57243] - DMAS Search Failed Notification: 10-Dec-2020 22:17:28 UTC, Nortek Aquadopp Profiler A3P9320 AQD14543, Nortek Time Series, SearchHdrId 6119519, UserId 27378
  • [DMAS-57272] - Fix failing test in geospatialMap
  • [DMAS-57280] - Fix issues with merge of release/20.11.000 into master
  • [DMAS-57305] - DMAS Search Failed Notification: 18-Dec-2020 04:32:35 UTC, Folger Passage-Folger Deep, Log File, SearchHdrId 6151449, UserId 2851
  • [DMAS-57314] - Text widget on dashboards allows text to go over its frame
  • [DMAS-57322] - UI test suite failed with "Error forwarding the new session Empty pool of VM for setup Capabilities" after crash
  • [DMAS-57325] - User defined tasks widget config missing a name attribute
  • [DMAS-57344] - Reset button not working for organizations in Broad Search
  • [DMAS-57356] - Catalina exceptions in CruiseVocabCacheLoader
  • [DMAS-57361] - Fix failing tests in DataPreviewManagement
  • [DMAS-57383] - Fix failing tests in GeospatialMap

User Story

  • [DMAS-34552] - As a user, I would like to Utilize Sensor-Level Data Ratings in CSV/JSON Data Products, Services and Apps
  • [DMAS-56968] - As a data steward, I would like a message to validate that the site device is being saved

Task

  • [DMAS-56187] - add selenium test for fullscreen dashboard
  • [DMAS-56408] - As a systemer, I would like to see database save values of device attribute "password" in some encrypted form
  • [DMAS-56473] - Add UI tests to Dashboards to test the edit functionality of the Data Source List
  • [DMAS-56829] - Update selenium scripts for code change on sensorcodename
  • [DMAS-56915] - As a data steward, I would like the drop-down list in the Add Task to Batch to be aphabetically listed
  • [DMAS-56970] - Update Device Action selenium tests
  • [DMAS-56981] - Improve unit test coverage on dashboard related tests
  • [DMAS-57003] - Make UI fixes and include RO field for Modify By and Modify Date on the Electrical Ratings Tab of DeviceListing
  • [DMAS-57055] - Fix errors in service calls for electrical rating service
  • [DMAS-57076] - Extract contents of data.tar without creating data subfolder
  • [DMAS-57117] - Update HoloSea code to use GainDecibels instead of Gain
  • [DMAS-57195] - Use different icon for Quarantine and Quick plot on DeviceConsole
  • [DMAS-57197] - Convert AnnotationSearchExecutionStrategy to an abstract class
  • [DMAS-57205] - Improve broad searching on organizations
  • [DMAS-57207] - Fix auto merge failure on 493836b715b
  • [DMAS-57209] - Please Transfer Dec-2-2020 and Dec-3-2020 T'Souke data to QA and reprocess
  • [DMAS-57265] - Investigate broad search performance improvements
  • [DMAS-57266] - As an outgoing Data Manager I would like senior members of the Data Team to have permission to close other people's annotations
  • [DMAS-57267] - Sort "Add Widget menu" on Dashboards alphabetically
  • [DMAS-57273] - Fix broken test in DeviceService test
  • [DMAS-57278] - Update UI tests in DataViewer
  • [DMAS-57302] - Add dropdown for organizations to Broad Search
  • [DMAS-57308] - Update JEP calibration formula needed to correct Rinko Oxygen calibration data from Pacific Salmon Foundation RBR/Rinko instrument sets
  • [DMAS-57315] - Refactor getpiggybackdevicesensor, to use piggyback flags in deviceport table
  • [DMAS-57318] - Remove character limit for searchtreenodename
  • [DMAS-57320] - ERROR on ZapParser
  • [DMAS-57346] - Add Dashboards to menu

Design

  • [DMAS-57256] - CSV data product header and content

Implementation

  • [DMAS-55271] - Implementation of sensor level DataRating in Java gap filling
  • [DMAS-56993] - Update backend for Procurement tab
  • [DMAS-56994] - Write new React Page for Procurement tab
  • [DMAS-56995] - Update selenium scripts for Procurement
  • [DMAS-57011] - Add ui testing to check for info bars when site device being saved or deleted
  • [DMAS-57040] - Update backend for nameplate tab
  • [DMAS-57041] - Write new react page for Nameplate tab
  • [DMAS-57048] - Write new React page for Nameplate maintenance
  • [DMAS-57049] - update backend for Nameplate Maintenance
  • [DMAS-57119] - Update ui tests for Nameplate tab
  • [DMAS-57139] - Update backend for IP tab
  • [DMAS-57140] - Write new react page for IP tab
  • [DMAS-57141] - Update UI tests for IP tab
  • [DMAS-57146] - extract DmasServiceManagerImpl to its own bundle
  • [DMAS-57147] - Write new React page for Ip maintenance
  • [DMAS-57148] - Update backend for Ip maintenance
  • [DMAS-57158] - create a version of the DmasServiceManager to be used by the correlator
  • [DMAS-57181] - Add Still Camera Methods to CameraSystemDevice
  • [DMAS-57191] - Code Change for Alphabetizing Add Task to Batch Dropdown
  • [DMAS-57212] - Refactor frontend to allow one-character taxon autocompletes for user-defined taxonomies
  • [DMAS-57222] - Refactor button set config to also use one-character autocompletes
  • [DMAS-57251] - Create a new role "CORRELATOR" for EEW correlators
  • [DMAS-57264] - Convert jep-2.4.0.jar to an OSGi bundle, if possible
  • [DMAS-57281] - Allow instance to be configured for each host separately
  • [DMAS-57299] - Update front end for changes made to service after removing UI class
  • [DMAS-57311] - Add support menu & wiki links to the geospatial map
  • [DMAS-57326] - Code change for new Quarantine icon
  • [DMAS-57393] - script to provide new passwords in prod

Bug (ST)

Documentation

  • [DMAS-57271] - Update internal documentation for CSV/JSON products for sensor level data ratings

January 6, 2021

Citizen Scientist Android version CF.3.2.1 for Community Fishers Project

User Story

  • [DMAS-23436] - As a Pacific Salmon Foundation person, I would like feedback on numbers of casts on tablet
  • [DMAS-37530] - As a citizen scientist, I would like to have the User Manual in citizen scientist app updated

Task

  • [DMAS-57382] - Release New Community Fisher App Version (3.2.1)

Implementation

  • [DMAS-57268] - Display number of files uploaded after files have been uploaded to Oceans 2.0, and add a progress bar
  • [DMAS-57269] - Display Files in descending order (for date) in 'View Data'
  • [DMAS-57294] - Update 'Help' Documentation in App