This page contains release notes from 2019, primarily for Oceans 2.0 / DMAS, as well as any applications created/maintained by the ONC software development group, including mobile Apps and desktop/PC applications. In progress project status may be presented as well.

December 3, 2019

Major release for Oceans 2.0. 

Instruments

  • AIS parsing: design and investigation

  • Sandbox improvements: improvements to support user's code, more usability issues
  • Improvements the Community Fishers / Citizen Scientist data acquisition Android App, including app update system

Community Fishers

  • Integration testing and fixes

Automated Testing

  • Automated task testing framework design

  • Automated webservice testing expanded coverage and test improvements
  • Continuous deployment: process changes for requirements and design reviews (in-progress)

Data Products

  • New data product for ASL echosounders: a CSV format that's compatible with EchoView data viewing and analysis software
  • New data product options for ASL echosounders: Target Strength now available for all formats, ZAP noise reduction now optional (matches ASL processing)
  • A weekly long-term spectral average plot is now available for all hydrophones
  • Change to support automated State of Ocean plot generation (all plots are now up to date)
  • Bug fixes in these areas: CODAR, ice buoy, rotary sonar

Maintenance and Production Developer

  • Replace manual search templates for State of Ocean / Environment plots and products with an automated job (deployed last month, now active)
  • System console improvements: version/revision/deployment date now displayed
  • Various other bug fixes and small projects

SeaTubeV3 - CANARIE & NOAA & ONC

  • User interface and styling consistency for SeaTube V3
  • Bug fixes

Dashboards - CANARIE

  • Automated testing for sharing and video player
  • Live video

MINTED - CANARIE

  • UI for sitedevicesubsets and siteDevice (in-progress)
  • Requirements and design for versioning data, including updating DOIs (in-progress)
  • Citation logic and metadata improvements (in-progress)

CIOOS / ERDDAP

  • Mobile scalar data is now available on ERDDAP
  • Saanich inlet data on CIOOS metadata server for demo only

Tickets Released: Oceans 2.0: 19.11.000 (accessible to internal users only). Total: 100.

November 7, 2019

Major release for Oceans 2.0. 

Instruments

  • Fixed an issue blocking a new calibration formula

  • Camera system driver improved
  • Sandbox usability update complete. Starting further improvements to support user's code.
  • Improvements the Community Fishers / Citizen Scientist data acquisition Android App

Community Fishers

  • Handling different instruments, reliability, bugs and refactoring
  • On-demand .cor file data product product

Automated Testing

  • Automated UI testing tool improvements (with Selenium)

  • Automated UI testing expanded coverage
  • Continuous deployment: MATLAB migration from SVN to Git repository, new review process (in-progress)

Data Products

  • CODAR quality controlled surface currents data product revised, released and activated (available in all apps, including Data Preview), changes include:
    made grid files available in Data Search, revamped MAT file structure, updated plotting, additional GDOP testing, bug fixes, automated testing
  • Bug fixes: RDI netCDF products on mobile devices, edge case on ASL echosounders and more
  • Migrated code repository to Git/BitBucket, updated/modernized pathing
  • Maintain and expand search automation, particularly in support of Git migration and FGDC deprecation

Maintenance and Production Developer

  • Fixes to ONC websites, including converting remaining http (non-secure) pages and links
  • FGDC metadata report deprecated from Data Search
  • Various other bug fixes and small projects

SeaTubeV3 - CANARIE & NOAA & ONC

  • Continuing fixes and various improvements for V3
  • User interface panel designs and usability improvements

Dashboards - CANARIE

  • Completed advanced sharing screen & permissions
  • Video component improvements (in-progress)

MINTED - CANARIE

  • UI for sitedevicesubsets and siteDevice (in-progress)
  • Requirements for versioning data (in-progress)

CIOOS / ERDDAP

  • In progress

Tickets Released: Oceans 2.0: 19.10.000 (accessible to internal users only). Total: 95.

October 3, 2019

Major release for Oceans 2.0. 

Instruments

  • Didson sonar driver

  • UMN sampler parser / driver fixes
  • Sandbox update (in-progress)
  • Finalize EEW PNSN integration

Community Fishers

  • Handling different instruments, reliability, bugs and refactoring

Automated Testing

  • Automated UI testing tool improvements (with Selenium)

  • Automated UI testing expanded coverage
  • Continuous deployment (in-progress)

Data Products

  • CODAR quality controlled surface currents data product deployed (not yet available to public - seeking internal user feedback)
  • Bug fixes

Maintenance and Production Developer

  • Project reporting scheduled job for World Data System International Technology Office
  • Improved loading indicators
  • New system console available
  • Various other bug fixes

SeaTubeV3 - CANARIE & NOAA & ONC

  • Big push to finish functional requirements for NOAA
  • Useability testing and improvements (in-progress)
  • Click on annotation marker brings up related information
  • Bug fixes

Dashboards - CANARIE

  • Advanced sharing screen & permissions

MINTED - CANARIE

  • UI for sitedevicesubsets (in-progress)
  • Requirements gathering (in-progress)

CIOOS / ERDDAP

  • Upgrade ERDDAP server version (to be deployed after release)
  • expand coverage, include mobile sensors/device and other complex data sets (in-progress)

Tickets Released: Oceans 2.0: 19.09.000 (accessible to internal users only). Total: 66.


September 4, 2019

Major release for Oceans 2.0. 

Instruments

  • Didson sonar driver (in-progress)

  • Sandbox update (in-progress)
  • Community Fishers: updates to handle AML CTDs

Automated Testing

  • Automated UI testing tool improvements (with Selenium)

  • Expanded automation UI testing coverage
  • Progress on moving toward continuous deployment

Data Products

  • CODAR data products (in-progress)
  • Bug fixes

Maintenance and Production Developer

  • Add URLs to device work flow
  • Various other bug fixes

Complex Data Viewer / Hydrophone

  • Gathering requirements for Aquadopp and other complex data sets

SeaTubeV3 - CANARIE & NOAA & ONC

  • Annotation export, refactor to use taxon-based system
  • Performance improvements
  • Digital Fishers UI improvements
  • Bug fixes

Dashboards - CANARIE

  • bug fixes

MINTED - CANARIE

  • Requirements and development ongoing

Tickets Released: Oceans 2.0: 19.08.000 (accessible to internal users only). Total: 60.

Aug 7, 2019

Major release for Oceans 2.0. HydroCal 19.06.000 released on July 24th. 

Instruments

  • Didson sonar driver (in-progress)

  • Geographic status map for EEW
  • Sandbox update is half finished: usability and task machine integration improvements
  • Community Fishers: minor fixes to data pipeline

Automated Testing

  • Automated UI testing tool improvements (with Selenium)

  • All developers spent time adding automated UI tests to replace their manual regression tests. 52% complete, aim to finish by September.
  • Oceans-Next PROD server online, pages embedded in Oceans 2.0 (these pages are in beta, not yet available to public)
  • Progress on moving toward continuous deployment

Data Products

  • Major HydroCal update released (July 24th). Improved support for HF calibrations, specifically:
    • Handles start/stops/reloads of calibrations much better
    • Handles loading older versions of calibration data files and settings files
    • Added ability to recover badly synchronized data by cross-correlating to target tones
    • Improved spacing around plots
    • Various UI changes to display and interaction, including warnings for missing parameters that would caused calibrations to fail
    • Fixed cal sheet mis-alignment
    • Changed a number of defaults: source voltage ramp rates, sample rates
    • Made more parameters configurable, including the low voltage alert
    • Changed filename and date stamping to the date of the data acquisition instead of file creation
    • Improved re/post-processing of the data, plus added the ability (optionally) to reprocess the reference data, including changing some parameters
    • Add quality metrics: correlation and signal to noise ratios - this allows users to compare multiple runs and pick the best result
  • CODAR data products (started)
  • Bug fixes

Maintenance and Production Developer

  • Fixed Network Console load speed
  • Support fault reset functionality on ONC "miniJB" type junction boxes
  • Web service improvements and documentation (getByDevice method in the ScalarData service)
  • Various other bug fixes

Complex Data Viewer / Hydrophone

  • Working on complex data viewer front-end and making additional option sets available for spectrogram product generation in the back-end

SeaTubeV3 - CANARIE & NOAA & ONC

  • All SeaTube V2 functionality in V3 (on Oceans-Next), plus new features
  • Working on completing functions, beginning maintenance phase (after successful demo), prep for ONC and NOAA new requirements

Dashboards - CANARIE

  • clean up, fixes (in-progress)
  • demo, development phase completion

MINTED - CANARIE

  • Instrument footprints
  • Scoping, requirements and development ongoing

Tickets Released: Oceans 2.0: 19.07.000 (accessible to internal users only). Total: 79.

HydroCal: HC.19.06.000 (link accessible to internal users only). Total: 22


July 4, 2019

Major release.

Instruments

  • WERA Integration (added support for USORT files)

  • Created a new webservice to access RDI ADCP data with averaging from specific bins. This is to provide ocean current data to Port Metro Vancouver.
  • Community Fishers data access project: clean up and fixes
  • Small driver changes

Automated Testing

  • Automated UI testing implemented with Selenium

  • All developers spent time adding automated UI tests to replace their manual regression tests
  • Develop infrastructure for Oceans Next webserver
  • Automated DAF testing final demo of phase 1

Data Products

  • Major HydroCal update to support HF hydrophone field testing - separate release coming later in July
  • RDI ADCP minor fix to comments and NaN'ing in specific scenarios

Maintenance and Production Developer

  • RDI ADCP complex parser: added screening, fixed bugs and made it match Matlab data products and manufacturer's processing suite
  • JIRA service desk is now available in Oceans 2.0
  • Web service improvements and documentation
  • Various other bug fixes

Complex Data Viewer / Hydrophone

  • Requirements and implementation (in-progress)

SeaTubeV3 - CANARIE & NOAA & ONC

  • Primary development phase for CANARIE is ending, transition to maintenance and minor feature updates (NOAA and ONC development is ongoing)
  • Completion of features, improvements and bug fixes
  • Continuing moving features into SeaTubeV3 on Ocean Next webserver, to replace SeaTube Pro (current public version) and SeaTubeV2 (NOAA variant)
  • Demo prep

Dashboards - CANARIE

  • Primary development phase is ending, making dashboards webserver (Oceans Next) available in production
  • clean up, fixes (in-progress)
  • Demo prep

MINTED - CANARIE

  • Added concepts of batched commits and data areas to the database (in-progress)

Tickets Released: Oceans 2.0: 19.06.000 (accessible to internal users only). Total: 138.


June 4, 2019

Major release.

Instruments

  • WERA Integration (FTP job and file archiving)

  • Community Fishers Android app: supports USB and RBR devices
  • Community Fishers data access project: web portal ready, working on data pipeline
  • Phytoplankton sampler drivers

Web Presence

  • Website fully online for World Data System - International Technology Office 

Automated Testing

  • UI improvements

  • Live automatic DAF testing (nearly complete)

Data Products

  • WERA animated GIF data products available in Data Search and Data Preview

Maintenance

  • Internal maintenance for QA and build systems
  • Security improvements on device details page
  • ONC web search ordered by date
  • ONC staff photos all same size
  • Various other bug fixes

Complex Data Viewer / Hydrophone

  • Project initiation

SeaTubeV3 - CANARIE & NOAA

  • Many components updated/modified in SeaTube V2 and copied to the new Oceans Next SeaTube (V3) (in-progress), including:
  • Support for multiple user-configurable Digital Fishers campaigns
  • Ocean Biogeographic Information System (OBIS) statistics on annotations
  • Cruise Summary Reports (initial version)

Dashboards - CANARIE

  • Widgets and dashboards (in-progress)
  • Standardized behaviour improved

MINTED - CANARIE

  • Working on services (in-progress)

Tickets Released: Oceans 2.0: 19.05.000 (accessible to internal users only). Total: 161.

May 1, 2019

Major release.

Instruments

  • Declarative parsers: last test file integrated into declarative tests. Project complete.

  • Community Fishers Android app: working on USB driver
  • Community Fishers data access project: web portal ready, working on data pipeline
  • New and modified drivers and parsers in support of maintenance cruises: chemical samplers, microscopes, RBR BPR and more.

Web Presence

  • Website for World Data System - International Technology Office
  • Website for CIOOS, CKAN server (in-progress)

Automated Testing

  • Added testing history

  • Live automatic DAF testing (in-progress)

Maintenance

  • System and status console pages ready in new front-end. Allows batching of various system commands from a UI: cache reloads in particular.
  • Web service fixes to date ranges: documentation and vocabulary
  • Improved speed for data product upload
  • Many bugs fixed in search hydrophone page: data access violations, improper file downloads
  • Various other bugs

SeaTubeV3 - CANARIE

  • Updates and features in initial release
  • Updates to annotations, digital fishers
  • Building components in new framework
  • Bug fixes

Dashboards - CANARIE

  • More widgets in progress
  • Creating pages

MINTED - CANARIE

  • Progress on assigning DOIs to datasets

Tickets Released: Oceans 2.0: 19.04.000 (accessible to internal users only). Total: 63.


April 1, 2019

Major release.

Instruments

  • Declarative parsers done

  • Community Fishers Android app: working on USB driver
  • Community Fishers data access project: data model done, workflow design, geospatial areas defined, integration of data products and processing
  • Driver and parser updates in support of upcoming field maintenance: SeaFET, STRAW driver & FTP online and more
  • World magnetic model update
  • Bug fixes for parsers found in DAF testing and by improved reprocessing automated testing

Web Presence

  • Two conference sites created in Liferay

Automated Testing

  • Improvements for reprocessing/data acquisition framework (DAF) automated testing

  • Live automatic DAF testing: UI built, basic validation, checks on device attributes and topology, set up and removal of device metadata

Maintenance

  • Various bug fixes
  • Archiver performance improved with efficient QAQC writing
  • Back-end support for sending system commands in batches, front-end in progress
  • Web service updates to unify the behaviour of dateTo parameters

Earthquake Early Warning

  • Small bug fixes

SeaTubeV3 - CANARIE

  • Design complete for SeaTubeV3
  • Building components in new framework
  • Changes for NOAA

Dashboards - CANARIE

  • More widgets
  • Creating wrappers for base components

MINTED - CANARIE

  • Progress on the base level case

Tickets Released: Oceans 2.0: 19.03.000 (accessible to internal users only). Total: 97.

March 5, 2019

Major release.

Instruments

  • Declarative parsers: mitigating test cases, adding documentation

  • Community Fishers Android app: working on USB driver
  • Community Fishers data products and portal project: data model design, workflow design
  • STRAW (test neutrino detection project) virtual machine integration and driver
  • Driver and parser fixes in support of upcoming field maintenance: mini-junction box and more
  • Bug fixes for parsers found by improved reprocessing automated testing

Web Presence

  • Data Search "V2" released: Geospatial search and Data Search UI improvements final user testing, improvements
  • Two conference sites, including a new simpler submission system

Automated Testing

  • Improvements for reprocessing/data acquisition framework (DAF) automated testing

  • Progress on automating manual DAF testing

Maintenance

  • Various bug fixes
  • Progress on improving archiving time
  • Progress on metrics and event detection/reaction

Data Products

  • State of Ocean product updates
  • Various bug fixes

Earthquake Early Warning

  • Data from PNSN (Pacific NorthWest Seismic Network) is on online and contributing
  • Documentation

SeaTubeV3 - CANARIE

  • Design for mobile and desktop SeaTube

Dashboards - CANARIE

  • Mock-ups to stakeholders
  • Building widget components

MINTED - CANARIE

  • Requisition DOI's for siteDevices

Tickets Released: Oceans 2.0: 19.02.000 (accessible to internal users only). Total: 54.

February 7, 2019

Major release.

Instruments

  • Declarative parsers nearly done, mitigating test cases, adding documentation

  • Updates to Community Fishers Android app (bug fixes), working on RBR driver and parser
  • Community Fishers data products and portal project: requirements complete, working on design

Web Presence

  • Geospatial search and Data Search UI improvements final round of testing
  • Conference websites

Automated Testing

  • Improvements Data Search automation system

  • Data Search automation coverage increased to > 90%, project complete.
  • Progress on reprocessing automated testing, automated data acquisition framework testing

Maintenance

  • Good progress (10 tickets): improvements to back-end, particularly sites cache
  • Progress on event monitoring and metrics for data acquisition framework

Data Products

  • State of Ocean data products updated to include pressure data and have consistent gap filling
  • SIDSSE Underwater Ultraviolet Raman Spectrometer (UURS) data products released

Earthquake Early Warning

  • Integration of PNSN (Pacific NorthWest Seismic Network) data ready to switch on

SeaTubeV3 - CANARIE

  • Requirements complete, designs in progress
  • Building page components

Dashboards - CANARIE

  • Progress on new front-end technologies and tools (liferay)
  • Requirements and mock-ups with user feedback

MINTED - CANARIE

  • Investigation and requirements (no features)
  • Workflows investigated

Tickets Released: Oceans 2.0: 19.01.000 (accessible to internal users only). Total: 134.

January 8, 2019

Major release. Smaller than usual due to holiday break.

Instruments

  • Moved more parsers from java into declarative parsers, added more unit tests.

  • Updates to sensor load system that handles variations within devicetypes for the declarative parsers.
  • Adding declarative parsers to Community Fishers App
  • Community Fishers data products and portal project initiation

Web Presence

  • Geospatial search and Data Search UI improvements (not yet publicly available)

Automated Testing

  • Improvements Data Search automation system

  • Added test cases to Data Search automation (increased coverage metric from 40% to 58%, remaining cases are simple file products and scalar data products (tested elsewhere))

Maintenance

  • Various bug fixes, including but not limited to:
  • Cache improvements
  • Add more data acquisition metrics to Grafana, add configurations and work on reactions

Data Products

  • HydroCal software updated with new metadata fields (serial numbers), handling biased wav data, saturation detection, calibration m-file metadata improved, calibration m-files now produced by default.

Earthquake Early Warning

  • Progress on integration of PNSN (Pacific NorthWest Seismic Network) data

SeaTubeV3 - CANARIE

  • Investigation of new technologies and requirements (no features)
  • Building page components

Dashboards - CANARIE

  • Investigation of new technologies and requirements (no features)

MINTED - CANARIE

  • Investigation and requirements (no features)

Tickets Released: Oceans 2.0: 18.12.000 (accessible to internal users only). Total: 47.

                              HydroCal App: HC.18.12.000 (accessible to internal users only). Total: 1.