Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

This page contains the current year's release notes and new features, primarily for Oceans 3.0 / 2.0 / DMAS, as well as any applications created/maintained by the ONC software engineering group, including mobile Apps and desktop/PC applications. In progress project status may be presented as well. The information below is written in plain language as much as possible. Detailed release notes are available on internal confluence pages (requires login).

...

Minor release: Bug fix for dataset landing load time, Data Preview links and file generation, EEW report, chat log and more.

Tickets Released: Oceans 23.0: 22.01.001 (accessible to internal users only). Total: 17.

Expand

Bug

  • [DMAS-67638] - Dataset Landing pages are not loading, even after waiting over an hour
  • [DMAS-67737] - Update the EEW Report Job to expand how it relates organizationdetections
  • [DMAS-67756] - Some Links on Data Preview for SOO Plots are Too Close to Each Other
  • [DMAS-67757] - Session errors when searches for files on the file management page
  • [DMAS-67788] - Occasional archiver disconnects on the EEW archiver
  • [DMAS-67796] - Chat Log Ingestion does not save / load the Chat Log config cookie
  • [DMAS-67803] - Chat Log isn't storing config values in a cookie in SeaTube V3

Task

  • [DMAS-66886] - Data Preview - make links of gif data products more accessible so it is easier too click on them
  • [DMAS-67437] - Update data product / MATLAB code to send emails via authenticated SMTP
  • [DMAS-67646] - Add typescript linter plugins
  • [DMAS-67722] - Update email sender user for Oceans 3.0
  • [DMAS-67790] - When clicking on a link in the Chat Log, open the link in a new tab instead of the same page
  • [DMAS-67795] - Add logging and buffer time to handle live log file availability delays

Implementation

  • [DMAS-67578] - Moving edit button to the left side of UI
  • [DMAS-67651] - Implement LandingPageButtons component
  • [DMAS-67729] - Filter chat log messages by the time range of the selected dive

Bug (ST)

  • [DMAS-67789] - Too many navdata-like chat log messages are being filtered out

February 1, 2022

Mega release. Contains progress from December 2021 and January 2022 (no January 1st release this year).

...

New Features or Improvements:

  • new Scheduled job: CODAR Configuration Contiguous DateTo
  • non-null jobname on Task Management
  • better date/time input tool on File Management, Topology View and Reprocess Console
  • delete own published plot on Plotting Utility
  • new search option (devicecode) on File Management page
  • implement dmasuserid for device quarantine
  • Two trx tables (groupprivilege, userpreference) and several indices and sequences
  • Email for "forgotten password"
  • modify AMLx parser converter for UV in the data message

Bug fixes:

  • DOI related issues
  • annotation buttons on sensor maintenance page

  • update IP for test Jira system

Annotation UI

  • Design for the annotation voting system to have annotations adjudicated by domain specialists
  • UI testing and finishing touches to new UI
  • Other bug fixes

Oceans 3

  • Replaced "Oceans 2.0" text with "Oceans 3.0"
  • New landing page (in-progress)

CIOOS: ERDDAP

  • Backend support for OBIS exports
  • New scheduled job to create event.csv for OBIS exports
  • Clean up unused column for dataset record tracking
  • Continuing ERDDAP support after 2.14 update

...

  • Update to magnetic declination (simplify / refactor it - no numerical change)
  • Handle raw file table truncation for data preview generation
  • Device-level MATLAB products for JBs
  • DB configuration update
  • Improve figure handling / memory leak
  • Email sending update

Instruments

  • External receiver queue accepts new format of messages (for Kugluktuk AIS)
  • New jep function for rinko oxygen
  • Changes to RBRConcertoTiltMeter, TetraAccelerometer and TitanAccelerometer drivers
  • Driver deployment required to fitlets and PA.
  • Driver for Valeport Current meter
  • Reprocessing bug, changes made to cache, including bug that never made it to production

Earthquake Early Warning

  • Date formatting problem in EEW web page
  • Selenium tests for eew page
  • Allow tokens on EEW web service
  • Display Organization detection IDs and event urls in Organization Detection table
  • Extra info on earthquake detection page
  • Add deep links for the earthquake catalog filters

Tickets Released: Oceans 2.0: 22.01.000 (accessible to internal users only). Total: 191.

Expand

Bug

  • [DMAS-66594] - Customizing a SeaTube layout highlights the "Public" layout in the menu
  • [DMAS-67072] - Service desk dropdown is disabled in QA
  • [DMAS-67321] - Dev failing to send forgotten password email
  • [DMAS-67337] - Jenkins test status emails aren't being sent
  • [DMAS-67364] - annotation buttons on sensor maintenance page are missed
  • [DMAS-67367] - Oceans 2 fails to start up in QA: unresolved package javax.mail 1.6.0
  • [DMAS-67420] - Data Preview showing incomplete complex data from Echosounder @Saanich Inlet VENUS Instrument Platform
  • [DMAS-67454] - Step Cast option for the cast scalar profile plot (DP 61) needs to filter out casts that aren't combined into step casts
  • [DMAS-67470] - CODARDownloadTask tests fail around January 1
  • [DMAS-67536] - Error Reprocessing EEW accelerometer
  • [DMAS-67569] - Can't create a taxonomy attribute with same name even other attribute in the other group
  • [DMAS-67598] - qaqc service failing for all devices in QA
  • [DMAS-67608] - Users can't download any playlist
  • [DMAS-67623] - Oceans Next version notification timers aren't removed after a redeployment
  • [DMAS-67637] - Preview generation long job time
  • [DMAS-67663] - Incorrect Date being sent to back end during chat log ingestion
  • [DMAS-67671] - When downloading many CF casts from a station as a COR file, the "END DATA" line overlaps with the "Deployment" line
  • [DMAS-67676] - Incorrect header used in step 3 of chat log ingestion
  • [DMAS-67689] - Search failure in QA automation for netCDF profile gridded data
  • [DMAS-67717] - Chat Log panel displaying with no height after ingestion in SeaTube V3
  • [DMAS-67721] - Cannot create new annotation from DMAS main menu "More", "Annotations", "New annotation"
  • [DMAS-67733] - SiteDeviceSubsetMaintenance does not redirect to SiteDevice page on save
  • [DMAS-67739] - URL Query does not match QA
  • [DMAS-67750] - Remove formsection 94

User Story

  • [DMAS-19662] - As an operator, I would like to be able to stop and start drivers on a schedule
  • [DMAS-25072] - As a creator of published plots on plotting utility, I would like the ability to be able to delete the published plots if I created them
  • [DMAS-50989] - As a Community Fishers data user, I would like configurable cast data products from Data Search
  • [DMAS-56294] - As a data steward, I would like a better date/time select tool (especially time)
  • [DMAS-56514] - As an Iqaluit Community Fishers Data Partner, I want to have the crude oil and refined fuels sensor added into suite (CTD, Oceans 2.0 data base and Pipeline data processing jobs)
  • [DMAS-57132] - As a user from NOAA, I would like to display chat logs into Ocean's 2
  • [DMAS-57835] - As a data specialist, I want cast data products to include annotations that they have been verified after being reviewed
  • [DMAS-64661] - As a data stewardship member, I would like to automatically update CODAR config file datetos when new files are archived
  • [DMAS-66713] - As a software developer, I want to extract session-handling boilerplate from DAOs to reduce the surface for bugs and reduce the number of tests needed
  • [DMAS-66862] - Import CSV with vocabularies and vocabulary terms to Taxonomies
  • [DMAS-66947] - As a Data Specialist, I want to re-post-process multiple Site Device Subset Ids at the same time.

Task

  • [DMAS-54910] - please remove two unused sequences (tm_taskgroup_seq and tm_taskdetail_seq)
  • [DMAS-56792] - jobs without names should not be created through the TaskManagement page
  • [DMAS-57135] - fix dmasuserid for quarantine operations
  • [DMAS-57851] - Add Monitoring to send a Notification/e-mail if a CF Pipeline job fails with an error
  • [DMAS-57933] - Add unassigned casts layer to Geospatial map
  • [DMAS-64392] - In PU only show CF nodes that have data
  • [DMAS-65593] - Can we include dmasuserid in dmas.log to tell who start or stop machine in reprocess?
  • [DMAS-66392] - Add indexes for sy_token
  • [DMAS-66468] - Remove extra UUID column from the database
  • [DMAS-66701] - Write a script to update some incorrect tasktypeid in prod database
  • [DMAS-66730] - As a Data specialist, I would like extend the search field option to include deviceCode
  • [DMAS-66848] - Check on magnetic declination calculation
  • [DMAS-66995] - the state of devicetype DOI minting job 378 indicates completed when it is actually still running, causing problems when running job again before it is actually finished
  • [DMAS-67006] - document job 370 for DOI Tombstone Job
  • [DMAS-67177] - please create hist or trx table for groupprivilege database table
  • [DMAS-67225] - Allow Resource type to be changed when opening Annotation Entry from Device and Sensor
  • [DMAS-67264] - Add dateto to hydrophone sensitivity device attributes when adding new attributes through the device attribute upload
  • [DMAS-67282] - Return unassigned casts from GeospatialAreaService
  • [DMAS-67317] - as a Community Fishers data user, I would like Data Search to automatically apply the CF Sampling station filter when using a deep link to a CF Node
  • [DMAS-67326] - Update CF preview job to generate plots for unassigned casts
  • [DMAS-67386] - Investigate December 9th earthquake detection
  • [DMAS-67452] - Update all "Oceans 2.0" strings to "Oceans 3.0" in java code
  • [DMAS-67457] - Change links to DeviceListing in Oceans Next code to use OpenInNewLink
  • [DMAS-67472] - Update matlab code to use "Oceans 3.0" instead of "Oceans 2.0"
  • [DMAS-67493] - Apply changes to community fishers cast detection to VPS and BPS as well
  • [DMAS-67496] - EEW Event expression - move to JSON format only
  • [DMAS-67497] - Add job.failed.email.recipients job parameter for CF pipeline jobs
  • [DMAS-67498] - Add device-level MATLAB data products for JBs
  • [DMAS-67499] - move "migrated" earthquake files to Bitbucket
  • [DMAS-67532] - Investigate why we have different codecs for one ROV camera
  • [DMAS-67537] - new JEP formula for Rinko ARO-FT Oxygen Concentration Corrected
  • [DMAS-67547] - Do not send corrected cast emails from Cast Data (3) Correction Matlab Postprocess Job if no casts processed
  • [DMAS-67597] - New driver attributes for P/Swave_forgetting_factor and amplitude_step_size device attributes for EEW Accelerometer (350), Nanometrics Titan EA (156) and RBR Tilt Meter (430)
  • [DMAS-67601] - Replace references to qapgsql2 with qapgsql1 in Oceans2 code
  • [DMAS-67603] - Replace references to qapgsql2 with qapgsql1 in MATLAB code
  • [DMAS-67607] - Migrate Drupal Earthquake Dashboard code for new IG website
  • [DMAS-67611] - Show cast reviewed status on popup
  • [DMAS-67613] - Store last location in geospatial map
  • [DMAS-67614] - Update the password reset link to use https
  • [DMAS-67617] - Create _trx table for UserPreference database table
  • [DMAS-67618] - Can't commit to Earthquake Dashboard repo
  • [DMAS-67643] - modify AMLx parser converter for UV in the data message
  • [DMAS-67646] - Add typescript linter plugins
  • [DMAS-67654] - Clarify use of code handling redirects to/from SSL from Oceans 3
  • [DMAS-67670] - Create location based URLs on geospatial map
  • [DMAS-67723] - Change background color of chat log entries

Requirement

  • [DMAS-67201] - Write CSV Upload acceptance criteria and requirements
  • [DMAS-67379] - Requirements for user configurable community fishers cast dataproducts

Design

  • [DMAS-64781] - Back end design for NOAA Chat Logs
  • [DMAS-65468] - Design taxon csv upload
  • [DMAS-66372] - Design how to display chat logs in Seatube V3
  • [DMAS-67385] - Design for user configurable dataproducts
  • [DMAS-67566] - Design/prototype to link to documentation from dataproduct options on datasearch

Implementation

  • [DMAS-54859] - Update GlobalProperties when loading the ConfigProperty cache
  • [DMAS-64161] - Implement JMS Ingestion protocol
  • [DMAS-66772] - Java Code change for Contiguous Archive File Job
  • [DMAS-66773] - SQL change for Contiguous Archive File Job
  • [DMAS-66859] - Adjust logging
  • [DMAS-66974] - Add a utility to more easily manage sessions
  • [DMAS-67049] - Use the stream's VUI parameters to parse timestamps
  • [DMAS-67071] - Add job for OBIS export and generate event.csv with header
  • [DMAS-67125] - Create DiveDataset class
  • [DMAS-67186] - Add OBIS dataset
  • [DMAS-67217] - Back end logic for NOAA Chat Log Ingestion
  • [DMAS-67260] - Implement page for showing earthquake information
  • [DMAS-67267] - Backend for new Ingestion Landing Page
  • [DMAS-67269] - Implement frontend for SeaTube Ingestion landing page
  • [DMAS-67270] - Add a stepper
  • [DMAS-67272] - Create new cast reviewed column in im_sitedevicesubsetcastdefinition table - Database
  • [DMAS-67273] - Create new cast reviewed column in im_sitedevicesubsetcastdefinition table - Java
  • [DMAS-67274] - Add step 1: Provide Chat Log Information
  • [DMAS-67275] - Add step 2: Select Parsing Method
  • [DMAS-67276] - Add step 3: Preview
  • [DMAS-67277] - Add step 4: Ingest
  • [DMAS-67279] - Add backend logic to filter cruises and dives by date
  • [DMAS-67291] - Implement front end checkbox for cast reviewed status
  • [DMAS-67302] - Parser Injection - Allow specifying target broker
  • [DMAS-67311] - Support using SSL to connect to LDAP
  • [DMAS-67338] - Disable LDAPS by default
  • [DMAS-67340] - Add 'get all' operation to SiteDeviceSubsetService
  • [DMAS-67347] - Clean up login logging a bit
  • [DMAS-67360] - Add cast reviewed status to Community Fishers Dataproducts
  • [DMAS-67365] - Add Chat Log Panel to the SeaTube layouts
  • [DMAS-67376] - Implement Cast Re-process Management Design
  • [DMAS-67381] - Add proper permissions for the SeaTube Ingestion page
  • [DMAS-67389] - Put Cast Re-post-process Management page in DMAS
  • [DMAS-67393] - Update the report job email to include a link to the earthquake catalog page And fixes
  • [DMAS-67394] - Implement running community fishers cast detection on one potential cast at a time
  • [DMAS-67397] - Write SQL to create data product options for configurable cast data products
  • [DMAS-67400] - Create Driver for Valeport Current Meter
  • [DMAS-67418] - Extract Chat Log from existing annotation list
  • [DMAS-67422] - Implement configurable cast processing
  • [DMAS-67430] - Add configurable task definition field for dataproductformatid
  • [DMAS-67438] - Improvements to the earthquake catalog and details pages
  • [DMAS-67451] - Daf processing performance improvments
  • [DMAS-67456] - Switch from ant to gradle and copy Wowza dependencies into the project
  • [DMAS-67459] - Remove any Chat Log-related functionality from the Annotation List
  • [DMAS-67464] - Add support for annotations to OBISDataset
  • [DMAS-67475] - Support processing for crude oil sensor in pipeline
  • [DMAS-67477] - Support crude oil sensor in community fishers dataproducts
  • [DMAS-67479] - Use executeInSession in EW, ED, FM
  • [DMAS-67480] - Use executeInSession in TX, CU, EE
  • [DMAS-67481] - Use executeInSession in ST and parts of IM
  • [DMAS-67482] - Use executeInSession in DP, PR, DQ, DD
  • [DMAS-67483] - Use executeInSession in DA
  • [DMAS-67484] - Use executeInSession in AM
  • [DMAS-67485] - Use executeInSession in misc modules
  • [DMAS-67486] - Use executeInSession in IM modules
  • [DMAS-67491] - Update DiveDataset to include the taxon data needed for OBIS export
  • [DMAS-67521] - Add support for surveys
  • [DMAS-67525] - UI improvement to avoid creating job without name
  • [DMAS-67526] - update database tm_taskdefinition to avoid null value for name column
  • [DMAS-67533] - Rename all oceans 2->3 in oceans next code
  • [DMAS-67534] - Rename all occurrences of oceans 2 in databases to oceans 3
  • [DMAS-67542] - Allow null in st_chatlog_user.username
  • [DMAS-67543] - Update dataproduct options set in data product delivery call on the geospatial map
  • [DMAS-67563] - Add date indices on cruise and dive tables
  • [DMAS-67572] - Change date/time input for File Management
  • [DMAS-67573] - Change date/time input for Reprocess Console
  • [DMAS-67580] - change date/time tool for Topology page
  • [DMAS-67591] - Add new column to formfield to contain links to data product option documentation
  • [DMAS-67592] - Implement links to documentation from dataproduct options on datasearch
  • [DMAS-67594] - update web services to authenticate with a user token
  • [DMAS-67599] - Exclude navigation chat log lines during file read
  • [DMAS-67610] - Display Organization detection Ids and event urls in Organization Detection table
  • [DMAS-67616] - Create database scripts for DeviceTypeAttributes
  • [DMAS-67622] - Plotting utility delete published plots oceans 2.0 changes
  • [DMAS-67627] - Implement Deep Links in Data Search
  • [DMAS-67633] - Create database table for Annotation Review
  • [DMAS-67649] - Display Sites that detected a pwave or swave but did not get associated to an event
  • [DMAS-67657] - Create date check between selected date and dates in the text file
  • [DMAS-67658] - Map Chat Log Ingestion page into Oceans 3.0
  • [DMAS-67667] - Write SQL to set documentation links for Configurable Cast Processing Formfields
  • [DMAS-67669] - Don't consider the time portion of the given date on the backend
  • [DMAS-67672] - add deep links for the earthquake catalog filters
  • [DMAS-67702] - Add proper permissions for the Chat Log Ingestion page
  • [DMAS-67704] - Add general chat log message uniqueness constraint
  • [DMAS-67707] - Implement Deep links with code instead of number

Test

  • [DMAS-67371] - Add update to post-refresh DB script to flip a cast's reviewed status to true.
  • [DMAS-67476] - Add test cases for crude oil sensor to search automation

Bug (ST)

  • [DMAS-67234] - Figure not closing for dataproductformat 53 and 256
  • [DMAS-67341] - Multiqueue memory leak
  • [DMAS-67348] - Non-SSL LDAP port is incorrect in the database post-refresh scripts
  • [DMAS-67494] - Failed to load ConfigProperty cache on one host in nightly integration testing
  • [DMAS-67564] - timestamps appear as current time when they null
  • [DMAS-67589] - Wowza fails to run when the date-time-generator module is installed
  • [DMAS-67650] - Chat log lines don't parse as expected if the username has a hyphen
  • [DMAS-67678] - Searches without cast configuration options are causing errors
  • [DMAS-67687] - SeaTube Ingestion page has a bit of overhang at a smaller breakpoint
  • [DMAS-67690] - Resolve issues pointed out by Matlab search automation.

Documentation

  • [DMAS-67357] - Document setting up remote debugging of jdbc in remote tomcat
  • [DMAS-67368] - Update requirements to include cast reviewed
  • [DMAS-67372] - Documentation for codar contiguous dateTo job
  • [DMAS-67519] - Document new dataproduct options
  • [DMAS-67660] - Write documentation for configurable cast processing dataproduct options
  • [DMAS-67703] - Update data product documentation for data product 139 152

January 18, 2022

Minor release: Bug fix for taxonomy attribute

Tickets Released: Oceans 2.0: 21.11.004 (accessible to internal users only). Total: 1.

Expand

Bug

  • [DMAS-67570] - Can't create/update taxonomy attribute for a taxonomy root

January 11, 2022

Minor release: Bug fixes for new annotation UI and ERDDAP datasets

Tickets Released: Oceans 2.0: 21.11.003 (accessible to internal users only). Total: 2.

Expand

Bug

  • [DMAS-67421] - New ERDDAP datasets not appearing in UVic ERDDAP
  • [DMAS-67505] - Annotation V2 links not bringing up annotations

January 5, 2022

Minor release: Bug fixes for SeaTube V3 annotations, ERDDAP, DOI job, driver schedule and data products

Tickets Released: Oceans 2.0: 21.11.002 (accessible to internal users only). Total: 19.

Expand

Bug

  • [DMAS-67335] - Annotation table isn't sorting ID correctly
  • [DMAS-67350] - Annotation Entry not always clearing fields
  • [DMAS-67356] - There are no Resource options in Annotation Entry
  • [DMAS-67370] - ERDDAP datasets aren't loading correctly
  • [DMAS-67411] - DOI Job fails for all non memorial buoy devices
  • [DMAS-67425] - DMAS Search Failed Notification: 16-Dec-2021 00:31:23 UTC, Cascadia Basin-ODP 1026, Time Series Scalar Plot, SearchHdrId 11177213, UserId 108970
  • [DMAS-67434] - DMAS Search Failed Notification: 16-Dec-2021 19:55:58 UTC, Barkley Canyon Upper Slope-Upper Slope Vertical Profiler, Time Series Scalar Profile Plot and Gridded Data, SearchHdrId 11181631, UserId 15223

Task

  • [DMAS-67377] - Upgrade datasets generator to provide html for start body with ONC data

Implementation

  • [DMAS-66418] - Remove VersionNumber column from Database
  • [DMAS-67396] - Add specific error message when trying to save a non-existing deviceId
  • [DMAS-67416] - Modify By should display name instead of ID backend
  • [DMAS-67419] - Description should be a required field
  • [DMAS-67442] - Modify By should display name instead of ID react
  • [DMAS-67448] - Moving edit button to the left side of UI
  • [DMAS-67450] - Device IDs should be clickable
  • [DMAS-67489] - Wait for tempscalardata records to be deleted in initializeReprocessing

Bug (ST)

  • [DMAS-67363] - Driver Schedule end date appears as local time when editing