22 December 2014
ERDDAP
- Added ERDDAP (OPeNDAP) functionality. ERDDAP (Environmental Research Division's Data Access Program) is a data server that gives you a simple, consistent way to download subsets of scientific datasets in common file formats and make graphs and maps.
- On the oceannetworks.ca website it's it’s under Data & Tools as OPeNDAP Web Services.
- On the dmas.uvic.ca website see OPeNDAP Web Services on the Tools menu.
...
- Annotations uploaded using a file now have the option of declaring them reviewed and shareable immediately.
- Implemented the framework to allow plots of large amounts of data (eg. over 1 year) to display quickly by using the Cassandra database (this is just the framework; it is not being used yet).
- Installed and began to configure an OPeNDAP server (an instance of ERDDAP) which will allow us to eventually serve NetCDF files as well as other file formats over OPeNDAP.
- Images from the VENUS 3D camera are now being received and archived.
- Implemented a scheduled job to retrieve data from the instruments on the Spirit of Vancouver Island ferry, via FTP.
- Modified the Network Console and database to make it easier to add new observatories and modify existing ones. This will be used to "create" the new FORCE observatory described above.
- Started the process of using the same software to produce data products for the same instrument type for both VENUS and NEPTUNE, starting with the AZFP.
29 September 2014
WARN (Web-enabled Awareness Research Network)
...
- Added the ability to view the most recent underwater and (where applicable) dock camera videos for the community observatories (currently Mill Bay, British Columbia and Cambridge Bay, Nunavut.)
- Added "quick plots" to show the data from user-selectable sensors and data ranges. These plots automatically update over time, and it is not necessary to have an account or to log in in order to see the data. They can be copied and pasted into a user's document.
- Added the ability to copy and embed HTML code into a user's web page in order to plot data of their choosing from one of the community observatories.
28 August 2014
Data Products
- Added "pressure VPS" data (ie. pressure from the CTD on the VPS in order to establish depth) to the data products for the SBE63 dissolved oxygen sensor on the VPS (Vertical Profile System).
- Modified all data products for all mobile devices to include whatever mobile position data is available for each reading (latitude, longitude, depth/altitude, pitch, roll, heading). This applies to all mobile devices such as Buoy Profile System (ie. Saanich Inlet Profiler), Vertical Profile System (ie. Barkley Upper Slope Profiler), ferry instruments, gliders, ROVs, ice buoys, etc.
- Improved profile plots and added daily inshore profile plots to the website.
- Initial changes to ADCP plots to make them more consistent across networks. Eg. changed intensity plots from compensated backscatter to RSSI, smarter ranges, removed extra time stamps, etc.
- Implemented standardized spectrogram data products for all hydrophones, enables posting live data to the website (will be brought online mid-september pending military driver changes).
- Implemented a tool to bulk import annotations. This will enable us to import libraries of hydrophone annotations, among other applications.
- Added clean option for quick plots.
- Finalized Kongsberg Rotary sonar data products, including handling of big files, speed and plotting improvements.
...
- Created a zoom feature for use on the spectrogram preview.
- Clicking on a spectrogram displays it full screen.
- Select individual hydrophone segments to the cart for download.
- Ability to select an entire day's worth of spectrograms for download.
- Ability to deselect a previously selected segment if download hasn't been requested yet.
- Ability to move to "next day" or "previous day".
- Display an icon when a spectrogram preview is not available but other data formats are available to download.
WARN
Progressed with the development of the tsunami-detection section of the WARN (Web-enabled Awareness Research Network) project. Added the following derived sensors to record the output from several tsunami detectors:
- Direct Detider Weighted Threshold changes state if the detided pressure ("DART Pressure Residual") value exceeds a threshold.
- Signal to Noise Ratio (using the STA/LTA algorithm) - outputs the ratio of the short term average to the long term average of the detided pressure.
- Signal to Noise Ratio Weighted Threshold - changes state if the Signal to Noise Ratio exceeds a threshold.
- WARN Kertosis - outputs the result of the Kertosis statistical analysis algorithm.
...
- Made some minor improvements to the Cruise maintenance pages.
- Created an FTP job to archive images captured by the Nikon D800 DSLR camera (which is not yet deployed).
- Added a "Take Event Sample" button for Sediment Traps in the device attribute page.
- Created a new group of Observatory level QAQC tests for mobile instruments.
2 April 2014
Digital Fishers
- Developed a new way of creating new Digital Fishers campaigns. See the Digital Fishers Campaign List item on the Tools menu. This should make it easier for non-programmers to create and test campaigns in the future before deploying them. Up to now it was not possible to view a new campaign without actually deploying it but now it can be previewed and corrected if necessary. Further improvements may be coming later. The Digital Fishers Video Management page has been hidden but is still available if needed.
- Relocated the videos played by Digital Fishers from Amazon to our internal servers.
- Upgraded SeaTube and Digital Fishers to use the latest version of JWPlayer (6.5) for streaming videos. This will allow videos from these applications to be viewed on iPhones and iPads.
...
- When a queued task is canceled, the name of the host that was running the task is now displayed.
- Did some planning and initial software development for the WARN project (Web-enabled Awareness Research Network) which will eventually provide notifications that the start of an earthquake and/or tsunami has just been detected in our area.
- Made the canceling of running tasks more robust.
- Scientific data is now written to the Cassandra database as well as to Oracle. This does not include quarterscalar data. Many other tasks were completed in the migration to Cassandra.
- Modified the driver for the Omegabus to make it more flexible.
- Migrated all Data Search data products (including metadata reports), quick plot, and Plotting Utility to use the new quarterscalardata table for all cases where data averaged over periods of 15 minutes and above are needed. This should improve performance, simplify the software, and reduce the chances of errors.
- The Simulator for the RM Young meteorological station now supports both push and pull modes.
18 February 2014
Data Search:
- Improved the rendering of hydrophone spectrograms when using the PDF format.
- Improved the contents of Data Search failure e-mails to include data options and site information.
- When data products are generated, now the status will change to "Completed" only after both the data product and metadata report have been generated.
- Sped up production of COVIS and BioSonics data products where the files already exist in the archives.
...
- In Task Monitor, tasks that cannot be cancelled while running now have their check box disabled so you cannot attempt to cancel them. As well, jobs that are in the process of being cancelled can be found by checking the new "Cancelling" checkbox in the filter area.
- Changed SensorCode to SensorName in SNMP traps from junction boxes.
- In the Junction Box Alarm page, the tabs are now in order of J number rather than breaker number.
- Made additional improvements to support the eventual switch to the Cassandra database.
- Developed a parser for the SCIMPI device.
- Modified the Site Maintenance page to handle mobile devices, such as devices mounted on ferries and drifting buoys.
- Improved the Omegabus transmitter driver/parser.
- Developed a UDP simulator for the Nikon camera.
- Developed a new parser for the Wetlabs ECO-FLS.
23 January 2014
Data Search:
- Prepared Data Search to handle the data products for the new SCIMPI device deployed to Clayoquot Slope (running autonomously for now) but will not be made searchable until the data is ready.
- Added additional data products for hydrophones, including .wav and .mp3 audio, .png and .pdf spectrograms, and .mp4 videos to show moving spectrograms with sound. Note that only limited videos are available at this time.
...