Data Extraction and Processing
If your stakeholders would like to see and access the data they contributed, it may become pertinent that you download and share the data yourself. To do this, you will need to follow the steps outlined in the NCEI/DCDB data extraction section. Once raw data are obtained from the DCDB, they should be tide corrected using the CSB Processing Tool in Pydro Explorer, following the instructions in the Pydro tidal corrections section.
NCEI/DCDB data extraction
Perform the following steps to extract CSB data from the DCDB:
- Go to the IHO Data Centre for Digital Bathymetry Viewer.
- Click the IHO DCDB/NOAA NCEI drop down menu, uncheck the ‘Multibeam Dataset’ layer(s), scroll down, and select the ‘Crowdsourced Bathymetry' layer (it is the last layer under the IHO DCDB/NOAA NCEI drop down menu).
- As an alternative to steps 1 and 2, you can use this link (bookmark it) to navigate directly to the CSB data, instead of having to deselect the multibeam data.
- Zoom in on the area from which you want to extract data. You can also open the ‘Filter Crowdsourced Bathymetry’ carat to filter for a certain date range, Provider (Trusted Node), or Platform (vessel name), and zoom to filter results. This filter service automatically populates the filter as URL parameters, and you can copy and paste/save the filtered URLs for ease of reference.
- When you are ready to extract data, click to expand the 'Filter by Geometry' menu in the upper right corner and select the option you would like to use. You may select a bounding box by clicking and dragging on the map, or enter max/min coordinates.
- Draw your bounding area of interest, select the ‘Extract CSB Point Store Data’ from the popup window. You will be prompted to enter an email address where the link to download files will be sent to. Do not check the box for ‘Create a Grid in addition to the XYZ points file.' Leave the default for the rest of the options. NOTE: The Point Count value may remain at zero for large geographic extents or high density areas if the API times out while calculating your request. The data will still be delivered as requested.
- Depending on the current volume of requests and the size of your requested area, you should receive an email with a link to download your data within a few minutes.
Your CSB data are now downloaded and ready to have Pydro tidal corrections applied.
Pydro tidal corrections
Support Contact: Anthony Klemm, NOAA Office of Coast Survey
anthony.r.klemm@noaa.gov
A Windows operating system is currently required to use Pydro Explorer
Perform the following steps to process CSB data extracted from NCEI/DCDB to correct for tides and data-derived vessel transducer offset values:
- You will need to download the Pydro software here (supplemental downloads not required, just the base download).
- Follow the Data Extraction instructions to retrieve the data you want to process.
- When you receive the email link from NCEI, download the data and save it in an appropriate location.
- Open Pydro Explorer, navigate to the ‘BETA/EXPERIMENTAL’ section of the Applications pane, and select ‘CSB Processing.’
- Click 'Run Program'. You’ll see a Windows terminal execute the python environment and a GUI should eventually pop up.
If no GUI pops up, open the command line window to check if the following error was encountered: ModuleNotFoundError: No module named 'pyfes'
To resolve this error, enter the following line of code: conda install -c conda-forge pyfes -y
When the install is complete, close and re-open Pydro Explorer, navigate to the CSB Processing tool and click Run Program again. The GUI should pop up.
- In the popup window:
- (1) Locate and select the Folder containing the file you downloaded from NCEI; navigate to the Tide Zone file (see file path provided below); and specify an output folder.
-
-
- Note: make sure the input Folder you select contains only the data you wish to process, the tool will process all CSV files located in the folder.
-
-
- (2) Check the box to use automated BlueTopo data (unless a BAG/GeoTIFF of bathymetry covering the area of interest is available).
- (3) Leave the default settings checked and set the desired grid resolution (5-10 m) for your workflow.
- (1) Locate and select the Folder containing the file you downloaded from NCEI; navigate to the Tide Zone file (see file path provided below); and specify an output folder.
For use outside the United States, the CSB Processing tool has an option to use a global tide model (AVISO+ FES2022b) to resolve/correct depths to approximate Lowest Astronomical Tide (approx LAT).
Inside United States waters, it is recommended (but not required) to use the Discrete Tide Zoning model option instead.
US Tide Zone .shp location: C:\Pydro24\NOAA\site-packages\Python3\svn_repo\HSTB\CSB_processing\BETA_subordinate_tide_zones\tide_zone_polygons_new_WGS84_merge.shp
- Click 'Start Processing' and allow it to run. You can watch processing progress in the command line window. The application window will close when processing is complete.
Your CSB data are now tide corrected and have been output in a GeoPackage (.gpkg) that can be visualized using GIS software.