Data Management

Acoustic data management is a complex endeavor. There are many moving parts, and can collect terabytes of data in a survey. This page outlines the AST data management efforts, including directory structures and storage locations for different types of data.

This page provides the in-the-weeds data management details, which will likely only be relevant for AST program members. Users looking for more general information about acoustic-trawl data products should go to the Accessing Our Data page.

AST Google Shared Drive Structure:

Calibrations

The file structure for Survey Calibration data on the GDrive.

20210702_LASKER_SummerCPS
├── DATA
  ├── EK80
    ├── RAW
    ├── CALIBRATION
      ├── RAW
      ├── RESULTS
      ├── SETUP

Projects

The file structure for Projects on the GDrive.

CCE Mooring and Landers
├── Point Conception Lander
  ├── 06 (Deployment Number)
    ├── WBAT
      ├── RAW
      ├── SETUP
      ├── CALIBRATION
        ├── RAW
        ├── RESULTS
        ├── SETUP
      
    
California Current Ecosystem Buoys
  ├── CCE1
    ├── 02 (Deployment Number)
      ├── WBAT
        ├── RAW
        ├── SETUP
        ├── CALIBRATION
          ├── RAW
          ├── RESULTS
          ├── SETUP
        

Data Archiving:

We use the NCEI Software CruisePack to archive acoustic data. CruisePack is a data packaging and metadata gathering software tool NCEI developed to simplify data submission preparation for cruise-based data. All AST acoustic survey data should be archived to the NCEI Water Column Sonar Data Archive which is hosted on an Amazon Web Service (AWS) cloud database. Here are AST procedures for archiving acoustic data to NCEI.