Final data
Final CTD data have passed through the CalCOFI quality control process and are considered the best data we provide. After standard SBE Data Processing (Seabird's data processing suite) tuned for our SBE 911 or 911+, the CTD asc files are additionally processed by SIO-CalCOFI in-house software (BtlVsCTD). Averaged (4-sec or 1m binavg) CTD sensor data are matched with corresponding bottle data and corrected two ways: cruise-corrected and station-corrected.
The final CTD.csvs include three versions of sensor data:
- SBE-processed data; no bottle corrections applied
- Cruise-corrected CTD data (column labels '_CruiseCorr'); cruise-corrected data are CTD sensor data corrected using regression coefficients derived from 4-sec ave sensor data vs bottle data comparisons for the entire cruise (all casts with bottle samples; n=~1400; fliers omitted).
- Station-corrected CTD data (column labels '_StaCorr') are CTD sensor data corrected using regression coefficients generated dynamically for each cast, 1m binavg sensor data vs bottle data (n=~20; fliers omitted). Since sensor behavior may vary from station-to-station, station-corrected CTD data for salinity, oxygen, estimated NO3, estimated chlorophyll-a; corrected using the individual cast bottle samples station-corrected CTD sensor data are considered the best, particularly for estimated nitrate.
Prior to the adoption of the station and casts csv data processing formats in 2012. SIO-CalCOFI processed bottle data using the IEH-format developed in 1983 from the original CalCOFI SD2 data format. Fortran programs from a VMS mini-computer were ported to IBM PCs running DOS initially then updated to run under Windows. Each software transition was tested to insure the calculated data were identical - VMS vs DOS, DOS vs Windows, IEH vs Sta.csvs.
In order to bottle-correct CTD sensor data from cruises prior to the switch to sta.csvs in 2012, IEH files are required. Using SIO-CalCOFI authored software, BtlVsCTD.exe, this is done seamlessly but some additional checks are required.
This short list outlines those differences:
- Use the cruise's "arch.ieh" file (YYMMarch.ieh such as 1004arch.ieh), not the "terpled" ieh (YYMMt.ieh ie 1004t.ieh). "Terpled" (interpolated) bottle data should not be used to bottle-correct CTD sensor data. Only actual bottle samples should be compared to CTD data.
- "Arch.ieh" files should have sigma-theta and oxygen saturation in the optional "wildcard" columns (104-110). This originally required a DOS program Addstho2.exe to be run on the YYMMarch.ieh file(s). These two columns of calculated data are sometimes missing from archived ieh files so adding them prior to running BtlVsCTD is recommended in order to generate bottle oxygen data in uMol/kg.
- When running BtlVsCTD.exe, be sure to checkbox "IEH" under "Bottle Data Source File" in the upper right on the main form. On the next form, be sure "yymmarch.ieh" is selected. This is the default setting but double-check and make sure the arch.ieh file is in the same CTD data directory. This will generate the merged CTD + bottle csv file that is imported into Excel for calculating the salt offsets and sensor regressions.
- YYMMarch.ieh should be in the CTD data directory. Occasionally, downloaded IEH files are formatted without "line feed/caridge return" (ie DOS text format) and reads like one long line of text. This can be corrected with a text editor such as Ultradedit using the Unix/Mac to DOS text conversion. This is under menu "File/Conversion" in Ultraedit.
- *2004 ISUS + 9 additional stations added: an ISUS nitrate sensor and 9 additional SCCOOs stations were added in 2004. Prior to these station additions, a typical CalCOFI cruise occupied 66 stations. Winter & Spring cruises can include more if the station pattern extends north of Pt Conception.
- *Aug 2009: a new 911+ CTD & deck unit (v2) were purchased with new dual sensor arrays including dual O2 sensors - cruises prior to 0908 had dual T & C but only one O2 sensor. CalCOFI started using a version 2 deck unit, which automatically offsets the secondary conductivity sensor . Secondary conductivity sensor data from earlier cruises (1992-200407) require an offset of 0.073secs in AlignCTD. A SBE 18 pH sensor was added to the sensor array in late 2009.
*BtlVsCTD should handle all sensor configurations and generate the same number of data columns regardless of sensors deployed or missing. The voltage channels for each sensor have been somewhat standardized on recent cruises. But sensors may be on different voltage channels depending on the sensor array deployed. Refer to the cast's .hdr, .con files, or cruise CTD summary for sensors used & their arrangement.
Seasoft Note: CalCOFI's Seabird CTD raw data from mid-1998 to present can be processed using Seasoft for Windows. The raw CTD data collected before Sept 1998 (9808 and earlier) require Seasoft for DOS. Seasoft for DOS will run on Windows XP, 7, or 10 computers using a DOS command line. Windows XP has a compatible DOS command executable that will run Seasoft for DOS. On Windows 7 or 10 computers, a DOS program called DOSBox can be used to run Seasoft for DOS. Seasoft for DOS is required to convert the raw CTD .dat files to .cnv, which can then be processed by Seasoft for Windows. DOSBox will also run Addstho2.exe which will add sigma-theta and oxygen saturation columns to IEH files.
20 Aug 2020 - posted final re-processed 0110NH CTD data: 20-0110NH_CTDFinalQC & DB.zip
30 Jun 2020 - posted final re-processed 0201JD CTD data: 20-0201JD_CTDFinalQC & DB.zip
22 Jun 2020 - posted final re-processed 0204JD CTD data: 20-0204JD_CTDFinalQC & DB.zip
15 Jun 2020 - posted final re-processed 0207NH CTD data: 20-0207NH_CTDFinalQC & DB.zip
03 Jun 2020 - posted final re-processed 0211NH CTD data: 20-0211NH_CTDFinalQC & DB.zip
26 May 2020 - posted final re-processed 0302JD CTD data: 20-0302JD_CTDFinalQC & DB.zip
22 May 2020 - added 0304RR extra CTD sta data to final re-processed CTD data: 20-0304RR_CTDFinalQC
19 May 2020 - posted final re-processed CTD data from 0304JD: 20-0304JD_CTDFinalQC & DB.zip
17 May 2020 - posted final re-processed CTD data from 0304RR: 20-0304RR_CTDFinalQC & DB.zip
26 Mar 2019 - posted final processed CTD data from 1804SH: 20-1804SH_CTDFinalQC & DB.zip
19 Mar 2019 - posted final reprocessed CTD data from 0504NH: 20-0504NH_CTDFinalQC & DB.zip
16 Mar 2019 - posted final reprocessed CTD data from 0507NH: 20-0507NH_CTDFinalQC & DB.zip
13 Mar 2019 - posted final reprocessed CTD data from 0511NH: 20-0511NH_CTDFinalQC & DB.zip
05 Mar 2019 - posted final reprocessed CTD data from 0602JD: 20-0602JD_CTDFinalQC & DB.zip
01 Mar 2019 - posted final reprocessed CTD data from 0604NH: 20-0604NH_CTDFinalQC & DB.zip
25 Jan 2019 - posted final reprocessed CTD data from 0607NH: 20-0607NH_CTDFinalQC & DB.zip
24 Jan 2019 - posted final reprocessed CTD data from 0610RR: 20-0610RR_CTDFinalQC & DB.zip
18 Jan 2019 - posted final processed CTD data from 1802SH: 20-1802SH_CTDFinalQC & DB.zip
Also re-posted 20-1802SH_CTDCast.zip w/ sta correction to Cast 045
17 Jan 2019 - reposted final processed CTD data from 1711SR: 20-1711SR_CTDFinalQC & DB.zip w/ missing transmissometer data
16 Jan 2019 - reposted final processed CTD data from 1708SR: 20-1708SR_CTDFinalQC & DB.zip w/ missing transmissometer data
10 Jan 2019 - reposted final processed CTD data from 1704SH: 20-1704SH_CTDFinalQC & DB.zip w/ missing transmissometer data
08 Jan 2019 - reposted final processed CTD data from 1701RL: 20-1701RL_CTDFinalQC & DB.zip w/ missing transmissometer data
03 Jan 2019 - reposted final processed CTD data from 1611SR: 20-1611SR_CTDFinalQC & DB.zip w/ missing transmissometer data
13 Dec 2018 - posted final reprocessed CTD data from 0701JD: 20-0701JD_CTDFinalQC & DB.zip
07 Dec 2018 - re-posted preliminary CTD data from 1810SR: 20-1810SR_CTDPrelim.zip, fixing Line.Sta on casts 054-059
27 Nov 2018 - posted final reprocessed CTD data from 0704JD: 20-0704JD_CTDFinalQC & DB.zips
27 Nov 2018 - posted prelim CTD data from 1810SR 20-1810SR_CTDPrelim & cast.zips; line.sta corrected for casts 54-59
09 Oct 2018 - posted final reprocessed CTD data from 0707NH: 20-0707NH_CTDFinalQC & DB.zips
20 Sep 2018 - posted final reprocessed CTD data from 0711NH: 20-0711NH_CTDFinalQC & DB.zips
14 Sep 2018 - posted final reprocessed CTD data from 0801JD: 20-0801JD_CTDFinalQC & DB.zips
13 Sep 2018 - entered missing event numbers into 0804JD CTD.csvs & reposted FinalQC & FinalDB zips
11 Sep 2018 - posted final reprocessed CTD data from 0804JD: 20-0804JD_CTDFinalQC & DB.zips
27 Aug 2018 - reposted raw CTD data for 0808NH: 20-0808_CTDCast.zip as some cast zips were corrupted
22 Aug 2018 - posted final re-processed bottle-corrected CTD data for 0810NH: 20-0810_CTDFinalQC.zip
14 Aug 2018 - posted final bottle-corrected CTD data for 1711SR: 20-1711SR_CTDFinalQC.zip
08 Aug 2018 - posted final bottle-corrected CTD data for 0901NH: 20-0901NH_CTDFinalQC.zip
06 Aug 2018 - (re)posted final bottle-corrected CTD data for 0903JD: 20-0903JD_CTDFinalQC.zip
22 May 2018 - posted final bottle-corrected CTD data for 1708SR: 20-1708SR_CTDFinalQC.zip
15 May 2018 - posted final bottle-corrected CTD data for 1704SH: 20-1704SH_CTDFinalQC.zip
15 May 2018 - fixed a station mislabeling on 1804 CTD casts 097 - labeled 63.3 50.0, should be 63.3 55.0
02 Mar 2018 - fixed a station mislabeling on 1802 CTD casts 045 - labeled 76.7 55.0, should be 76.7 70.0
02 Mar 2018 - fixed a station mislabeling on 1711 CTD casts 036 & 037 - they were labeled 86.4, should be 86.7
21 Feb 2018 - uploaded 1802SH CTD casts & preliminary data zips: 20-1802SH_CTDCast & CTDPrelim
06 Feb 2018 - uploaded revised FinalQC zips for 0911NH, with latest datacode format, revised file structure, filenames; bad ISUS voltages excluded
22 Jan 2018 - uploaded revised FinalQC zips for 1011NH, with latest datacode format, revised file structure, filenames; data unchanged
17 Jan 2018 - uploaded revised FinalQC zips for 1008NH, with latest datacode format, revised file structure, filenames; data unchanged
05 Jan 2018 - uploaded revised FinalQC zips for 1004MF, with latest datacode format, revised file structure, filenames; data unchanged