WIN_data_ingest

Data ingestion and initial analysis from FL WIN water quality database and other sources.

Below is a demonstration of how to load the data.

For more information about the data please see “Provider Reports” in the top navigation.

read in the WIN txt pipe-delimited file for example program.

librarian::shelf(
  dplyr,
  glue,
  here,
  tidyr
)

source("R/getData.R")
df <- getData("BBAP")


===========================================
DATA LOADING FOR PROGRAM: BBAP===========================================

=== WIN Data Loading ===
Source: _WIN_WAVES_OTIS_BBAP.txtLoaded 30 columns--- Column statistics ---
No columns were dropped during processing
Final column count: 30------------------------

--- Data Summary ---
Total rows: 22524Total columns: 30------------------

--- Processing DMS Coordinates ---
No change in row count during DMS coordinate processing

--- Standardizing Column Types ---
Converted DEP.Result.ID to character type
Converted Activity.ID to standardized typeConverted WBID to standardized typeConverted Organization.ID to standardized typeConverted Lab.ID to standardized typeConverted Sample.Collection.Type to standardized typeConverted DEP.Result.Value.Number to standardized type===========================================

Print the first few rows of the dataframe

# head(df)

library(pander)

pander(head(df), digits = 6)

Table continues below
Organization.ID	Monitoring.Location.ID	Org.Decimal.Latitude
21FLBBAP	WQ04	25.826
21FLBBAP	WQ02	25.8533
21FLBBAP	WQ02	25.8533
21FLBBAP	WQ04	25.826
21FLBBAP	WQ04	25.826
21FLBBAP	WQ04	25.826

Table continues below
Org.Latitude..DD.MM.SS.SSSS.	Org.Decimal.Longitude
NA	-80.1341
NA	-80.1455
NA	-80.1455
NA	-80.1341
NA	-80.1341
NA	-80.1341

Table continues below
Org.Longitude..DD.MM.SS.SSSS.	WBID	Activity.ID	Activity.Type
NA	3226H6	WQ04-04/06/20	Sample
NA	3226H5	WQ02-05/05/20	Sample
NA	3226H5	WQ02-05/05/20	Sample
NA	3226H6	WQ04-04/06/20	Sample
NA	3226H6	WQ04-04/06/20	Sample
NA	3226H6	WQ04-04/06/20	Sample

Table continues below
Activity.Start.Date.Time	Matrix	Sample.Collection.Type
04/06/2020 12:35:00	AQUEOUS-Surface Water	Direct Grab
05/05/2020 15:00:00	AQUEOUS-Surface Water	Direct Grab
05/05/2020 15:00:00	AQUEOUS-Surface Water	Direct Grab
04/06/2020 12:35:00	AQUEOUS-Surface Water	Direct Grab
04/06/2020 12:35:00	AQUEOUS-Surface Water	Direct Grab
04/06/2020 12:35:00	AQUEOUS-Surface Water	Direct Grab

Table continues below
Sampling.Agency.Name	Activity.Depth	Activity.Depth.Unit
FDEP BISCAYNE BAY AQUATIC PRESERVES	1.691	m
FDEP BISCAYNE BAY AQUATIC PRESERVES	1.676	m
FDEP BISCAYNE BAY AQUATIC PRESERVES	1.676	m
FDEP BISCAYNE BAY AQUATIC PRESERVES	1.691	m
FDEP BISCAYNE BAY AQUATIC PRESERVES	1.691	m
FDEP BISCAYNE BAY AQUATIC PRESERVES	1.691	m

Table continues below
Activity.Top.Depth	Activity.Bottom.Depth	Activity.Depth.Top.Bottom.Unit
NA	NA	NA
NA	NA	NA
NA	NA	NA
NA	NA	NA
NA	NA	NA
NA	NA	NA

Table continues below
DEP.Result.ID	DEP.Analyte.Name	DEP.Result.Value.Number
7190664	Nitrate-Nitrite (N)	0.007
7187465	Nitrogen- Total Kjeldahl	0.28
7186300	Phosphorus- Total	0.01
7190134	Phosphorus- Total	0.011
7190741	Ammonia (N)	0.01
7189987	Nitrogen- Total Kjeldahl	0.26

Table continues below
DEP.Result.Unit	DEP.MDL	DEP.PQL	Value.Qualifier
mg/L	0.004	0.01	I
mg/L	0.16	0.4	I
mg/L	0.004	0.01
mg/L	0.004	0.01
mg/L	0.002	0.005
mg/L	0.16	0.4	I

Sample.Fraction	Lab.ID	Audit.Censored.Decisions
Total	E31780	NA
Total	E31780	NA
Total	E31780	NA
Total	E31780	NA
Total	E31780	NA
Total	E31780	NA

If you have visualization ideas for this data, please open a github issue here.