This workflow copies the contents of the turtle tagging database
WAMTRAM2 into the WA Sea Turtle Database (WAStD).
- Load the turtle tagging db WAMTRAM from its MS SQL Server database
into memory and save objects as RData
- Load existing tagging records from TSC: load only a minimal set of
source, source ID, QA status to determine later what to create / update
/ skip:
- does not exist in TSC: create (POST)
- exists in TSC with status “new”: update (PATCH)
- exists in TSC with status higher than “new”: skip (and message)
- Make (transform) WAMTRAM to TSC data
- Load transformed data into TSC’s API (create/update/skip)
- Extract tagging records from TSC again
- Show (map, tabulate, summarise) tagging records from TSC
- Compare tagging data from TSC to tagging data from WAMTRAM -
e.g. tally across factor levels (species, health, tag status). At least
compare: same number of sightings of same tag?
The current ETL process is being built in the R package etlTurtleNesting.
Progress is tracked at wastdr.