diff --git a/.dockerignore b/.dockerignore index 96f5cd2..258af7b 100644 --- a/.dockerignore +++ b/.dockerignore @@ -17,3 +17,5 @@ data-raw/ CLAUDE.md TODO.md README.md + +logs/ diff --git a/.gitignore b/.gitignore index 5197580..b656ea4 100644 --- a/.gitignore +++ b/.gitignore @@ -27,10 +27,15 @@ data-raw/uscb/ # Derived data (rebuilt from data-raw via data-raw/main.R) data/owners.rds + +# Downloaded HOA documents (large, not committed) +www/docs/ data/venice.rds data/venice_facts.rds data/beaches.rds .Renviron .aider* .env -.env + +# Logs +logs/ diff --git a/CLAUDE.md b/CLAUDE.md index 98cc653..aba0cec 100644 --- a/CLAUDE.md +++ b/CLAUDE.md @@ -189,3 +189,8 @@ operation with no manual steps. - Geocoding used Google API via `tidygeocoder`; results cached in `data-raw/geotagged_street_addresses.rds` to avoid re-calling the API. - Point deduplication (multiple units at same address) was done manually in QGIS — not scripted. `owners_moved.gpkg` is the authoritative geocoded dataset. - `data-raw/` is gitignored except for the shapefiles in `data-raw/PlatBoundary/` and `data-raw/SarasotaCountyBoundary/` which are committed. + +## Ops + +- **Check latest refresh log:** `tail -50 /data/projects/r/stAndrews/logs/refresh.log` +- Cron runs every Sunday at 11pm; logs go to `logs/refresh.log` (not `~/`) diff --git a/TODO.md b/TODO.md index f6a8b8b..dd6153a 100644 --- a/TODO.md +++ b/TODO.md @@ -12,6 +12,9 @@ - [x] Add cron job to run `update_owners.R` weekly inside the rstudio container: Runs every Sunday at 11pm via crontab; restarts standrews_shiny after; logs to ~/standrews_update.log Tested end-to-end 2026-03-09 — 388 owners written, options(timeout=300) required for 87.5 MB download +- [x] Move cron log from ~/ to project dir (2026-04-16): + Log now writes to /data/projects/r/stAndrews/logs/refresh.log + logs/ added to .gitignore and .dockerignore ## Features diff --git a/data-raw/refresh_all.R b/data-raw/refresh_all.R index 06e830c..45c643c 100644 --- a/data-raw/refresh_all.R +++ b/data-raw/refresh_all.R @@ -32,4 +32,8 @@ source("./data-raw/update_owners.R") cat("\n--- update_sales.R ---\n") source("./data-raw/update_sales.R") +# ── Update listings ─────────────────────────────────────────────────────────── +cat("\n--- update_listings.R ---\n") +source("./data-raw/update_listings.R") + cat("\n=== Refresh complete", format(Sys.time()), "===\n") diff --git a/data/listings.rds b/data/listings.rds index 0930be1..23e5cbd 100644 Binary files a/data/listings.rds and b/data/listings.rds differ diff --git a/data/sales.rds b/data/sales.rds index 213a9d1..bd0e04c 100644 Binary files a/data/sales.rds and b/data/sales.rds differ