Refresh data, move logs to project dir, update docs
Some checks failed
Deploy stAndrews / deploy (push) Failing after 16s

- Weekly refresh: 388 owners, 10 sales, 11 listings (2026-04-16)
- Move cron logs from ~/ to logs/ in each project dir
- Add logs/ to .gitignore and .dockerignore
- Update CLAUDE.md with log location and ops notes
- Update TODO.md with log relocation completion
This commit is contained in:
2026-04-16 06:15:07 -04:00
parent ef5c62d2a6
commit 29f48172fb
7 changed files with 20 additions and 1 deletions

View File

@@ -17,3 +17,5 @@ data-raw/
CLAUDE.md CLAUDE.md
TODO.md TODO.md
README.md README.md
logs/

7
.gitignore vendored
View File

@@ -27,10 +27,15 @@ data-raw/uscb/
# Derived data (rebuilt from data-raw via data-raw/main.R) # Derived data (rebuilt from data-raw via data-raw/main.R)
data/owners.rds data/owners.rds
# Downloaded HOA documents (large, not committed)
www/docs/
data/venice.rds data/venice.rds
data/venice_facts.rds data/venice_facts.rds
data/beaches.rds data/beaches.rds
.Renviron .Renviron
.aider* .aider*
.env .env
.env
# Logs
logs/

View File

@@ -189,3 +189,8 @@ operation with no manual steps.
- Geocoding used Google API via `tidygeocoder`; results cached in `data-raw/geotagged_street_addresses.rds` to avoid re-calling the API. - Geocoding used Google API via `tidygeocoder`; results cached in `data-raw/geotagged_street_addresses.rds` to avoid re-calling the API.
- Point deduplication (multiple units at same address) was done manually in QGIS — not scripted. `owners_moved.gpkg` is the authoritative geocoded dataset. - Point deduplication (multiple units at same address) was done manually in QGIS — not scripted. `owners_moved.gpkg` is the authoritative geocoded dataset.
- `data-raw/` is gitignored except for the shapefiles in `data-raw/PlatBoundary/` and `data-raw/SarasotaCountyBoundary/` which are committed. - `data-raw/` is gitignored except for the shapefiles in `data-raw/PlatBoundary/` and `data-raw/SarasotaCountyBoundary/` which are committed.
## Ops
- **Check latest refresh log:** `tail -50 /data/projects/r/stAndrews/logs/refresh.log`
- Cron runs every Sunday at 11pm; logs go to `logs/refresh.log` (not `~/`)

View File

@@ -12,6 +12,9 @@
- [x] Add cron job to run `update_owners.R` weekly inside the rstudio container: - [x] Add cron job to run `update_owners.R` weekly inside the rstudio container:
Runs every Sunday at 11pm via crontab; restarts standrews_shiny after; logs to ~/standrews_update.log Runs every Sunday at 11pm via crontab; restarts standrews_shiny after; logs to ~/standrews_update.log
Tested end-to-end 2026-03-09 — 388 owners written, options(timeout=300) required for 87.5 MB download Tested end-to-end 2026-03-09 — 388 owners written, options(timeout=300) required for 87.5 MB download
- [x] Move cron log from ~/ to project dir (2026-04-16):
Log now writes to /data/projects/r/stAndrews/logs/refresh.log
logs/ added to .gitignore and .dockerignore
## Features ## Features

View File

@@ -32,4 +32,8 @@ source("./data-raw/update_owners.R")
cat("\n--- update_sales.R ---\n") cat("\n--- update_sales.R ---\n")
source("./data-raw/update_sales.R") source("./data-raw/update_sales.R")
# ── Update listings ───────────────────────────────────────────────────────────
cat("\n--- update_listings.R ---\n")
source("./data-raw/update_listings.R")
cat("\n=== Refresh complete", format(Sys.time()), "===\n") cat("\n=== Refresh complete", format(Sys.time()), "===\n")

Binary file not shown.

Binary file not shown.