Refresh data, move logs to project dir, update docs
Some checks failed
Deploy stAndrews / deploy (push) Failing after 16s
Some checks failed
Deploy stAndrews / deploy (push) Failing after 16s
- Weekly refresh: 388 owners, 10 sales, 11 listings (2026-04-16) - Move cron logs from ~/ to logs/ in each project dir - Add logs/ to .gitignore and .dockerignore - Update CLAUDE.md with log location and ops notes - Update TODO.md with log relocation completion
This commit is contained in:
@@ -17,3 +17,5 @@ data-raw/
|
||||
CLAUDE.md
|
||||
TODO.md
|
||||
README.md
|
||||
|
||||
logs/
|
||||
|
||||
7
.gitignore
vendored
7
.gitignore
vendored
@@ -27,10 +27,15 @@ data-raw/uscb/
|
||||
|
||||
# Derived data (rebuilt from data-raw via data-raw/main.R)
|
||||
data/owners.rds
|
||||
|
||||
# Downloaded HOA documents (large, not committed)
|
||||
www/docs/
|
||||
data/venice.rds
|
||||
data/venice_facts.rds
|
||||
data/beaches.rds
|
||||
.Renviron
|
||||
.aider*
|
||||
.env
|
||||
.env
|
||||
|
||||
# Logs
|
||||
logs/
|
||||
|
||||
@@ -189,3 +189,8 @@ operation with no manual steps.
|
||||
- Geocoding used Google API via `tidygeocoder`; results cached in `data-raw/geotagged_street_addresses.rds` to avoid re-calling the API.
|
||||
- Point deduplication (multiple units at same address) was done manually in QGIS — not scripted. `owners_moved.gpkg` is the authoritative geocoded dataset.
|
||||
- `data-raw/` is gitignored except for the shapefiles in `data-raw/PlatBoundary/` and `data-raw/SarasotaCountyBoundary/` which are committed.
|
||||
|
||||
## Ops
|
||||
|
||||
- **Check latest refresh log:** `tail -50 /data/projects/r/stAndrews/logs/refresh.log`
|
||||
- Cron runs every Sunday at 11pm; logs go to `logs/refresh.log` (not `~/`)
|
||||
|
||||
3
TODO.md
3
TODO.md
@@ -12,6 +12,9 @@
|
||||
- [x] Add cron job to run `update_owners.R` weekly inside the rstudio container:
|
||||
Runs every Sunday at 11pm via crontab; restarts standrews_shiny after; logs to ~/standrews_update.log
|
||||
Tested end-to-end 2026-03-09 — 388 owners written, options(timeout=300) required for 87.5 MB download
|
||||
- [x] Move cron log from ~/ to project dir (2026-04-16):
|
||||
Log now writes to /data/projects/r/stAndrews/logs/refresh.log
|
||||
logs/ added to .gitignore and .dockerignore
|
||||
|
||||
## Features
|
||||
|
||||
|
||||
@@ -32,4 +32,8 @@ source("./data-raw/update_owners.R")
|
||||
cat("\n--- update_sales.R ---\n")
|
||||
source("./data-raw/update_sales.R")
|
||||
|
||||
# ── Update listings ───────────────────────────────────────────────────────────
|
||||
cat("\n--- update_listings.R ---\n")
|
||||
source("./data-raw/update_listings.R")
|
||||
|
||||
cat("\n=== Refresh complete", format(Sys.time()), "===\n")
|
||||
|
||||
Binary file not shown.
BIN
data/sales.rds
BIN
data/sales.rds
Binary file not shown.
Reference in New Issue
Block a user