rkw/bank-fraud-baf-lakehouse
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Refactor bucket structure: baf-fraud/ prefix under lake bucket

Browse Source 
All functions now default to bucket_name = "lake" with "baf-fraud/"
prepended to all layer prefixes, matching the contemporary lakehouse
naming convention (one bucket per environment, project as prefix).

Migration: copy baf-fraud/ data to lake/baf-fraud/ on analyticsvm,
update BAF_BUCKET env var from "baf-fraud" to "lake".

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Rob Wiederstein
2026-02-22 05:36:25 -05:00
parent dac01da6cb
commit df978d042f
11 changed files with 63 additions and 63 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
man/convert_to_parquet.Rd
View File

@@ -4,14 +4,14 @@
\alias{convert_to_parquet}
\title{Convert BAF CSV to partitioned Parquet in MinIO (S3)}
\usage{
convert_to_parquet(from_prefix, to_prefix, bucket_name = "baf-fraud")
convert_to_parquet(from_prefix, to_prefix, bucket_name = "lake")
}
\arguments{
\item{from_prefix}{Character. Prefix/key under the bucket containing CSVs (e.g. \code{"01_raw"}).}
\item{to_prefix}{Character. Prefix/key under the bucket to write Parquet dataset (e.g. \code{"02_intermediate"}).}
\item{bucket_name}{Character. Bucket name. Default \code{"baf-fraud"}.}
\item{bucket_name}{Character. Bucket name. Default \code{"lake"}.}
}
\value{
A character string giving the destination dataset prefix (typically \code{to_prefix}).
@@ -36,6 +36,6 @@ Sys.setenv(
BAF_KEY = "YOUR_ACCESS_KEY",
BAF_SECRET = "YOUR_SECRET_KEY"
)
convert_to_parquet(from_prefix = "01_raw", to_prefix = "02_intermediate", bucket_name = "baf-fraud")
convert_to_parquet(from_prefix = "01_raw", to_prefix = "02_intermediate", bucket_name = "lake")
}
}