108 Data Analysis
File: Data Analysis - Standardized process to ingest raw data

Standardize the process of moving data from disk to cloud to database

Have a standardized, documented, procedures to move data into the database. This part is pretty easy but takes a long time for a newbie to figure out and could be done wrong, causing headaches later.

Moving data from local disk (or virtual machine) to S3 Data Analysis - Moving data from disk to S3

Sample commands to move data from s3 to redshift Data Analysis - Commands to move data from S3 to Redshift

Ingestion tools

(more detail necessary)
- S3
- Redshift COPY
- Spark

  • Me