[BigQuery] memo (1)

1.수집 (extract/capture,ingest) 

2.변환/처리(tranform, process)

3.저장 (load, store)

(ETL,ELT)

*CDC(change Data Capture): 데이터 실시간 복

4. 분석(analyze)

5.활용(explore) -ML, 시각화

 

BigQuery / Dataproc(Managed Spark/Hadoop)

Realtime streaming Analytics ( Pub/Sub, Dataflow, Bigquery)

Horizontally Scalable SQL (Spanner)

---

QUERY = 기본 디폴트

PIPELINE = ELT 추가 작업 

ML_EXTERNAL = 행렬 인수분해 모델

---