簡麗榮,HashDatatabasenHDFS總結fork程terStatsCollectorArchiverterAutofork程terStatsCollectorArchiverterAuto果libpq)(內存SLICE3ionionJOINcustomerSELECTcustomer,amountWHEREdate=2008;SLICE3ionionJOINcustomerSELECTcustomer,amountWHEREdate=2008;SLICE1SLICESLICE1LICESEGMENT1SEGMENTSEGMENT1SLICESLICE3QEProcessSlice2QEProcessSlice1Slice3QEProcessSlice2QEProcessSlice1QEProcessSlice2QEProcessSlice1Slice3QEProcessSlice2QEProcessSlice1—般來說,—般來說,N張表做連接需要2N個GangTABLE1主節(jié)點主節(jié)點接受客戶連接,處理請求,執(zhí)行認證處理解析樹,生成查詢計劃行處理解析樹,生成查詢計劃行Segment例Segment例Segment系統(tǒng)表本地事務Segment例Segment例Segment例Segment例SegmentInterconnectSegmentSegment例Segment例Segment例Segment資源,收集并返回結果給Segment資源,收集并返回結果給Segment例Segment例Segment例SegmentSegment例Segment例Segment例SegmentSegment例Segment例Segment系統(tǒng)表本地事務Segment例Interconnect資源,收集并返回結果給資源,收集并返回結果給Segment例Segment例Segment系統(tǒng)表本地事務Segment例Segment例Segment例Segment例SegmentInterconnectSegmentSegment例Segment例Segment例Segment資源,收集并返回結果給資源,收集并返回結果給entententSegmentSegment例Segment例SegmentSegment例SegmentSegment例Segment例Segment例SegmentSegmentSegment例Segment例Segment系統(tǒng)表本地事務Segment例Segment例Segment例Segment例SegmentInterconnectSegmentSegment例Segment例Segment例Segmentent志,確定合適提交和回滾Segment例Segment例Segment系統(tǒng)表本地事務Segment例Segment例Segment例Segment例SegmentInterconnectSegmentSegment例Segment例Segment例SegmentSegment例Segment實例egmentSegment3Segment例Segment例Segment0Segment7rrSegment0Segment點1Segment例SegmentSegment例Segment實例egmentSegment3Segment例Segment例Segment0Segment7rrSegment0Segment點1Segment例Segment例Segment0Segment1Segment例Segment實例Segment5Segment6(mirror)(mirror)表日志數據表日志數據Segment3Segment2Segment例Segment例mentSegment5Segment例Segment例Segment1egmentrrSegment實例Segment6Segment實例Segment3rSegment實例Segment7Segment實例mentr表日志數據表日志數據teryStandby例erAO日志AO分區(qū)數據統(tǒng)表Segment實例Segment實例Segment實例/goh/seg0/…/goh/seg1/…/goh/seg2/…erAO日志AO分區(qū)數據統(tǒng)表Segment實例Segment實例Segment實例/goh/seg0/…/goh/seg1/…/goh/seg2/…SegmentSegment節(jié)點1SegmentmentMetadataDispatch禁止更新和刪除,增加AO文件mentMetadataDispatch禁止更新和刪除,增加AO文件libhdfs問HDFSLC原生HDFS訪問庫AO分區(qū)數據Segment實例AO分區(qū)數據存儲Segment實例Segment實例AO分區(qū)數據時存儲AO分區(qū)數據時存儲erSegment表erSegment節(jié)點0Segment節(jié)點Segment實例AO分區(qū)數據存儲Segment實例Segment實例AO分區(qū)數據時存儲AO分區(qū)數據時存儲erSegment表erSegment節(jié)點0Segment節(jié)點1Segment節(jié)點2/goh/seg0/…/goh/seg1/…/goh/seg2/…數據分布:并行處理的基礎Segment實例Segment實例seg2seg0物理上分離,邏輯上集成Segment實例Segment實例seg2seg0Segment實例segseg1Segment實例Segment實例物理上分離,邏輯上也分Segment實例Segment實例Segment實例tbltbl2tbl0tbl3tbl4Segment實例Segment實例Segment實例seg2seg0Segment實例SegmentSegment實例Segment實例Segment實例seg2seg0Segment實例Segment實例tbl1tbl2tbl0tbl4tbl3ersegseg1erSegmentSegment實例Master