Hive 3 (Architecture)

Design: components

Query Flow (Analysis from the Logs)

service.CompositeService (:()) — Session opened, SessionHandle [f8afd0d8-ec65–4bb8-a4c6-f5537781fcfb], current sessions:2
<PERFLOG method=waitCompile from=org.apache.hadoop.hive.ql.Driver>
ql.Driver (:()) — Acquired the compile lock.
ql.Driver (:()) — Compiling command(queryId=hive_20200408113511_15f380d1–2ad4–4f7f-bcbb-cfd97e38f2f6): select id,name from user_data_managed where age < 50 order by id limit 50
parse.ParseDriver (:()) — Parsing command: select id,name from user_data_managed where age < 50 order by id limit 50
parse.CalcitePlanner (:()) — Starting Semantic Analysis
parse.CalcitePlanner (:()) — Get metadata for source tables
org.apache.hadoop.hive.ql.parse.CalcitePlanner$CalcitePlannerAction Calcite: Plan generation>

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store