Hive 3 (Architecture)

Design: components

Query Flow (Analysis from the Logs)

service.CompositeService (:()) — Session opened, SessionHandle [f8afd0d8-ec65–4bb8-a4c6-f5537781fcfb], current sessions:2
<PERFLOG method=waitCompile from=org.apache.hadoop.hive.ql.Driver>
ql.Driver (:()) — Acquired the compile lock.
ql.Driver (:()) — Compiling command(queryId=hive_20200408113511_15f380d1–2ad4–4f7f-bcbb-cfd97e38f2f6): select id,name from user_data_managed where age < 50 order by id limit 50
parse.ParseDriver (:()) — Parsing command: select id,name from user_data_managed where age < 50 order by id limit 50
parse.CalcitePlanner (:()) — Starting Semantic Analysis
parse.CalcitePlanner (:()) — Get metadata for source tables
org.apache.hadoop.hive.ql.parse.CalcitePlanner$CalcitePlannerAction Calcite: Plan generation>

--

--

--

Support Engineer @DataRobot

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Autowire all the implementations of an interface in Springboot

Introducing the New Hologram Dashboard

A Primer on Databases for Beginners Written by a Total Beginner

Tower of Hanoi Problem

How to set up CI/CD using docker and github actions

WHAT IS NEXT FOR UNICORP SPACE?

Learn These Things To Master Python: A Roadmap For Beginners

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Tamil Selvan K

Tamil Selvan K

Support Engineer @DataRobot

More from Medium

SQOOP Architecture and Commands

Apache Spark Typed/Untyped API and UDF Processing Performance

Sparkify Project

How to read table in parallel without partition column with JDBC reader