You might have used Tez extensively if you are using HDP distribution of Hive but if you are new to the HDP/CDP or have used Hive on MR only, then this article will give you an quick overview on what Apache Tez is and how it uses the existing Yarn Architecture to speed up the Query Execution for Hive and Pig. Tez relies on Yarn for Running the tasks and it requires a durable shared filesystem accessible through Hadoop Filesystem interface.

Traditional MapReduce Execution has proved very reliable for Data Processing in a cluster environment but at the same time it has few limitations. Frequent read/writes, overhead in job startups, no caching etc were few of them which are addressed via Apache Tez. …

About

Tamil Selvan K

Staff Support Engineer @Cloudera

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store