Question - What are the components of the Apache Pig architecture?
Answer -
The components of the Apache Pig architecture are as follows:
- Parser: It is responsible for handling Pig scripts and checking the syntax of the script.
- Optimizer: Its function is to carry out the logical optimization such as projection pushdown, etc. It is the optimizer that receives the logical plan (DAG).
- Compiler: It is responsible for the conversion of the logical plan into a series of MapReduce jobs.
- Execution Engine: In the execution engine, MapReduce jobs get submitted in Hadoop in a sorted manner.
- Execution Mode: The execution modes in Apache Pig are local, and MapReduce modes and their selection entirely depends on the location where the data is stored and the place where you want to run the Pig script.