Question - What are the significant components in the execution environment of Pig?
Answer -
The main components of a Pig execution environment are as follows:
- Pig Scripts: They are written in Pig with the help of UDFs and built-in operators and are then sent to the execution environment.
- Parser: It checks the script syntax and completes type checking. Parser’s output is a directed acyclic graph (DAG).
- Optimizer: It conducts optimization with operations such as transform, merges, etc., to minimize the data in the pipeline.
- Compiler: It automatically converts the code that is optimized into a MapReduce job.
- Execution Engine: The MapReduce jobs are sent to these engines in order to get the required output.