Start networking and exchanging professional insights

Register now or log in to join your professional community.

Follow

Are map reduce and pig similar in the programming?

user-image
Question added by AANCH MURUGESH NATH N E D , SENIOR OFFICER , ICICI BANK LTD
Date Posted: 2013/10/17
Fasi Ahmed
by Fasi Ahmed , Hadoop Architect , vmware

no, 

PIG is a scripting language which gets converted into mapreduce while the programme is running on hadoop

Masoud DaneshPour
by Masoud DaneshPour , Senior Developer , DAPA

Lets look at the definition on Hadoop for PIG :

A high-level data-flow language and execution framework for parallel computation.

and in here :

Pig's infrastructure layer consists of a compiler that produces sequences of Map-Reduce programs

 

so we can tell that Pig is an abstract over map-reduce.

Adil Kaleem
by Adil Kaleem , Data Engineer , Teradata Corporation

I concur with Mohsin.

MapReduce programming paradigm is precisely & purely written in Java and more suitable for core data design programmers. Pig is like an abstraction for MapReduce where the core programming concepts are not involved in designing the programs. It is designed in such a way that a non programmer can also write a MapReduce program without actually knowing the basics of it. Pig is mainly for Data Analysts & Architects.

harihar nahak
by harihar nahak , Module Lead , Persistent System Ltd

Yes, Pig Internally create list of map reduce jobs and run one after another.  

Mohsin Ali Khan
by Mohsin Ali Khan , Technical Consultant , Acnovate

They are not similar.  Pig is like a high level language which is internaly coverted to map reduce on hadoop.  

More Questions Like This