Award-winning data science platform for open technologies: Pig, Python, MongoDB and more. Easily run a custom recommender system, analyze logs, or do NLP.
PigUnit is a simple xUnit framework that enables you to easily test your Pig scripts. With PigUnit you can perform unit testing, regression testing, and rapid prototyping. No cluster set up is required if you run Pig in local mode.
Get free access to the in-progress manuscript of Programming Pig via the Open Feedback Publishing System (OFPS). Interact with the authors and community and provide your feedback in real-time.
Apache Pig is a platform for analyzing large data sets that consists of a high-level language for expressing data analysis programs, coupled with infrastructure for evaluating these programs. The salient property of Pig programs is that their structure is amenable to substantial parallelization, which in turns enables them to handle very large data sets.
C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins. SIGMOD '08: Proceedings of the 2008 ACM SIGMOD international conference on Management of data, page 1099--1110. New York, NY, USA, ACM, (2008)
C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins. SIGMOD '08: Proceedings of the 2008 ACM SIGMOD international conference on Management of data, page 1099--1110. New York, NY, USA, ACM, (2008)
