Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Tags: Netflix/PigPen

Tags

v0.3.3

Toggle v0.3.3's commit message
Release of 0.3.3

- fa9dc4d: Merge pull request #176 from Netflix/feature-keyword-field-selector-error
- 9ecde06: Add a better error message for storage types that expect a map with keywords
- b0a188d: Merge pull request #175 from Netflix/feature-print-length
- 36dadfb: Explicitly disable *print-length* and *print-level* when generating scripts
- c80d178: Update readme

v0.3.3-rc.1

Toggle v0.3.3-rc.1's commit message
Release of 0.3.3-rc.1

- fa9dc4d: Merge pull request #176 from Netflix/feature-keyword-field-selector-error
- 9ecde06: Add a better error message for storage types that expect a map with keywords
- b0a188d: Merge pull request #175 from Netflix/feature-print-length
- 36dadfb: Explicitly disable *print-length* and *print-level* when generating scripts
- c80d178: Update readme

v0.3.2

Toggle v0.3.2's commit message

v0.3.1

Toggle v0.3.1's commit message
Release of 0.3.1

- c6fae29: Merge pull request #172 from Netflix/ptaoussanis-issue-168
- c1bdca2: Update cascading project with nippy tuning
- ebe8154: Fix #168, tune Nippy performance
- e1da88d: Merge pull request #169 from Netflix/nippy-29
- 9431c8b: Update nippy to 2.9.1 & disable headerless serialization
- e0c5a5b: Merge pull request #166 from RallySoftware/remove-read-json
- 2952157: Remove unused bytes->json
- ce5a839: Merge pull request #162 from Netflix/fs111-frameworks
- 4ee372e: Get version at runtime
- ba00de3: Merge branch 'frameworks' of https://github.com/fs111/PigPen into fs111-frameworks
- 8cfcfde: Merge pull request #159 from fs111/cascading-2.7
- efb8e8c: add PigPen to Cascading appliction frameworks
- 2ca7abb: update to Cascading 2.7.0
- 0fe96d4: Update readme version to 0.3.0

v0.3.0

Toggle v0.3.0's commit message
Release of 0.3.0

- f08d419: Update readme version to 0.3.0-rc.7
- 531b206: Merge pull request #157 from Netflix/fix-local-nils
- b0c7f08: Fix pigpen.pig/set-options after store command
- 92e5316: Fix local handling of nil values
- 882cdf7: Merge pull request #156 from Netflix/perm-gen-optimizations
- 8c71a7f: Add explicit command to set pig options
- 1d328bb: Cache local evals per-run to save PermGen
- 105fc34: Merge pull request #155 from Netflix/core-async-update
- 857ff64: Update core.async version and fix bug in macro expansion
- f03b4b5: Merge pull request #154 from Netflix/memoize-pig-udf
- c9fb083: Memoize user code evaluation in pig UDFs
- 5d310ec: Add local support for native filter expressions
- 6cf3237: Update licenses
- 58fb109: Merge pull request #153 from Netflix/projects
- 4991f91: Merge pigpen-local and pigpen-tests into pigpen-core
- c80c0d0: Merge pull request #152 from Netflix/parquet-v2
- e7c6c56: Parquet, take 2. Better handling of schema & new local approach without pig dependency.
- 609fa17: Merge pull request #151 from rspieldenner/master
- 9a39b83: Add properties to config cloudbees job creation
- e050b11: Merge pull request #150 from rspieldenner/master
- 51a7330: Fix netflixoss conversion
- 4ced3b0: Merge pull request #149 from Netflix/cascading
- 7b7567a: Disable AOT
- 9637af7: Qualify symbols in native filter expressions with ?
- 472bf64: Merge branch 'master' into cascading
- ababe13: Fix handling of nil vs false in user data
- e71385b: Merge pull request #148 from Netflix/pkozikow-cascading
- 1909d3a: Merge branch 'cascading' of https://github.com/pkozikow/PigPen into pkozikow-cascading
- 4d8ddfb: Perf improvements. Use protocols instead of multimethods for hybrid->clojure. Use transducer-like functions for binds. Move cascading runtime code to preprocessing.
- 7942a43: misc fixes
- 840e4fc: Merge pull request #146 from rspieldenner/netflixoss
- 6b8ab41: Moving to new netflixoss build
- cf2078e: Merge pull request #145 from Netflix/license
- 2caa566: Update licenses
- 278b967: Merge pull request #144 from Netflix/docs
- 4263f10: Add docs for pigpen.core.fn and pigpen.core.op
- a3c0373: Merge pull request #143 from Netflix/docs
- 8f3ea82: Doc updates
- 5b2c95e: Merge pull request #142 from Netflix/store-tap
- 7e93175: Add store-tap
- 847e70c: Merge branch 'master' into cascading
- d968b8d: Fix test result ordering issue
- ff84ccc: Missed file
- bc91ad5: Merge commit '3474b8f4b38b76a17bf546942a1059832d9b44e6' into cascading
- 7264c2b: Merge pull request #139 from Netflix/fix-gz-local-input
- 9ef0aa5: Merge pull request #141 from Netflix/ns-cleanup
- 89fe5dd: Clean up folder/namespace structure. Move viz into separate project. Switch pigpen.cascading & pigpen.cascading.core. Split parquet into common & pig parts.
- f20bf2f: Move files to prep for refactoring
- ee40398: Merge pull request #140 from Netflix/rename
- 1e30e1e: Clean up threading of * calls. Add namespaces for raw & function operations.
- 312f59a: Rename script -> store-many
- 1126a05: Switch raw & oven commands to thread-last
- 6e6f10b: Rename union -> concat
- 9eee8fe: Rename limit -> take
- 61a44c7: Rename order -> sort
- b68f251: Look for gz files when loading locally
- 5bbf19b: Merge pull request #135 from ljank/features/convert-enums-in-avro
- 5e975b7: Rename generate -> project
- 5eefc64: Fix cascading runtime field lookup
- 37ede78: Merge branch 'master' of github.com:Netflix/PigPen
- ae31c84: Don't lose focus during tests
- af25365: Implement native->clojure for GenericData$EnumSymbol
- d47bb9a: [Gradle Release Plugin] - new version commit:  '0.2.16-SNAPSHOT'.
- d8bf0e0: Merge pull request #113 from Netflix/fields
- 758ca69: Perf enhancements & new perf test
- cf303a9: Update cascading branch with new field model
- b3def2f: Merge branch 'sans-pig' into fields
- ab78391: Merge pull request #111 from Netflix/fields
- 26bb1eb: Field updates for Parquet
- 97631bf: Changes to pig script generation for new field model
- a5cb222: Flatten Func into CodeExpr
- 3f41275: Refactor projections
- eaec952: Check schemas
- 4ca84b5: Update to reflect model
- 0038c7a: Update pigpen-local with model
- 4c75b83: Merge pull request #109 from pkozikow/cascading
- 64cefb8: Add model. Remove structural tests.
- f0df969: added load tap
- af32b63: Merge pull request #107 from pkozikow/cascading
- fba276a: all tests should pass now
- c4a12eb: implemented naive rank
- 810ef8a: handle reverse sort order and sort-by
- 6d71148: initial implementation of order
- bc227be: simplify handling of group-all
- adc0066: suggestions from code review
- 924da28: Merge pull request #106 from pkozikow/cascading
- 40aaf5e: Merge pull request #5 from pkozikow/partial_aggregation
- ffde7cb: cleanup
- 116e037: removed debug test
- 02123a4: simplify group-by since folds are handled elsewhere
- 9147555: refactoring
- 83893cc: modified SingleIterationSeq to only apply the restriction to large collections
- 3c171c9: refactored handling of groups
- 62a9b21: label groups that required partial aggregation during preprocessing
- 20b6740: also include func projections
- f7ee3c5: handle self-join case
- dfce7ca: better handling of output fields
- 8677609: fixed bug handling sentinel value
- 0d657f2: handle case where pre returns a collection with more than 1 elements
- 5f9a57e: discard group-all field after using it
- 6d86eb1: Merge pull request #104 from pkozikow/cascading
- 8cde9a6: progress to handle group-all
- 55e3710: use a sentinel values to emulate multiple streams
- c6df6c8: beginnings of multiple streams with partial aggregation
- 39c63d2: first pass at partial aggregation
- 72ae0e6: handle serialization outside of user functions
- f8d1903: fixed yet another cogroup bug
- a550ed7: fixed bug in group handling
- 045d420: more robust way to determine if the key is separate from the value
- cfb365b: removed redundant load funcs
- 7245ac8: fixed bug
- 2c33476: detect when the key should be emitted separately from the value
- cc5db12: more tests pass
- aa28ab4: implemented union command
- b1c5142: Merge pull request #102 from pkozikow/cascading
- 2876673: don't pass lazy seqs to GroupBuffer's constructor
- 1c03eaf: make fields private
- 37f1c95: attempt to circumvent OOEM problem
- 4fbc3d4: got store tests to work
- 1d05d3b: got all remaining fold tests to work
- d4f6e16: got remaining join-fold tests to work
- db7d5d5: got test-fold-cogroup-dual to work
- 1a7351d: use default field value in absence of explicit projections
- 08416bc: got another couple of fold tests to work
- 0a6a40b: got test-cogroup-self-join+fold to work
- edaeadf: removed hack and unused code
- c9e986e: got test-fold-count to work
- 6c147f9: Merge branch 'cascading' into fold
- 2356e66: allow passing in flow connector
- 8023807: Merge branch 'master' of github.com:pkozikow/PigPen into cascading
- 2ed2d4b: propagate group-opts only to immediate successor
- 46f141f: progress towards supporting fold
- a5c52d1: Merge pull request #4 from pkozikow/cascading
- c920e1d: refactoring
- afb12f3: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- fe26e9e: Update local mode with field changes
- 6398e89: Clean up debugging
- 5614828: Fix tests
- 340fca4: better idiom
- f8eeb9b: Merge pull request #99 from pkozikow/cascading
- 93ed900: got cogroup-full-outer to work
- fac1c6a: got cogroup left and right outer to work
- 6c612b0: take :join-nils into account in :group
- f108777: refactoring
- cf49014: refactoring
- 691367c: pass cogroup opts explicitly, handle cogroup-inner
- a528dc7: Merge pull request #98 from pkozikow/cascading
- b34fcaf: Change fields to namespaced symbols, initial cut
- 39dbc41: added support for group-all operations
- dc00e0d: added support for all-args in join
- 304b497: got self-joins to work
- 57ff6df: handle join-nils in outer joins
- 1d5fcee: added support for :join-nils to join
- e86dca7: implemented sample
- 19176f5: clear output before running
- ef21f97: implemented limit
- 55ebfab: tmp change to build to make it work
- ba30452: added temporary test for development
- 600876b: remove pig dependency
- 4bf45a0: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- f4c9ce1: Using core.reducers to perform the fold
- 0102c00: Merge pull request #94 from Netflix/cascading-functional-tests
- 1ed767c: Disable new tests for not-implemented features
- 90198e7: Merge branch 'sans-pig' into cascading-functional-tests
- 9c3b920: Merge pull request #97 from Netflix/rx-clean
- 1ad41e0: Move fold test to pigpen-tests. Implement fold in local mode. End pig-rx!
- 8f8d153: Add script to local
- d4bdfa3: Implement join for local & rx
- 1faabb6: Add group-all to local & rx
- 6516aed: Create a new pigpen-rx project with a streamlined non-pig rx implementation. Currently matches functionality of pigpen-local.
- 1702da5: fixed other potential sources of memory problems
- 1e591dd: Merge pull request #96 from Netflix/local-mode-filter
- a6bd4c1: Merge pull request #95 from Netflix/local-mode-group-by
- c9ee34e: Add functional tests for limit, sample, and distinct. Implement limit, sample, distinct, and union in local mode.
- 72de416: Implement :group for local mode
- 6a9706a: Add pigpen-tests dependency
- 7e2f04a: Add functional tests for cascading
- 6db62e8: Merge branch 'sans-pig' into cascading
- 6b2456a: Merge pull request #93 from Netflix/local-mode
- 519254e: Merge pull request #92 from Netflix/functional-tests
- 194c6e2: Add project for pigpen-local. Move stuff.
- 3de019f: Merge branch 'functional-tests' into local-mode
- 6ac758b: Move rx functional tests to rx. Add pig functional tests.
- f060b5a: Fix rank adjustments locally to match pig
- f414340: Fix order-dependent tests
- f6d7d33: Call seq on the results of all co-groupings to enforce consistency
- e4190bf: Only DataBag supports accumulation & returning bags. Move accumulator & add explicit bag creation.
- de48e8f: Fix quoting bug in script generation
- 8fbba9d: Refactor oven to make operations more modular. Move some pig specific ones to pigpen-pig.
- 4c4378b: Add local mode
- 3673b5b: Fixed default post-process
- 4844a64: Make functional tests a library
- 2dd7f41: Merge pull request #3 from matthagy/seq_cnv
- 03985fa: Lazy conversion of sequences in hybrid->clojure
- 72ef729: Merge pull request #91 from pkozikow/master
- 6c330f7: removed debug print stmts and ns, fixed comment
- 3883df7: removed redundant function, formatting
- 98d8e9f: unnecessary let
- e3e91be: removed stuff already available in pigpen.core
- 2e84303: emit tuples from clojure
- f2228d1: emit tuples from clojure
- 5b03b38: Merge branch 'cascading' into cascading_origin
- eadd4f3: Merge branch 'sans-pig' into cascading
- 6cd2f98: Merge branch 'master' into sans-pig
- da04db1: removed bogus import
- 2ee74ee: refactoring
- d0a0105: refactoring
- ff7c680: removed redundant method and implemented distinction for nils
- 1d386f0: more requires
- 4674f09: require runtime
- 5339b6f: identity
- 654a394: misc fixes
- dd2cc0a: implemented distinct
- ba54685: added test for mapcat
- a543a7f: implemented script
- b37ae81: Merge pull request #1 from matthagy/lr_extensions
- 217148c: Fixed handling of field projections
- 23b7d9c: Small changes to support LiveRamp extensions
- 87525ac: don't use cascading ns directly
- 7636ba5: make io functions available
- 309eb4c: remove debug print stmts
- a07ea4e: removed redundant helper, fixed test
- b61fa93: added test for group-by
- b45c117: added support for outer joins
- 75eb0c8: use real field names
- 932c8ce: progress implementing join
- bb45009: partial implementation of join
- e28de42: added support for arbitrary number of input pipes to cogroup
- 57752c8: Merge branch 'master' of github.com:Netflix/PigPen into cascading
- c33e9bf: simplify
- 2f314ca: got rid of unnecessary reduce
- d04058c: updated pg
- f21a4a4: turned tap dispatch into multimethod
- c08c183: rename
- d011627: got cogroup to work with custom serialization
- 78d7f82: moved serialization stuff to new ns
- 8cfa955: fixed storage handling
- 3e1adb8: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- 18ab584: Merge branch 'sans-pig' into cascading
- 6760750: Merge pull request #87 from Netflix/return-to-core
- b3b0bfb: Move pigpen.core to pigpen-core
- a3ed01f: Move pigpen.exec -> pigpen.pig
- 5068865: Move pigpen.pig -> pigpen.pig.runtime
- 35d6d95: Move pigpen.io
- 8b0e0a0: Merge pull request #86 from Netflix/unfreeze-return
- 5513e06: Don't freeze values in pig/return
- ba2bf7b: Merge branch 'sans-pig' into cascading
- 246a221: Merge pull request #85 from Netflix/fix-bootstrap-ns
- e5174d4: Update the bootstrap namespace to pigpen.runtime
- b90420d: Merge pull request #84 from Netflix/dispatch-io
- 9fe580f: Merge pull request #83 from Netflix/pig-oven
- 59cb87b: Merge pull request #82 from Netflix/update-deps
- 4591c8d: Change io operations to dispatch on keywords instead of pig-specific loader classes
- e03b94a: Move register$ and option$ into new pigpen.pig.oven
- 23df77e: Remove column pruning (wasn't used)
- 7da21de: beginnings of serialization for cascading
- a7c7a8e: cleaned up test
- 7383184: remove cascading dependencies from core
- afa349e: got simple flow to work sans pig
- 4666707: moved all cascading stuff to the corresponding project
- f62d6bd: updated function not to use pig classes
- 9c5d309: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- 1562c71: Remove pig dependencies from pigpen-core
- d1aeab8: Add clojure dependency to cascading project
- 9bb476c: Merge branch 'sans-pig' into cascading
- 192a721: Merge pull request #80 from Netflix/move-oven
- 623236f: Move pigpen.oven back to pigpen-core
- 1399fe5: Merge pull request #79 from Netflix/pig-rx
- 683a04a: Rename pigpen.local -> pigpen.pig-rx
- 178d975: Merge branch 'master' into sans-pig
- 1522c11: cleanup
- 1ff6514: got cogroup example to work
- 3dfe1b2: getting close to a working cogroup
- e834049: used field projections in PigPenFunction
- 8371677: collapse field projections into the preceding step
- 90e94d5: removed unbaked
- 81b6348: hack around serialization using Pig classes
- 3a87957: fixed field assignment in cogroup
- 1e021b2: Merge pull request #75 from Netflix/move-exec
- 055540e: Move tuples & bags to post-processing & the UDF. Move exec to runtime.
- 0b589dd: Merge pull request #74 from Netflix/move-util-fns
- 6ba80eb: Move pigpen.pig/args->map and pigpen.pig/debug to pigpen.runtime
- 5ab6214: Merge pull request #73 from Netflix/generalize-serialization
- ff3118e: Merge pull request #72 from Netflix/change-code-dispatch
- c0e8aeb: Use multimethods for serialization. Each platform implements these.
- aa872f4: Update code$ to not refer to pig classes. Using keywords instead
- 2974492: Move pigpen.pig/eval-string to pigpen.runtime
- ba9f609: Add cascading project
- a88bfe6: Move ->bind fns and with-ns to pigpen.runtime
- 076418f: Update build with new locations
- 46c8533: handle fields and aliases
- e36c352: process field projections together
- b246ee5: shaping up cogroup
- 22e2687: back to using pipes directly
- b87d34c: Add pigpen-pig project
- 7a6f595: Move files into pigpen-pig
- f3f65c2: Remove extra imports
- 036ff27: adding support for cogroup - work in progress
- dc74a98: added scripts to pg for reference
- aa9dc9c: set up test for cogroup
- e3a0015: added load-clj
- 3b1a2b8: added generate-flow, refactored test
- 99f0457: added comment
- 6ddbc6b: added store-clj, refactored pigpen function
- 490501c: added store-tsv
- 74ac671: added load-tsv
- f2552f6: invoke clj func from cascading operation
- a58bf4c: beginnings of :projection and :code
- 50a6747: bind field in load-text
- 92a0d3a: added store-text, replaced hardcoded commands with real query in test
- 17cb8f7: first test actually executing a cascading flow
- 8df0045: build real cascading flow
- 5c372ad: started implementing :store
- 8b0ff08: started implementing :generate
- 2cd1e21: added method for :register, use example query in test
- 0bd584e: added example my-func to pg
- 0d073f8: initial implementation of commands->flow
- 2b21372: beginnings of cascading backend
- dea4e44: added simple flow definitions
- 2804131: updated dependencies
- 28fdf6f: added playground file
- cbb0fe6: added cascading dependency

v0.3.0-rc.7

Toggle v0.3.0-rc.7's commit message
Release of 0.3.0-rc.7

- 531b206: Merge pull request #157 from Netflix/fix-local-nils
- b0c7f08: Fix pigpen.pig/set-options after store command
- 92e5316: Fix local handling of nil values
- 882cdf7: Merge pull request #156 from Netflix/perm-gen-optimizations
- 8c71a7f: Add explicit command to set pig options
- 1d328bb: Cache local evals per-run to save PermGen
- 105fc34: Merge pull request #155 from Netflix/core-async-update
- 857ff64: Update core.async version and fix bug in macro expansion
- f03b4b5: Merge pull request #154 from Netflix/memoize-pig-udf
- c9fb083: Memoize user code evaluation in pig UDFs
- 5d310ec: Add local support for native filter expressions
- 6cf3237: Update licenses
- 58fb109: Merge pull request #153 from Netflix/projects
- 4991f91: Merge pigpen-local and pigpen-tests into pigpen-core
- c80c0d0: Merge pull request #152 from Netflix/parquet-v2
- e7c6c56: Parquet, take 2. Better handling of schema & new local approach without pig dependency.
- 609fa17: Merge pull request #151 from rspieldenner/master
- 9a39b83: Add properties to config cloudbees job creation
- e050b11: Merge pull request #150 from rspieldenner/master
- 51a7330: Fix netflixoss conversion
- 4ced3b0: Merge pull request #149 from Netflix/cascading
- 7b7567a: Disable AOT
- 9637af7: Qualify symbols in native filter expressions with ?
- 472bf64: Merge branch 'master' into cascading
- ababe13: Fix handling of nil vs false in user data
- e71385b: Merge pull request #148 from Netflix/pkozikow-cascading
- 1909d3a: Merge branch 'cascading' of https://github.com/pkozikow/PigPen into pkozikow-cascading
- 4d8ddfb: Perf improvements. Use protocols instead of multimethods for hybrid->clojure. Use transducer-like functions for binds. Move cascading runtime code to preprocessing.
- 7942a43: misc fixes
- 840e4fc: Merge pull request #146 from rspieldenner/netflixoss
- 6b8ab41: Moving to new netflixoss build
- cf2078e: Merge pull request #145 from Netflix/license
- 2caa566: Update licenses
- 278b967: Merge pull request #144 from Netflix/docs
- 4263f10: Add docs for pigpen.core.fn and pigpen.core.op
- a3c0373: Merge pull request #143 from Netflix/docs
- 8f3ea82: Doc updates
- 5b2c95e: Merge pull request #142 from Netflix/store-tap
- 7e93175: Add store-tap
- 847e70c: Merge branch 'master' into cascading
- d968b8d: Fix test result ordering issue
- ff84ccc: Missed file
- bc91ad5: Merge commit '3474b8f4b38b76a17bf546942a1059832d9b44e6' into cascading
- 7264c2b: Merge pull request #139 from Netflix/fix-gz-local-input
- 9ef0aa5: Merge pull request #141 from Netflix/ns-cleanup
- 89fe5dd: Clean up folder/namespace structure. Move viz into separate project. Switch pigpen.cascading & pigpen.cascading.core. Split parquet into common & pig parts.
- f20bf2f: Move files to prep for refactoring
- ee40398: Merge pull request #140 from Netflix/rename
- 1e30e1e: Clean up threading of * calls. Add namespaces for raw & function operations.
- 312f59a: Rename script -> store-many
- 1126a05: Switch raw & oven commands to thread-last
- 6e6f10b: Rename union -> concat
- 9eee8fe: Rename limit -> take
- 61a44c7: Rename order -> sort
- b68f251: Look for gz files when loading locally
- 5bbf19b: Merge pull request #135 from ljank/features/convert-enums-in-avro
- 5e975b7: Rename generate -> project
- 5eefc64: Fix cascading runtime field lookup
- 37ede78: Merge branch 'master' of github.com:Netflix/PigPen
- ae31c84: Don't lose focus during tests
- af25365: Implement native->clojure for GenericData$EnumSymbol
- d47bb9a: [Gradle Release Plugin] - new version commit:  '0.2.16-SNAPSHOT'.
- d8bf0e0: Merge pull request #113 from Netflix/fields
- 758ca69: Perf enhancements & new perf test
- cf303a9: Update cascading branch with new field model
- b3def2f: Merge branch 'sans-pig' into fields
- ab78391: Merge pull request #111 from Netflix/fields
- 26bb1eb: Field updates for Parquet
- 97631bf: Changes to pig script generation for new field model
- a5cb222: Flatten Func into CodeExpr
- 3f41275: Refactor projections
- eaec952: Check schemas
- 4ca84b5: Update to reflect model
- 0038c7a: Update pigpen-local with model
- 4c75b83: Merge pull request #109 from pkozikow/cascading
- 64cefb8: Add model. Remove structural tests.
- f0df969: added load tap
- af32b63: Merge pull request #107 from pkozikow/cascading
- fba276a: all tests should pass now
- c4a12eb: implemented naive rank
- 810ef8a: handle reverse sort order and sort-by
- 6d71148: initial implementation of order
- bc227be: simplify handling of group-all
- adc0066: suggestions from code review
- 924da28: Merge pull request #106 from pkozikow/cascading
- 40aaf5e: Merge pull request #5 from pkozikow/partial_aggregation
- ffde7cb: cleanup
- 116e037: removed debug test
- 02123a4: simplify group-by since folds are handled elsewhere
- 9147555: refactoring
- 83893cc: modified SingleIterationSeq to only apply the restriction to large collections
- 3c171c9: refactored handling of groups
- 62a9b21: label groups that required partial aggregation during preprocessing
- 20b6740: also include func projections
- f7ee3c5: handle self-join case
- dfce7ca: better handling of output fields
- 8677609: fixed bug handling sentinel value
- 0d657f2: handle case where pre returns a collection with more than 1 elements
- 5f9a57e: discard group-all field after using it
- 6d86eb1: Merge pull request #104 from pkozikow/cascading
- 8cde9a6: progress to handle group-all
- 55e3710: use a sentinel values to emulate multiple streams
- c6df6c8: beginnings of multiple streams with partial aggregation
- 39c63d2: first pass at partial aggregation
- 72ae0e6: handle serialization outside of user functions
- f8d1903: fixed yet another cogroup bug
- a550ed7: fixed bug in group handling
- 045d420: more robust way to determine if the key is separate from the value
- cfb365b: removed redundant load funcs
- 7245ac8: fixed bug
- 2c33476: detect when the key should be emitted separately from the value
- cc5db12: more tests pass
- aa28ab4: implemented union command
- b1c5142: Merge pull request #102 from pkozikow/cascading
- 2876673: don't pass lazy seqs to GroupBuffer's constructor
- 1c03eaf: make fields private
- 37f1c95: attempt to circumvent OOEM problem
- 4fbc3d4: got store tests to work
- 1d05d3b: got all remaining fold tests to work
- d4f6e16: got remaining join-fold tests to work
- db7d5d5: got test-fold-cogroup-dual to work
- 1a7351d: use default field value in absence of explicit projections
- 08416bc: got another couple of fold tests to work
- 0a6a40b: got test-cogroup-self-join+fold to work
- edaeadf: removed hack and unused code
- c9e986e: got test-fold-count to work
- 6c147f9: Merge branch 'cascading' into fold
- 2356e66: allow passing in flow connector
- 8023807: Merge branch 'master' of github.com:pkozikow/PigPen into cascading
- 2ed2d4b: propagate group-opts only to immediate successor
- 46f141f: progress towards supporting fold
- a5c52d1: Merge pull request #4 from pkozikow/cascading
- c920e1d: refactoring
- afb12f3: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- fe26e9e: Update local mode with field changes
- 6398e89: Clean up debugging
- 5614828: Fix tests
- 340fca4: better idiom
- f8eeb9b: Merge pull request #99 from pkozikow/cascading
- 93ed900: got cogroup-full-outer to work
- fac1c6a: got cogroup left and right outer to work
- 6c612b0: take :join-nils into account in :group
- f108777: refactoring
- cf49014: refactoring
- 691367c: pass cogroup opts explicitly, handle cogroup-inner
- a528dc7: Merge pull request #98 from pkozikow/cascading
- b34fcaf: Change fields to namespaced symbols, initial cut
- 39dbc41: added support for group-all operations
- dc00e0d: added support for all-args in join
- 304b497: got self-joins to work
- 57ff6df: handle join-nils in outer joins
- 1d5fcee: added support for :join-nils to join
- e86dca7: implemented sample
- 19176f5: clear output before running
- ef21f97: implemented limit
- 55ebfab: tmp change to build to make it work
- ba30452: added temporary test for development
- 600876b: remove pig dependency
- 4bf45a0: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- f4c9ce1: Using core.reducers to perform the fold
- 0102c00: Merge pull request #94 from Netflix/cascading-functional-tests
- 1ed767c: Disable new tests for not-implemented features
- 90198e7: Merge branch 'sans-pig' into cascading-functional-tests
- 9c3b920: Merge pull request #97 from Netflix/rx-clean
- 1ad41e0: Move fold test to pigpen-tests. Implement fold in local mode. End pig-rx!
- 8f8d153: Add script to local
- d4bdfa3: Implement join for local & rx
- 1faabb6: Add group-all to local & rx
- 6516aed: Create a new pigpen-rx project with a streamlined non-pig rx implementation. Currently matches functionality of pigpen-local.
- 1702da5: fixed other potential sources of memory problems
- 1e591dd: Merge pull request #96 from Netflix/local-mode-filter
- a6bd4c1: Merge pull request #95 from Netflix/local-mode-group-by
- c9ee34e: Add functional tests for limit, sample, and distinct. Implement limit, sample, distinct, and union in local mode.
- 72de416: Implement :group for local mode
- 6a9706a: Add pigpen-tests dependency
- 7e2f04a: Add functional tests for cascading
- 6db62e8: Merge branch 'sans-pig' into cascading
- 6b2456a: Merge pull request #93 from Netflix/local-mode
- 519254e: Merge pull request #92 from Netflix/functional-tests
- 194c6e2: Add project for pigpen-local. Move stuff.
- 3de019f: Merge branch 'functional-tests' into local-mode
- 6ac758b: Move rx functional tests to rx. Add pig functional tests.
- f060b5a: Fix rank adjustments locally to match pig
- f414340: Fix order-dependent tests
- f6d7d33: Call seq on the results of all co-groupings to enforce consistency
- e4190bf: Only DataBag supports accumulation & returning bags. Move accumulator & add explicit bag creation.
- de48e8f: Fix quoting bug in script generation
- 8fbba9d: Refactor oven to make operations more modular. Move some pig specific ones to pigpen-pig.
- 4c4378b: Add local mode
- 3673b5b: Fixed default post-process
- 4844a64: Make functional tests a library
- 2dd7f41: Merge pull request #3 from matthagy/seq_cnv
- 03985fa: Lazy conversion of sequences in hybrid->clojure
- 72ef729: Merge pull request #91 from pkozikow/master
- 6c330f7: removed debug print stmts and ns, fixed comment
- 3883df7: removed redundant function, formatting
- 98d8e9f: unnecessary let
- e3e91be: removed stuff already available in pigpen.core
- 2e84303: emit tuples from clojure
- f2228d1: emit tuples from clojure
- 5b03b38: Merge branch 'cascading' into cascading_origin
- eadd4f3: Merge branch 'sans-pig' into cascading
- 6cd2f98: Merge branch 'master' into sans-pig
- da04db1: removed bogus import
- 2ee74ee: refactoring
- d0a0105: refactoring
- ff7c680: removed redundant method and implemented distinction for nils
- 1d386f0: more requires
- 4674f09: require runtime
- 5339b6f: identity
- 654a394: misc fixes
- dd2cc0a: implemented distinct
- ba54685: added test for mapcat
- a543a7f: implemented script
- b37ae81: Merge pull request #1 from matthagy/lr_extensions
- 217148c: Fixed handling of field projections
- 23b7d9c: Small changes to support LiveRamp extensions
- 87525ac: don't use cascading ns directly
- 7636ba5: make io functions available
- 309eb4c: remove debug print stmts
- a07ea4e: removed redundant helper, fixed test
- b61fa93: added test for group-by
- b45c117: added support for outer joins
- 75eb0c8: use real field names
- 932c8ce: progress implementing join
- bb45009: partial implementation of join
- e28de42: added support for arbitrary number of input pipes to cogroup
- 57752c8: Merge branch 'master' of github.com:Netflix/PigPen into cascading
- c33e9bf: simplify
- 2f314ca: got rid of unnecessary reduce
- d04058c: updated pg
- f21a4a4: turned tap dispatch into multimethod
- c08c183: rename
- d011627: got cogroup to work with custom serialization
- 78d7f82: moved serialization stuff to new ns
- 8cfa955: fixed storage handling
- 3e1adb8: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- 18ab584: Merge branch 'sans-pig' into cascading
- 6760750: Merge pull request #87 from Netflix/return-to-core
- b3b0bfb: Move pigpen.core to pigpen-core
- a3ed01f: Move pigpen.exec -> pigpen.pig
- 5068865: Move pigpen.pig -> pigpen.pig.runtime
- 35d6d95: Move pigpen.io
- 8b0e0a0: Merge pull request #86 from Netflix/unfreeze-return
- 5513e06: Don't freeze values in pig/return
- ba2bf7b: Merge branch 'sans-pig' into cascading
- 246a221: Merge pull request #85 from Netflix/fix-bootstrap-ns
- e5174d4: Update the bootstrap namespace to pigpen.runtime
- b90420d: Merge pull request #84 from Netflix/dispatch-io
- 9fe580f: Merge pull request #83 from Netflix/pig-oven
- 59cb87b: Merge pull request #82 from Netflix/update-deps
- 4591c8d: Change io operations to dispatch on keywords instead of pig-specific loader classes
- e03b94a: Move register$ and option$ into new pigpen.pig.oven
- 23df77e: Remove column pruning (wasn't used)
- 7da21de: beginnings of serialization for cascading
- a7c7a8e: cleaned up test
- 7383184: remove cascading dependencies from core
- afa349e: got simple flow to work sans pig
- 4666707: moved all cascading stuff to the corresponding project
- f62d6bd: updated function not to use pig classes
- 9c5d309: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- 1562c71: Remove pig dependencies from pigpen-core
- d1aeab8: Add clojure dependency to cascading project
- 9bb476c: Merge branch 'sans-pig' into cascading
- 192a721: Merge pull request #80 from Netflix/move-oven
- 623236f: Move pigpen.oven back to pigpen-core
- 1399fe5: Merge pull request #79 from Netflix/pig-rx
- 683a04a: Rename pigpen.local -> pigpen.pig-rx
- 178d975: Merge branch 'master' into sans-pig
- 1522c11: cleanup
- 1ff6514: got cogroup example to work
- 3dfe1b2: getting close to a working cogroup
- e834049: used field projections in PigPenFunction
- 8371677: collapse field projections into the preceding step
- 90e94d5: removed unbaked
- 81b6348: hack around serialization using Pig classes
- 3a87957: fixed field assignment in cogroup
- 1e021b2: Merge pull request #75 from Netflix/move-exec
- 055540e: Move tuples & bags to post-processing & the UDF. Move exec to runtime.
- 0b589dd: Merge pull request #74 from Netflix/move-util-fns
- 6ba80eb: Move pigpen.pig/args->map and pigpen.pig/debug to pigpen.runtime
- 5ab6214: Merge pull request #73 from Netflix/generalize-serialization
- ff3118e: Merge pull request #72 from Netflix/change-code-dispatch
- c0e8aeb: Use multimethods for serialization. Each platform implements these.
- aa872f4: Update code$ to not refer to pig classes. Using keywords instead
- 2974492: Move pigpen.pig/eval-string to pigpen.runtime
- ba9f609: Add cascading project
- a88bfe6: Move ->bind fns and with-ns to pigpen.runtime
- 076418f: Update build with new locations
- 46c8533: handle fields and aliases
- e36c352: process field projections together
- b246ee5: shaping up cogroup
- 22e2687: back to using pipes directly
- b87d34c: Add pigpen-pig project
- 7a6f595: Move files into pigpen-pig
- f3f65c2: Remove extra imports
- 036ff27: adding support for cogroup - work in progress
- dc74a98: added scripts to pg for reference
- aa9dc9c: set up test for cogroup
- e3a0015: added load-clj
- 3b1a2b8: added generate-flow, refactored test
- 99f0457: added comment
- 6ddbc6b: added store-clj, refactored pigpen function
- 490501c: added store-tsv
- 74ac671: added load-tsv
- f2552f6: invoke clj func from cascading operation
- a58bf4c: beginnings of :projection and :code
- 50a6747: bind field in load-text
- 92a0d3a: added store-text, replaced hardcoded commands with real query in test
- 17cb8f7: first test actually executing a cascading flow
- 8df0045: build real cascading flow
- 5c372ad: started implementing :store
- 8b0ff08: started implementing :generate
- 2cd1e21: added method for :register, use example query in test
- 0bd584e: added example my-func to pg
- 0d073f8: initial implementation of commands->flow
- 2b21372: beginnings of cascading backend
- dea4e44: added simple flow definitions
- 2804131: updated dependencies
- 28fdf6f: added playground file
- cbb0fe6: added cascading dependency

v0.3.0-rc.6

Toggle v0.3.0-rc.6's commit message
Release of 0.3.0-rc.6

- 882cdf7: Merge pull request #156 from Netflix/perm-gen-optimizations
- 8c71a7f: Add explicit command to set pig options
- 1d328bb: Cache local evals per-run to save PermGen
- 105fc34: Merge pull request #155 from Netflix/core-async-update
- 857ff64: Update core.async version and fix bug in macro expansion
- f03b4b5: Merge pull request #154 from Netflix/memoize-pig-udf
- c9fb083: Memoize user code evaluation in pig UDFs
- 5d310ec: Add local support for native filter expressions
- 6cf3237: Update licenses
- 58fb109: Merge pull request #153 from Netflix/projects
- 4991f91: Merge pigpen-local and pigpen-tests into pigpen-core
- c80c0d0: Merge pull request #152 from Netflix/parquet-v2
- e7c6c56: Parquet, take 2. Better handling of schema & new local approach without pig dependency.
- 609fa17: Merge pull request #151 from rspieldenner/master
- 9a39b83: Add properties to config cloudbees job creation
- e050b11: Merge pull request #150 from rspieldenner/master
- 51a7330: Fix netflixoss conversion
- 4ced3b0: Merge pull request #149 from Netflix/cascading
- 7b7567a: Disable AOT
- 9637af7: Qualify symbols in native filter expressions with ?
- 472bf64: Merge branch 'master' into cascading
- ababe13: Fix handling of nil vs false in user data
- e71385b: Merge pull request #148 from Netflix/pkozikow-cascading
- 1909d3a: Merge branch 'cascading' of https://github.com/pkozikow/PigPen into pkozikow-cascading
- 4d8ddfb: Perf improvements. Use protocols instead of multimethods for hybrid->clojure. Use transducer-like functions for binds. Move cascading runtime code to preprocessing.
- 7942a43: misc fixes
- 840e4fc: Merge pull request #146 from rspieldenner/netflixoss
- 6b8ab41: Moving to new netflixoss build
- cf2078e: Merge pull request #145 from Netflix/license
- 2caa566: Update licenses
- 278b967: Merge pull request #144 from Netflix/docs
- 4263f10: Add docs for pigpen.core.fn and pigpen.core.op
- a3c0373: Merge pull request #143 from Netflix/docs
- 8f3ea82: Doc updates
- 5b2c95e: Merge pull request #142 from Netflix/store-tap
- 7e93175: Add store-tap
- 847e70c: Merge branch 'master' into cascading
- d968b8d: Fix test result ordering issue
- ff84ccc: Missed file
- bc91ad5: Merge commit '3474b8f4b38b76a17bf546942a1059832d9b44e6' into cascading
- 7264c2b: Merge pull request #139 from Netflix/fix-gz-local-input
- 9ef0aa5: Merge pull request #141 from Netflix/ns-cleanup
- 89fe5dd: Clean up folder/namespace structure. Move viz into separate project. Switch pigpen.cascading & pigpen.cascading.core. Split parquet into common & pig parts.
- f20bf2f: Move files to prep for refactoring
- ee40398: Merge pull request #140 from Netflix/rename
- 1e30e1e: Clean up threading of * calls. Add namespaces for raw & function operations.
- 312f59a: Rename script -> store-many
- 1126a05: Switch raw & oven commands to thread-last
- 6e6f10b: Rename union -> concat
- 9eee8fe: Rename limit -> take
- 61a44c7: Rename order -> sort
- b68f251: Look for gz files when loading locally
- 5bbf19b: Merge pull request #135 from ljank/features/convert-enums-in-avro
- 5e975b7: Rename generate -> project
- 5eefc64: Fix cascading runtime field lookup
- 37ede78: Merge branch 'master' of github.com:Netflix/PigPen
- ae31c84: Don't lose focus during tests
- af25365: Implement native->clojure for GenericData$EnumSymbol
- d47bb9a: [Gradle Release Plugin] - new version commit:  '0.2.16-SNAPSHOT'.
- d8bf0e0: Merge pull request #113 from Netflix/fields
- 758ca69: Perf enhancements & new perf test
- cf303a9: Update cascading branch with new field model
- b3def2f: Merge branch 'sans-pig' into fields
- ab78391: Merge pull request #111 from Netflix/fields
- 26bb1eb: Field updates for Parquet
- 97631bf: Changes to pig script generation for new field model
- a5cb222: Flatten Func into CodeExpr
- 3f41275: Refactor projections
- eaec952: Check schemas
- 4ca84b5: Update to reflect model
- 0038c7a: Update pigpen-local with model
- 4c75b83: Merge pull request #109 from pkozikow/cascading
- 64cefb8: Add model. Remove structural tests.
- f0df969: added load tap
- af32b63: Merge pull request #107 from pkozikow/cascading
- fba276a: all tests should pass now
- c4a12eb: implemented naive rank
- 810ef8a: handle reverse sort order and sort-by
- 6d71148: initial implementation of order
- bc227be: simplify handling of group-all
- adc0066: suggestions from code review
- 924da28: Merge pull request #106 from pkozikow/cascading
- 40aaf5e: Merge pull request #5 from pkozikow/partial_aggregation
- ffde7cb: cleanup
- 116e037: removed debug test
- 02123a4: simplify group-by since folds are handled elsewhere
- 9147555: refactoring
- 83893cc: modified SingleIterationSeq to only apply the restriction to large collections
- 3c171c9: refactored handling of groups
- 62a9b21: label groups that required partial aggregation during preprocessing
- 20b6740: also include func projections
- f7ee3c5: handle self-join case
- dfce7ca: better handling of output fields
- 8677609: fixed bug handling sentinel value
- 0d657f2: handle case where pre returns a collection with more than 1 elements
- 5f9a57e: discard group-all field after using it
- 6d86eb1: Merge pull request #104 from pkozikow/cascading
- 8cde9a6: progress to handle group-all
- 55e3710: use a sentinel values to emulate multiple streams
- c6df6c8: beginnings of multiple streams with partial aggregation
- 39c63d2: first pass at partial aggregation
- 72ae0e6: handle serialization outside of user functions
- f8d1903: fixed yet another cogroup bug
- a550ed7: fixed bug in group handling
- 045d420: more robust way to determine if the key is separate from the value
- cfb365b: removed redundant load funcs
- 7245ac8: fixed bug
- 2c33476: detect when the key should be emitted separately from the value
- cc5db12: more tests pass
- aa28ab4: implemented union command
- b1c5142: Merge pull request #102 from pkozikow/cascading
- 2876673: don't pass lazy seqs to GroupBuffer's constructor
- 1c03eaf: make fields private
- 37f1c95: attempt to circumvent OOEM problem
- 4fbc3d4: got store tests to work
- 1d05d3b: got all remaining fold tests to work
- d4f6e16: got remaining join-fold tests to work
- db7d5d5: got test-fold-cogroup-dual to work
- 1a7351d: use default field value in absence of explicit projections
- 08416bc: got another couple of fold tests to work
- 0a6a40b: got test-cogroup-self-join+fold to work
- edaeadf: removed hack and unused code
- c9e986e: got test-fold-count to work
- 6c147f9: Merge branch 'cascading' into fold
- 2356e66: allow passing in flow connector
- 8023807: Merge branch 'master' of github.com:pkozikow/PigPen into cascading
- 2ed2d4b: propagate group-opts only to immediate successor
- 46f141f: progress towards supporting fold
- a5c52d1: Merge pull request #4 from pkozikow/cascading
- c920e1d: refactoring
- afb12f3: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- fe26e9e: Update local mode with field changes
- 6398e89: Clean up debugging
- 5614828: Fix tests
- 340fca4: better idiom
- f8eeb9b: Merge pull request #99 from pkozikow/cascading
- 93ed900: got cogroup-full-outer to work
- fac1c6a: got cogroup left and right outer to work
- 6c612b0: take :join-nils into account in :group
- f108777: refactoring
- cf49014: refactoring
- 691367c: pass cogroup opts explicitly, handle cogroup-inner
- a528dc7: Merge pull request #98 from pkozikow/cascading
- b34fcaf: Change fields to namespaced symbols, initial cut
- 39dbc41: added support for group-all operations
- dc00e0d: added support for all-args in join
- 304b497: got self-joins to work
- 57ff6df: handle join-nils in outer joins
- 1d5fcee: added support for :join-nils to join
- e86dca7: implemented sample
- 19176f5: clear output before running
- ef21f97: implemented limit
- 55ebfab: tmp change to build to make it work
- ba30452: added temporary test for development
- 600876b: remove pig dependency
- 4bf45a0: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- f4c9ce1: Using core.reducers to perform the fold
- 0102c00: Merge pull request #94 from Netflix/cascading-functional-tests
- 1ed767c: Disable new tests for not-implemented features
- 90198e7: Merge branch 'sans-pig' into cascading-functional-tests
- 9c3b920: Merge pull request #97 from Netflix/rx-clean
- 1ad41e0: Move fold test to pigpen-tests. Implement fold in local mode. End pig-rx!
- 8f8d153: Add script to local
- d4bdfa3: Implement join for local & rx
- 1faabb6: Add group-all to local & rx
- 6516aed: Create a new pigpen-rx project with a streamlined non-pig rx implementation. Currently matches functionality of pigpen-local.
- 1702da5: fixed other potential sources of memory problems
- 1e591dd: Merge pull request #96 from Netflix/local-mode-filter
- a6bd4c1: Merge pull request #95 from Netflix/local-mode-group-by
- c9ee34e: Add functional tests for limit, sample, and distinct. Implement limit, sample, distinct, and union in local mode.
- 72de416: Implement :group for local mode
- 6a9706a: Add pigpen-tests dependency
- 7e2f04a: Add functional tests for cascading
- 6db62e8: Merge branch 'sans-pig' into cascading
- 6b2456a: Merge pull request #93 from Netflix/local-mode
- 519254e: Merge pull request #92 from Netflix/functional-tests
- 194c6e2: Add project for pigpen-local. Move stuff.
- 3de019f: Merge branch 'functional-tests' into local-mode
- 6ac758b: Move rx functional tests to rx. Add pig functional tests.
- f060b5a: Fix rank adjustments locally to match pig
- f414340: Fix order-dependent tests
- f6d7d33: Call seq on the results of all co-groupings to enforce consistency
- e4190bf: Only DataBag supports accumulation & returning bags. Move accumulator & add explicit bag creation.
- de48e8f: Fix quoting bug in script generation
- 8fbba9d: Refactor oven to make operations more modular. Move some pig specific ones to pigpen-pig.
- 4c4378b: Add local mode
- 3673b5b: Fixed default post-process
- 4844a64: Make functional tests a library
- 2dd7f41: Merge pull request #3 from matthagy/seq_cnv
- 03985fa: Lazy conversion of sequences in hybrid->clojure
- 72ef729: Merge pull request #91 from pkozikow/master
- 6c330f7: removed debug print stmts and ns, fixed comment
- 3883df7: removed redundant function, formatting
- 98d8e9f: unnecessary let
- e3e91be: removed stuff already available in pigpen.core
- 2e84303: emit tuples from clojure
- f2228d1: emit tuples from clojure
- 5b03b38: Merge branch 'cascading' into cascading_origin
- eadd4f3: Merge branch 'sans-pig' into cascading
- 6cd2f98: Merge branch 'master' into sans-pig
- da04db1: removed bogus import
- 2ee74ee: refactoring
- d0a0105: refactoring
- ff7c680: removed redundant method and implemented distinction for nils
- 1d386f0: more requires
- 4674f09: require runtime
- 5339b6f: identity
- 654a394: misc fixes
- dd2cc0a: implemented distinct
- ba54685: added test for mapcat
- a543a7f: implemented script
- b37ae81: Merge pull request #1 from matthagy/lr_extensions
- 217148c: Fixed handling of field projections
- 23b7d9c: Small changes to support LiveRamp extensions
- 87525ac: don't use cascading ns directly
- 7636ba5: make io functions available
- 309eb4c: remove debug print stmts
- a07ea4e: removed redundant helper, fixed test
- b61fa93: added test for group-by
- b45c117: added support for outer joins
- 75eb0c8: use real field names
- 932c8ce: progress implementing join
- bb45009: partial implementation of join
- e28de42: added support for arbitrary number of input pipes to cogroup
- 57752c8: Merge branch 'master' of github.com:Netflix/PigPen into cascading
- c33e9bf: simplify
- 2f314ca: got rid of unnecessary reduce
- d04058c: updated pg
- f21a4a4: turned tap dispatch into multimethod
- c08c183: rename
- d011627: got cogroup to work with custom serialization
- 78d7f82: moved serialization stuff to new ns
- 8cfa955: fixed storage handling
- 3e1adb8: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- 18ab584: Merge branch 'sans-pig' into cascading
- 6760750: Merge pull request #87 from Netflix/return-to-core
- b3b0bfb: Move pigpen.core to pigpen-core
- a3ed01f: Move pigpen.exec -> pigpen.pig
- 5068865: Move pigpen.pig -> pigpen.pig.runtime
- 35d6d95: Move pigpen.io
- 8b0e0a0: Merge pull request #86 from Netflix/unfreeze-return
- 5513e06: Don't freeze values in pig/return
- ba2bf7b: Merge branch 'sans-pig' into cascading
- 246a221: Merge pull request #85 from Netflix/fix-bootstrap-ns
- e5174d4: Update the bootstrap namespace to pigpen.runtime
- b90420d: Merge pull request #84 from Netflix/dispatch-io
- 9fe580f: Merge pull request #83 from Netflix/pig-oven
- 59cb87b: Merge pull request #82 from Netflix/update-deps
- 4591c8d: Change io operations to dispatch on keywords instead of pig-specific loader classes
- e03b94a: Move register$ and option$ into new pigpen.pig.oven
- 23df77e: Remove column pruning (wasn't used)
- 7da21de: beginnings of serialization for cascading
- a7c7a8e: cleaned up test
- 7383184: remove cascading dependencies from core
- afa349e: got simple flow to work sans pig
- 4666707: moved all cascading stuff to the corresponding project
- f62d6bd: updated function not to use pig classes
- 9c5d309: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- 1562c71: Remove pig dependencies from pigpen-core
- d1aeab8: Add clojure dependency to cascading project
- 9bb476c: Merge branch 'sans-pig' into cascading
- 192a721: Merge pull request #80 from Netflix/move-oven
- 623236f: Move pigpen.oven back to pigpen-core
- 1399fe5: Merge pull request #79 from Netflix/pig-rx
- 683a04a: Rename pigpen.local -> pigpen.pig-rx
- 178d975: Merge branch 'master' into sans-pig
- 1522c11: cleanup
- 1ff6514: got cogroup example to work
- 3dfe1b2: getting close to a working cogroup
- e834049: used field projections in PigPenFunction
- 8371677: collapse field projections into the preceding step
- 90e94d5: removed unbaked
- 81b6348: hack around serialization using Pig classes
- 3a87957: fixed field assignment in cogroup
- 1e021b2: Merge pull request #75 from Netflix/move-exec
- 055540e: Move tuples & bags to post-processing & the UDF. Move exec to runtime.
- 0b589dd: Merge pull request #74 from Netflix/move-util-fns
- 6ba80eb: Move pigpen.pig/args->map and pigpen.pig/debug to pigpen.runtime
- 5ab6214: Merge pull request #73 from Netflix/generalize-serialization
- ff3118e: Merge pull request #72 from Netflix/change-code-dispatch
- c0e8aeb: Use multimethods for serialization. Each platform implements these.
- aa872f4: Update code$ to not refer to pig classes. Using keywords instead
- 2974492: Move pigpen.pig/eval-string to pigpen.runtime
- ba9f609: Add cascading project
- a88bfe6: Move ->bind fns and with-ns to pigpen.runtime
- 076418f: Update build with new locations
- 46c8533: handle fields and aliases
- e36c352: process field projections together
- b246ee5: shaping up cogroup
- 22e2687: back to using pipes directly
- b87d34c: Add pigpen-pig project
- 7a6f595: Move files into pigpen-pig
- f3f65c2: Remove extra imports
- 036ff27: adding support for cogroup - work in progress
- dc74a98: added scripts to pg for reference
- aa9dc9c: set up test for cogroup
- e3a0015: added load-clj
- 3b1a2b8: added generate-flow, refactored test
- 99f0457: added comment
- 6ddbc6b: added store-clj, refactored pigpen function
- 490501c: added store-tsv
- 74ac671: added load-tsv
- f2552f6: invoke clj func from cascading operation
- a58bf4c: beginnings of :projection and :code
- 50a6747: bind field in load-text
- 92a0d3a: added store-text, replaced hardcoded commands with real query in test
- 17cb8f7: first test actually executing a cascading flow
- 8df0045: build real cascading flow
- 5c372ad: started implementing :store
- 8b0ff08: started implementing :generate
- 2cd1e21: added method for :register, use example query in test
- 0bd584e: added example my-func to pg
- 0d073f8: initial implementation of commands->flow
- 2b21372: beginnings of cascading backend
- dea4e44: added simple flow definitions
- 2804131: updated dependencies
- 28fdf6f: added playground file
- cbb0fe6: added cascading dependency

v0.3.0-rc.5

Toggle v0.3.0-rc.5's commit message
Release of 0.3.0-rc.5

- 105fc34: Merge pull request #155 from Netflix/core-async-update
- 857ff64: Update core.async version and fix bug in macro expansion
- f03b4b5: Merge pull request #154 from Netflix/memoize-pig-udf
- c9fb083: Memoize user code evaluation in pig UDFs
- 5d310ec: Add local support for native filter expressions
- 6cf3237: Update licenses
- 58fb109: Merge pull request #153 from Netflix/projects
- 4991f91: Merge pigpen-local and pigpen-tests into pigpen-core
- c80c0d0: Merge pull request #152 from Netflix/parquet-v2
- e7c6c56: Parquet, take 2. Better handling of schema & new local approach without pig dependency.
- 609fa17: Merge pull request #151 from rspieldenner/master
- 9a39b83: Add properties to config cloudbees job creation
- e050b11: Merge pull request #150 from rspieldenner/master
- 51a7330: Fix netflixoss conversion
- 4ced3b0: Merge pull request #149 from Netflix/cascading
- 7b7567a: Disable AOT
- 9637af7: Qualify symbols in native filter expressions with ?
- 472bf64: Merge branch 'master' into cascading
- ababe13: Fix handling of nil vs false in user data
- e71385b: Merge pull request #148 from Netflix/pkozikow-cascading
- 1909d3a: Merge branch 'cascading' of https://github.com/pkozikow/PigPen into pkozikow-cascading
- 4d8ddfb: Perf improvements. Use protocols instead of multimethods for hybrid->clojure. Use transducer-like functions for binds. Move cascading runtime code to preprocessing.
- 7942a43: misc fixes
- 840e4fc: Merge pull request #146 from rspieldenner/netflixoss
- 6b8ab41: Moving to new netflixoss build
- cf2078e: Merge pull request #145 from Netflix/license
- 2caa566: Update licenses
- 278b967: Merge pull request #144 from Netflix/docs
- 4263f10: Add docs for pigpen.core.fn and pigpen.core.op
- a3c0373: Merge pull request #143 from Netflix/docs
- 8f3ea82: Doc updates
- 5b2c95e: Merge pull request #142 from Netflix/store-tap
- 7e93175: Add store-tap
- 847e70c: Merge branch 'master' into cascading
- d968b8d: Fix test result ordering issue
- ff84ccc: Missed file
- bc91ad5: Merge commit '3474b8f4b38b76a17bf546942a1059832d9b44e6' into cascading
- 7264c2b: Merge pull request #139 from Netflix/fix-gz-local-input
- 9ef0aa5: Merge pull request #141 from Netflix/ns-cleanup
- 89fe5dd: Clean up folder/namespace structure. Move viz into separate project. Switch pigpen.cascading & pigpen.cascading.core. Split parquet into common & pig parts.
- f20bf2f: Move files to prep for refactoring
- ee40398: Merge pull request #140 from Netflix/rename
- 1e30e1e: Clean up threading of * calls. Add namespaces for raw & function operations.
- 312f59a: Rename script -> store-many
- 1126a05: Switch raw & oven commands to thread-last
- 6e6f10b: Rename union -> concat
- 9eee8fe: Rename limit -> take
- 61a44c7: Rename order -> sort
- b68f251: Look for gz files when loading locally
- 5bbf19b: Merge pull request #135 from ljank/features/convert-enums-in-avro
- 5e975b7: Rename generate -> project
- 5eefc64: Fix cascading runtime field lookup
- 37ede78: Merge branch 'master' of github.com:Netflix/PigPen
- ae31c84: Don't lose focus during tests
- af25365: Implement native->clojure for GenericData$EnumSymbol
- d47bb9a: [Gradle Release Plugin] - new version commit:  '0.2.16-SNAPSHOT'.
- d8bf0e0: Merge pull request #113 from Netflix/fields
- 758ca69: Perf enhancements & new perf test
- cf303a9: Update cascading branch with new field model
- b3def2f: Merge branch 'sans-pig' into fields
- ab78391: Merge pull request #111 from Netflix/fields
- 26bb1eb: Field updates for Parquet
- 97631bf: Changes to pig script generation for new field model
- a5cb222: Flatten Func into CodeExpr
- 3f41275: Refactor projections
- eaec952: Check schemas
- 4ca84b5: Update to reflect model
- 0038c7a: Update pigpen-local with model
- 4c75b83: Merge pull request #109 from pkozikow/cascading
- 64cefb8: Add model. Remove structural tests.
- f0df969: added load tap
- af32b63: Merge pull request #107 from pkozikow/cascading
- fba276a: all tests should pass now
- c4a12eb: implemented naive rank
- 810ef8a: handle reverse sort order and sort-by
- 6d71148: initial implementation of order
- bc227be: simplify handling of group-all
- adc0066: suggestions from code review
- 924da28: Merge pull request #106 from pkozikow/cascading
- 40aaf5e: Merge pull request #5 from pkozikow/partial_aggregation
- ffde7cb: cleanup
- 116e037: removed debug test
- 02123a4: simplify group-by since folds are handled elsewhere
- 9147555: refactoring
- 83893cc: modified SingleIterationSeq to only apply the restriction to large collections
- 3c171c9: refactored handling of groups
- 62a9b21: label groups that required partial aggregation during preprocessing
- 20b6740: also include func projections
- f7ee3c5: handle self-join case
- dfce7ca: better handling of output fields
- 8677609: fixed bug handling sentinel value
- 0d657f2: handle case where pre returns a collection with more than 1 elements
- 5f9a57e: discard group-all field after using it
- 6d86eb1: Merge pull request #104 from pkozikow/cascading
- 8cde9a6: progress to handle group-all
- 55e3710: use a sentinel values to emulate multiple streams
- c6df6c8: beginnings of multiple streams with partial aggregation
- 39c63d2: first pass at partial aggregation
- 72ae0e6: handle serialization outside of user functions
- f8d1903: fixed yet another cogroup bug
- a550ed7: fixed bug in group handling
- 045d420: more robust way to determine if the key is separate from the value
- cfb365b: removed redundant load funcs
- 7245ac8: fixed bug
- 2c33476: detect when the key should be emitted separately from the value
- cc5db12: more tests pass
- aa28ab4: implemented union command
- b1c5142: Merge pull request #102 from pkozikow/cascading
- 2876673: don't pass lazy seqs to GroupBuffer's constructor
- 1c03eaf: make fields private
- 37f1c95: attempt to circumvent OOEM problem
- 4fbc3d4: got store tests to work
- 1d05d3b: got all remaining fold tests to work
- d4f6e16: got remaining join-fold tests to work
- db7d5d5: got test-fold-cogroup-dual to work
- 1a7351d: use default field value in absence of explicit projections
- 08416bc: got another couple of fold tests to work
- 0a6a40b: got test-cogroup-self-join+fold to work
- edaeadf: removed hack and unused code
- c9e986e: got test-fold-count to work
- 6c147f9: Merge branch 'cascading' into fold
- 2356e66: allow passing in flow connector
- 8023807: Merge branch 'master' of github.com:pkozikow/PigPen into cascading
- 2ed2d4b: propagate group-opts only to immediate successor
- 46f141f: progress towards supporting fold
- a5c52d1: Merge pull request #4 from pkozikow/cascading
- c920e1d: refactoring
- afb12f3: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- fe26e9e: Update local mode with field changes
- 6398e89: Clean up debugging
- 5614828: Fix tests
- 340fca4: better idiom
- f8eeb9b: Merge pull request #99 from pkozikow/cascading
- 93ed900: got cogroup-full-outer to work
- fac1c6a: got cogroup left and right outer to work
- 6c612b0: take :join-nils into account in :group
- f108777: refactoring
- cf49014: refactoring
- 691367c: pass cogroup opts explicitly, handle cogroup-inner
- a528dc7: Merge pull request #98 from pkozikow/cascading
- b34fcaf: Change fields to namespaced symbols, initial cut
- 39dbc41: added support for group-all operations
- dc00e0d: added support for all-args in join
- 304b497: got self-joins to work
- 57ff6df: handle join-nils in outer joins
- 1d5fcee: added support for :join-nils to join
- e86dca7: implemented sample
- 19176f5: clear output before running
- ef21f97: implemented limit
- 55ebfab: tmp change to build to make it work
- ba30452: added temporary test for development
- 600876b: remove pig dependency
- 4bf45a0: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- f4c9ce1: Using core.reducers to perform the fold
- 0102c00: Merge pull request #94 from Netflix/cascading-functional-tests
- 1ed767c: Disable new tests for not-implemented features
- 90198e7: Merge branch 'sans-pig' into cascading-functional-tests
- 9c3b920: Merge pull request #97 from Netflix/rx-clean
- 1ad41e0: Move fold test to pigpen-tests. Implement fold in local mode. End pig-rx!
- 8f8d153: Add script to local
- d4bdfa3: Implement join for local & rx
- 1faabb6: Add group-all to local & rx
- 6516aed: Create a new pigpen-rx project with a streamlined non-pig rx implementation. Currently matches functionality of pigpen-local.
- 1702da5: fixed other potential sources of memory problems
- 1e591dd: Merge pull request #96 from Netflix/local-mode-filter
- a6bd4c1: Merge pull request #95 from Netflix/local-mode-group-by
- c9ee34e: Add functional tests for limit, sample, and distinct. Implement limit, sample, distinct, and union in local mode.
- 72de416: Implement :group for local mode
- 6a9706a: Add pigpen-tests dependency
- 7e2f04a: Add functional tests for cascading
- 6db62e8: Merge branch 'sans-pig' into cascading
- 6b2456a: Merge pull request #93 from Netflix/local-mode
- 519254e: Merge pull request #92 from Netflix/functional-tests
- 194c6e2: Add project for pigpen-local. Move stuff.
- 3de019f: Merge branch 'functional-tests' into local-mode
- 6ac758b: Move rx functional tests to rx. Add pig functional tests.
- f060b5a: Fix rank adjustments locally to match pig
- f414340: Fix order-dependent tests
- f6d7d33: Call seq on the results of all co-groupings to enforce consistency
- e4190bf: Only DataBag supports accumulation & returning bags. Move accumulator & add explicit bag creation.
- de48e8f: Fix quoting bug in script generation
- 8fbba9d: Refactor oven to make operations more modular. Move some pig specific ones to pigpen-pig.
- 4c4378b: Add local mode
- 3673b5b: Fixed default post-process
- 4844a64: Make functional tests a library
- 2dd7f41: Merge pull request #3 from matthagy/seq_cnv
- 03985fa: Lazy conversion of sequences in hybrid->clojure
- 72ef729: Merge pull request #91 from pkozikow/master
- 6c330f7: removed debug print stmts and ns, fixed comment
- 3883df7: removed redundant function, formatting
- 98d8e9f: unnecessary let
- e3e91be: removed stuff already available in pigpen.core
- 2e84303: emit tuples from clojure
- f2228d1: emit tuples from clojure
- 5b03b38: Merge branch 'cascading' into cascading_origin
- eadd4f3: Merge branch 'sans-pig' into cascading
- 6cd2f98: Merge branch 'master' into sans-pig
- da04db1: removed bogus import
- 2ee74ee: refactoring
- d0a0105: refactoring
- ff7c680: removed redundant method and implemented distinction for nils
- 1d386f0: more requires
- 4674f09: require runtime
- 5339b6f: identity
- 654a394: misc fixes
- dd2cc0a: implemented distinct
- ba54685: added test for mapcat
- a543a7f: implemented script
- b37ae81: Merge pull request #1 from matthagy/lr_extensions
- 217148c: Fixed handling of field projections
- 23b7d9c: Small changes to support LiveRamp extensions
- 87525ac: don't use cascading ns directly
- 7636ba5: make io functions available
- 309eb4c: remove debug print stmts
- a07ea4e: removed redundant helper, fixed test
- b61fa93: added test for group-by
- b45c117: added support for outer joins
- 75eb0c8: use real field names
- 932c8ce: progress implementing join
- bb45009: partial implementation of join
- e28de42: added support for arbitrary number of input pipes to cogroup
- 57752c8: Merge branch 'master' of github.com:Netflix/PigPen into cascading
- c33e9bf: simplify
- 2f314ca: got rid of unnecessary reduce
- d04058c: updated pg
- f21a4a4: turned tap dispatch into multimethod
- c08c183: rename
- d011627: got cogroup to work with custom serialization
- 78d7f82: moved serialization stuff to new ns
- 8cfa955: fixed storage handling
- 3e1adb8: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- 18ab584: Merge branch 'sans-pig' into cascading
- 6760750: Merge pull request #87 from Netflix/return-to-core
- b3b0bfb: Move pigpen.core to pigpen-core
- a3ed01f: Move pigpen.exec -> pigpen.pig
- 5068865: Move pigpen.pig -> pigpen.pig.runtime
- 35d6d95: Move pigpen.io
- 8b0e0a0: Merge pull request #86 from Netflix/unfreeze-return
- 5513e06: Don't freeze values in pig/return
- ba2bf7b: Merge branch 'sans-pig' into cascading
- 246a221: Merge pull request #85 from Netflix/fix-bootstrap-ns
- e5174d4: Update the bootstrap namespace to pigpen.runtime
- b90420d: Merge pull request #84 from Netflix/dispatch-io
- 9fe580f: Merge pull request #83 from Netflix/pig-oven
- 59cb87b: Merge pull request #82 from Netflix/update-deps
- 4591c8d: Change io operations to dispatch on keywords instead of pig-specific loader classes
- e03b94a: Move register$ and option$ into new pigpen.pig.oven
- 23df77e: Remove column pruning (wasn't used)
- 7da21de: beginnings of serialization for cascading
- a7c7a8e: cleaned up test
- 7383184: remove cascading dependencies from core
- afa349e: got simple flow to work sans pig
- 4666707: moved all cascading stuff to the corresponding project
- f62d6bd: updated function not to use pig classes
- 9c5d309: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- 1562c71: Remove pig dependencies from pigpen-core
- d1aeab8: Add clojure dependency to cascading project
- 9bb476c: Merge branch 'sans-pig' into cascading
- 192a721: Merge pull request #80 from Netflix/move-oven
- 623236f: Move pigpen.oven back to pigpen-core
- 1399fe5: Merge pull request #79 from Netflix/pig-rx
- 683a04a: Rename pigpen.local -> pigpen.pig-rx
- 178d975: Merge branch 'master' into sans-pig
- 1522c11: cleanup
- 1ff6514: got cogroup example to work
- 3dfe1b2: getting close to a working cogroup
- e834049: used field projections in PigPenFunction
- 8371677: collapse field projections into the preceding step
- 90e94d5: removed unbaked
- 81b6348: hack around serialization using Pig classes
- 3a87957: fixed field assignment in cogroup
- 1e021b2: Merge pull request #75 from Netflix/move-exec
- 055540e: Move tuples & bags to post-processing & the UDF. Move exec to runtime.
- 0b589dd: Merge pull request #74 from Netflix/move-util-fns
- 6ba80eb: Move pigpen.pig/args->map and pigpen.pig/debug to pigpen.runtime
- 5ab6214: Merge pull request #73 from Netflix/generalize-serialization
- ff3118e: Merge pull request #72 from Netflix/change-code-dispatch
- c0e8aeb: Use multimethods for serialization. Each platform implements these.
- aa872f4: Update code$ to not refer to pig classes. Using keywords instead
- 2974492: Move pigpen.pig/eval-string to pigpen.runtime
- ba9f609: Add cascading project
- a88bfe6: Move ->bind fns and with-ns to pigpen.runtime
- 076418f: Update build with new locations
- 46c8533: handle fields and aliases
- e36c352: process field projections together
- b246ee5: shaping up cogroup
- 22e2687: back to using pipes directly
- b87d34c: Add pigpen-pig project
- 7a6f595: Move files into pigpen-pig
- f3f65c2: Remove extra imports
- 036ff27: adding support for cogroup - work in progress
- dc74a98: added scripts to pg for reference
- aa9dc9c: set up test for cogroup
- e3a0015: added load-clj
- 3b1a2b8: added generate-flow, refactored test
- 99f0457: added comment
- 6ddbc6b: added store-clj, refactored pigpen function
- 490501c: added store-tsv
- 74ac671: added load-tsv
- f2552f6: invoke clj func from cascading operation
- a58bf4c: beginnings of :projection and :code
- 50a6747: bind field in load-text
- 92a0d3a: added store-text, replaced hardcoded commands with real query in test
- 17cb8f7: first test actually executing a cascading flow
- 8df0045: build real cascading flow
- 5c372ad: started implementing :store
- 8b0ff08: started implementing :generate
- 2cd1e21: added method for :register, use example query in test
- 0bd584e: added example my-func to pg
- 0d073f8: initial implementation of commands->flow
- 2b21372: beginnings of cascading backend
- dea4e44: added simple flow definitions
- 2804131: updated dependencies
- 28fdf6f: added playground file
- cbb0fe6: added cascading dependency

v0.3.0-rc.4

Toggle v0.3.0-rc.4's commit message
Release of 0.3.0-rc.4

- f03b4b5: Merge pull request #154 from Netflix/memoize-pig-udf
- c9fb083: Memoize user code evaluation in pig UDFs
- 5d310ec: Add local support for native filter expressions
- 6cf3237: Update licenses
- 58fb109: Merge pull request #153 from Netflix/projects
- 4991f91: Merge pigpen-local and pigpen-tests into pigpen-core
- c80c0d0: Merge pull request #152 from Netflix/parquet-v2
- e7c6c56: Parquet, take 2. Better handling of schema & new local approach without pig dependency.
- 609fa17: Merge pull request #151 from rspieldenner/master
- 9a39b83: Add properties to config cloudbees job creation
- e050b11: Merge pull request #150 from rspieldenner/master
- 51a7330: Fix netflixoss conversion
- 4ced3b0: Merge pull request #149 from Netflix/cascading
- 7b7567a: Disable AOT
- 9637af7: Qualify symbols in native filter expressions with ?
- 472bf64: Merge branch 'master' into cascading
- ababe13: Fix handling of nil vs false in user data
- e71385b: Merge pull request #148 from Netflix/pkozikow-cascading
- 1909d3a: Merge branch 'cascading' of https://github.com/pkozikow/PigPen into pkozikow-cascading
- 4d8ddfb: Perf improvements. Use protocols instead of multimethods for hybrid->clojure. Use transducer-like functions for binds. Move cascading runtime code to preprocessing.
- 7942a43: misc fixes
- 840e4fc: Merge pull request #146 from rspieldenner/netflixoss
- 6b8ab41: Moving to new netflixoss build
- cf2078e: Merge pull request #145 from Netflix/license
- 2caa566: Update licenses
- 278b967: Merge pull request #144 from Netflix/docs
- 4263f10: Add docs for pigpen.core.fn and pigpen.core.op
- a3c0373: Merge pull request #143 from Netflix/docs
- 8f3ea82: Doc updates
- 5b2c95e: Merge pull request #142 from Netflix/store-tap
- 7e93175: Add store-tap
- 847e70c: Merge branch 'master' into cascading
- d968b8d: Fix test result ordering issue
- ff84ccc: Missed file
- bc91ad5: Merge commit '3474b8f4b38b76a17bf546942a1059832d9b44e6' into cascading
- 7264c2b: Merge pull request #139 from Netflix/fix-gz-local-input
- 9ef0aa5: Merge pull request #141 from Netflix/ns-cleanup
- 89fe5dd: Clean up folder/namespace structure. Move viz into separate project. Switch pigpen.cascading & pigpen.cascading.core. Split parquet into common & pig parts.
- f20bf2f: Move files to prep for refactoring
- ee40398: Merge pull request #140 from Netflix/rename
- 1e30e1e: Clean up threading of * calls. Add namespaces for raw & function operations.
- 312f59a: Rename script -> store-many
- 1126a05: Switch raw & oven commands to thread-last
- 6e6f10b: Rename union -> concat
- 9eee8fe: Rename limit -> take
- 61a44c7: Rename order -> sort
- b68f251: Look for gz files when loading locally
- 5bbf19b: Merge pull request #135 from ljank/features/convert-enums-in-avro
- 5e975b7: Rename generate -> project
- 5eefc64: Fix cascading runtime field lookup
- 37ede78: Merge branch 'master' of github.com:Netflix/PigPen
- ae31c84: Don't lose focus during tests
- af25365: Implement native->clojure for GenericData$EnumSymbol
- d47bb9a: [Gradle Release Plugin] - new version commit:  '0.2.16-SNAPSHOT'.
- d8bf0e0: Merge pull request #113 from Netflix/fields
- 758ca69: Perf enhancements & new perf test
- cf303a9: Update cascading branch with new field model
- b3def2f: Merge branch 'sans-pig' into fields
- ab78391: Merge pull request #111 from Netflix/fields
- 26bb1eb: Field updates for Parquet
- 97631bf: Changes to pig script generation for new field model
- a5cb222: Flatten Func into CodeExpr
- 3f41275: Refactor projections
- eaec952: Check schemas
- 4ca84b5: Update to reflect model
- 0038c7a: Update pigpen-local with model
- 4c75b83: Merge pull request #109 from pkozikow/cascading
- 64cefb8: Add model. Remove structural tests.
- f0df969: added load tap
- af32b63: Merge pull request #107 from pkozikow/cascading
- fba276a: all tests should pass now
- c4a12eb: implemented naive rank
- 810ef8a: handle reverse sort order and sort-by
- 6d71148: initial implementation of order
- bc227be: simplify handling of group-all
- adc0066: suggestions from code review
- 924da28: Merge pull request #106 from pkozikow/cascading
- 40aaf5e: Merge pull request #5 from pkozikow/partial_aggregation
- ffde7cb: cleanup
- 116e037: removed debug test
- 02123a4: simplify group-by since folds are handled elsewhere
- 9147555: refactoring
- 83893cc: modified SingleIterationSeq to only apply the restriction to large collections
- 3c171c9: refactored handling of groups
- 62a9b21: label groups that required partial aggregation during preprocessing
- 20b6740: also include func projections
- f7ee3c5: handle self-join case
- dfce7ca: better handling of output fields
- 8677609: fixed bug handling sentinel value
- 0d657f2: handle case where pre returns a collection with more than 1 elements
- 5f9a57e: discard group-all field after using it
- 6d86eb1: Merge pull request #104 from pkozikow/cascading
- 8cde9a6: progress to handle group-all
- 55e3710: use a sentinel values to emulate multiple streams
- c6df6c8: beginnings of multiple streams with partial aggregation
- 39c63d2: first pass at partial aggregation
- 72ae0e6: handle serialization outside of user functions
- f8d1903: fixed yet another cogroup bug
- a550ed7: fixed bug in group handling
- 045d420: more robust way to determine if the key is separate from the value
- cfb365b: removed redundant load funcs
- 7245ac8: fixed bug
- 2c33476: detect when the key should be emitted separately from the value
- cc5db12: more tests pass
- aa28ab4: implemented union command
- b1c5142: Merge pull request #102 from pkozikow/cascading
- 2876673: don't pass lazy seqs to GroupBuffer's constructor
- 1c03eaf: make fields private
- 37f1c95: attempt to circumvent OOEM problem
- 4fbc3d4: got store tests to work
- 1d05d3b: got all remaining fold tests to work
- d4f6e16: got remaining join-fold tests to work
- db7d5d5: got test-fold-cogroup-dual to work
- 1a7351d: use default field value in absence of explicit projections
- 08416bc: got another couple of fold tests to work
- 0a6a40b: got test-cogroup-self-join+fold to work
- edaeadf: removed hack and unused code
- c9e986e: got test-fold-count to work
- 6c147f9: Merge branch 'cascading' into fold
- 2356e66: allow passing in flow connector
- 8023807: Merge branch 'master' of github.com:pkozikow/PigPen into cascading
- 2ed2d4b: propagate group-opts only to immediate successor
- 46f141f: progress towards supporting fold
- a5c52d1: Merge pull request #4 from pkozikow/cascading
- c920e1d: refactoring
- afb12f3: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- fe26e9e: Update local mode with field changes
- 6398e89: Clean up debugging
- 5614828: Fix tests
- 340fca4: better idiom
- f8eeb9b: Merge pull request #99 from pkozikow/cascading
- 93ed900: got cogroup-full-outer to work
- fac1c6a: got cogroup left and right outer to work
- 6c612b0: take :join-nils into account in :group
- f108777: refactoring
- cf49014: refactoring
- 691367c: pass cogroup opts explicitly, handle cogroup-inner
- a528dc7: Merge pull request #98 from pkozikow/cascading
- b34fcaf: Change fields to namespaced symbols, initial cut
- 39dbc41: added support for group-all operations
- dc00e0d: added support for all-args in join
- 304b497: got self-joins to work
- 57ff6df: handle join-nils in outer joins
- 1d5fcee: added support for :join-nils to join
- e86dca7: implemented sample
- 19176f5: clear output before running
- ef21f97: implemented limit
- 55ebfab: tmp change to build to make it work
- ba30452: added temporary test for development
- 600876b: remove pig dependency
- 4bf45a0: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- f4c9ce1: Using core.reducers to perform the fold
- 0102c00: Merge pull request #94 from Netflix/cascading-functional-tests
- 1ed767c: Disable new tests for not-implemented features
- 90198e7: Merge branch 'sans-pig' into cascading-functional-tests
- 9c3b920: Merge pull request #97 from Netflix/rx-clean
- 1ad41e0: Move fold test to pigpen-tests. Implement fold in local mode. End pig-rx!
- 8f8d153: Add script to local
- d4bdfa3: Implement join for local & rx
- 1faabb6: Add group-all to local & rx
- 6516aed: Create a new pigpen-rx project with a streamlined non-pig rx implementation. Currently matches functionality of pigpen-local.
- 1702da5: fixed other potential sources of memory problems
- 1e591dd: Merge pull request #96 from Netflix/local-mode-filter
- a6bd4c1: Merge pull request #95 from Netflix/local-mode-group-by
- c9ee34e: Add functional tests for limit, sample, and distinct. Implement limit, sample, distinct, and union in local mode.
- 72de416: Implement :group for local mode
- 6a9706a: Add pigpen-tests dependency
- 7e2f04a: Add functional tests for cascading
- 6db62e8: Merge branch 'sans-pig' into cascading
- 6b2456a: Merge pull request #93 from Netflix/local-mode
- 519254e: Merge pull request #92 from Netflix/functional-tests
- 194c6e2: Add project for pigpen-local. Move stuff.
- 3de019f: Merge branch 'functional-tests' into local-mode
- 6ac758b: Move rx functional tests to rx. Add pig functional tests.
- f060b5a: Fix rank adjustments locally to match pig
- f414340: Fix order-dependent tests
- f6d7d33: Call seq on the results of all co-groupings to enforce consistency
- e4190bf: Only DataBag supports accumulation & returning bags. Move accumulator & add explicit bag creation.
- de48e8f: Fix quoting bug in script generation
- 8fbba9d: Refactor oven to make operations more modular. Move some pig specific ones to pigpen-pig.
- 4c4378b: Add local mode
- 3673b5b: Fixed default post-process
- 4844a64: Make functional tests a library
- 2dd7f41: Merge pull request #3 from matthagy/seq_cnv
- 03985fa: Lazy conversion of sequences in hybrid->clojure
- 72ef729: Merge pull request #91 from pkozikow/master
- 6c330f7: removed debug print stmts and ns, fixed comment
- 3883df7: removed redundant function, formatting
- 98d8e9f: unnecessary let
- e3e91be: removed stuff already available in pigpen.core
- 2e84303: emit tuples from clojure
- f2228d1: emit tuples from clojure
- 5b03b38: Merge branch 'cascading' into cascading_origin
- eadd4f3: Merge branch 'sans-pig' into cascading
- 6cd2f98: Merge branch 'master' into sans-pig
- da04db1: removed bogus import
- 2ee74ee: refactoring
- d0a0105: refactoring
- ff7c680: removed redundant method and implemented distinction for nils
- 1d386f0: more requires
- 4674f09: require runtime
- 5339b6f: identity
- 654a394: misc fixes
- dd2cc0a: implemented distinct
- ba54685: added test for mapcat
- a543a7f: implemented script
- b37ae81: Merge pull request #1 from matthagy/lr_extensions
- 217148c: Fixed handling of field projections
- 23b7d9c: Small changes to support LiveRamp extensions
- 87525ac: don't use cascading ns directly
- 7636ba5: make io functions available
- 309eb4c: remove debug print stmts
- a07ea4e: removed redundant helper, fixed test
- b61fa93: added test for group-by
- b45c117: added support for outer joins
- 75eb0c8: use real field names
- 932c8ce: progress implementing join
- bb45009: partial implementation of join
- e28de42: added support for arbitrary number of input pipes to cogroup
- 57752c8: Merge branch 'master' of github.com:Netflix/PigPen into cascading
- c33e9bf: simplify
- 2f314ca: got rid of unnecessary reduce
- d04058c: updated pg
- f21a4a4: turned tap dispatch into multimethod
- c08c183: rename
- d011627: got cogroup to work with custom serialization
- 78d7f82: moved serialization stuff to new ns
- 8cfa955: fixed storage handling
- 3e1adb8: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- 18ab584: Merge branch 'sans-pig' into cascading
- 6760750: Merge pull request #87 from Netflix/return-to-core
- b3b0bfb: Move pigpen.core to pigpen-core
- a3ed01f: Move pigpen.exec -> pigpen.pig
- 5068865: Move pigpen.pig -> pigpen.pig.runtime
- 35d6d95: Move pigpen.io
- 8b0e0a0: Merge pull request #86 from Netflix/unfreeze-return
- 5513e06: Don't freeze values in pig/return
- ba2bf7b: Merge branch 'sans-pig' into cascading
- 246a221: Merge pull request #85 from Netflix/fix-bootstrap-ns
- e5174d4: Update the bootstrap namespace to pigpen.runtime
- b90420d: Merge pull request #84 from Netflix/dispatch-io
- 9fe580f: Merge pull request #83 from Netflix/pig-oven
- 59cb87b: Merge pull request #82 from Netflix/update-deps
- 4591c8d: Change io operations to dispatch on keywords instead of pig-specific loader classes
- e03b94a: Move register$ and option$ into new pigpen.pig.oven
- 23df77e: Remove column pruning (wasn't used)
- 7da21de: beginnings of serialization for cascading
- a7c7a8e: cleaned up test
- 7383184: remove cascading dependencies from core
- afa349e: got simple flow to work sans pig
- 4666707: moved all cascading stuff to the corresponding project
- f62d6bd: updated function not to use pig classes
- 9c5d309: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- 1562c71: Remove pig dependencies from pigpen-core
- d1aeab8: Add clojure dependency to cascading project
- 9bb476c: Merge branch 'sans-pig' into cascading
- 192a721: Merge pull request #80 from Netflix/move-oven
- 623236f: Move pigpen.oven back to pigpen-core
- 1399fe5: Merge pull request #79 from Netflix/pig-rx
- 683a04a: Rename pigpen.local -> pigpen.pig-rx
- 178d975: Merge branch 'master' into sans-pig
- 1522c11: cleanup
- 1ff6514: got cogroup example to work
- 3dfe1b2: getting close to a working cogroup
- e834049: used field projections in PigPenFunction
- 8371677: collapse field projections into the preceding step
- 90e94d5: removed unbaked
- 81b6348: hack around serialization using Pig classes
- 3a87957: fixed field assignment in cogroup
- 1e021b2: Merge pull request #75 from Netflix/move-exec
- 055540e: Move tuples & bags to post-processing & the UDF. Move exec to runtime.
- 0b589dd: Merge pull request #74 from Netflix/move-util-fns
- 6ba80eb: Move pigpen.pig/args->map and pigpen.pig/debug to pigpen.runtime
- 5ab6214: Merge pull request #73 from Netflix/generalize-serialization
- ff3118e: Merge pull request #72 from Netflix/change-code-dispatch
- c0e8aeb: Use multimethods for serialization. Each platform implements these.
- aa872f4: Update code$ to not refer to pig classes. Using keywords instead
- 2974492: Move pigpen.pig/eval-string to pigpen.runtime
- ba9f609: Add cascading project
- a88bfe6: Move ->bind fns and with-ns to pigpen.runtime
- 076418f: Update build with new locations
- 46c8533: handle fields and aliases
- e36c352: process field projections together
- b246ee5: shaping up cogroup
- 22e2687: back to using pipes directly
- b87d34c: Add pigpen-pig project
- 7a6f595: Move files into pigpen-pig
- f3f65c2: Remove extra imports
- 036ff27: adding support for cogroup - work in progress
- dc74a98: added scripts to pg for reference
- aa9dc9c: set up test for cogroup
- e3a0015: added load-clj
- 3b1a2b8: added generate-flow, refactored test
- 99f0457: added comment
- 6ddbc6b: added store-clj, refactored pigpen function
- 490501c: added store-tsv
- 74ac671: added load-tsv
- f2552f6: invoke clj func from cascading operation
- a58bf4c: beginnings of :projection and :code
- 50a6747: bind field in load-text
- 92a0d3a: added store-text, replaced hardcoded commands with real query in test
- 17cb8f7: first test actually executing a cascading flow
- 8df0045: build real cascading flow
- 5c372ad: started implementing :store
- 8b0ff08: started implementing :generate
- 2cd1e21: added method for :register, use example query in test
- 0bd584e: added example my-func to pg
- 0d073f8: initial implementation of commands->flow
- 2b21372: beginnings of cascading backend
- dea4e44: added simple flow definitions
- 2804131: updated dependencies
- 28fdf6f: added playground file
- cbb0fe6: added cascading dependency

v0.3.0-rc.3

Toggle v0.3.0-rc.3's commit message
Release of 0.3.0-rc.3

- 5d310ec: Add local support for native filter expressions
- 6cf3237: Update licenses
- 58fb109: Merge pull request #153 from Netflix/projects
- 4991f91: Merge pigpen-local and pigpen-tests into pigpen-core
- c80c0d0: Merge pull request #152 from Netflix/parquet-v2
- e7c6c56: Parquet, take 2. Better handling of schema & new local approach without pig dependency.
- 609fa17: Merge pull request #151 from rspieldenner/master
- 9a39b83: Add properties to config cloudbees job creation
- e050b11: Merge pull request #150 from rspieldenner/master
- 51a7330: Fix netflixoss conversion
- 4ced3b0: Merge pull request #149 from Netflix/cascading
- 7b7567a: Disable AOT
- 9637af7: Qualify symbols in native filter expressions with ?
- 472bf64: Merge branch 'master' into cascading
- ababe13: Fix handling of nil vs false in user data
- e71385b: Merge pull request #148 from Netflix/pkozikow-cascading
- 1909d3a: Merge branch 'cascading' of https://github.com/pkozikow/PigPen into pkozikow-cascading
- 4d8ddfb: Perf improvements. Use protocols instead of multimethods for hybrid->clojure. Use transducer-like functions for binds. Move cascading runtime code to preprocessing.
- 7942a43: misc fixes
- 840e4fc: Merge pull request #146 from rspieldenner/netflixoss
- 6b8ab41: Moving to new netflixoss build
- cf2078e: Merge pull request #145 from Netflix/license
- 2caa566: Update licenses
- 278b967: Merge pull request #144 from Netflix/docs
- 4263f10: Add docs for pigpen.core.fn and pigpen.core.op
- a3c0373: Merge pull request #143 from Netflix/docs
- 8f3ea82: Doc updates
- 5b2c95e: Merge pull request #142 from Netflix/store-tap
- 7e93175: Add store-tap
- 847e70c: Merge branch 'master' into cascading
- d968b8d: Fix test result ordering issue
- ff84ccc: Missed file
- bc91ad5: Merge commit '3474b8f4b38b76a17bf546942a1059832d9b44e6' into cascading
- 7264c2b: Merge pull request #139 from Netflix/fix-gz-local-input
- 9ef0aa5: Merge pull request #141 from Netflix/ns-cleanup
- 89fe5dd: Clean up folder/namespace structure. Move viz into separate project. Switch pigpen.cascading & pigpen.cascading.core. Split parquet into common & pig parts.
- f20bf2f: Move files to prep for refactoring
- ee40398: Merge pull request #140 from Netflix/rename
- 1e30e1e: Clean up threading of * calls. Add namespaces for raw & function operations.
- 312f59a: Rename script -> store-many
- 1126a05: Switch raw & oven commands to thread-last
- 6e6f10b: Rename union -> concat
- 9eee8fe: Rename limit -> take
- 61a44c7: Rename order -> sort
- b68f251: Look for gz files when loading locally
- 5bbf19b: Merge pull request #135 from ljank/features/convert-enums-in-avro
- 5e975b7: Rename generate -> project
- 5eefc64: Fix cascading runtime field lookup
- 37ede78: Merge branch 'master' of github.com:Netflix/PigPen
- ae31c84: Don't lose focus during tests
- af25365: Implement native->clojure for GenericData$EnumSymbol
- d47bb9a: [Gradle Release Plugin] - new version commit:  '0.2.16-SNAPSHOT'.
- d8bf0e0: Merge pull request #113 from Netflix/fields
- 758ca69: Perf enhancements & new perf test
- cf303a9: Update cascading branch with new field model
- b3def2f: Merge branch 'sans-pig' into fields
- ab78391: Merge pull request #111 from Netflix/fields
- 26bb1eb: Field updates for Parquet
- 97631bf: Changes to pig script generation for new field model
- a5cb222: Flatten Func into CodeExpr
- 3f41275: Refactor projections
- eaec952: Check schemas
- 4ca84b5: Update to reflect model
- 0038c7a: Update pigpen-local with model
- 4c75b83: Merge pull request #109 from pkozikow/cascading
- 64cefb8: Add model. Remove structural tests.
- f0df969: added load tap
- af32b63: Merge pull request #107 from pkozikow/cascading
- fba276a: all tests should pass now
- c4a12eb: implemented naive rank
- 810ef8a: handle reverse sort order and sort-by
- 6d71148: initial implementation of order
- bc227be: simplify handling of group-all
- adc0066: suggestions from code review
- 924da28: Merge pull request #106 from pkozikow/cascading
- 40aaf5e: Merge pull request #5 from pkozikow/partial_aggregation
- ffde7cb: cleanup
- 116e037: removed debug test
- 02123a4: simplify group-by since folds are handled elsewhere
- 9147555: refactoring
- 83893cc: modified SingleIterationSeq to only apply the restriction to large collections
- 3c171c9: refactored handling of groups
- 62a9b21: label groups that required partial aggregation during preprocessing
- 20b6740: also include func projections
- f7ee3c5: handle self-join case
- dfce7ca: better handling of output fields
- 8677609: fixed bug handling sentinel value
- 0d657f2: handle case where pre returns a collection with more than 1 elements
- 5f9a57e: discard group-all field after using it
- 6d86eb1: Merge pull request #104 from pkozikow/cascading
- 8cde9a6: progress to handle group-all
- 55e3710: use a sentinel values to emulate multiple streams
- c6df6c8: beginnings of multiple streams with partial aggregation
- 39c63d2: first pass at partial aggregation
- 72ae0e6: handle serialization outside of user functions
- f8d1903: fixed yet another cogroup bug
- a550ed7: fixed bug in group handling
- 045d420: more robust way to determine if the key is separate from the value
- cfb365b: removed redundant load funcs
- 7245ac8: fixed bug
- 2c33476: detect when the key should be emitted separately from the value
- cc5db12: more tests pass
- aa28ab4: implemented union command
- b1c5142: Merge pull request #102 from pkozikow/cascading
- 2876673: don't pass lazy seqs to GroupBuffer's constructor
- 1c03eaf: make fields private
- 37f1c95: attempt to circumvent OOEM problem
- 4fbc3d4: got store tests to work
- 1d05d3b: got all remaining fold tests to work
- d4f6e16: got remaining join-fold tests to work
- db7d5d5: got test-fold-cogroup-dual to work
- 1a7351d: use default field value in absence of explicit projections
- 08416bc: got another couple of fold tests to work
- 0a6a40b: got test-cogroup-self-join+fold to work
- edaeadf: removed hack and unused code
- c9e986e: got test-fold-count to work
- 6c147f9: Merge branch 'cascading' into fold
- 2356e66: allow passing in flow connector
- 8023807: Merge branch 'master' of github.com:pkozikow/PigPen into cascading
- 2ed2d4b: propagate group-opts only to immediate successor
- 46f141f: progress towards supporting fold
- a5c52d1: Merge pull request #4 from pkozikow/cascading
- c920e1d: refactoring
- afb12f3: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- fe26e9e: Update local mode with field changes
- 6398e89: Clean up debugging
- 5614828: Fix tests
- 340fca4: better idiom
- f8eeb9b: Merge pull request #99 from pkozikow/cascading
- 93ed900: got cogroup-full-outer to work
- fac1c6a: got cogroup left and right outer to work
- 6c612b0: take :join-nils into account in :group
- f108777: refactoring
- cf49014: refactoring
- 691367c: pass cogroup opts explicitly, handle cogroup-inner
- a528dc7: Merge pull request #98 from pkozikow/cascading
- b34fcaf: Change fields to namespaced symbols, initial cut
- 39dbc41: added support for group-all operations
- dc00e0d: added support for all-args in join
- 304b497: got self-joins to work
- 57ff6df: handle join-nils in outer joins
- 1d5fcee: added support for :join-nils to join
- e86dca7: implemented sample
- 19176f5: clear output before running
- ef21f97: implemented limit
- 55ebfab: tmp change to build to make it work
- ba30452: added temporary test for development
- 600876b: remove pig dependency
- 4bf45a0: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- f4c9ce1: Using core.reducers to perform the fold
- 0102c00: Merge pull request #94 from Netflix/cascading-functional-tests
- 1ed767c: Disable new tests for not-implemented features
- 90198e7: Merge branch 'sans-pig' into cascading-functional-tests
- 9c3b920: Merge pull request #97 from Netflix/rx-clean
- 1ad41e0: Move fold test to pigpen-tests. Implement fold in local mode. End pig-rx!
- 8f8d153: Add script to local
- d4bdfa3: Implement join for local & rx
- 1faabb6: Add group-all to local & rx
- 6516aed: Create a new pigpen-rx project with a streamlined non-pig rx implementation. Currently matches functionality of pigpen-local.
- 1702da5: fixed other potential sources of memory problems
- 1e591dd: Merge pull request #96 from Netflix/local-mode-filter
- a6bd4c1: Merge pull request #95 from Netflix/local-mode-group-by
- c9ee34e: Add functional tests for limit, sample, and distinct. Implement limit, sample, distinct, and union in local mode.
- 72de416: Implement :group for local mode
- 6a9706a: Add pigpen-tests dependency
- 7e2f04a: Add functional tests for cascading
- 6db62e8: Merge branch 'sans-pig' into cascading
- 6b2456a: Merge pull request #93 from Netflix/local-mode
- 519254e: Merge pull request #92 from Netflix/functional-tests
- 194c6e2: Add project for pigpen-local. Move stuff.
- 3de019f: Merge branch 'functional-tests' into local-mode
- 6ac758b: Move rx functional tests to rx. Add pig functional tests.
- f060b5a: Fix rank adjustments locally to match pig
- f414340: Fix order-dependent tests
- f6d7d33: Call seq on the results of all co-groupings to enforce consistency
- e4190bf: Only DataBag supports accumulation & returning bags. Move accumulator & add explicit bag creation.
- de48e8f: Fix quoting bug in script generation
- 8fbba9d: Refactor oven to make operations more modular. Move some pig specific ones to pigpen-pig.
- 4c4378b: Add local mode
- 3673b5b: Fixed default post-process
- 4844a64: Make functional tests a library
- 2dd7f41: Merge pull request #3 from matthagy/seq_cnv
- 03985fa: Lazy conversion of sequences in hybrid->clojure
- 72ef729: Merge pull request #91 from pkozikow/master
- 6c330f7: removed debug print stmts and ns, fixed comment
- 3883df7: removed redundant function, formatting
- 98d8e9f: unnecessary let
- e3e91be: removed stuff already available in pigpen.core
- 2e84303: emit tuples from clojure
- f2228d1: emit tuples from clojure
- 5b03b38: Merge branch 'cascading' into cascading_origin
- eadd4f3: Merge branch 'sans-pig' into cascading
- 6cd2f98: Merge branch 'master' into sans-pig
- da04db1: removed bogus import
- 2ee74ee: refactoring
- d0a0105: refactoring
- ff7c680: removed redundant method and implemented distinction for nils
- 1d386f0: more requires
- 4674f09: require runtime
- 5339b6f: identity
- 654a394: misc fixes
- dd2cc0a: implemented distinct
- ba54685: added test for mapcat
- a543a7f: implemented script
- b37ae81: Merge pull request #1 from matthagy/lr_extensions
- 217148c: Fixed handling of field projections
- 23b7d9c: Small changes to support LiveRamp extensions
- 87525ac: don't use cascading ns directly
- 7636ba5: make io functions available
- 309eb4c: remove debug print stmts
- a07ea4e: removed redundant helper, fixed test
- b61fa93: added test for group-by
- b45c117: added support for outer joins
- 75eb0c8: use real field names
- 932c8ce: progress implementing join
- bb45009: partial implementation of join
- e28de42: added support for arbitrary number of input pipes to cogroup
- 57752c8: Merge branch 'master' of github.com:Netflix/PigPen into cascading
- c33e9bf: simplify
- 2f314ca: got rid of unnecessary reduce
- d04058c: updated pg
- f21a4a4: turned tap dispatch into multimethod
- c08c183: rename
- d011627: got cogroup to work with custom serialization
- 78d7f82: moved serialization stuff to new ns
- 8cfa955: fixed storage handling
- 3e1adb8: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- 18ab584: Merge branch 'sans-pig' into cascading
- 6760750: Merge pull request #87 from Netflix/return-to-core
- b3b0bfb: Move pigpen.core to pigpen-core
- a3ed01f: Move pigpen.exec -> pigpen.pig
- 5068865: Move pigpen.pig -> pigpen.pig.runtime
- 35d6d95: Move pigpen.io
- 8b0e0a0: Merge pull request #86 from Netflix/unfreeze-return
- 5513e06: Don't freeze values in pig/return
- ba2bf7b: Merge branch 'sans-pig' into cascading
- 246a221: Merge pull request #85 from Netflix/fix-bootstrap-ns
- e5174d4: Update the bootstrap namespace to pigpen.runtime
- b90420d: Merge pull request #84 from Netflix/dispatch-io
- 9fe580f: Merge pull request #83 from Netflix/pig-oven
- 59cb87b: Merge pull request #82 from Netflix/update-deps
- 4591c8d: Change io operations to dispatch on keywords instead of pig-specific loader classes
- e03b94a: Move register$ and option$ into new pigpen.pig.oven
- 23df77e: Remove column pruning (wasn't used)
- 7da21de: beginnings of serialization for cascading
- a7c7a8e: cleaned up test
- 7383184: remove cascading dependencies from core
- afa349e: got simple flow to work sans pig
- 4666707: moved all cascading stuff to the corresponding project
- f62d6bd: updated function not to use pig classes
- 9c5d309: Merge branch 'cascading' of github.com:Netflix/PigPen into cascading
- 1562c71: Remove pig dependencies from pigpen-core
- d1aeab8: Add clojure dependency to cascading project
- 9bb476c: Merge branch 'sans-pig' into cascading
- 192a721: Merge pull request #80 from Netflix/move-oven
- 623236f: Move pigpen.oven back to pigpen-core
- 1399fe5: Merge pull request #79 from Netflix/pig-rx
- 683a04a: Rename pigpen.local -> pigpen.pig-rx
- 178d975: Merge branch 'master' into sans-pig
- 1522c11: cleanup
- 1ff6514: got cogroup example to work
- 3dfe1b2: getting close to a working cogroup
- e834049: used field projections in PigPenFunction
- 8371677: collapse field projections into the preceding step
- 90e94d5: removed unbaked
- 81b6348: hack around serialization using Pig classes
- 3a87957: fixed field assignment in cogroup
- 1e021b2: Merge pull request #75 from Netflix/move-exec
- 055540e: Move tuples & bags to post-processing & the UDF. Move exec to runtime.
- 0b589dd: Merge pull request #74 from Netflix/move-util-fns
- 6ba80eb: Move pigpen.pig/args->map and pigpen.pig/debug to pigpen.runtime
- 5ab6214: Merge pull request #73 from Netflix/generalize-serialization
- ff3118e: Merge pull request #72 from Netflix/change-code-dispatch
- c0e8aeb: Use multimethods for serialization. Each platform implements these.
- aa872f4: Update code$ to not refer to pig classes. Using keywords instead
- 2974492: Move pigpen.pig/eval-string to pigpen.runtime
- ba9f609: Add cascading project
- a88bfe6: Move ->bind fns and with-ns to pigpen.runtime
- 076418f: Update build with new locations
- 46c8533: handle fields and aliases
- e36c352: process field projections together
- b246ee5: shaping up cogroup
- 22e2687: back to using pipes directly
- b87d34c: Add pigpen-pig project
- 7a6f595: Move files into pigpen-pig
- f3f65c2: Remove extra imports
- 036ff27: adding support for cogroup - work in progress
- dc74a98: added scripts to pg for reference
- aa9dc9c: set up test for cogroup
- e3a0015: added load-clj
- 3b1a2b8: added generate-flow, refactored test
- 99f0457: added comment
- 6ddbc6b: added store-clj, refactored pigpen function
- 490501c: added store-tsv
- 74ac671: added load-tsv
- f2552f6: invoke clj func from cascading operation
- a58bf4c: beginnings of :projection and :code
- 50a6747: bind field in load-text
- 92a0d3a: added store-text, replaced hardcoded commands with real query in test
- 17cb8f7: first test actually executing a cascading flow
- 8df0045: build real cascading flow
- 5c372ad: started implementing :store
- 8b0ff08: started implementing :generate
- 2cd1e21: added method for :register, use example query in test
- 0bd584e: added example my-func to pg
- 0d073f8: initial implementation of commands->flow
- 2b21372: beginnings of cascading backend
- dea4e44: added simple flow definitions
- 2804131: updated dependencies
- 28fdf6f: added playground file
- cbb0fe6: added cascading dependency