Commits

Branch selector

 master

User selector

All users

All time

Commit History

Commits on Jan 25, 2018

• Merge pull request #5 from oli-hall/fix-versioning

  Show description for f6ee1f4
  ekkoshell

  authored
  f6ee1f4

  Copy full SHA for f6ee1f4

• make sure name matches package name

  

  Oli Hall

  committed
  a91a4de

  Copy full SHA for a91a4de

Commits on Nov 8, 2017

• Merge pull request #4 from oli-hall/rdd-improvements

  Show description for 6924708
  ekkoshell

  authored
  6924708

  Copy full SHA for 6924708

• Update README

  

  Oli Hall

  committed
  e8d70cf

  Copy full SHA for e8d70cf

• Clean up TODO around deep copying after analysis

  Show description for fc31031
  

  Oli Hall

  committed
  fc31031

  Copy full SHA for fc31031

Commits on Nov 7, 2017

• Merge pull request #3 from oli-hall/implement-missing-rdd-methods

  Show description for 8066238
  ekkoshell

  authored
  8066238

  Copy full SHA for 8066238

• Fix issue with map not deep-copying input RDD before mapping

  Show description for d783488
  

  Oli Hall

  committed
  d783488

  Copy full SHA for d783488

• Revert "only create DataFrame through SQLContext"

  Show description for c205c73
  

  Oli Hall

  committed
  c205c73

  Copy full SHA for c205c73

• Revert "Skip DataFrame tests until DataFrame work complete"

  Show description for f06303f
  

  Oli Hall

  committed
  f06303f

  Copy full SHA for f06303f

• Skip DataFrame tests until DataFrame work complete

  

  Oli Hall

  committed
  91d8844

  Copy full SHA for 91d8844

• only create DataFrame through SQLContext

  Show description for ae500d4
  

  Oli Hall

  committed
  ae500d4

  Copy full SHA for ae500d4

Commits on Nov 2, 2017

• Pass sc.parallelize numSlices through to created RDD

  

  Oli Hall

  committed
  fc1ae00

  Copy full SHA for fc1ae00

• Add RDD.mapPartitionsWithIndex implementation

  

  Oli Hall

  committed
  2bbd925

  Copy full SHA for 2bbd925

• Pass numPartitions through to calls to groupByKey

  Show description for 01ccc19
  

  Oli Hall

  committed
  01ccc19

  Copy full SHA for 01ccc19

• Add RDD.combineByKey implementation

  

  Oli Hall

  committed
  e60940f

  Copy full SHA for e60940f

• add RDD.takeSample implementation

  

  Oli Hall

  committed
  2a45169

  Copy full SHA for 2a45169

• Add RDD.zipWithUniqueIndex implementation

  

  Oli Hall

  committed
  44ebf50

  Copy full SHA for 44ebf50

• Add initial partitionBy implementation

  

  Oli Hall

  committed
  8e3cd1f

  Copy full SHA for 8e3cd1f

• Add sortBy implementation

  

  Oli Hall

  committed
  387e8ed

  Copy full SHA for 387e8ed

• Rename sc to context

  Show description for 6c10674
  

  Oli Hall

  committed
  6c10674

  Copy full SHA for 6c10674

Commits on Nov 1, 2017

• Add sortByKey implementation

  

  Oli Hall

  committed
  811c829

  Copy full SHA for 811c829

• Rewrite partitioning to preserve input order

  

  Oli Hall

  committed
  0dad2d0

  Copy full SHA for 0dad2d0

• Add SparkContext.union and test cases

  

  Oli Hall

  committed
  3185f86

  Copy full SHA for 3185f86

• Add test case for SparkContext.emptyRDD()

  

  Oli Hall

  committed
  8439697

  Copy full SHA for 8439697

• Add fullOuterJoin implementation

  

  Oli Hall

  committed
  6e9ee63

  Copy full SHA for 6e9ee63

• Rewrite RDD to avoid flattening and repartitioning everywhere

  Show description for 97aa8ad
  

  Oli Hall

  committed
  97aa8ad

  Copy full SHA for 97aa8ad

Commits on Oct 31, 2017

• Rejig how mapPartitions works to better reflect spark implementation

  

  Oli Hall

  committed
  ecb5988

  Copy full SHA for ecb5988

• Add mapPartitions test

  

  Oli Hall

  committed
  d5f7886

  Copy full SHA for d5f7886

• Remove superfluous sorted calls in tests

  

  Oli Hall

  committed
  88f512d

  Copy full SHA for 88f512d

• experiment with sorting output of collect

  Show description for 964666b
  

  Oli Hall

  committed
  964666b

  Copy full SHA for 964666b

• Add TODO to test mapPartitions

  

  Oli Hall

  committed
  8d06cf3

  Copy full SHA for 8d06cf3

• expand mapped partitions in mapPartitions

  

  Oli Hall

  committed
  54ed98a

  Copy full SHA for 54ed98a

• Add initial repartition implementation

  

  Oli Hall

  committed
  9527f13

  Copy full SHA for 9527f13

• Rewrite RDD to support partitions

  Show description for 89ec53a
  

  Oli Hall

  committed
  89ec53a

  Copy full SHA for 89ec53a

• Initial pass at partitions in RDD

  Show description for 4e36361
  

  Oli Hall

  committed
  4e36361

  Copy full SHA for 4e36361