Skip to content

Bringing Aggregator Goodness to 0.8 branch

Compare
Choose a tag to compare
@johnynek johnynek released this 04 Dec 23:43
· 1095 commits to develop since this release

Similar to the 0.7.2 release, this is identical to the 0.8 release except that it has many Aggregators and Folds added.

See: https://github.com/twitter/algebird/blob/0.8.2/algebird-core/src/main/scala/com/twitter/algebird/Aggregator.scala#L55

There are now Aggregators for count, size, max, maxBy, min, minBy, forall, exists, sortedTake, sortedReverseTake, toSet, toList, uniqueCount and a few more.

Also, by an enrichment (for binary compatibility), you can .join two aggregators to aggregate a sequence (or a Scalding TypedPipe) without passing over it twice.

If you are not operating in parallel, the Fold type is just as useful. You can toFold and Aggregator, which can also be joined.

Aggregate away!