Feedback driven lightweight distributed query optimization

Project

Feedback driven lightweight distributed query optimization

Principal Investigator

Kenneth Ross

Columbia university

Oracle Fellowship Recipient

Orestis Polychroniou

Summary

We focus on three aspects of query processing: (a) efficiently aggregating data skewed by (a few) frequently occurring heavy-hitters, (b) designing distributed join algorithms to greatly reduce network traffic---often the key performance bottleneck, and (c) fast partitioning techniques to distribute large sets of data. Our work so far has been published in DaMon'13, VLDB'14 and SIGMOD'15.