Zhou Ke

A Spark Join Algorithm Based on Memory Monitoring and Batch Processing

2018

In recent years, the Spark memory computing framework has risen rapidly, and the data processing speed has been greatly improved. However, the upper limit of speed is limited by the Spark memory size. The most …