In the previous two blogs in this series I showed how solving an apparently simple problem about loading a lot of data into RAM using mmap() also turned out to require a solution that improved CPU use across cores. In this blog, I’ll show how we dealt with the bottleneck problems that ensued, and finally, […]
Blog Archives
Little Trouble in Big Data – Part 2 improving CPU utilization across cores
Little Trouble in Big Data – Part 1 how to use mmap() to load a large data set into RAM
Making the Most of your Memory with mmap
Today’s complex applications can soak up megabytes, a memory management strategy is crucial for RAM intensive applications like image/video processing, massive databases, and machine learning.