I had already built a small HDFS-style distributed file system in Go. (Part I) It has a controller for metadata, storage nodes that hold replicated chunks, and a client. All three talk over TCP with Protocol Buffers. This post is about the next step: running MapReduce jobs on the data stored in it. Here's the design goal. The data is already split... Weiterlesen
Intelligence View
⚡ tsecurity.de Intelligence
Adding MapReduce to My Go Distributed File System
I had already built a small HDFS-style distributed file system in Go. (Part I) It has a controller for metadata, storage nodes that hold replicated chunks, and…