As implemented in #416, the proxy simply routes requests to backends randomly. For a cache proxy, we will need to support some stateful request routing (consistent hashing across the backends). This will also require considerations to be made for fan-out for multi-key get requests for memcache protocol.