Model parallel is slow due to the big hash tables

[ryanrhymes]

The service loop is rather slow if the hash tables (used for maintaining worker info) is too big.