Stop leaking file descriptors

[thomasqueirozb]

Fixes #170

~The thread::sleep isn't ideal but I didn't see a simple way to wait until the queue is dropped to check the number of fds.~