Avoid code bloat due to generics

[adamreichold]

Very little of the clean function is actually generic and hence multiple instantiations of the main bulk of the code can be avoided by splitting out the .as_ref() from the rest of the implementation.