stop `assert`ing on `nullptr`

[lefticus]

Just as the title says. If it's an assert on a nullptr, that should be a reference!