C#: Consider using `Unsafe` instead of `BitConverter` to convert values to/from bytes

[dicej]

Per https://github.com/dotnet/runtimelab/pull/2614#discussion_r1700019060, Unsafe.Write and Unsafe.As might be more efficient than BitConverter.TryWriteBytes and BitConverter.To*, respectively.