read_and_format doesn't cover all cases

[szeevs]

The function is not robust. To cover all cases you need to comply with: https://docs.aws.amazon.com/datapipeline/latest/DeveloperGuide/dp-template-redshift.html

For example, what if you get int(8) from MySQL?

[benjamingregory]

Very good point @szeevs. This was done quickly to handle a specific implementation but you're absolutely right; it needs to be more robust.

Are you interested in taking this issue?

[szeevs]

Yes. I will resolve this.

[benjamingregory]

Great! Just assigned you @szeevs.