data-setup icon indicating copy to clipboard operation
data-setup copied to clipboard

fix student and glovebox sqlite versions

Open gmanchon opened this issue 3 years ago • 2 comments

sqlite versions on student env and in glovebox can differ since sqlite is not installed by python (python only provides a wrapper)

the slack thread issue was a student using a right join in their challenge when the sqlite version in glovebox does not support it

the solution is to fix sqlite version in student setup and glovebox so they match

https://formulae.brew.sh/formula/sqlite https://doc.ubuntu-fr.org/sqlite

gmanchon avatar Jan 20 '23 10:01 gmanchon

For future reference based on my setups:

  • macOS sqlite version 3.43.2
  • my linux setup on Ubuntu 23.10 version 3.42
  • RIGHT and FULL JOIN introduced in version 3.39
  • WSL using Ubuntu 22.04 version 3.37.2
  • python:3.10.6-slim-buster version 3.27.2

So:

  • macOS and recent Ubuntu is not aligned with glovebox (or the other way around).
  • Windows is aligned with glovebox. For the time being, because Ubuntu 24.04 is about to come out and will probably become default version in WSL at some point.

julesvanrie avatar Apr 05 '24 14:04 julesvanrie

Experimented a bit with the data-runner and tried out some things, all unsuccesful:

  • apt update libsqlite: sticks to the same version because the package is not available for buster (needs a more recent glibc
  • building from source 🤓 : doesn't build because the necessary files to compile are missing (duh)
  • looking at other python-3.10 base images: would need debian bookworm to come with a new enough sqlite version, but bookworm is not available

Conclusion: this will have to wait until we switch to a newer python (something I want to do, currently experimenting myself with a new setup using 3.12, new pandas, sklearn, tensorflow 2.16 and keras>3 - which is a big change).

julesvanrie avatar May 18 '24 18:05 julesvanrie