Livebook already has a SQL Smart cell (https://livebook.dev/integrations/sql). It doesn't integrate with Explorer yet, but it's already possible to reference a database connection, run a SQL query, and visualize the results in a table.
Here's a video showing how to do that https://www.youtube.com/watch?v=F98OWdigCjY