This session is likely to be either discussion of setting up and administering databases or working with large datasets in a “data lake” context of having many data files without a formal database, focusing on Arrow.

• Setting up an SQLite database
• Setting up a PostgreSQL database
  • We’ll need to do this on a Linux machine, so one convenient approach is to use a Docker container (a container is sort of like a virtual machine but less self-contained and easier to work with). There are some instructions in docker.sh that we’ll demo.
• Using DuckDB with external data
• Using Arrow with large datasets