Pyspark — Parallel read from database

How to leverage spark to read in parallel from a database

Maria Karanasou

--

Spark Parallelization

A usual way to read from a database, e.g. Postgres, using spark would be something like the following:

--

--

Maria Karanasou

A mom and a Software Engineer who loves to learn new things & all about ML & Big Data. Buy me a coffee to help me keep going buymeacoffee.com/mkaranasou