This Python ETL app (GUI built with Streamlit) is able to extract, transform and load data in a user-friendly manner. See the progress of included functionalities below.

• Extract: read_data() (all including data previewing)

  • Delimited:
    • Comma
    • Semicolon
    • Pipe
    • Space
    • Tab
  • Excel
  • SQL
  • JSON
  • XML

• Transform: transform_data()

  • Filter columns
  • Filter rows
  • Transform column
  • Calculate column

• Load: convert_df()

  • CSV
  • TXT
  • TSV
  • Excel
  • SQL
  • JSON
  • XML

• Additional features are:

  • Save settings
  • Import settings

The assets used to build this app are:

• Anaconda
• Streamlit
• Pandas
• NumPy

conda env create -f environment.yml

conda activate StreamlitEnv

• Locally:

First cd into the correct directory:

cd /Users/user/directory

streamlit run main.py

• GitHub:

streamlit run https://raw.githubusercontent.com/MikeBidinger/ETL/main/main.py