How can I optimally build a data pipeline from REST end point?

Question

I want to build a Spark/Parquet/Delta pipeline for processing proprietary data

1. Stored in SQL databases on AWS and Azure

2. List item Json and x