<|im_start|>user
For Bronze layer, how do you suggest handling the data sources that are coming as JSON/CSV/Avro, etc. (Onprem SQL data imported as json via Azure Data Factory into ADLS Or API Calls that return JSON) Should that be stored without processing in bronze layer in ADLS/Process them and store as Delta in bronze or should we have a pre bronze layer?<|im_end|>
<|im_start|>assistant
Either method will work.  There are some advantages to using a delta bronze layer over relying on your JSON files in ADLS.  It is a lot more performant to re-process data that's in the bronze delta format than re-processing the json files in ADLS.  This is because all of your data will be consolidated and filesizes will be optimized in your bronze layer.<|im_end|>
