Posts

Showing posts from January, 2022

Loading Multiple JSON Files Into Different Tables Using AZURE DATA FACTORY

Image
TASK: Loading Multiple JSON Files Into Azure SQL Using AZURE DATA FACTORY SOLUTION: In Azure first we need load the given files into blob ,after that we need to create a pipeline . The following will show you that entire pipe line diagram.  Here I have used several activities namely GETMETA DATA, FILTERS,FOREACH,COPY ACTIVITY, STORED PROCEDURES etc.           GETMETA DATA   à  it will give different properties of data , and it will give    acknowledgement for loaded multiple files.           FILTERS   à  Filters will used to filter the files based on the given requirements like   ‘File starting name’, ‘file ending name’ and some string functions etc.         FOR EACH   à  For each activity is loop the process means if we need to do same  operation more than one time at that time we will use FOR EACH Activity.       COPY ACTIVITY   à  ...