ADF Beginner Level Interview Questions
1) what is ADF and why do you need it ?
2)what is pipeline in ADF ?
3) What is a Linked Service in ADF?
4)What are Data Sets in Azure Data Factory?
5)What I s Integration Runtime in Azure Data Factory?
6)What are Mapping Data Flows?
7) Triggers in Azure Data Factory
8) What is Copy Activity in Azure Data Factory:
LeveL II ---Interview Questions ?
9)Difference between Trigger and Debug?
10)what are Pipeline Parameters in ADF?
11) what are Global Parameters in ADF ?
12)Different Levels of Parameterization in ADF?
13)What are Annotations in ADF?
14) what are different types of integration runtime available in ADF ?
15 .is it mandatory to create an IR in adf ?expalin Why?
Level III-Scenario based interview Questions ?
16 Assume that you want to call one pipeline from another pipeline .is it possible?
explain in detail?
17 .Assume if you are pulling multiple tables data from your onpremise SQL databse
Using copy data activity inside the foreach . How you can ensure that on premise
server you will send only one request at a time?
18 .Assume that you have Azure SQL db defined in US-East region and you have to
move the data to ADLS in same region. But you have compliance issue that data
shouldn't move outside the region.
How would you ensure while using the ADF copy?
19 . Assume that you are working as data engineer at Azurelib.com. There you got
business requirement in such a way that, it needed for loop inside for each.
However ADF doesn't support nested foreach (at the moment). How you can tackle
this situation?
20 .Assume that your pipelines are deployed on prod. Suddenly one day you have been
informed that it stopped working. What will you do in this situation?
21.Assume that you have to pull the data from on-prem db to the Azure SQL db on the
daily basis in the incremental manner.
How would you create incremental pipeline?
22.Assume that there is business requirement. An external application drops the
file in the blob storage account. Your pipeline has to pick this file and push the
data into the azure sql database.
How would you design solution?
23.Assume that there is business requirement. An external application drops the
file in the blob storage account. Your pipeline has to pick this file and push the
data into the azure sql database.
How would you design solution?
24. Assume that you are developing a pipeline. Your pipeline is copying the data
from source to destination (ADLS). This pipeline runs on daily basis. You have to
create a folder hierarchy (year/month/day) and store files inside it. How would you
design this solution?
25. Assume that you copying the data from file to table using ADF? Now there are
few rows not matched with table schema.
Hence due to that copy activity is failing. How you deal with such scenarios?
i
26.Assume that you copying the data from file to table using ADF? It is working
very slow. What you can do improve the performance?
27.Assume that your pipeline got failed at second activity.
To avoid data inconsistency you have wanted to rerun the pipeline from failed
activity. Can we do this? Give reason