AZURE DATA FACTORY INTERVIEW QUESTIONS:1-10

 1.WHAT ARE KEY COMPONENTS OF AZURE DATA FACTORY?

           1.Pipelines

           2.Activities

           3.Datasets

           4.Linked Services

           5.Integration Runtime

2.WHAT IS PIPELINE?

          A Pipeline is a logical grouping of activities that together perform a task.

3.WHAT ARE ACTIVITIES?

         Activities in a pipeline define actions or operation to perform on your Data.

4.WHAT ARE DATASETS?

         A  Dataset connects the data source via linked service. It is created based upon the type of data and data source you want to connect.

         Dataset resembles the type of data holds by data source.

5.WHAT ARE LINKED SERVICES?

        Linked services in ADF are the connection mechanism to connect to external data source outside the ADF.

6.WHAT ARE INTEGRATION RUNTIME?

        Integration runtime is the compute infrastructure used by the ADF which provides the resources for the data transfer activities and provides the area where this activity can execute.

7.WHAT ARE THE VARIOUS PIPELINE EXECUTION METHODS AVAILABLE IN AZURE DATA FACTORY?

         1.Debug mode.

         2.Trigger Now

         3.Trigger

note:- Web Activity can also execute a pipeline.

8.    WHAT ARE THE PARAMETERS AND HOW MANY TYPES OF PARAMETERS IN ADF?

     Parameters are used to pass external values into Pipelines, Datasets,Linked services and Data flows.  

    By parameterizing resources ,we can reuse them with different values each time.

    This reduces redundancy in your ETL pipelines and improves flexibility.

    Types:-

     1.Dateset parameters.

     2.Linked service Parameters.

     3.Pipeline parameters.

9.HOW MANY TYPES OF LINKED SERVICES?

      It is based on our requirements .We can create many number of Linked services for Azure Blob storage linked services , Azure Data Lake storage , Azure SQL Database , FTP linked service.

10.WHAT ARE THE DIFFERENT TYPES OF ACTIVITIES?

     There  are mainly three types...

     1.Data movement Activities.

     2.Data Transformation Activities.

     3.Control Activites.

       


        


Comments

Post a Comment

Popular posts from this blog

SQL Interview Questions:3

Image
3. FETCH THE EMPLOYEES WHOSE SALARY IS GREATER THAN AVERAGE SALARY OF THEIR DEPARTMENT. CREATE   table employee ( id int, name varchar (100), dept_Id int, salary int ) insert into employee values(1,'vineela',1,20000),(2,'lakshmi',1,30000),(3,'gayithri',1,30000), (4,'mukundh',2,45000),(5,'kavya',2,300000),(6,'sithara,2,45000) select * from employee method1:-         select a.name,a.dept_Id,a.salary  from employee a where a.salary >(select avg(salary) from         employee b where b.dept_Id=a.dept_Id)                                              method2:- select t1.name,t1.dept_Id, ,t1.salary  from employee as t1 join (select dept_Id,avg(salary) as avgsalary from employee group by dept_Id) as t2 on t1.dept_Id=t2.dept_Id where salary>avgsalary             ...
Read more

AZURE DATA FACTORY INTERVIEW QUESTIONS: FILES FORMATS

  21.Diffrence types of file formats? 1.Delimited text files       CSV Files and TSV Files   CSV Files:-            *Comma Separated Values           *  In which comma ,pipe etc. are used to separate the fields and values in CSV files.  TSV Files:-           * Tab separated values.           *In which tab or space are used to separate the fields and values.           *Fixed width data in which each field is allocated a fixed number of characters. 2.JSON           *Java Script Object Notation (JSON).            * JSON format file is a standard data interchange format.            *JSON files are text-based, human-readable, can be edited easily.     example:-          {         ...
Read more

AZURE DATA FACTORY INTERVIEW QUESTIONS :ACTIVITIES AND TYPES.

  ACTIVITIES:-      The Activities in a pipeline defines actions or operations to perform on your data. TYPES:-        1.DATA MOVEMENT ACTIVITIES.       2.DATA TRANSFORMATION  ACTIVITIES.       3. CONTROL FLOW ACTIVITIES.   1. DATA MOVEMENT ACTIVITIES :-         Copy Data :-                   The Copy Data Activity is the core tool in Azure data factory that can move the data from Source to Sink (destination). 2. DATA TRANSFORMATION  ACTIVITIES :-         Data flow:-               Data flow activity is a cloud native graphical data transformation tool.             types:-             1.Mapping Data flow             2.Wrangling Data flow.          1.Mapping Data flow:- ...
Read more