AZURE DATA FACTORY INTERVIEW QUESTION : TRIGGER AND TYPES.

 TRIGGERS:-

     Triggers are used to automate the execute of pipeline or workflow.

TYPES:-

     1.Scheduled Trigger.

     2.Thumbling window Trigger.

     3.Event-based Trigger.

           * Storage Event Trigger.

           *Custom Event Trigger.

1.Scheduled Trigger:-

         *These Triggers are used to automate the pipelines at specified times or intervals ,such as daily                 ,weekly or monthly.

        * Only for future dated loads, not for past.

         *Many to many relation i.e  one trigger can apply to many pipelines and many triggers can                         applies for single pipeline.

2.Thumbling window Trigger.

        *Thumbling window triggers can be  configued to initiate past and future dated loads.

        *Thumbling window has one-to-one relationship with  a pipeline and can only refernece a single               pipleine.

        *It has a self dependency property which means the trigger shouldn't proceed to the next window              until the precending window is successfully completed.

 3.Event-based Trigger.

         Trigger that responds to an  Azure blob related event.

         Types:-

           *Storage Event Trigger:-

                  It kick offs pipelines based on events such as the arrival or deletion of a file in your azure                   storage account. 

         * Custom Event Trigger:-

                  It supports filtering capabilities ,these conditional filters allow pipelines to trigger based                    upon the values of event payload.

 Advantages:-               

            we can use it in different time zones.


          

         

Comments

Post a Comment

Popular posts from this blog

SQL Interview Questions:3

Image
3. FETCH THE EMPLOYEES WHOSE SALARY IS GREATER THAN AVERAGE SALARY OF THEIR DEPARTMENT. CREATE   table employee ( id int, name varchar (100), dept_Id int, salary int ) insert into employee values(1,'vineela',1,20000),(2,'lakshmi',1,30000),(3,'gayithri',1,30000), (4,'mukundh',2,45000),(5,'kavya',2,300000),(6,'sithara,2,45000) select * from employee method1:-         select a.name,a.dept_Id,a.salary  from employee a where a.salary >(select avg(salary) from         employee b where b.dept_Id=a.dept_Id)                                              method2:- select t1.name,t1.dept_Id, ,t1.salary  from employee as t1 join (select dept_Id,avg(salary) as avgsalary from employee group by dept_Id) as t2 on t1.dept_Id=t2.dept_Id where salary>avgsalary             ...
Read more

AZURE DATA FACTORY INTERVIEW QUESTIONS: FILES FORMATS

  21.Diffrence types of file formats? 1.Delimited text files       CSV Files and TSV Files   CSV Files:-            *Comma Separated Values           *  In which comma ,pipe etc. are used to separate the fields and values in CSV files.  TSV Files:-           * Tab separated values.           *In which tab or space are used to separate the fields and values.           *Fixed width data in which each field is allocated a fixed number of characters. 2.JSON           *Java Script Object Notation (JSON).            * JSON format file is a standard data interchange format.            *JSON files are text-based, human-readable, can be edited easily.     example:-          {         ...
Read more

AZURE DATA FACTORY INTERVIEW QUESTIONS :ACTIVITIES AND TYPES.

  ACTIVITIES:-      The Activities in a pipeline defines actions or operations to perform on your data. TYPES:-        1.DATA MOVEMENT ACTIVITIES.       2.DATA TRANSFORMATION  ACTIVITIES.       3. CONTROL FLOW ACTIVITIES.   1. DATA MOVEMENT ACTIVITIES :-         Copy Data :-                   The Copy Data Activity is the core tool in Azure data factory that can move the data from Source to Sink (destination). 2. DATA TRANSFORMATION  ACTIVITIES :-         Data flow:-               Data flow activity is a cloud native graphical data transformation tool.             types:-             1.Mapping Data flow             2.Wrangling Data flow.          1.Mapping Data flow:- ...
Read more