Scribd
Upload
50 views2 pages

Ds Filter

The document discusses different types of aggregation stages in data pipelines including the Aggrigator stage which can perform aggregation functions like sum, avg, max, min and count. It provides an example of aggregating employee salary data by department number and calculating total salary, maximum salary and minimum salary by department.

Uploaded by

abreddy2003
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as TXT, PDF, TXT or read online on Scribd
50 views2 pages

Ds Filter

The document discusses different types of aggregation stages in data pipelines including the Aggrigator stage which can perform aggregation functions like sum, avg, max, min and count. It provides an example of aggregating employee salary data by department number and calculating total salary, maximum salary and minimum salary by department.

Uploaded by

abreddy2003
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as TXT, PDF, TXT or read online on Scribd
You are on page 1/ 2

Aggrigator:

------------

1.Aggrigator it is a processing stage


2.it can have 1-i/p link and 1-o/p link and dosnt support reject link
3.by using aggrigator stage we can perform aggrigations
1.sum
2.avg
3.max
4.min
5.count

4.group key=deptno
column for calculation=sal

empno,ename,sal,comm,deptno,COMPNAY
100,bhaskar,1000,100,10,ibm
200,raj,2000,200,20,ibm
300,vijay,3000,300,10,ibm
400,vidhya,4000,4000,20,ibm
500,dinesh,5000,400,30,ibm

op1
deptno,totsal
10,4000
20,6000
30,5000

op2
deptno,totsal
10,3000
20,4000
30,5000

op3
deptno,totsal
10,1000
20,2000
30,5000

========================
deptno,totsal,maxsal,minsal
10,4000,3000,1000
20,6000,4000,2000
30,5000,5000,5000

================================
copy stage

1.it is a processing stage


2.this stage can give multiple copies
select deptno,sum(sal) as totsal from emp
group by deptno
=====================================================
Filter:

1.FILTER

we have three filter category stage in data stage


1.filter
2.external filter
3.switch

Filter stage:
--------------
1.a FILTER IS A processing stage
2.it can have 1-i/p link and multiple ouput links and one rejectlink
3.how mnay noof where candiions we are taking and those many no of output links
were required
4.options
output rejects=false

You might also like