Solve in Datastage

Input:

col1, col2, col3
----------------
a, b, c
d, e, f

Output like

Col
---
a
b
c
d
e
f

Ram

• Mar 23rd, 2016

Src --> colgen(Dummy) --> Pivot (type=Horizntal & derivaion col=col1,col2,col3) -->copy(drop dummy col) --> trg.

sai3689

 Profile Answers by sai3689 Questions by sai3689

• Oct 10th, 2015

In the properties Pivot type=horizontal Tell me which to take pivot column?

Answer Question  Select Best Answer

My input data:

Field_Name Value
Customer_ID 100
Customer_Name ABC
Customer_City Delhi
Customer_ID 200
Customer_Name BCD
Customer_City Mumbai

My output should look like
Customer_ID Customer_Name Customer_City
100 ABC Delhi
200 ...

Arpit jain

• Apr 5th, 2016

We can do this by using roll up component by using accumulation function in it .

Ram

• Mar 10th, 2016

Its simple..
Src(file 2 cols) --> Transform (drop 1st col and create dummy field for group id) -->
Pivot enterprise(type vertical and array size=3) --> copy (rename the column names as required) --> trg.
Pls try , it will work..thanks !

Answer Question  Select Best Answer

What will happen if we will change the partition to Auto in Join stage?

Huma

• Feb 18th, 2017

We usually go for join stage when the source input data is huge!!! If we select Hash partitioning only then it will improve the performance of job because Hash partitioning ensures that the data with ...

Aloka

 Profile Answers by Aloka Questions by Aloka

• Jul 1st, 2016

Thanks Suresh for your reply !
But when Hash partition used..It will also verify for all the partition.
It will be more helpful if you will elaborate more on this.

Answer Question  Select Best Answer

By seeing a Datastage job how you will identify which one is Normal lookup and which one is Sparse Lookup?

Ram

• May 23rd, 2017

Sparse look up can be used only for DB stages as Source and Target where as Normal can be used for both files as well as DB stages

Sri

• Mar 30th, 2017

It can be viewed when you open the Oracle connector stage and where the lookup type is mentioned.
By default lookup type is normal

Answer Question  Select Best Answer

Source have single column data, How can I get Target like row 1 goes to target 1, row 2 goes to target 2.

src :-
column_id
1
2
3
4
.
.
.
1000 ,
Target :-
Target1(1)
Target2(2)
Target3(3),
Target4(4)
.
.
Target1000(1000)

How can you achieve this scenario?

Yash Ojha

• May 9th, 2020

We can use the option "generate multiple files" in sequential file stage and then assign the data column as Key. SO with every change in key it will generate a new target file.

Rv

• Dec 7th, 2019

There are thousand rows, who will write thousand different where conditions and then will configure 1000 different files, is there any other solution which dynamic?

Answer Question  Select Best Answer

introJ

 Profile Answers by introJ Questions by introJ

• Mar 25th, 2010

First import the columns through metadata importer for xmlFolder stage(Path for xml. or if it  doesnt  work put the xml file in the project directory)   |   |XML Input St...

tisha24

 Profile Answers by tisha24 Questions by tisha24

• Dec 29th, 2008

XML files can be read using FOLDER stage followed by XML input stage in server jobs.

Answer Question  Select Best Answer

nagoosk

 Profile Answers by nagoosk Questions by nagoosk

• May 29th, 2008

sort the records using the key field.In sort stage put "key change column = true".Then zero will be assigned to the duplicate records.then put a condition as which is record is zero then send it to reject link

nagoosk

 Profile Answers by nagoosk Questions by nagoosk

• Jan 17th, 2008

we can remove duplicate records by specifying the one of the column in target stage as key column

Answer Question  Select Best Answer

a)Star Schema - Simple & Much Faster. Denormalized form. b)Snowflake Schema - Complex with more Granularity. More normalized form. 

cyberdiptikanta

 Profile Answers by cyberdiptikanta Questions by cyberdiptikanta

• Jun 26th, 2010

Star Schema is performance wise better than Snow Flake Schema.  As Star schema uses denormalise tables, so there will be less no of join as compared to Snow flake Schema.RegardsDiptikanta

shady2pac

 Profile Answers by shady2pac Questions by shady2pac

• Oct 19th, 2008

Is not star schema better performance wise (querying) as it has less no of join due to denormalized structure? Please clarify

Answer Question  Select Best Answer

veer.dwh

 Profile Answers by veer.dwh Questions by veer.dwh

• Oct 1st, 2009

Hi,I have worked on server to px migration project. you can't directly convert a server job to PX job. the only way is, you have to redevelop the px job using px environment.Regards,Veeru.

Abhijain

 Profile Answers by Abhijain Questions by Abhijain

• Feb 20th, 2008

On a job level- to convert server jobs into a parellel job is not possible.The mechnism of server jobs is different then that of parellel jobs.You have to re-build the job.

Answer Question  Select Best Answer

uma

• Sep 15th, 2017

Kill the process id for the specific job.

jamesbond777

• Mar 9th, 2017

Just to elaborate on kogantis answer. Independent links are stream/input links and dependent links would be the reference links from lookup.

Answer Question  Select Best Answer

Sequencers are job control programs that execute other jobs with preset Job parameters.    

Read Best Answer

Editorial / Best Answer

jagannimmagadda  

 Profile Answers by jagannimmagadda Questions by jagannimmagadda

• Member Since Jan-2006 | Jan 10th, 2006

---

A sequencer allows you to synchronize the control flow of multiple activities in a job sequence. It can have multiple input triggers as well as multiple output triggers.The sequencer operates in two modes:ALL mode. In this mode all of the inputs to the sequencer must be TRUE for any of the sequencer outputs to fire.ANY mode. In this mode, output triggers can be fired if any of the sequencer inputs are TRUE

Tariq Awan

• Oct 25th, 2016

As previous posts already pointed out, there are only two modes: All or Any. All means all incoming triggers must be true and Any means at least one needs to be true. However, in case, if you want to execute next job even though all the incoming triggers are False, then Seqencer is NOT the solution.

Priyanka

• Mar 10th, 2016

@Rohit: Yes you can run the 2nd job even if the first one fails. For that you need to set the trigger option to unconditional. However, the control comes to the 2nd job only after the 1st job has run (pass or fail).

Improve Answer

sankarganeshvel

 Profile Answers by sankarganeshvel Questions by sankarganeshvel

• May 13th, 2008

Hi ,if your job is using OCI stage as the target stage  .then u can do it. just specify the no of the record in the Transaction handling of the OCI stage . So if the job get aborted after 1000 records  ,say some 1220 then 1000 record will be there in the target table 

nagoosk

 Profile Answers by nagoosk Questions by nagoosk

• Apr 22nd, 2008

It is possible to restart the job after the aborted rows.You have to select the "check point" property in the sequence.There you have to give the aborted final record number.This is only in datastage(PX)

Answer Question  Select Best Answer

RAM

• Aug 27th, 2015

SMP is a shared Disk. Its having 62 or 124 CPUs.
MPP is a shared nothing or clustered systems . We can say combination of multiple SMPs.

Himanshu Maheshwari

• Apr 2nd, 2015

The environment in which you run your parallel jobs is defined by your systems architecture and hardware resources. All parallel processing environments are categorized as one of: SMP (...

Answer Question  Select Best Answer

jaffar95

 Profile Answers by jaffar95 Questions by jaffar95

• Mar 20th, 2008

Yes you can query a hash file using Datastage Administrator --> Command  window -->

John

• Feb 8th, 2007

You can also use a Universe stage if the data is need in your job. I don't recall all details when I used this but I think there is an option when creating the hash file to make it Universe compatable or something like that. Then you can use it in a universe stage and do any query you like on it.

Answer Question  Select Best Answer

How to remove duplicates in datastage?

dwh_com

 Profile Answers by dwh_com Questions by dwh_com

• Jun 22nd, 2008

There are several ways in removing the duplicates depends on the data u have..have to use stage variables effectively to remove the duplicates.use rowprevious compare function.. which is available in datastage...RegardsSriks

Suri123

 Profile Answers by Suri123 Questions by Suri123

• May 9th, 2008

In parallel jobs by using sort stage Or Remove Duplicates stage We can remove duplicate records Regards Suri

Answer Question  Select Best Answer

Anil.K.Thodeti

• Mar 31st, 2017

Cat abc.txt | tr
, | sed s/,$//(Exec command stage), Start Loop (pass this output $CommandOutput), and then send this into a job, and then end loop at the end

karthick

• May 30th, 2014

Parameter file will have comma delimiter.
use cat file1.txt |cut -d, -f1| tr -d "
" command to extract the first field ...
use execute command activity for extracting all the parameter. then finally pass the value to actual job.

Answer Question  Select Best Answer

SRC has 1 record I want 10records in target how is it possible ? plz explain me ?

Ram

• Mar 31st, 2016

Src --> Transform --> Trg

Use Iteration < = 10 for the records...
So you will 10 records in target.

Nikhil

• Dec 15th, 2015

Take a rowgen stage, limit number of rows=9, funnel it src file

Answer Question  Select Best Answer

A Sequences is calling activity 1, activity 2 and activity 3.while running, activity 1 and 2 got finished but 3 got aborted. How can I design a sequence such that the sequence has to run from activity 2 when I restart the sequences?

Mallikarjuna_G

 Profile Answers by Mallikarjuna_G Questions by Mallikarjuna_G

• May 8th, 2014

To make the job re-run from activity 3, we need to introduce restartability in the sequence job. For this below points have to be taken care of in Job Sequence Adding Checkpoints: Checkpoints have t...

Ritwik

• Apr 21st, 2014

You have to check the " Do not checkpoint run " checkbox for activity 2. If you set the checkbox for a job that job will be run if any of the job later in the sequence fails and the sequence is restarted.

Answer Question  Select Best Answer

hi

i have sourse like
name,city
johny,newyork
johny,mumbai
johny,del

want output like
name,city1,city2,city3
johny,nework,mumbai,delhi

thanks in advance..

Sharali Sharna

• Nov 24th, 2015

You can use Pivot Enterprise stage to achive this.

Abhinandan

• Nov 20th, 2015

Use 2 stage variable in transformer
Stagevar: if Stagevar1=sno then marks:",":Stagevar Else marks
Stagevar1: sno

map stageVar to marks

Answer Question  Select Best Answer

I have two files target 3 files

file no1:
1
2
3
4

file2
3
4
5
6

output like first file 1,2 first file 3,4 second file 5 ,6 3rd file target how to achieve this

Thwara

• Jul 15th, 2017

First copy the value from your seq. file using "copy stage", then use "funnel stage" to join the two seq. file, then sort them and use "remove duplicate stage" to find the duplicate values (eg: 3,4) t...

Amit

• Jul 28th, 2015

Basically Question is about how you will achive Left Join, Inner Join and Outer Join.

Answer Question  Select Best Answer