removing duplicate records.



IBM's flagship sort product DFSORT for sorting, merging, copying, data manipulation and reporting. Includes ICETOOL and ICEGENER

removing duplicate records.

Postby jvinoth » Wed Jun 06, 2012 5:39 pm

hi,
please tell me how to remove the duplicate records from the input file and write it into another dataset.I need to write the duplicate records seperately how to achieve this please tell me.

my input data

0007900
0005412
0007900
0001111
0001111
0003333
0004444

and the expected output
0007900
0001111
0003333


thanks
jvinoth
 
Posts: 132
Joined: Fri Nov 18, 2011 3:13 pm
Has thanked: 0 time
Been thanked: 1 time

Re: removing duplicate records.

 

Re: removing duplicate records.

Postby NicC » Wed Jun 06, 2012 5:54 pm

why is 0003333 there? It only appears once. Have you tried looking in the manual for DISCARD or SAVE or 'saving duplicates' or something like that?
The problem I have is that people can explain things quickly but I can only comprehend slowly.
Regards
Nic
NicC
Global moderator
 
Posts: 2690
Joined: Sun Jul 04, 2010 12:13 am
Location: Pushing up the daisys (almost)
Has thanked: 4 times
Been thanked: 105 times

Re: removing duplicate records.

Postby jvinoth » Wed Jun 06, 2012 5:55 pm

I have used xsum and its working fine thanks...
jvinoth
 
Posts: 132
Joined: Fri Nov 18, 2011 3:13 pm
Has thanked: 0 time
Been thanked: 1 time

Re: removing duplicate records.

Postby dick scherrer » Wed Jun 06, 2012 9:28 pm

Hello,

I believe xsum is a Syncsort function - not a DFSORT function.

Look at the output from this sort that works with XSUM and post the messages (with the message ids) here and we can see which sort product you are using.

If your system uses Syncsort, you need to post in the Syncsort part of the forum, not the DFSORT part of the forum.
Hope this helps,
d.sch.
User avatar
dick scherrer
Global moderator
 
Posts: 6304
Joined: Sat Jun 09, 2007 8:58 am
Has thanked: 3 times
Been thanked: 91 times

Re: removing duplicate records.

Postby NicC » Wed Jun 06, 2012 9:29 pm

Glad to know that. I was thinking of chucking XSUM into the mix but I thought it may have been a SYNCSORT keyword and I had no time to check in the manual.
The problem I have is that people can explain things quickly but I can only comprehend slowly.
Regards
Nic
NicC
Global moderator
 
Posts: 2690
Joined: Sun Jul 04, 2010 12:13 am
Location: Pushing up the daisys (almost)
Has thanked: 4 times
Been thanked: 105 times

Re: removing duplicate records.

Postby dick scherrer » Wed Jun 06, 2012 9:56 pm

Hi Nic,

After posting that, i peeked into the Syncsort doc - yup, XSUM is for Syncsort.

Then i went and looked for where XSUM is mentioned in topics on the other forum. All of the XSUMs in a sort control statement were Syncsort topics. Unfortunately lots of folks use a ddname of XSUM or SORTXSUM in DFSORT processes. . .

Maybe TS will provide the info.
Hope this helps,
d.sch.
User avatar
dick scherrer
Global moderator
 
Posts: 6304
Joined: Sat Jun 09, 2007 8:58 am
Has thanked: 3 times
Been thanked: 91 times

Re: removing duplicate records.

Postby NicC » Thu Jun 07, 2012 12:08 pm

Hi Dick, as I said I did not have time to look up manuals as I was on my lunch break. And I have never used SYNCSORT so I have never looked at their manual. And what is available is, anyway, dependent on the sort level and PTFs applied.
The problem I have is that people can explain things quickly but I can only comprehend slowly.
Regards
Nic
NicC
Global moderator
 
Posts: 2690
Joined: Sun Jul 04, 2010 12:13 am
Location: Pushing up the daisys (almost)
Has thanked: 4 times
Been thanked: 105 times


Return to DFSORT/ICETOOL/ICEGENER

 


  • Related topics
    Replies
    Views
    Last post