Identifying "Missing" Records



IBM's flagship sort product DFSORT for sorting, merging, copying, data manipulation and reporting. Includes ICETOOL and ICEGENER

Identifying "Missing" Records

Postby Thomas Ramseier » Mon Mar 19, 2012 10:21 pm

Hi All
I'm faced to a problem with SMF-records. I need to find out which records are in FILE1 but nor in FILE2 and vice versa. Optionally, I'd like to keep the records that are identical in both files in a third file. I *thought* this or a very similar problem was discussed in a former "smart DFSORT-Tricks" doc but couldn't find it anymore.
Both files contain SMF30-records, subtype 2 or 3, Recfm=VB, no spanned records, but they can go up to the full length of 32K.

Thanks a ton for any advice and have a great week

Thomas
Thomas Ramseier
 
Posts: 16
Joined: Mon Sep 20, 2010 11:31 am
Has thanked: 0 time
Been thanked: 0 time

Re: Identifying "Missing" Records

Postby Frank Yaeger » Mon Mar 19, 2012 10:41 pm

DFSORT is not a comparison utility per se. It can do some comparison operations but the maximum number of bytes for the comparison is about 4K. It cannot compare 32K records. As the author of the Smart DFSORT Tricks paper, I can assure you that no such trick ever appeared in it.
Frank Yaeger - DFSORT Development Team (IBM) - yaeger@us.ibm.com
Specialties: JOINKEYS, FINDREP, WHEN=GROUP, ICETOOL, Symbols, Migration
=> DFSORT/MVS is on the Web at http://www.ibm.com/storage/dfsort
User avatar
Frank Yaeger
Global moderator
 
Posts: 1079
Joined: Sat Jun 09, 2007 8:44 pm
Has thanked: 0 time
Been thanked: 15 times

Re: Identifying "Missing" Records

Postby Thomas Ramseier » Tue Mar 20, 2012 12:13 am

Hi Frank
Thank you for your response and for the hint about the 4k. Could the comparison be done for less than the 1st 4k per record?
Background: We are currently transforming our SMF-process from SYS1.MANx-datasets to log streams. Since we are in transition, both collecting processes run in parallel and we recognize slight differences in the post processing, especially in the accounting totals. There's a plethora of records written every day and we try to find out which records are "missing".
Thanks again
Thomas Ramseier
 
Posts: 16
Joined: Mon Sep 20, 2010 11:31 am
Has thanked: 0 time
Been thanked: 0 time

Re: Identifying "Missing" Records

Postby Frank Yaeger » Tue Mar 20, 2012 1:00 am

Could the comparison be done for less than the 1st 4k per record?


DFSORT's JOINKEYS function can be used for that kind of thing. For examples of using JOINKEYS for various types of comparisons, see the "Create files with matching and non-matching records​" Smart DFSORT Trick at:

http://www.ibm.com/support/docview.wss? ... g3T7000094
Frank Yaeger - DFSORT Development Team (IBM) - yaeger@us.ibm.com
Specialties: JOINKEYS, FINDREP, WHEN=GROUP, ICETOOL, Symbols, Migration
=> DFSORT/MVS is on the Web at http://www.ibm.com/storage/dfsort
User avatar
Frank Yaeger
Global moderator
 
Posts: 1079
Joined: Sat Jun 09, 2007 8:44 pm
Has thanked: 0 time
Been thanked: 15 times

Re: Identifying "Missing" Records

Postby Thomas Ramseier » Tue Mar 20, 2012 1:42 am

Frank Yaeger wrote:
Could the comparison be done for less than the 1st 4k per record?


DFSORT's JOINKEYS function can be used for that kind of thing. For examples of using JOINKEYS for various types of comparisons, see the "Create files with matching and non-matching records​" Smart DFSORT Trick at:

http://www.ibm.com/support/docview.wss? ... g3T7000094


Thank you, I'll try JOINKEYS.

Cheers

Thomas
Thomas Ramseier
 
Posts: 16
Joined: Mon Sep 20, 2010 11:31 am
Has thanked: 0 time
Been thanked: 0 time


Return to DFSORT/ICETOOL/ICEGENER

 


  • Related topics
    Replies
    Views
    Last post