File Comparison using ICETOOL



IBM's flagship sort product DFSORT for sorting, merging, copying, data manipulation and reporting. Includes ICETOOL and ICEGENER

Re: File Comparison using ICETOOL

Postby dick scherrer » Thu Aug 30, 2012 7:44 pm

Hello,

SUPERC tool showed timeout error!
Suggest you run this in batch. If the job abends with a timeout, ask your support people which class you should use for a job that exceeds the allowed time for the class you are using. Your organization may permit changing the TIME parameter on the JOB statement to allow more.
Hope this helps,
d.sch.
User avatar
dick scherrer
Global moderator
 
Posts: 6304
Joined: Sat Jun 09, 2007 8:58 am
Has thanked: 3 times
Been thanked: 91 times

Re: Re: File Comparison using ICETOOL

 

Re: File Comparison using ICETOOL

Postby skolusu » Thu Aug 30, 2012 10:06 pm

thermalchu,

The maximum length of a field you can sort is 4092 for character data. So you cannot use SORT to compare 7000 bytes of data. You need to write a program for the comparison.

check this link which shows the Control Field Formats and Lengths allowed
Kolusu - DFSORT Development Team (IBM)
DFSORT is on the Web at:
www.ibm.com/storage/dfsort
skolusu
 
Posts: 586
Joined: Wed Apr 02, 2008 10:38 pm
Has thanked: 0 time
Been thanked: 39 times

Re: File Comparison using ICETOOL

Postby thermalchu » Fri Aug 31, 2012 11:32 am

//STEP1 EXEC PGM=SORT
//SYSOUT DD SYSOUT=*
//SORTJNF1 DD DSN=PXXXX.SORT1.PS,
// DISP=SHR
//SORTJNF2 DD DSN=PXXXX.SORT2.PS,
// DISP=SHR
//SORTOUT DD DSN=PXXXX.MISMATCH.PS,
// DISP=SHR
//SYSIN DD *
JOINKEYS FILES=F1,FIELDS=(1,7000,A)
JOINKEYS FILES=F2,FIELDS=(1,7000,A)
JOIN UNPAIRED,F2,ONLY
REFORMAT FIELDS=(F2:1,7000)
OPTION COPY
/*

It is showing ths error:
ICE407A 0 JOINKEYS STATEMENT HAD TOTAL KEY LENGTH GREATER THAN 4080 BYTES
thermalchu
 
Posts: 38
Joined: Thu Aug 30, 2012 3:47 pm
Has thanked: 0 time
Been thanked: 0 time

Re: File Comparison using ICETOOL

Postby BillyBoyo » Fri Aug 31, 2012 11:53 am

Did you read Kolusu's post? Right above your last?

Because your record is 7000 bytes, you are running into limits. DFSORT is not a file-comparison product.

Are you expecting your files to match? Is there something you regard as a "key"?

Did you try the suggestion about SUPERC?
BillyBoyo
Global moderator
 
Posts: 3804
Joined: Tue Jan 25, 2011 12:02 am
Has thanked: 22 times
Been thanked: 264 times

Re: File Comparison using ICETOOL

Postby thermalchu » Fri Aug 31, 2012 11:57 am

SUPERC, I tried as batch program. It took almost 6 hours to complete and then abended. SUPERC is time consuming. There is a 9 digit key starting from 12th position.
thermalchu
 
Posts: 38
Joined: Thu Aug 30, 2012 3:47 pm
Has thanked: 0 time
Been thanked: 0 time

Re: File Comparison using ICETOOL

Postby BillyBoyo » Fri Aug 31, 2012 12:19 pm

OK, odd, but what about my other questions?

Plus, are there duplicates on either file on the basis of the key?

About how many records are we talking of?
BillyBoyo
Global moderator
 
Posts: 3804
Joined: Tue Jan 25, 2011 12:02 am
Has thanked: 22 times
Been thanked: 264 times

Re: File Comparison using ICETOOL

Postby thermalchu » Fri Aug 31, 2012 12:34 pm

There are 4million records in both files. I sorted them using ICEMAN and Dynamic allocation. Almost all records will be matching. We have to check whether there is some difference in them. The records are like this:
CBF 100002345 JFGHHGJD GJDFHD DGGJH.......(7000 BYTES)
CBF 100002367 JAFSAGJD WETEY EYERUUDF.....(7000 BYTES)
The ID which starts from 12th position will be same for both files since sorted. We have to check whether there is any change is remaining record.
thermalchu
 
Posts: 38
Joined: Thu Aug 30, 2012 3:47 pm
Has thanked: 0 time
Been thanked: 0 time

Re: File Comparison using ICETOOL

Postby NicC » Fri Aug 31, 2012 12:59 pm

Have you started on your 2 file match program yet? You could have done it by now even working on it part-time.
The problem I have is that people can explain things quickly but I can only comprehend slowly.
Regards
Nic
NicC
Global moderator
 
Posts: 2690
Joined: Sun Jul 04, 2010 12:13 am
Location: Pushing up the daisys (almost)
Has thanked: 4 times
Been thanked: 105 times

Re: File Comparison using ICETOOL

Postby enrico-sorichetti » Fri Aug 31, 2012 1:01 pm

very dirty, but quick enough

why not run two compares
1) key and the first 3500 bytes
2) key and second 3500 bytes
cheers
enrico
When I tell somebody to RTFM or STFW I usually have the page open in another tab/window of my browser,
so that I am sure that the information requested can be reached with a very small effort
enrico-sorichetti
Global moderator
 
Posts: 2644
Joined: Fri Apr 18, 2008 11:25 pm
Has thanked: 0 time
Been thanked: 130 times

Re: File Comparison using ICETOOL

Postby thermalchu » Fri Aug 31, 2012 1:04 pm

Will it be possible? Because only first part contains the KEY.
thermalchu
 
Posts: 38
Joined: Thu Aug 30, 2012 3:47 pm
Has thanked: 0 time
Been thanked: 0 time

PreviousNext

Return to DFSORT/ICETOOL/ICEGENER

 


  • Related topics
    Replies
    Views
    Last post