Page 1 of 1

ICETOOL abending with SORT Capacity Exceeded

PostPosted: Mon Jan 06, 2014 1:26 pm
by gborja888
We have a very small SORT job which abended with msgid ICE046A (sort capacity exceeded) RC=08. The job was resubmitted and rerun and succeeded without changing anything.

The estimated size of the file input is only 608. I can't really determine what's the reason for this problem. Anyone has ever encountered similar issues before? TIA.

Comparing the joblog output (before and after):

Before:
ICE093I 0 MAIN STORAGE = (MAX,6291456,6291456)
ICE156I 0 MAIN STORAGE ABOVE 16MB = (5259264,5242880)
ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
ICE128I 0 OPTIONS: SIZE=6291456,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16 ,MSGDDN=DFSMSG
ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO   ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA   ,004),ABCODE=MSG
ICE131I 0 OPTIONS: TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=16384,CINV=Y,CFW=Y,DSA=0
ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE    ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N
ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=MAX
ICE235I 0 OPTIONS: NULLOUT=RC0
ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y
ICE084I 0 EXCP ACCESS METHOD USED FOR TEMP3
ICE084I 0 EXCP ACCESS METHOD USED FOR TEMP2
ICE750I 0 DC 27968 TC 0 CS DSVVV KSZ 20 VSZ 20
ICE752I 0 FSZ=608 RC  IGN=0 E  AVG=52 0  WSP=41 C  DYN=0 0
ICE805I 0 JOBNAME: UZZ33014 , STEPNAME: SPLICE
ICE802I 0 BLOCKSET     TECHNIQUE IN CONTROL
ICE887I 0 CSES 0,0,0 ES 0,0,0
ICE886I 0 SYS 0 TSTG 0 FS 0 INIT 0 MAX 0 LEN 0
ICE915I 0 MOFSZ=1,MOSZ=0,MOSYS=3887(2),MOSTG=164176,MEML=3887(1)
ICE916I 0 MOFR=0402,MOVR=VV
ICE996I 0 ESM=49048832,ESO=49048832,ESR=0,ESP=4096,ESS=16384,CES=49048832,HSZ=1048576
ICE997I 0 HWSP=10,HMAX=8388608,HES=995072,ASV=42029085,EQ=I1,HN=1
ICE898I 0 OMAX=36780896,NMAX=42029085,ENQT=35057693,CMAX=256,HU=99,BUN=61408,MD=NK,M ,DU=0,DR=10000,HN=1
ICE880I 0 QP=1 QA=1 HI=10262 LI=10262 MI=10262 TZ=29 N1=10 N2=10 SZ=2 HN=1
ICE889I 0 CT=MAX     , SB=241, L=0, D=0000, CCW=1MAM
ICE902I 0 O PP10  I PP11
ICE046A 8 SORT CAPACITY EXCEEDED - RECORD COUNT 12
ICE253I 0 RECORDS SORTED - PROCESSED: 12, EXPECTED: 608
ICE753I 1 FWK=(0,0) SWK=(0,0) TWK=(0,0) RWK=(0,0) TOTAL=(0,0) BLK=0
ICE751I 1 DE-K83743 D5-K58148 E8-K79990
ICE052I 0 END OF DFSORT


ICE093I 0 MAIN STORAGE = (MAX,6291456,6291456)                               
ICE156I 0 MAIN STORAGE ABOVE 16MB = (5259264,5242880)
ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
ICE128I 0 OPTIONS: SIZE=6291456,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16 ,MSGDDN=DFSMSG
ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO   ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA   ,004),ABCODE=MSG
ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 ,CHECK=N,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2
ICE131I 0 OPTIONS: TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=16384,CINV=Y,CFW=Y,DSA=0
ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE    ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N
ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=MAX
ICE235I 0 OPTIONS: NULLOUT=RC0
ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y
ICE084I 0 EXCP ACCESS METHOD USED FOR TEMP3
ICE084I 0 EXCP ACCESS METHOD USED FOR TEMP2
ICE750I 0 DC 27968 TC 0 CS DSVVV KSZ 20 VSZ 20
ICE752I 0 FSZ=608 RC  IGN=0 E  AVG=52 0  WSP=41 C  DYN=0 0
ICE751I 1 DE-K83743 D5-K58148 D3-K83080 D7-K58148 E8-K79990
ICE090I 0 OUTPUT LRECL = 46, BLKSIZE = 27968, TYPE = FB   (SDB)
ICE055I 0 INSERT 9, DELETE 9
ICE054I 0 RECORDS - IN: 12, OUT: 12
ICE134I 0 NUMBER OF BYTES SORTED: 552
ICE253I 0 RECORDS SORTED - PROCESSED: 12, EXPECTED: 608
ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 0 , TRACKS USED: 0
ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES
ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 1M BYTES
ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES
ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES
ICE052I 0 END OF DFSORT


Code'd

Re: ICETOOL abending with SORT Capacity Exceeded

PostPosted: Mon Jan 06, 2014 3:01 pm
by BillyBoyo
We need to see the JCL and the SORT control cards.

Re: ICETOOL abending with SORT Capacity Exceeded

PostPosted: Tue Jan 07, 2014 7:05 am
by gborja888
Please find below the JCL:

//UZZ33014 JOB (DEDP,A247),'BUILD BSFZZ03',CLASS=M,                   
//  MSGCLASS=X,MSGLEVEL=(1,1),NOTIFY=&SYSUID                                   
//*******************************************************************           
//*                                                                             
//CLEANUP  EXEC PGM=IEFBR14,REGION=2M                                           
//SYSPRINT DD SYSOUT=X                                                   
//DELFILE  DD DSN=PRODPR.Q.FILE.BSFZZ03.UXX33014,UNIT=SYSDA,                   
//         DISP=(MOD,DELETE,DELETE),SPACE=(TRK,(0,0))                           
//*                                                                             
//******************************************************************           
//SPLICE   EXEC PGM=ICETOOL,REGION=4M,COND=(4,LE)                           
//SYMNAMES DD DSN=DSN=PRODDP.COM.PARMLIB.PRM(SYNAINVM),DISP=SHR                                   
//DFSMSG   DD SYSOUT=X                                                   
//TOOLMSG  DD SYSOUT=X                                                   
//INCUSR   DD DSN=PRODPR.CUSR.SORT.US460014,DISP=SHR                           
//INBRHM   DD DSN=PRODPR.BRHM.SORT,DISP=SHR                                   
//ININVM   DD DSN=PRODPR.UNLO.INVM.UU873001,DISP=SHR                           
//OUTZZ03  DD DSN=PRODPR.Q.FILE.BSFZZ03.UXX33014,DISP=(,CATLG),                 
//         SPACE=(CYL,(100,3000),RLSE),UNIT=3390,VOL=(,,,30)                                   
//TEMP     DD DSN=PRODPR.TEMP.UXX33014.S01,DISP=(MOD,DELETE,DELETE),           
//         SPACE=(CYL,(100,3000),RLSE),UNIT=3390,VOL=(,,,30)                                   
//TEMP2    DD DSN=PRODPR.TEMP.UXX33014.S02,DISP=(MOD,DELETE,DELETE),           
//         SPACE=(CYL,(100,3000),RLSE),UNIT=3390,VOL=(,,,30)                                   
//TEMP3    DD DSN=PRODPR.TEMP.UXX33014.S03,DISP=(MOD,DELETE,DELETE),           
//         SPACE=(CYL,(100,3000),RLSE),UNIT=3390,VOL=(,,,30)                                   
//TEMP4    DD SYSOUT=X                                                   
//TOOLIN   DD * 
   * 1. GET THE PROV_BR_NO AND COPY INCUSR TO THE TOP OF TEMP2         
     COPY    FROM(INBRHM)  TO(TEMP)    USING(BRHM)                     
     COPY    FROM(ININVM)  TO(TEMP)    USING(INVM)                     
     COPY    FROM(INCUSR)  TO(TEMP2)   USING(CUSR)                     
     SPLICE  FROM(TEMP)    TO(TEMP2)   ON(19,5,CH)  WITHALL -         
       WITH(2,17)   WITH(29,16)  USING(SPL1)  KEEPNODUPS KEEPBASE
                                                                       
   * 2. GET CUSTOMER_TYPE AND SORT                                     
     SPLICE  FROM(TEMP2)   TO(TEMP3) ON(3,16,CH) WITHALL -             
             WITH(2,1)    WITH(21,26)  KEEPNODUPS   KEEPBASE           
     COPY    FROM(TEMP3)   TO(OUTZZ03) USING(COPY)                     
//BRHMCNTL DD *                                                                 
   OUTFIL FNAMES=TEMP,OUTREC=(C'AA',16X,1,10,16X)
//INVMCNTL DD *                                 
   OUTFIL FNAMES=TEMP,OUTREC=(C'BB',CUSTOMER_NO,
                                       BRANCH_NO,5X,ACCT_NO),VTOF                               
//CUSRCNTL DD *
  OUTFIL FNAMES=TEMP2,OUTREC=(C'CC',1,18,26X)                                                                 
//SPL1CNTL DD *                             
  OUTFIL  FNAMES=TEMP2,OUTREC=(C'DD',3,16,2X,19,26),
                     INCLUDE=(1,2,CH,EQ,C'AB',OR,1,2,CH,EQ,C'BB')                                   
//COPYCNTL DD *                                                                 
  SORT   FIELDS=(31,16,CH,A)
  OUTFIL FNAMES=OUTZZ03,
         INCLUDE=(1,2,CH,EQ,C'CD'),
         OUTREC=(31,16,C'|',3,16,C'|',21,5,C'|',26,5,C'|',19,2,C'|')
/*

Code'd

Re: ICETOOL abending with SORT Capacity Exceeded

PostPosted: Tue Jan 07, 2014 7:54 pm
by Terry Heinze
Please use Code tags:
Like this


Re: ICETOOL abending with SORT Capacity Exceeded

PostPosted: Tue Jan 07, 2014 8:09 pm
by dick scherrer
Hello,

As Terry mentioned, you need to use the Code tag whan posting information that needs to keep alignment.

Your post has been coded, but you need to do this for future posts.

Re: ICETOOL abending with SORT Capacity Exceeded

PostPosted: Tue Jan 07, 2014 9:42 pm
by NicC
Why, if you only have 12 records do you specify an estimate of 608? Why, if there are so few records (even if it was 608) do you specify hundreds of cylinders of space. You could probably use just a couple of tracks.
Gnerally, when a sort fails with insufficient space and works ok on refeeding with no changes it is because there is insufficient space on the volumes allocated when the job first runs but some other process finishes before the refeed and so frees up space. Really, the only people who can help you are your storage people. But you would have to know the dasd usage at the time of failure.

Re: ICETOOL abending with SORT Capacity Exceeded

PostPosted: Wed Jan 08, 2014 5:49 am
by gborja888
Terry/Dick,

Sorry about that, will do that next time.

Re: ICETOOL abending with SORT Capacity Exceeded

PostPosted: Wed Jan 08, 2014 5:55 am
by gborja888
NicC wrote:Why, if you only have 12 records do you specify an estimate of 608? Why, if there are so few records (even if it was 608) do you specify hundreds of cylinders of space. You could probably use just a couple of tracks.
Gnerally, when a sort fails with insufficient space and works ok on refeeding with no changes it is because there is insufficient space on the volumes allocated when the job first runs but some other process finishes before the refeed and so frees up space. Really, the only people who can help you are your storage people. But you would have to know the dasd usage at the time of failure.


We didn't specify any estimated records (FSZ) in the JCL, it was just determined by DFSORT. Even if FSZ was specified, should the space been sufficient since 608 > 12? Not sure why this happened as we can't seem to recreate the problem..

Re: ICETOOL abending with SORT Capacity Exceeded

PostPosted: Wed Jan 08, 2014 7:17 am
by dick scherrer
Hello,

I suspect something in the environment has changed so the failure does not happen now.

If the "something: is ever put back, the failure would probably happen again.

Re: ICETOOL abending with SORT Capacity Exceeded

PostPosted: Wed Jan 08, 2014 9:58 am
by gborja888
Only the job mix has changed. The same job was resubmitted after 30 minutes. So far, it didn't happen again. The chances that it will re-occur is pretty small considering how big the memory (160GB) and DASD space available in the system. And also considering how small this job storage requirement that is if this really was caused by insufficient storage.