SORTWork area changes v/s Job Execution Stats
![Post Post](https://www.ibmmainframeforum.com/styles/prosilver/imageset/icon_post_target.gif)
Hello,
We have a batch COBOL program with internal sort; the job processes a fairly large amount of data almost everyday, test run file was a replica with 65% of actual record count; count standing at: 202429599 records. We were trying to benchmark the SORTWork area to be provided to DFSORT; SYSOUTs are given below for reference:
The JOB execution stats are as below:
The query is, what caused the EXCP/SRB to be almost halved in either runs; we have tried multiple test runs, the results in all remaining the same.
Any pointers would be really helpful.
<Edit: JOB names have been modified in the stats>
Thanks.
We have a batch COBOL program with internal sort; the job processes a fairly large amount of data almost everyday, test run file was a replica with 65% of actual record count; count standing at: 202429599 records. We were trying to benchmark the SORTWork area to be provided to DFSORT; SYSOUTs are given below for reference:
With 12 SORTWork datasets of:
//SORTWK01 DD DSN=&&TEMP,DSNTYPE=LARGE,
// DISP=(NEW,DELETE,DELETE),
// SPACE=(CYL,(1000,1000),RLSE)
SYSOUT -
1ICE201I H RECORD TYPE IS F - DATA STARTS IN POSITION 1
ICE118I 0 UNKNOWN FILE SIZE - FILSZ=EN MAY IMPROVE RESOURCE USAGE AND PERFORMANCE
ICE751I 0 C5-I12416 C6-K90026 C7-K94453 C8-K94453 E4-K58148 C9-BASE E5-K80744 E7-I12416
ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED
ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EXAMPLES AND MORE
ICE000I 0 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 14:03 ON MON JUN 22, 2015 -
0 OPTION MOSIZE=10%,HIPRMAX=10%,DYNALLOC=(SYSDA,15),DSPSIZE=300 -HP13512
EXPMAX=10%,EXPOLD=10%,EXPRES=10% HP13512
ICE140I 0 END OF PARAMETERS FROM DFSPARM - SYSIN OR SORTCNTL/PARAMETER LIST CONTROL STATEMENTS FOLLOW
SORT FIELDS=(0001,0023,CH,A)
RECORD TYPE=F,LENGTH=(000111,,)
ICE193I 0 ICEAM2 INVOCATION ENVIRONMENT IN EFFECT - ICEAM2 ENVIRONMENT SELECTED
ICE089I 1 TEST . , INPUT LRECL = 111, TYPE = F
ICE093I 0 MAIN STORAGE = (MAX,6291456,6291456)
ICE156I 0 MAIN STORAGE ABOVE 16MB = (6234096,6234096)
ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
ICE128I 0 OPTIONS: SIZE=6291456,MAXLIM=1048576,MINLIM=450560,EQUALS=N,LIST=Y,ERET=RC16 ,MSGDDN=SYSOUT
ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=N ,ABCODE=MSG
ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2
ICE131I 0 OPTIONS: TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=16384,CINV=Y,CFW=Y,DSA=0
ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N
ICE133I 0 OPTIONS: HIPRMAX=1406 ,DSPSIZE=300 ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=1407
ICE235I 0 OPTIONS: NULLOUT=RC0
ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y
ICE750I 0 DC 0 TC 0 CS DSVVV KSZ 23 VSZ 23
ICE752I 0 FSZ=0 RE IGN=0 C AVG=112 0 WSP=0 E DYN=0 0
ICE247I 0 INTERMEDIATE MERGE ENTERED - PERFORMANCE MAY BE DEGRADED
(PGMSTAT) SCSMCU - SMCU - OPENED: SEQ INPUT 393 READS, 0 WRITES, 0 REWRITES, 0 DELETES
ICE751I 1 DE-K83743 D5-K91600 D3-K83080 E1-I16099 D6-K58148 D3-K83080 D7-K58148 E8-I12416
ICE091I 0 OUTPUT LRECL = 111, TYPE = F
ICE055I 0 INSERT 202429599, DELETE 202429599
ICE054I 0 RECORDS - IN: 0, OUT: 0
ICE134I 0 NUMBER OF BYTES SORTED: 22469685489
ICE253I 0 RECORDS SORTED - PROCESSED: 202429599, EXPECTED: 0
ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 510000 , TRACKS USED: 507435
ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES
ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 1407M BYTES
ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES
ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES
ICE052I 0 END OF DFSORT
//SORTWK01 DD DSN=&&TEMP,DSNTYPE=LARGE,
// DISP=(NEW,DELETE,DELETE),
// SPACE=(CYL,(1000,1000),RLSE)
SYSOUT -
1ICE201I H RECORD TYPE IS F - DATA STARTS IN POSITION 1
ICE118I 0 UNKNOWN FILE SIZE - FILSZ=EN MAY IMPROVE RESOURCE USAGE AND PERFORMANCE
ICE751I 0 C5-I12416 C6-K90026 C7-K94453 C8-K94453 E4-K58148 C9-BASE E5-K80744 E7-I12416
ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED
ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EXAMPLES AND MORE
ICE000I 0 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 14:03 ON MON JUN 22, 2015 -
0 OPTION MOSIZE=10%,HIPRMAX=10%,DYNALLOC=(SYSDA,15),DSPSIZE=300 -HP13512
EXPMAX=10%,EXPOLD=10%,EXPRES=10% HP13512
ICE140I 0 END OF PARAMETERS FROM DFSPARM - SYSIN OR SORTCNTL/PARAMETER LIST CONTROL STATEMENTS FOLLOW
SORT FIELDS=(0001,0023,CH,A)
RECORD TYPE=F,LENGTH=(000111,,)
ICE193I 0 ICEAM2 INVOCATION ENVIRONMENT IN EFFECT - ICEAM2 ENVIRONMENT SELECTED
ICE089I 1 TEST . , INPUT LRECL = 111, TYPE = F
ICE093I 0 MAIN STORAGE = (MAX,6291456,6291456)
ICE156I 0 MAIN STORAGE ABOVE 16MB = (6234096,6234096)
ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
ICE128I 0 OPTIONS: SIZE=6291456,MAXLIM=1048576,MINLIM=450560,EQUALS=N,LIST=Y,ERET=RC16 ,MSGDDN=SYSOUT
ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=N ,ABCODE=MSG
ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2
ICE131I 0 OPTIONS: TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=16384,CINV=Y,CFW=Y,DSA=0
ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N
ICE133I 0 OPTIONS: HIPRMAX=1406 ,DSPSIZE=300 ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=1407
ICE235I 0 OPTIONS: NULLOUT=RC0
ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y
ICE750I 0 DC 0 TC 0 CS DSVVV KSZ 23 VSZ 23
ICE752I 0 FSZ=0 RE IGN=0 C AVG=112 0 WSP=0 E DYN=0 0
ICE247I 0 INTERMEDIATE MERGE ENTERED - PERFORMANCE MAY BE DEGRADED
(PGMSTAT) SCSMCU - SMCU - OPENED: SEQ INPUT 393 READS, 0 WRITES, 0 REWRITES, 0 DELETES
ICE751I 1 DE-K83743 D5-K91600 D3-K83080 E1-I16099 D6-K58148 D3-K83080 D7-K58148 E8-I12416
ICE091I 0 OUTPUT LRECL = 111, TYPE = F
ICE055I 0 INSERT 202429599, DELETE 202429599
ICE054I 0 RECORDS - IN: 0, OUT: 0
ICE134I 0 NUMBER OF BYTES SORTED: 22469685489
ICE253I 0 RECORDS SORTED - PROCESSED: 202429599, EXPECTED: 0
ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 510000 , TRACKS USED: 507435
ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES
ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 1407M BYTES
ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES
ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES
ICE052I 0 END OF DFSORT
Without SORTWork datasets, but additional DFSORT parameters coded:
1ICE060I 0 INVALID DFSPARM PARAMETER
ICE201I H RECORD TYPE IS F - DATA STARTS IN POSITION 1
ICE751I 0 C5-I12416 C6-K90026 C7-K94453 C8-K94453 E4-K58148 C9-BASE E5-K80744 E6-K94453 C4-K94453 E7-I12416
ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED
ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EXAMPLES AND MORE
ICE000I 0 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 22:17 ON SAT JUN 27, 2015 -
0 OPTION MOSIZE=10%,HIPRMAX=10%,DYNALLOC=(,6),FILSZ=E99999999 - HP13512
EXPMAX=10%,EXPOLD=10%,EXPRES=10% HP13512
$ $ $
ICE140I 0 END OF PARAMETERS FROM DFSPARM - SYSIN OR SORTCNTL/PARAMETER LIST CONTROL STATEMENTS FOLLOW
SORT FIELDS=(0001,0023,CH,A)
RECORD TYPE=F,LENGTH=(000111,,)
ICE193I 0 ICEAM2 INVOCATION ENVIRONMENT IN EFFECT - ICEAM2 ENVIRONMENT SELECTED
ICE089I 1 TEST . , INPUT LRECL = 111, TYPE = F
ICE093I 0 MAIN STORAGE = (MAX,40307196,40307196)
ICE156I 0 MAIN STORAGE ABOVE 16MB = (40249836,40249836)
ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
ICE128I 0 OPTIONS: SIZE=40307196,MAXLIM=1048576,MINLIM=450560,EQUALS=N,LIST=Y,ERET=RC16 ,MSGDDN=SYSOUT
ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA ,006),ABCODE=MSG
ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2
ICE131I 0 OPTIONS: TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=16384,CINV=Y,CFW=Y,DSA=64
ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N
ICE133I 0 OPTIONS: HIPRMAX=1406 ,DSPSIZE=MAX ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=1407
ICE235I 0 OPTIONS: NULLOUT=RC0
ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y
ICE750I 0 DC 0 TC 0 CS DSVVV KSZ 23 VSZ 23
ICE752I 0 FSZ=99999999 RE IGN=0 C AVG=112 0 WSP=14546875 E DYN=252474 53216
(PGMSTAT) SCSMCU - SMCU - OPENED: SEQ INPUT 393 READS, 0 WRITES, 0 REWRITES, 0 DELETES
ICE751I 1 DE-K83743 D5-K91600 D3-K83080 D7-K58148 E8-I12416
ICE091I 0 OUTPUT LRECL = 111, TYPE = F
ICE055I 0 INSERT 202429599, DELETE 202429599
ICE054I 0 RECORDS - IN: 0, OUT: 0
ICE134I 0 NUMBER OF BYTES SORTED: 22469685489
ICE253I 0 RECORDS SORTED - PROCESSED: 202429599, EXPECTED: 99999999
ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 438000 , TRACKS USED: 429585
ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES
ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 1404M BYTES
ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES
ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES
ICE052I 0 END OF DFSORT
1ICE060I 0 INVALID DFSPARM PARAMETER
ICE201I H RECORD TYPE IS F - DATA STARTS IN POSITION 1
ICE751I 0 C5-I12416 C6-K90026 C7-K94453 C8-K94453 E4-K58148 C9-BASE E5-K80744 E6-K94453 C4-K94453 E7-I12416
ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED
ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EXAMPLES AND MORE
ICE000I 0 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 22:17 ON SAT JUN 27, 2015 -
0 OPTION MOSIZE=10%,HIPRMAX=10%,DYNALLOC=(,6),FILSZ=E99999999 - HP13512
EXPMAX=10%,EXPOLD=10%,EXPRES=10% HP13512
$ $ $
ICE140I 0 END OF PARAMETERS FROM DFSPARM - SYSIN OR SORTCNTL/PARAMETER LIST CONTROL STATEMENTS FOLLOW
SORT FIELDS=(0001,0023,CH,A)
RECORD TYPE=F,LENGTH=(000111,,)
ICE193I 0 ICEAM2 INVOCATION ENVIRONMENT IN EFFECT - ICEAM2 ENVIRONMENT SELECTED
ICE089I 1 TEST . , INPUT LRECL = 111, TYPE = F
ICE093I 0 MAIN STORAGE = (MAX,40307196,40307196)
ICE156I 0 MAIN STORAGE ABOVE 16MB = (40249836,40249836)
ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
ICE128I 0 OPTIONS: SIZE=40307196,MAXLIM=1048576,MINLIM=450560,EQUALS=N,LIST=Y,ERET=RC16 ,MSGDDN=SYSOUT
ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA ,006),ABCODE=MSG
ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2
ICE131I 0 OPTIONS: TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=16384,CINV=Y,CFW=Y,DSA=64
ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N
ICE133I 0 OPTIONS: HIPRMAX=1406 ,DSPSIZE=MAX ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=1407
ICE235I 0 OPTIONS: NULLOUT=RC0
ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y
ICE750I 0 DC 0 TC 0 CS DSVVV KSZ 23 VSZ 23
ICE752I 0 FSZ=99999999 RE IGN=0 C AVG=112 0 WSP=14546875 E DYN=252474 53216
(PGMSTAT) SCSMCU - SMCU - OPENED: SEQ INPUT 393 READS, 0 WRITES, 0 REWRITES, 0 DELETES
ICE751I 1 DE-K83743 D5-K91600 D3-K83080 D7-K58148 E8-I12416
ICE091I 0 OUTPUT LRECL = 111, TYPE = F
ICE055I 0 INSERT 202429599, DELETE 202429599
ICE054I 0 RECORDS - IN: 0, OUT: 0
ICE134I 0 NUMBER OF BYTES SORTED: 22469685489
ICE253I 0 RECORDS SORTED - PROCESSED: 202429599, EXPECTED: 99999999
ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 438000 , TRACKS USED: 429585
ICE199I 0 MEMORY OBJECT USED AS MAIN STORAGE = 0M BYTES
ICE299I 0 MEMORY OBJECT USED AS WORK STORAGE = 1404M BYTES
ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES
ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES
ICE052I 0 END OF DFSORT
The JOB execution stats are as below:
JOB with SORTWork datasets:
JOBNAME STEPNAME PROCSTEP RC EXCP CPU SRB CLOCK
TEST STEP002 00 1683K 12.24 .38 78.06
JOBNAME STEPNAME PROCSTEP RC EXCP CPU SRB CLOCK
TEST STEP002 00 1683K 12.24 .38 78.06
JOB without SORTWork datasets and additional parameters:
JOBNAME STEPNAME PROCSTEP RC EXCP CPU SRB CLOCK
TEST STEP002 00 863K 12.25 .19 19.28
JOBNAME STEPNAME PROCSTEP RC EXCP CPU SRB CLOCK
TEST STEP002 00 863K 12.25 .19 19.28
The query is, what caused the EXCP/SRB to be almost halved in either runs; we have tried multiple test runs, the results in all remaining the same.
Any pointers would be really helpful.
<Edit: JOB names have been modified in the stats>
Thanks.