How to calculate sortwork



IBM's flagship sort product DFSORT for sorting, merging, copying, data manipulation and reporting. Includes ICETOOL and ICEGENER

Re: How to calculate sortwork

Postby dick scherrer » Wed Jun 05, 2013 9:04 pm

Hello,

Because malware is sometimes found in files found on the internet.

You might be "using it", but several of our helpers will not see it. . . In my case, the organization does not permit this kind of download.

If it did not work, the informational / diagnostic messages show this. Is there some reason hyou cannot simply copy/paste the Meaningful bit of the sysout?
Hope this helps,
d.sch.
User avatar
dick scherrer
Global moderator
 
Posts: 6304
Joined: Sat Jun 09, 2007 8:58 am
Has thanked: 3 times
Been thanked: 91 times

Re: Re: How to calculate sortwork

 

Re: How to calculate sortwork

Postby skolusu » Wed Jun 05, 2013 9:23 pm

samb01 wrote:heelo,
i tryed but it doesn't work...


Do you even bother reading the sysout messages?
 ICE083A D RESOURCES WERE UNAVAILABLE FOR DYNAMIC ALLOCATION OF WORK DATA SETS (
 ICE753I 0 FWK=(0,0) SWK=(1,56377) TWK=(0,0) RWK=(0,0) TOTAL=(1,56377) BLK=56664
 ICE248I 0 ATTEMPTED TO ALLOCATE 228491MB OF DISK WORK SPACE ON 60 WORK DATA SET
 ICE249I 0 SUCCESSFULLY ALLOCATED 3046MB OF DISK WORK SPACE ON 1 WORK DATA SETS


DFSORT tried to allocate 228,491MB of workspace on to 60 Work datasets (see message ICE248I) as you requested but it could only 3046MB. So talk to your systems programmer to findout why the sortworks are not able to find the volumes.

samb01 wrote:Just an other think, i thought the number of sortwork is limited to 32... So 60 sortworks is too much ?


Please don't assume on behalf of DFSORT. As Akatsukami pointed out, the limit is 255. Please read about DYNALLOC parm from the link

n - specifies the maximum number of requested work data sets. If you specify more than 255, a maximum of 255 data sets is used. If you specify 1 and the Blockset technique is selected, a maximum of 2 data sets is used. If you specify more than 32 and the Blockset technique is not selected, a maximum of 32 data sets is used.
Kolusu - DFSORT Development Team (IBM)
DFSORT is on the Web at:
www.ibm.com/storage/dfsort
skolusu
 
Posts: 586
Joined: Wed Apr 02, 2008 10:38 pm
Has thanked: 0 time
Been thanked: 39 times

Re: How to calculate sortwork

Postby samb01 » Thu Jun 06, 2013 1:11 am

dick scherrer wrote:Hello,

Because malware is sometimes found in files found on the internet.

You might be "using it", but several of our helpers will not see it. . . In my case, the organization does not permit this kind of download.

If it did not work, the informational / diagnostic messages show this. Is there some reason hyou cannot simply copy/paste the Meaningful bit of the sysout?


Ok i anderstand. But for me it's easier to put a file whith the whole sysout because when i cut/paste, il always miss something in the sysout.
samb01
 
Posts: 236
Joined: Mon Nov 16, 2009 7:24 pm
Has thanked: 0 time
Been thanked: 0 time

Re: How to calculate sortwork

Postby samb01 » Thu Jun 06, 2013 1:17 am

DFSORT tried to allocate 228,491MB of workspace on to 60 Work datasets (see message ICE248I) as you requested but it could only 3046MB. So talk to your systems programmer to findout why the sortworks are not able to find the volumes.


May be it's a problem of dataclass or storageclass. Dataset's work space are, may be, in the wrong storclass...

Is there a way to anderstabd what's happen with that sortwork which are unable to find any volume (SORTDIAG may be ?)
samb01
 
Posts: 236
Joined: Mon Nov 16, 2009 7:24 pm
Has thanked: 0 time
Been thanked: 0 time

Re: How to calculate sortwork

Postby NicC » Thu Jun 06, 2013 1:44 am

Yes - speak to your storge people. It may be that they need to re-arrange their dasd alloctions or even get in more dasd. But not telling them you have a problem means it isn't really going to get fixed long-term.

And as for uploads - I do not access them for security of MY system and at work I am probably proibited anyway. If you want help then help us to help you by making it easy to see your information. Besides which, it is quicker to cut and paste and use the code tags than it is to upload stuff.
The problem I have is that people can explain things quickly but I can only comprehend slowly.
Regards
Nic
NicC
Global moderator
 
Posts: 2690
Joined: Sun Jul 04, 2010 12:13 am
Location: Pushing up the daisys (almost)
Has thanked: 4 times
Been thanked: 105 times

Re: How to calculate sortwork

Postby samb01 » Thu Jun 06, 2013 2:07 pm

Hello,

whe i see this message

IEF285I   SYS13156.T150719.RA000.DFSORT01.R0130296     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150720.RA000.DFSORT01.R0130297     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150720.RA000.DFSORT01.R0130298     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150721.RA000.DFSORT01.R0130299     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150722.RA000.DFSORT01.R0130300     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150723.RA000.DFSORT01.R0130301     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150723.RA000.DFSORT01.R0130302     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150724.RA000.DFSORT01.R0130303     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150725.RA000.DFSORT01.R0130304     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150726.RA000.DFSORT01.R0130305     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150727.RA000.DFSORT01.R0130306     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150727.RA000.DFSORT01.R0130307     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150727.RA000.DFSORT01.R0130308     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150728.RA000.DFSORT01.R0130309     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150729.RA000.DFSORT01.R0130310     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150730.RA000.DFSORT01.R0130311     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150730.RA000.DFSORT01.R0130312     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150731.RA000.DFSORT01.R0130313     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150732.RA000.DFSORT01.R0130314     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150733.RA000.DFSORT01.R0130315     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150733.RA000.DFSORT01.R0130316     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150734.RA000.DFSORT01.R0130317     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150735.RA000.DFSORT01.R0130318     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150736.RA000.DFSORT01.R0130319     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150736.RA000.DFSORT01.R0130320     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150737.RA000.DFSORT01.R0130321     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150738.RA000.DFSORT01.R0130322     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150739.RA000.DFSORT01.R0130323     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150740.RA000.DFSORT01.R0130324     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150740.RA000.DFSORT01.R0130325     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150741.RA000.DFSORT01.R0130326     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150742.RA000.DFSORT01.R0130327     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150743.RA000.DFSORT01.R0130328     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150744.RA000.DFSORT01.R0130329     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150744.RA000.DFSORT01.R0130330     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150745.RA000.DFSORT01.R0130331     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150746.RA000.DFSORT01.R0130332     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150747.RA000.DFSORT01.R0130333     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150747.RA000.DFSORT01.R0130334     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150748.RA000.DFSORT01.R0130335     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150749.RA000.DFSORT01.R0130336     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150750.RA000.DFSORT01.R0130337     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150750.RA000.DFSORT01.R0130338     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150751.RA000.DFSORT01.R0130339     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150752.RA000.DFSORT01.R0130340     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150752.RA000.DFSORT01.R0130341     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150753.RA000.DFSORT01.R0130342     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150754.RA000.DFSORT01.R0130343     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150755.RA000.DFSORT01.R0130344     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150755.RA000.DFSORT01.R0130345     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150756.RA000.DFSORT01.R0130346     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150757.RA000.DFSORT01.R0130347     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150757.RA000.DFSORT01.R0130348     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150758.RA000.DFSORT01.R0130349     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150758.RA000.DFSORT01.R0130350     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150759.RA000.DFSORT01.R0130351     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150800.RA000.DFSORT01.R0130352     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150801.RA000.DFSORT01.R0130353     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEF285I   SYS13156.T150801.RA000.DFSORT01.R0130354     DELETED
 IEF285I   VOL SER NOS= VPUB01.
 IEA995I SYMPTOM DUMP OUTPUT
   USER COMPLETION CODE=0083
  TIME=15.08.45  SEQ=04523  CPU=0000  ASID=007F
  PSW AT TIME OF ERROR  078D1000   00DCB868  ILC 2  INTC 0D
    NO ACTIVE MODULE FOUND
    NAME=UNKNOWN
    DATA AT PSW  00DCB862 - 41A0C778  0A0D9602  D3CD9180
    AR/GR 0: A453F42A/00000000   1: 00000000/80000053
          2: 00000000/00000053   3: 00000000/00DCB812
          4: 00000000/00000050   5: 00000000/000063D7
          6: 00000000/0000879C   7: 00000000/40DCED94
          8: 00000000/00DCC100   9: 00000000/40DCF114
          A: 00000000/00DCB878   B: 00000000/00DCA100
          C: 00000000/00DCB100   D: 00000000/00007000
          E: 00000000/00DCB810   F: 00000000/00000010
  END OF SYMPTOM DUMP
 IEF472I DFSORT01 TRI41 - COMPLETION CODE - SYSTEM=000 USER=0083 REASO


It's sur there is not place enought in the volume VPUB01 but i can't anderstand why the dynamic allocation does not choose an other volume...
samb01
 
Posts: 236
Joined: Mon Nov 16, 2009 7:24 pm
Has thanked: 0 time
Been thanked: 0 time

Re: How to calculate sortwork

Postby Robert Sample » Thu Jun 06, 2013 2:57 pm

why the dynamic allocation does not choose an other volume
Because the storage management group at your site has coded rules to determine how dynamically allocated sort work requests will be handled. SMS rules dictate how data set allocations (both dynamic and static) are done: the eligible volumes, thresh hold limits, and so forth.
Robert Sample
Global moderator
 
Posts: 3367
Joined: Sat Dec 19, 2009 8:32 pm
Location: Dubuque, Iowa, USA
Has thanked: 1 time
Been thanked: 222 times

Re: How to calculate sortwork

Postby samb01 » Thu Jun 06, 2013 5:20 pm

Ok, thank you. I will ask so the spacemanager to change it (if it's possible).

With dynamic allocation, may be 60 sortwork is too much

OPTION AVGRLEN=204,DYNALLOC=(,60),FILSZ=E730000000


In the JCL, i coded :

//SORTWK01 DD DSN=TCFVD.TCFRT.SORTWK01,     
//            SPACE=(CYL,(100,200)),UNIT=3390,     
//            DISP=(,DELETE,DELETE)               
//*                                               



60 times.

But with dynamic allocation, may be i could use less sortwork like 32 for example :

OPTION AVGRLEN=204,DYNALLOC=(,32),FILSZ=E730000000


Il will try it when the ACS routine change.
samb01
 
Posts: 236
Joined: Mon Nov 16, 2009 7:24 pm
Has thanked: 0 time
Been thanked: 0 time

Re: How to calculate sortwork

Postby dick scherrer » Thu Jun 06, 2013 7:10 pm

Hello,

Something you might consider:

Split the input into multiple files, sort them (using FAR less sortwork space), and then merge the output for your required output.
Hope this helps,
d.sch.
User avatar
dick scherrer
Global moderator
 
Posts: 6304
Joined: Sat Jun 09, 2007 8:58 am
Has thanked: 3 times
Been thanked: 91 times

Re: How to calculate sortwork

Postby steve-myers » Fri Jun 07, 2013 1:17 am

Many people regard Mr. Scherrer's solution as a last resort solution as there is an impressive amount of manual effort.

What appears to be your solution: placing what amounts to temporary storage in a storage pool intended for "permanent" data is chancy, at best, since the storage is more likely to be heavily fragmented than the storage for temporary data.

You must discuss this with your storage folks. If they cannot provide the temporary storage you need, you need a plan B. At one time this involved using tape for SORTWK, but the sort products all seem to discourage this idea these days, and there may not be enough tape devices in any event. Most likely this involves Mr. Scherrer's idea as a plan C. Good luck!
steve-myers
Global moderator
 
Posts: 1886
Joined: Thu Jun 03, 2010 6:21 pm
Has thanked: 4 times
Been thanked: 197 times

PreviousNext

Return to DFSORT/ICETOOL/ICEGENER

 


  • Related topics
    Replies
    Views
    Last post