Need Help on Performance Improvement of SyncSort



Support for NetApp SyncSort for z/OS, Visual SyncSort, SYNCINIT, SYNCLIST and SYNCTOOL

Need Help on Performance Improvement of SyncSort

Postby gopal_NKP » Fri Feb 25, 2011 1:12 pm

hi,

One of the step of my job is merges two files and writes to one output file in sorted order using SyncSort.

The number of records in each file is about 30 millions . it is taking 14 minutes 37 seconds.

Please help to decrease this CPU usage time to minimum level.

Thanks
VGL
gopal_NKP
 
Posts: 22
Joined: Fri Feb 25, 2011 11:47 am
Has thanked: 0 time
Been thanked: 0 time

Re: Need Help on Performance Improvement of SyncSort

 

Re: Need Help on Performance Improvement of SyncSort

Postby Akatsukami » Fri Feb 25, 2011 3:49 pm

You have posted nothing to indicate that this job is taking an excessive amount of CPU time. Show us some JCL, control cards, and sysout.
"You have sat too long for any good you have been doing lately ... Depart, I say; and let us have done with you. In the name of God, go!" -- what I say to a junior programmer at least once a day
User avatar
Akatsukami
Global moderator
 
Posts: 1053
Joined: Sat Oct 16, 2010 2:31 am
Location: Bloomington, IL
Has thanked: 6 times
Been thanked: 51 times

Re: Need Help on Performance Improvement of SyncSort

Postby Robert Sample » Fri Feb 25, 2011 3:52 pm

The sort packages are NOT noted for wasting a lot of time, so your Syncsort time may be close to the minimum already. Is the 14 minutes 37 seconds elapsed time or CPU time? And remember, handling 60 million records will take a good bit of time, no matter what you want.
Robert Sample
Global moderator
 
Posts: 3367
Joined: Sat Dec 19, 2009 8:32 pm
Location: Dubuque, Iowa, USA
Has thanked: 1 time
Been thanked: 222 times

Re: Need Help on Performance Improvement of SyncSort

Postby BillyBoyo » Fri Feb 25, 2011 8:25 pm

As Robert says, things like sorts are pretty nippy already. If you are just merging two files, that's a pretty simple thing which doesn't leave much room for optimisation. It reads a record on file 1, reads a record on file 2, compares the keys, writes out the lower key, reads the file that had the lower key, repeats until end.

How often will the job be running?

How many key fields are defined?

What type of files are the input and output? Ensure optimal blocking.

Try to dig up a manual. I'm sure it will have advice on treating big files.

Don't expect any big savings, so consider the first question, which is asking "is it worth it"?
BillyBoyo
Global moderator
 
Posts: 3804
Joined: Tue Jan 25, 2011 12:02 am
Has thanked: 22 times
Been thanked: 264 times

Re: Need Help on Performance Improvement of SyncSort

Postby Alissa Margulies » Tue Mar 01, 2011 9:22 pm

Without seeing any of the JCL or sort messages, the only recommendation I can make to possibly improve CPU time would be to pass the CPU optimization parm...
//$ORTPARM DD *
 CPU

If you would like further assistance tuning this application, please email the COMPLETE job listing to me at alissa.margulies@syncsort.com and I would be happy to review it for you.

Regards,
Alissa Margulies
Syncsort Mainframe Product Services
201-930-8260
zos_tech@syncsort.com
Alissa Margulies
Global moderator
 
Posts: 369
Joined: Tue Feb 26, 2008 11:15 pm
Location: USA
Has thanked: 1 time
Been thanked: 1 time


Return to Syncsort/Synctool

 


  • Related topics
    Replies
    Views
    Last post