Parsing more than 1000 columns in a sort card Reply with quo

Support for NetApp SyncSort for z/OS, Visual SyncSort, SYNCINIT, SYNCLIST and SYNCTOOL
ssuthagar
Posts: 1
Joined: Tue Sep 22, 2020 3:00 am
Skillset: IMS DB/DC
Referer: I am a member at expert forum

Parsing more than 1000 columns in a sort card Reply with quo

Postby ssuthagar » Tue Sep 22, 2020 3:02 am

Hi Seniors,

My requirement is to parse CSV file with 1020 columns and I know that I can parse only 1000 columns in a sort card.

It is a VB file since the data may not be available for all columns but the delimiters are available.

I would really appreciate if someone can help me to resolve this situation.

Note: - I am trying to split a file based on delimiter with 1000 columns.

Thanks,
Suthagar

User avatar
sergeyken
Posts: 458
Joined: Wed Jul 24, 2019 10:12 pm
Skillset: Assembler, JCL, Utilities, PL/I, C/C++, DB2, SQL, REXX, COBOL, etc. etc. etc.
Referer: Internet search

Re: Parsing more than 1000 columns in a sort card Reply with

Postby sergeyken » Tue Sep 22, 2020 9:06 pm

ssuthagar wrote:Hi Seniors,

My requirement is to parse CSV file with 1020 columns and I know that I can parse only 1000 columns in a sort card.

It is a VB file since the data may not be available for all columns but the delimiters are available.

I would really appreciate if someone can help me to resolve this situation.

Note: - I am trying to split a file based on delimiter with 1000 columns.

Thanks,
Suthagar

You need to perform two (or more) passes of SORT operation - either as sequential JCL steps, or via SYNCTOOL:

1) use PARSE for the first maximum group of fields (with FIXLEN), while parsing all the rest fields as last PARSE parameter; use BUILD to create intermediate output record with aligned first group of fields (fixed size), and the last group of unparsed fields as single long “field” at the end of this intermediate record

2) scan that intermediate record: just copy the first group of already aligned fields, and PARSE the rest of input starting from fixed position; then - BUILD all fields with fixed size as final output record.
Javas and Pythons come and go, but JCL and SORT stay forever.


  • Similar Topics
    Replies
    Views
    Last post