How to get data via screen scraping

How to get data via screen scraping

Postby jjones » Thu Nov 03, 2011 11:43 am

Hello I'm new to the board and am unsure where I should post the below to get some guidance.

I have a project that I'm trying to put together, but am unsure of what I need to accomplish the end result.

Here is the scenario.

I'm trying to get information from a mainframe (tn3270 terminal)

So the info would be screen scraped from mainframe where you log into a citrix online web client connecting you to a TN3270 emulation.

Once logged in the information that I'm trying to screen scrap is in or under different locations and or different screens.

This information would be screen scraped and then exported to a format that could be placed into a oracle or sql database for manipulation

Again I apologize for posting in this location, just not sure where it should be posted and what is truly needed.

thank you in advance
Posts: 1
Joined: Thu Nov 03, 2011 11:29 am
Has thanked: 0 time
Been thanked: 0 time

Re: How to get data via screen scraping


Re: Pls Forgive Me Admin

Postby NicC » Thu Nov 03, 2011 11:47 am

Well, a quick browse of forum sections shows 'Other Mainframe Topics' which would certainly be more applicable than 'Suggestions and Feedback' re the forum! No doubt a moderator will move it.
The problem I have is that people can explain things quickly but I can only comprehend slowly.
Global moderator
Posts: 2989
Joined: Sun Jul 04, 2010 12:13 am
Location: Pushing up the daisies (almost)
Has thanked: 4 times
Been thanked: 135 times

Re: Pls Forgive Me Admin

Postby mongan » Thu Nov 03, 2011 12:46 pm

From what you said I would consider this to be a bad solution. Time consuming, long running, and complicated. Why not just write a program that gets the information needed? I am often astonished at how attempts are made to avoid writing programs and where the solution is more complicated than doing it the correct way and writing an application.
User avatar
Posts: 211
Joined: Tue Jan 11, 2011 8:32 pm
Has thanked: 1 time
Been thanked: 5 times

Re: Pls Forgive Me Admin

Postby BillyBoyo » Thu Nov 03, 2011 1:05 pm

I agree with Mongan. It is a ridiculous way to do it. Presumably you are not expecting 400 screens of data at once? Even two would be tedious for the user. And what if he doesn't bother with the second screen?

Ridiculous. I wouldn't touch it with a barge pole.
Global moderator
Posts: 3804
Joined: Tue Jan 25, 2011 12:02 am
Has thanked: 22 times
Been thanked: 265 times

Re: Pls Forgive Me Admin

Postby dick scherrer » Thu Nov 03, 2011 10:37 pm

Hello and welcome to the forum,

Your topic has been relocated and given a new subject. If you'd prefer a different subject, post what you'd like here and i'll change the subject.

How/Why was screen-scraping chosen?

If you explain in a bit more detail what you want to accomplish, someone may have an alternate suggestion.

One problem with screen-scraping is that when the "real application" has a screen change, the scraper will continue to run - but incorrectly. Sometimes this is not noticed for quite a while. . .

Why is there reluctance to write the code that is needed to get the desired data?
Hope this helps,
User avatar
dick scherrer
Global moderator
Posts: 6269
Joined: Sat Jun 09, 2007 8:58 am
Has thanked: 3 times
Been thanked: 93 times

Re: How to get data via screen scraping

Postby MrSpock » Fri Nov 04, 2011 2:11 am

Presuming that you're using one of the actual real 3270 screen-scraping software products out there, what exactly is the issue, and don't you think it might work better to direct your issue to the product's support team?
User avatar
Global moderator
Posts: 807
Joined: Wed Jun 06, 2007 9:37 pm
Location: Raleigh NC USA
Has thanked: 0 time
Been thanked: 4 times

Return to Off-Topics