Android Question Scraping / Mining Webpage Data

mangojack

Well-Known Member
Licensed User
Longtime User
I have read a few posts regarding scaping website data ..
Previously I have downloaded and parsed the entire webpage code. Using pattern matching I have been able to get the required data. (until they change their html code !).

I have an Idea which requires data from this source ..
http://www.fuelwatch.wa.gov.au/fuelwatch/pages/home.jspx

I have learn't I can get relavant data by building url rss queries/requests ??
ie: http://www.fuelwatch.wa.gov.au/fuelwatch/fuelWatchRSS?Product=5&Region=28

Is This the way to go ? submitting multiple queries, then downloading and parsing the returned page html code with webview extras (as I have done in the past).

Or is there other ways .. Javascript ??
I have read references to FireFly and have had a play .. but it is all gobbledeegook to me !

Any light / help on the subject would be appreciated ...

Regards
 

DonManfred

Expert
Licensed User
Longtime User
I have learn't I can get relavant data by building url rss queries/requests
This looks like the best way to get the data if you are allowed to use the data in the rss (which is an xml you need to parse).
 
Upvote 0

mangojack

Well-Known Member
Licensed User
Longtime User
Thanks for the reply Don .. I now know the difference between xml and html .
Onwards and Upwards ;)
 
Upvote 0
Top