mangojack Expert Licensed User Longtime User May 21, 2017 #1 I have read a few posts regarding scaping website data .. Previously I have downloaded and parsed the entire webpage code. Using pattern matching I have been able to get the required data. (until they change their html code !). I have an Idea which requires data from this source .. http://www.fuelwatch.wa.gov.au/fuelwatch/pages/home.jspx I have learn't I can get relavant data by building url rss queries/requests ?? ie: http://www.fuelwatch.wa.gov.au/fuelwatch/fuelWatchRSS?Product=5&Region=28 Is This the way to go ? submitting multiple queries, then downloading and parsing the returned page html code with webview extras (as I have done in the past). Or is there other ways .. Javascript ?? I have read references to FireFly and have had a play .. but it is all gobbledeegook to me ! Any light / help on the subject would be appreciated ... Regards
I have read a few posts regarding scaping website data .. Previously I have downloaded and parsed the entire webpage code. Using pattern matching I have been able to get the required data. (until they change their html code !). I have an Idea which requires data from this source .. http://www.fuelwatch.wa.gov.au/fuelwatch/pages/home.jspx I have learn't I can get relavant data by building url rss queries/requests ?? ie: http://www.fuelwatch.wa.gov.au/fuelwatch/fuelWatchRSS?Product=5&Region=28 Is This the way to go ? submitting multiple queries, then downloading and parsing the returned page html code with webview extras (as I have done in the past). Or is there other ways .. Javascript ?? I have read references to FireFly and have had a play .. but it is all gobbledeegook to me ! Any light / help on the subject would be appreciated ... Regards
DonManfred Expert Licensed User Longtime User May 21, 2017 #2 mangojack said: I have learn't I can get relavant data by building url rss queries/requests Click to expand... This looks like the best way to get the data if you are allowed to use the data in the rss (which is an xml you need to parse). Upvote 0
mangojack said: I have learn't I can get relavant data by building url rss queries/requests Click to expand... This looks like the best way to get the data if you are allowed to use the data in the rss (which is an xml you need to parse).
mangojack Expert Licensed User Longtime User May 21, 2017 #3 Thanks for the reply Don .. I now know the difference between xml and html . Onwards and Upwards Upvote 0
