Alessandro71 Well-Known Member Licensed User Longtime User Jan 28, 2023 #1 I'm downloading a web page and parsing it with MiniHtmlParser. Looking at the page with a web browser, I see a section with content that is not contained in the html file. Inspecting it I see that this section is enclosed in a HTML: Copy <section class="web-component" ...></section> tags I can see the content with a web browser, but not with MiniHtmlParser How can I get the same content I see in a web browser with an HttpJob Download?
I'm downloading a web page and parsing it with MiniHtmlParser. Looking at the page with a web browser, I see a section with content that is not contained in the html file. Inspecting it I see that this section is enclosed in a HTML: Copy <section class="web-component" ...></section> tags I can see the content with a web browser, but not with MiniHtmlParser How can I get the same content I see in a web browser with an HttpJob Download?
DonManfred Expert Licensed User Longtime User Jan 28, 2023 #2 probably the site is loading additional data with javascript and dynamically adding content. You don´t get the full content when downloading the initial webpage which uses Javascript... Upvote 1
probably the site is loading additional data with javascript and dynamically adding content. You don´t get the full content when downloading the initial webpage which uses Javascript...
Alessandro71 Well-Known Member Licensed User Longtime User Jan 28, 2023 #3 maybe an hidden webview may help, by getting the whole content after it has been handled by the webview itself... Upvote 0
maybe an hidden webview may help, by getting the whole content after it has been handled by the webview itself...
J joaomoraes83 Member Licensed User Longtime User Sep 18, 2023 #4 DonManfred said: probably the site is loading additional data with javascript and dynamically adding content. You don´t get the full content when downloading the initial webpage which uses Javascript... Click to expand... What's the best way to deal with these situations involving javascript? Upvote 0
DonManfred said: probably the site is loading additional data with javascript and dynamically adding content. You don´t get the full content when downloading the initial webpage which uses Javascript... Click to expand... What's the best way to deal with these situations involving javascript?
DonManfred Expert Licensed User Longtime User Sep 18, 2023 #5 I don´t know if there is such feature... Upvote 0