Android Question web scraping

[Isac]

Hello everybody,

does anyone have any ready examples of web scaping?

thank you for your attention

 

[walt61]

Here you go @Isac :

Sub Button1_Click

    ' NOTE: if you'd get error "java.security.cert.CertPathValidatorException",
    ' add Conditional Symbol (Ctl-B) 'HU2_ACCEPTALL'
    Wait For (GetWebPageHtml("https://www.b4x.com")) Complete (result As String)
    Log(result)

End Sub

Sub GetWebPageHtml(url As String) As ResumableSub

    ' Dependency: lib OkHttpUtils2

    Dim j As HttpJob
    Dim result As String = ""

    j.Initialize("", Me) 'name is empty as it is no longer needed
    j.Download(url)
    Wait For (j) JobDone(j As HttpJob)
    If j.Success Then
        result = j.GetString
    Else
        Log("Error: " & j.ErrorMessage)
    End If
    j.Release
    Return result

End Sub

 

[Alessandro71]

The scraping part can be found in this thread

[B4X] MiniHtmlParser - simple html parser implemented with B4X

MiniHtmlParser is a cross platform class that parses html strings and creates a tree with the various elements. It is a less powerful alternative to jTidy or jSoup, however it is simple to use, cross platform and as it is implemented in B4X it can be extended quite easily. Note that many...

www.b4x.com

 

[Isac]

Here you go @Isac :

Sub Button1_Click

    ' NOTE: if you'd get error "java.security.cert.CertPathValidatorException",
    ' add Conditional Symbol (Ctl-B) 'HU2_ACCEPTALL'
    Wait For (GetWebPageHtml("https://www.b4x.com")) Complete (result As String)
    Log(result)

End Sub

Sub GetWebPageHtml(url As String) As ResumableSub

    ' Dependency: lib OkHttpUtils2

    Dim j As HttpJob
    Dim result As String = ""

    j.Initialize("", Me) 'name is empty as it is no longer needed
    j.Download(url)
    Wait For (j) JobDone(j As HttpJob)
    If j.Success Then
        result = j.GetString
    Else
        Log("Error: " & j.ErrorMessage)
    End If
    j.Release
    Return result

End Sub

Here you go @Isac :

Sub Button1_Click

    ' NOTE: if you'd get error "java.security.cert.CertPathValidatorException",
    ' add Conditional Symbol (Ctl-B) 'HU2_ACCEPTALL'
    Wait For (GetWebPageHtml("https://www.b4x.com")) Complete (result As String)
    Log(result)

End Sub

Sub GetWebPageHtml(url As String) As ResumableSub

    ' Dependency: lib OkHttpUtils2

    Dim j As HttpJob
    Dim result As String = ""

    j.Initialize("", Me) 'name is empty as it is no longer needed
    j.Download(url)
    Wait For (j) JobDone(j As HttpJob)
    If j.Success Then
        result = j.GetString
    Else
        Log("Error: " & j.ErrorMessage)
    End If
    j.Release
    Return result

End Sub

Hello
thank you,
but to scrape data from an html page?
do you have any advice?

 

[walt61]

Ah I see. I'm afraid I interpret the html myself by splitting (with regex.Split) the result string and picking out the bits I need. @Alessandro71 's post probably points you in the direction you're after.