B4J Question [BANano] How can I build a web-scraper

[Mashiane]

Ola

How can one build a web scraper using BANano?

Thanks.

 

[mcqueccu]

With combination of okhttputils and B4X Minihtmlparser

 

[Mashiane]

Ok, yes I guess for a BANanoServer based app that would work perfect.

Im thinking of an app that will not use the jetty Server.

 

[alwaysbusy]

I highly doubt this is possible due to CORS. You will need indeed a server-side part like BANanoServer to do that.

EDIT: and even that would only work for static websites. For most you will need a server side renderer. Node.js is probably your best bet.

 

[tchart]

@Mashiane do you need a scraper or crawler? I have a B4J library that will crawl a site.

Its based on the Java code here; http://www.netinstructions.com/how-to-make-a-simple-web-crawler-in-java/