Hi,
Anyone tried to scrape Bootstrap 5 Offcanvas components with AI2 ?
Cheers
Steve
any website to test? and want exact data you want to retrieve?
Kevin thanks for the response.
I'm not sure if I'm right in what I expect to see ot not.
I use G Chrome on my PC I can open a page, right click on it and have the options to select view page source or inspect element.
If I select inspect element I can see the content of the slide out side bar but if I view the page source the side bar content isn't included.
Is that normal behaviour ?
Cheers
Steve
yes, since some content is generated/laded later by js or something.
Is it possible to scrape that data (js or ajax) with AppInventor ?
Don't know if i made myself clear, the data of the side bar is readable by using the developer tools in chrome by right clicking on it and clicking inspect that item, but it doesn't appear in the source if I right click and hit view page source instead of inspect
how about tell us which website and which data?
1 Like
No need to if AI2 cant scrape js or ajax data ... its a yes or no answer
if you can see it in the console panel, then yes.
Kevin, OSG | One Scotland Gazetteer
I can interact with the search side bar, click the button, inject text into the search field but cant retrieve the results no matter what i try.
They appear in the console but I cant retrieve the data ... addresses for instance visible and visible in the console but that it.
No luck Kevin ?
Kevin,
Any response?
sorry I will check today and revert.
I don't know what to search and what to retrieve. pls explain more specifically.
Left hand side enter a post code say "ab24 4lf" the address list appears ...
Sorry my connection to this site is so slow, after I enter the post code, and press enter, nothing happens.
I'm in the UK (Wales) but the site is not working. That could be either because you have to be in Scotland or you have to sign-up for membership.
However, the Terms and Conditions of the site do not permit programmatic extraction of data.
The terms and conditions permit display of their public data on a screen... its quite legitimate... already been through all that with them. So excuses about T & C dont count for anything.
There is no requirement to sign in or to be in scotland !!
First 4 digits then MUST have a space then the other 3 digits, no need to hit enter at all.
In that case, why are you not asking 'them' for access to the data instead of scraping it?
here is the relevant part of the t&c OSG | One Scotland Gazetteer
Use of content
You may retrieve and display Content from the Site on a computer screen, print individual pages on paper and store such pages in electronic form on disk (but not on any server or other storage device connected to a network) for your personal, non-commercial use provided that you acknowledge the copyright owner.
Except as expressly set out above, you may not reproduce, modify or in any way commercially exploit any of the Content.
scraping data is NOT the same as displaying the content on a screen...
you might want to show us a written permission from them, that you are allowed to do that...
meanwhile I will unlist this thread...
Taifun