Retrieve data from csv very slow and time consuming

[ABG]

The dictionary based version loads and filters okay, but might be speeded up for later runs by caching to a TinyDB Namespace.

I'll try that next.
TEST_csv_dictionaries.aia (780.3 KB)

[ABG]

And here's the ultimate extension-free TinyDB retentive version, with loading on the first run only:
TEST_csv_TinyDB_Namespace.aia (780.6 KB)

P.S. You might want to switch to List Pickers instead of Spinners.
They have optional search boxes.

I am surprised by how many cities are in even the tiniest of countries, and at how soon I lose patience with scrolling long lists.

[TIMAI2]

With SQLite, returns are immediate:

sqliteCountriesCities.aia (1.8 MB)

[ABG]

I forgot to ask, will this have to also run on iOS?

[D_M]

Dear all, very thank you for time spended to solve my problem....I appreciate!
TIMAI2 the speed of your last .aia app is impressive! I think I will use the SQ lite as in your example.
Is that a local SQlite?

[sol_roll]

Also this will help you😊

[FREE] Advanced Sqlite Extension

[ggsda] MySqlite Extension Guide This extension allows you to create and manage a powerful local SQLite database within your app. All database operations are asynchronous , which means they run in the background to prevent your app from freezing. The Basic Workflow is always the same: You call a Function block (like ExecuteSQL or Query). Your app continues to run without waiting. When the database operation is finished, an Event block (AfterExecution or AfterQuery) fires, retur…

[D_M]

ABG thank you for your app "ultimate extension-free TinyDB retentive version".
I have tested it and in first run the time to wait is about 90s
I will probably use the solution of TIMAI2 with SQlite.

For what concern the IOS...I know that apps that use extensions can not be exported to be used in IOS...is it true?
My app uses a lot of extensions: have you a solution?

[D_M]

thank you!

[D_M]

Dear TIMAI2, cities list for each country is usually long. For this reason I used a textbox in witch user have to enter first letter of city to search, and I introduced a "compare text" to filter (se attached screenshot in first message). Will same blocks work in your SQlite blocks sequence?

In my app I have functions that need a shared database, so I used TinyWEBDB.
Is TinyWEBDB (as TinyDB) slower than SQlite?

If you suggest to substitute TinyWEBDB with SQlite, how to create the web version of SQlite? Is it the same of local one?
And how to upload it in Google App Engine server?

[ABG]

@D_M

app uses a lot of extensions: have you a solution?

No, your path is clear.

[D_M]

Sorry ABG, I have not well understood your reply.. sorry. Could you better explain what you mean please?

[TIMAI2]

As suggested, use list pickers instead of spinners, these offer a search/filter bar, alternately you can use a text box and some blocks to filter.

Revival - Italo's Custom Listview Filter Bar - with Clock (and now TextChanged)

With all links to Italo's guide on the above lost from appyBuilder and Thunkable, I thought I would put up a remix of the original blocks, with an aia project example. This uses a clock timer instead of a textbox extension. The only change I have made is to add an extra conditional check: does the last textbox content equal the current textbox content (if so, do nothing), to cut down on unnecessary processing. This also ensures that listview selections above the last one can be made. Clock timer…

Not sure why you would use a tinywebdb for anything in relation to this.

@ABG means you are ok to carry on if you are not targeting iOS.

[D_M]

The reason I would use tinyweb is that I have an impressive Tinyweb block in my app..
substitution with SQlite = a great work

That said, what about this?

@D_M

If you suggest to substitute TinyWEBDB with SQlite, how to create the web version of SQlite? Is it the same of local one?
And how to upload it in Google App Engine server

Any solution for IOS compatibility for apps with extensions?

[TIMAI2]

@D_M

Any solution for IOS compatibility for apps with extensions?

It is currently not possible to use extensions if targeting ios.

@D_M

how to create the web version of SQlite?

METRIC RAT AI2 - HOWTO: php SQLite3 with AI2

but probably easier to use mySQL or even Google Sheets.

[D_M]

Is in your opinion Google sheet faster than tinyweb db?
Using gsheet as database is a possibility...

[TIMAI2]

Firebase is faster...

[TIMAI2]

Here is a version that uses google sheets, all the hard work is done at the server end, so just the time taken to return the results.

GSheetCountriesCities.aia (27.0 KB)

You must ensure that all your sheet data is formatted to "Plain Text" for the gviz query to work.

Countries

Cities

[D_M]

TIMAI2 very thank you for time you spent for my question.
I have compared your apps (SQlitebased for local and Googlesheets for web) and probably SQlite is faster.
That said, I think that both apps are great!!!

My only question is whether it's a good idea to use Google Sheets for other web features of my app (no countries/cities) where I have sensitive user data.
I've read the limits of Google Sheets (300 read/write requests per minute, 10 million cells, 50,000 characters per cell).
If I'm within the limits and encrypt both the JSON credentials and the Spreadsheet ID, my questions are:

• From a data loss point of view, Can I trust Google Sheets?
• Is there a chance that malicious people could access my Google Sheets and steal sensitive data?
• Is TinywebDB slower than Google Sheets?

[TIMAI2]

@D_M

From a data loss point of view, Can I trust Google Sheets?

That is a $64000 question. Millions of users do. Depends what you mean by data loss? (see below)

@D_M

Is there a chance that malicious people could access my Google Sheets and steal sensitive data?

Nothing is unhackable. Data transfer between AI2 and Google Sheets will be encrypted by https.

@D_M

Is TinywebDB slower than Google Sheets?

Don't use tinywebdb for production

[D_M]

@TIMAI2

That is a $64000 question. Millions of users do. Depends what you mean by data loss? (see below)

I have read that when many users are using Google sheets for retrieve/write data, overwriting or errors in savind data are possible. It could be?

@TIMAI2

Don't use tinywebdb for production

Sorry. I mean "CUSTOM" TinyWebDB. Is your opinion the same also for "custom" TinyWebDB? What are disadvantages respect GoogleSheets?