[FREE] 🗄️BigDB - Advanced key-value storage with TTL, metadata, multi-table support, encryption, and more

sarthakdev.in · May 25, 2025, 9:12am

[FREE] BigDB

Advanced key-value storage with TTL, metadata, multi-table support, encryption and more.

Extension specifications


Package	`in.sarthakdev.bigdb`
Version	2.0
Price	Free
Category	Data
Updated	18 September 2026
Platforms	MIT App Inventor, Kodular, Niotron, Android Builder, Thunkable
Built using	FAST
Store	BigDB Extension - Data Extension for MIT App Inventor, Kodular, Niotron \| SarthakDev.in

About

Local SQLite-backed key-value store with tables, TTL, metadata, encryption, and async reads. Use a queryId on Get so the matching Got event is easy to bind.

Features

Multiple table support
Time-to-live (TTL) for automatic data expiration
Metadata and tagging system
Built-in encryption for sensitive data
Advanced query and filtering
Batch operations
Export and import functionality
Better performance than TinyDB

Events

Got

Fires when a value is retrieved

queryId (text) → Id you pass so the matching event can be told apart.
value (text)

Key List

Fires when a key list is returned

queryId (text) → Id you pass so the matching event can be told apart.
keys (any)

Data Changed

Fires when data changes in the current table

Error Occurred

Fires when an error occurs

message (text)

Random Key Retrieved

Fires when a random key is retrieved

queryId (text) → Id you pass so the matching event can be told apart.
key (text)

Expired Keys Retrieved

Fires when expired keys are retrieved

queryId (text) → Id you pass so the matching event can be told apart.
keys (any)

Table Size Retrieved

Fires when the table size is retrieved

queryId (text) → Id you pass so the matching event can be told apart.
size (number)

Methods

Enable Auto Cleanup

Enable or disable auto-cleanup of expired records at the specified interval (in seconds). Set interval to 0 to disable.

intervalSeconds (number)

Purge Expired

Purge expired keys from the current table

Set Password

Set database encryption password (PRAGMA key)

pwd (text)

Remove Password

Remove encryption (PRAGMA rekey to empty)

Is Encrypted

Check if database is encrypted

Returns boolean.

Store

Store a value for a key with optional TTL and metadata

key (text)
value (text)
useTTL (boolean)
ttlSeconds (number)
metadata (text)

Get

Get the value for a key asynchronously

key (text)
queryId (text) → Id you pass so the matching event can be told apart.

Delete

Delete a key

key (text)

Clear

Clear all data in the current table

Rename Key

Rename a key

oldKey (text)
newKey (text)

Bulk Store

Store multiple key-value pairs

keys (list)
values (list)

Bulk Delete

Delete multiple keys

keys (list)

Keys

List all keys in the current table asynchronously

queryId (text) → Id you pass so the matching event can be told apart.

Exists

Check if a key exists

Returns boolean.

key (text)

Get Record

Get full record as JSON asynchronously

key (text)
queryId (text) → Id you pass so the matching event can be told apart.

Find By Metadata

Find keys by metadata substring asynchronously

query (text)
queryId (text) → Id you pass so the matching event can be told apart.

Expire

Set expiry time in seconds for a key

key (text)
seconds (number)

Set Metadata

Set metadata for a key

key (text)
metadata (text)

Get Metadata

Get metadata for a key

Returns text.

key (text)

Get TTL

Get remaining TTL in seconds for a key (0 if none or expired)

Returns number.

key (text)

Get Random Key

Get a random key from the current table asynchronously

queryId (text) → Id you pass so the matching event can be told apart.

Get Expired Keys

Get all expired keys from the current table asynchronously

queryId (text) → Id you pass so the matching event can be told apart.

Set Bulk Expiry

Set the same TTL for multiple keys

keys (list)
seconds (number)

Copy Table

Copy the current table to a new table

targetTable (text)

Merge Tables

Merge records from source table into current table

sourceTable (text)
conflictStrategy (text)

Get Table Size

Get an estimated size of the current table asynchronously

queryId (text) → Id you pass so the matching event can be told apart.

Rename Table

Rename the current table

newName (text)

Delete Table

Delete a table

tableName (text)

Check Table Exists

Check if a table exists

Returns boolean.

tableName (text)

Delete Database

Delete all tables in the database

Export CSV

Export current table as CSV to the specified file path. If filePath is empty, uses the app's external files directory.

filePath (text) → Absolute path to the file on the device.

Import CSV

Import data into current table from CSV

filename (text)

Export JSON

Export current table as JSON string

Returns text.

Import JSON

Import data into current table from JSON

json (text)

Count

Get total record count in current table

Returns number.

DBSize

Get database file size in bytes

Returns number.

List Tables

List all tables in database

Returns any.

Watch

Watch changes to a key in the current table

key (text)
queryId (text) → Id you pass so the matching event can be told apart.

Unwatch

Stop watching changes to a key

key (text)
queryId (text) → Id you pass so the matching event can be told apart.

More blocks

Get the AIX

Download the AIX from the store, then import from Projects → Import extension.

Built by Sarthak Gupta · hi@sarthakdev.in · sarthakdev.in

Kevinkun · May 26, 2025, 3:53am

is this database locally or online?
if locally, why we need to watch the data change event? isn't it changed by yourself?

sarthakdev.in · May 26, 2025, 4:26am

This database works locally. The 'Data Changed' event is returned whenever Data is changed in the table. The data although changed automatically, the event comes really handy for showing notifiers etc.
The purpose of the extension is to address the limitations of TinyDB combined with the features of SQLite in native android development.

Bulk Store, Bulk Delete, Watching for changes to a key, TTL, Metadata, Encryption, Renaming Keys, Data Export / Import as Json, csv and endless utilities like DBSize, Clear are offered by BigDB

Kevinkun · May 26, 2025, 4:45am

why the data will change automatically?

sarthakdev.in · May 26, 2025, 5:04am

I was referring to the use of a block like BulkStore or BulkDelete. These blocks will change the database and then the DataChanged event will be returned.

ABG · May 26, 2025, 9:02am

Maybe to enforce relational integrity after the fact?

sarthakdev.in · May 26, 2025, 10:16am

BigDB has many features including indexing the database.

sarthakdev.in · May 26, 2025, 10:35am

Just clarifying, @Kevinkun asked about the Data Changed event and what was its need. I was trying to say that Data is changed as soon as an operation is used like Bulk store and the event is returned indicating the operation to be successful.

sarthakdev.in · May 31, 2025, 6:31am

6 likes so far! The extension is getting lots of love.
Thanks everyone!

Any features you want to see in the next version.
Drop them below!

Android_Creator · June 5, 2025, 9:08am

sarthakdev.in:

Store

Store_Method180×155 6.27 KB

Store a value for a key with optional TTL and metadata

Parameter Type

key text

value text

useTTL boolean

ttlSeconds number

metadata

How can I set the ttlseconds to infinite?

ABG · June 5, 2025, 9:51am

Blind guess... Set useTTL to false?
(Trying to figure out how to set my own TTL)

Android_Creator · June 5, 2025, 9:56am

Because TTL offers security, can I have it active and have infinite time?

sarthakdev.in · June 5, 2025, 10:13am

How to set the value of TTL for a key to infinite?

There are 3 possible methods.

Set useTTL to false.
Set useTTL to true and set the TTL to a very large num

Using the Expire Key method with a value less than or equal to 0.
First create a key following the second method then, use the Expire block with the key name and set the value of seconds to any -ve value or 0.

Extensions, Tutorials and Resources from Sarthak Gupta

.

Android_Creator · June 5, 2025, 10:27am

Okay then, but I wasn't sure if it was possible to have TTL and infinite time at the same time. Thanks!

sarthakdev.in · June 5, 2025, 10:30am

It's possible with method 3 using the expire key block. Welcome

sarthakdev.in · June 12, 2025, 4:40pm

BigDB v1.1 is here!

Version: 1.1
Release Date: Thursday, June 12, 2025
Time: 2025-06-12T16:27:00Z

Overview

This release supercharges BigDB with powerful new features designed to enhance its already robust key-value storage capabilities—TTL, metadata, multi-table support, encryption, export/import, and now:

Automatic Cleanup of Expired Records
Advanced Table & Key Utilities
Better Monitoring & Maintenance Tools

These updates make BigDB more versatile, efficient, and developer-friendly, perfect for App Inventor projects of all types!

New Features

Auto-Cleanup of Expired Records

Block: EnableAutoCleanup(int intervalSeconds)

Description:
Automatically purges expired records at a specified interval using their TTL values.

How It Works:

EnableAutoCleanup(300) → Clean every 5 minutes
EnableAutoCleanup(0) → Disable cleanup
Settings persist via SharedPreferences
Internally uses a Handler to schedule PurgeExpired

Use Case:
Auto-manage temp data like session tokens or cached results.

Event Triggered: DataChanged after every cleanup

How This Works:

A new DataFormat enum with dropdown support (json or csv) was introduced.
CSV generation and parsing is handled by helper functions (generateCSV, importFromCSVString).
Reuses logic from previous import/export blocks for compatibility and reliability.

New Utility Methods

`GetRandomKey(String queryId)`

→ Returns: Random non-expired key
→ Event: RandomKeyRetrieved(queryId, key)
Use Case: Random selection for quizzes/games

`GetExpiredKeys(String queryId)`

→ Returns: Array of expired keys
→ Event: ExpiredKeysRetrieved(queryId, keys[])
Use Case: Auditing stale records for cleanup

`SetBulkExpiry(YailList keys, int seconds)`

→ Sets TTL for multiple keys at once
→ Event: DataChanged
Uses transactions for atomicity
Use Case: Managing sessions or temporary keys in bulk

`CopyTable(String targetTable)`

→ Copies current table to a new one
→ Fails if table already exists
→ Event: DataChanged
Use Case: Backup/archive before data edits

`MergeTables(String sourceTable, String conflictStrategy)`

→ Merges one table into another
→ Event: DataChanged
Strategy:

"overwrite": Replace existing keys
"ignore": Skip if key exists
Use Case: Merging user data from different sources

`GetTableSize(String queryId)`

→ Estimates table size (bytes)
→ Event: TableSizeRetrieved(queryId, size)
Use Case: Alert users of large table size

`RenameTable(String newName)`

→ Renames current table
→ Fails if name exists
→ Event: DataChanged
Use Case: Reorganizing tables during app updates

`DeleteTable(String tableName)`

→ Deletes specified table
→ Switches to data_table if current is deleted
→ Event: DataChanged
Use Case: Removing obsolete data

`CheckTableExists(String tableName)`

→ Returns: true/false
Use Case: Validation before operations

`DeleteDatabase()`

→ Deletes all tables, recreates data_table
→ Event: DataChanged
Use Case: Reset during development/testing

Usage Instructions

Auto-Cleanup

Enable with EnableAutoCleanup(seconds)
Disable with EnableAutoCleanup(0)
Auto-persisted across sessions

Asynchronous Methods

GetRandomKey → RandomKeyRetrieved
GetExpiredKeys → ExpiredKeysRetrieved
GetTableSize → TableSizeRetrieved

Synchronous Methods

SetBulkExpiry, CopyTable, MergeTables, RenameTable, DeleteTable, CheckTableExists, DeleteDatabase
→ Fire DataChanged on success
→ Fire ErrorOccurred on failure

MergeTables Conflict Resolution

"overwrite" → Replace keys
"ignore" → Keep existing keys

Table Management

DeleteTable and DeleteDatabase ensure default data_table exists afterward

Additional Notes

No Breaking Changes – All updates are fully backward-compatible
Performance Optimized – Uses indices and transactions
Asynchronous Handling – Keeps UI responsive via AsyncTask
Robust Error Handling – Clear messages via ErrorOccurred
Zero Dependencies – Lightweight and self-contained

Download link is updated at the top.

Thank You!

Your support drives the growth of BigDB. These new features bring automation, efficiency, and control to your app's data management. I am excited to hear your feedback and keep improving!

Do check out my other extensions here at https://ai2.sarthakdev.in/

Peter · June 12, 2025, 4:50pm

You should update your first post with the new blocks and information.

sarthakdev.in · June 12, 2025, 4:52pm

Done

sarthakdev.in · June 13, 2025, 3:35pm

BigDB v1.2 is here!

Overview

This release supercharges BigDB with powerful new features designed to enhance its already robust key-value storage capabilities—TTL, metadata, multi-table support, encryption, export/import, and now:

Advanced Table & Key Utilities
Easier Data Maintainance

ExportToString_Get_Method
ExportToFile_Call_Method
ImportFromFile_Call_Method
ImportFromString_Call_Method

New Features

Added new blocks ImportFromFile and ExportToFile with dropdown for file types like json, csv and sqlite db.
Added new blocks ImportFromString and ExportToString with dropdown for file types like json and csv.

Bug Fixes

Manifest file permissions updated
Improved Performance on old devices

Deprecated
Old blocks for Json and csv import/export.

Download the extension directly from Github Releases tab!

Thank You!

Your support drives the growth of BigDB. These new features bring automation, efficiency, and control to your app's data management. I am excited to hear your feedback and keep improving!

Do check out my other extensions here at https://ai2.sarthakdev.in/

Taifun · June 13, 2025, 7:49pm

Please follow the naming conventions also for the helper blocks

JSON --> Json

Taifun