Android Question Best way to store time-series

[Blueforcer]

What is the best way to store and read massive volumes of time-stamped data produced by sensors?
It needs to be locally. As i know SQLlite is not that good for parallel reading and writing.
Is there a better solution?

 

[Sandman]

RRDtool might be an inspiration, perhaps. I don't know if it's available for Android, sorry.

RRDtool - Wikipedia

en.wikipedia.org

 

[MikeSW17]

RRDtool might be an inspiration, perhaps. I don't know if it's available for Android, sorry.

There seems to be a java version: https://github.com/rrd4j/rrd4j
Could be others, there are 73 github repositories referencing "#RRDTool" https://github.com/topics/rrdtool

*EDIT*
Actually there a 9 java RDDTool offerings: https://github.com/search?l=Java&q=rrdtool&type=Repositories

 

[Erel]

As i know SQLlite is not that good for parallel reading and writing.

What does it mean? Only your app will access the database.

 

[Blueforcer]

What does it mean? Only your app will access the database.

Sorry, i mean simultaneous access.

Just found your post, will this help to manage my project?
[WebApp] Concurrent access to SQLite databases | B4X Programming Forum

 

[thetahsk]

..

This is a typical task for a Time Series Database (TSDB), such as InfluxDB.
In combination with Telegraf and Grafana, the data from the sensor is collected and visualised.

GitHub - influxdata/telegraf: Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.

Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data. - influxdata/telegraf

github.com

Grafana

play.grafana.org

Very easy installation on an Rasberry and there is also an InfluxDB client for Arduino

GitHub - tobiasschuerg/InfluxDB-Client-for-Arduino: Simple library for sending measurements to an InfluxDB with a single network request. Supports ESP8266 and ESP32.

Simple library for sending measurements to an InfluxDB with a single network request. Supports ESP8266 and ESP32. - tobiasschuerg/InfluxDB-Client-for-Arduino

github.com

See for more information in this german tutorial.

Sensordatenbank auf dem Raspberry Pi - reichelt Magazin

Jeder, der über eine längere Zeit Sensordaten aufnehmen möchte, steht unweigerlich vor einem Problem: Wie können die gesammelten Daten gespeichert und

www.reichelt.de

 

[Erel]

Just found your post, will this help to manage my project?
[WebApp] Concurrent access to SQLite databases | B4X Programming Forum

This is relevant for server solutions where multiple threads will access the database at once.

It is not relevant for B4A apps.
You don't need to do anything special. Do you use the async methods and make sure that your database is designed efficiently.

It is impossible to say whether it will be fast or not for your requirements. You need to do some tests.

 

[Blueforcer]

But out of the box there is no better solution i should try first?

 

[Blueforcer]

This is a typical task for a Time Series Database (TSDB), such as InfluxDB.
In combination with Telegraf and Grafana, the data from the sensor is collected and visualised.

GitHub - influxdata/telegraf: Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.

Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data. - influxdata/telegraf

github.com

Grafana

play.grafana.org

Very easy installation on an Rasberry and there is also an InfluxDB client for Arduino

GitHub - tobiasschuerg/InfluxDB-Client-for-Arduino: Simple library for sending measurements to an InfluxDB with a single network request. Supports ESP8266 and ESP32.

Simple library for sending measurements to an InfluxDB with a single network request. Supports ESP8266 and ESP32. - tobiasschuerg/InfluxDB-Client-for-Arduino

github.com

See for more information in this german tutorial.

Sensordatenbank auf dem Raspberry Pi - reichelt Magazin

Jeder, der über eine längere Zeit Sensordaten aufnehmen möchte, steht unweigerlich vor einem Problem: Wie können die gesammelten Daten gespeichert und

www.reichelt.de

Yes, im using InfluxDB for another project. But this time it needs to be locally on the device itself. And there is no influxDB server for android.

 

[Sandman]

How about you describe your upcoming project a little more, with focus on the data flowing back and forth?