Use case: A handful of quality indicators or data points (floats, doubles) along with a timestamp, an index integer [1 …N] and one or two foreign key values need to be stored as they happen, and then plotted in real time in a web application (PHP) for users to evaluate. There can be bursts of thousands of quality indicators per second.
In a programming language, this sort of data would probably be stored in arrays or lists. As I’m not aware of anything similar in the MariaDB / MySQL world (except maybe geometry/spatial types?) I’m just using a regular InnoDB table with a column for each of the values mentioned above. This has already 90+ million rows and is expected to grow faster in the coming months.
Does e.g. the TokuDB or MyRocks storage engines offer any advantages overall? Or is there another solution I should consider? How about archiving and/or compression? Would it help to separate real-time and historic data?
