I'm working on an open source project - OctoSQL[1] - which allows you to query and join data from different datasources using SQL.
Be it MySQL, PostgreSQL, JSON, CSV or Excel.
It's now also being my Bachelor thesis.
Recently we've been working hard on getting event time supporting exactly-once streaming into OctoSQL. Which means we currently (on the streaming branch) support Kafka as a datasource. Run using on-disk state (which allows grouping big datasets and is still blazingly fast thanks to Badger which we use as our underlying storage).
Obviously with streaming SQL extensions, which allow you to view partial results even with standard datasources. We use a dataflow-like retraction model for that.
We should have a big release out soon, so stay tuned!
Be it MySQL, PostgreSQL, JSON, CSV or Excel.
It's now also being my Bachelor thesis.
Recently we've been working hard on getting event time supporting exactly-once streaming into OctoSQL. Which means we currently (on the streaming branch) support Kafka as a datasource. Run using on-disk state (which allows grouping big datasets and is still blazingly fast thanks to Badger which we use as our underlying storage).
Obviously with streaming SQL extensions, which allow you to view partial results even with standard datasources. We use a dataflow-like retraction model for that.
We should have a big release out soon, so stay tuned!
[1]:https://github.com/cube2222/octosql