kotlin dataframe Archives

DEbrief

001. MQs, storages, and dataframes

00:00 / 38:01

Apache Geode 1.12.5
- enterprise edition is known as gemfire
- geodistributed storage
- has native clients in Java, C#, and C++ (!)
- JTA compliant transaction support
Pinot released 0.9.0
- Added Segment Merge and Rollup
  - Rollup is a technique for tree-like groupby
    example: city, streets, houses
- General info about pinot
  - Made by guys from LinkedIn and Uber
    has zookeeper as deps
  - column-oriented database
  - It’s an OLAP tool for real-time analytics
    - there are BI tools focused on dashboards and reports
      used by analists etc
    - this is more for data exploration
      for de / ds folks
    - Near real-time ingestion from streams (Kafka, Kinesis, and batch ingestion from Hadoop/S3 and the likes)
  - It has built-in UI for SQL edits and general BI for exploration
    focus on realtime analytics
  - You can connect Pinot to various BI tools such Superset, Tableau, or PowerBI to visualize data in Pinot
RocketMq 4.9.0 / 4.9.2 Comparison Table
- Based on ActiveMQ
- Does not need ZooKeeper
- Has conecept of strict message order
- Has focus on perfect configuration OOTB
- Rich web interface
SQLite 3.37
- new STRICT table definition and ANY type
  works as cast on write
- cli client update:
  - multiple connections from the same client
  - security mode with `-safe`
- author is well-known as a supporter of flexible typing, have a read https://sqlite.org/flextypegood.html

Superset 1.3.2
- bugfixes
- if you never saw what’s 1.3.0 has to offer, check it out: they have funnels
- also revised treemap viz
Beam 2.34.0
NiFi new release (1.15.0)
- main feature is parameter context inheritance
Apache Ratis release
- Raft
Airflow 2.2.2
- bugfixes 🤷‍♀️
Nats 2.6.5 recent release
- bugfixes

Tag: kotlin dataframe