Join us for a virtual meetup on Zoom at 8 PM, July 31 (PDT) about using One Time Series Database for Both Metrics and Logs 👉🏻 Register Now

Skip to content
On this page
Biweekly
April 30, 2025

5,000 Stars Milestone 🤩 Otel-Arrow Support & Flow Batching Now Live | Greptime Biweekly Report

Updates to GreptimeDB over the past two weeks include the implementation of the Otel-arrow protocol for GreptimeDB, a new Batching mode for Flow, and a new Pipeline processor for parsing JSON strings.

Summary

Together with our global community of contributors, GreptimeDB continues to evolve and flourish as a growing open-source project. We are grateful to each and every one of you.

Below are the highlights among recent commits:

  • Implements the otel-arrow protocol for GreptimeDB.
  • Adds a new Batching Mode for Flow.
  • Adds a new JSON parse processor in the pipeline.
(Figure 1: The Milestone of GreptimeDB-5,000 Stars)
(Figure 1: The Milestone of GreptimeDB-5,000 Stars)

Contributors

For the past two weeks, our community has been super active with a total of 133 PRs merged. 3 PRs from 2 individual contributors merged successfully and lots pending to be merged.

Congrats on becoming our most active contributors in the past 2 weeks:

🎉 A big THANK YOU to all our members and contributors! It is people like you who are making GreptimeDB a great product. Let's build an even greater community together.

Highlights of Recent PRs

db#5819 Adds a new HTTP API for querying the pipeline

Introduces a new API: /v1/events/pipelines/{pipeline_name} to retrieve pipeline information by name. Docs. For more details, please refer to this document here.

db#5836 Implements Arrow Flight DoPut method

Enables high-throughput ingestion via Arrow Flight’s DoPut. Arrow Flight is a gRPC-based RPC protocol for efficient data transfer using the Arrow format.

db#5840 Implements the otel-arrow protocol for GreptimeDB

Otel-arrow is the protocol for sending and receiving OpenTelemetry data using Apache Arrow. In this PR, we implement the support for it in GreptimeDB. With otel-arrow, it could be very convenient for GreptimeDB to load large volume of OpenTelemetry data.

db#5903 Adds a new Batching Mode for Flow

This PR adds a new batching mode for Flow. In batching mode, Flow can periodically process and flush data to utilize maximum ingestion volume. It's suitable for large-scale aggregation, reporting, or scheduled jobs with smoother resource consumption.

db#5910 Adds a new JSON parse processor in the pipeline

This PR adds a new processor for parsing JSON strings: json_parse. More details here.

For example, given the following log data:

json
{
  "product_object": "{\"hello\":\"world\"}",
}

Using the following configuration:

yaml
processors:
  - json_parse:
      fields:
        - product_object

The result will be:

json
{
  "product_object": {
    "hello": "world"
  }
}

Good First Issue

Issue#5899 Support the kill statement

kill statements can be useful for stopping an undesired long-run query.

Difficulty: Medium

Keywords: SQL


About Greptime

GreptimeDB is an open-source, cloud-native database purpose-built for real-time observability. Built in Rust and optimized for cloud-native environments, it provides unified storage and processing for metrics, logs, and traces—delivering sub-second insights from edge to cloud —at any scale.

  • GreptimeDB OSS – The open-sourced database for small to medium-scale observability and IoT use cases, ideal for personal projects or dev/test environments.

  • GreptimeDB Enterprise – A robust observability database with enhanced security, high availability, and enterprise-grade support.

  • GreptimeCloud – A fully managed, serverless DBaaS with elastic scaling and zero operational overhead. Built for teams that need speed, flexibility, and ease of use out of the box.

🚀 We’re open to contributors—get started with issues labeled good first issue and connect with our community.

GitHub | 🌐 Website | 📚 Docs

💬 Slack | 🐦 Twitter | 💼 LinkedIn

Join our community

Get the latest updates and discuss with other users.