Skip to content
On this page
Biweekly
September 3, 2025

Sparse Primary Key Encoding Performance Boosted by 235%, Flat Format in Progress, Custom Headers for OTLP | Greptime Biweekly Report

Sparse Primary Key Encoding Performance Boosted by 235%, Flat Format in Progress, Custom Headers for OTLP | Greptime Biweekly Report
Recent updates in GreptimeDB over the past two weeks include continuous improvements on Flat Format, distributed query optimization, OTLP reporting with custom header support, and a 235% performance boost in sparse primary key encoding.

Summary โ€‹

Together with our global community of contributors, GreptimeDB continues to evolve and flourish as a growing open-source project. We are grateful to each and every one of you.

Below are the highlights among recent commits:

  • Flat Format moves forward with range scan and write-path work
  • Distributed query optimization: prune irrelevant Regions at the planning stage
  • OTLP ingestion supports custom headers
  • Sparse primary key encoding is up to 235% faster

Contributors โ€‹

For the past two weeks, our community has been super active with a total of 122 PRs merged. 7 PRs from 7 individual contributors merged successfully and lots pending to be merged.

Congrats on becoming our most active contributors in the past 2 weeks:

๐ŸŽ‰ Welcome @aaraujo and @WaterWhisperer to the community as a new contributor with a successfully merged PR, and more PRs from other individual contributors are waiting to be merged.

๏ผˆFigure 1: New Contributors of GreptimeDB๏ผ‰
๏ผˆFigure 1: New Contributors of GreptimeDB๏ผ‰

๐Ÿ‘ A big THANK YOU to all our members and contributors! It is people like you who are making GreptimeDB a great product. Let's build an even greater community together.

Highlights of Recent PRs โ€‹

db#6505 High-cardinality-optimized Flat Format (ongoing) โ€‹

Progress has been made across multiple PRs to push Flat Format forward: RecordBatch adaptation(db#6771, db#6786), range-scan functions(db#6817), and write-path integration(db#6866).

db#6752 Prune Regions by logical plan predicate โ€‹

Regions that cannot satisfy the query predicate are skipped up front, reducing unnecessary scans and improving latency.

db#6777 Persist Metasrv internal metrics to internal tables โ€‹

Makes critical cluster internals queryable via SQL for better monitoring and troubleshooting.

db#6773 Configurable headers for OTLP ingestion โ€‹

Allows attaching custom headers when reporting metrics via OTLP to align with deployment requirements.

sql
## Additional OTLP headers, only valid when using OTLP http
[logging.otlp_headers]
Authorization = "Bearer my-token"
Database = "My database"

db#6809 235% faster sparse primary key encoding โ€‹

Substantial optimization of the sparse primary-key encoding path, reducing CPU overhead.

db#6816 Remote WAL replay checkpoints โ€‹

Introduces replay checkpoints to bound startup replays, accelerating Datanode restarts in worst-case scenarios.

db#6764 Support to specify schema for Postgres KV backend โ€‹

Adds a configuration option to choose the schema used by the Postgres KV backend.

Good First Issue โ€‹

Issue#6760 Add profile signal configuration for OLTP protocols โ€‹

Keywords: OLTP, Profiling

Difficulty: Simple

Stay in the loop

Join our community