docs: 26.2 What's New entries for shipped features (DOC-2395) - #1828
docs: 26.2 What's New entries for shipped features (DOC-2395)#1828Feediver1 wants to merge 3 commits into
Conversation
Adds entries for Cloud Topics enabled by default, shadow link role synchronization, Confluent Schema Registry migration via Shadowing, fetch read coalescing, and per-entity client quota metrics. Co-Authored-By: Claude Fable 5 <[email protected]>
✅ Deploy Preview for redpanda-docs-preview ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
|
Important Review skippedAuto reviews are disabled on base/target branches other than the default branch. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Organization UI Review profile: CHILL Plan: Pro Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Comment |
| * xref:cloud-data-platform:get-started:cloud-overview.adoc#redpanda-cloud-vs-self-managed-feature-compatibility[Redpanda Cloud vs Self-Managed feature compatibility] | ||
|
|
||
|
|
||
| == Cloud Topics enabled by default |
There was a problem hiding this comment.
@Feediver1 we're missing some stuff:
Unfinalized Upgrades (self-managed only)
Iceberg Key/Header translation
Iceberg Topics support for Schema Contexts
Enhanced cluster health summary
New 'load factor' metrics
Some of that's in here
https://github.com/redpanda-data/cupboard/tree/main/engineering/core/toi/v26.2
Ignore the Cloud Topics scale stuff since we don't publicize scale limits.
@Feediver1 of the ones you have, I'd put them in this order.
== Shadowing: migrate schemas from Confluent Schema Registry
== Shadowing: role synchronization
== Kafka 4.x client compatibility
== Fetch read coalescing
== Per-entity client quota metrics
== Cloud Topics enabled by default
There was a problem hiding this comment.
Iceberg Key/Header translation
Iceberg Topics support for Schema Contexts
^^ Will arrive in @kbatuigas' PRs for those updates. My goal here was just to capture the entries for the new features I added.
|
|
||
| == Cloud Topics enabled by default | ||
|
|
||
| Cloud Topics no longer require a separate cluster property. When cloud storage is enabled for your cluster (xref:reference:properties/object-storage-properties.adoc#cloud_storage_enabled[`cloud_storage_enabled`] set to `true`), you can create Cloud Topics directly. The `cloud_topics_enabled` cluster property is deprecated. |
There was a problem hiding this comment.
"you can create Cloud Topics immediately by setting the storage mode during topic creation"
|
|
||
| == Shadowing: role synchronization | ||
|
|
||
| Shadow links can now replicate RBAC roles from the source cluster to the shadow cluster, alongside topics, ACLs, consumer group offsets, and Schema Registry data. Configure role filters to select which roles to sync, so authorization is already in place on the shadow cluster when you fail over. |
There was a problem hiding this comment.
"Shadow links can now replicate cluster roles from the source cluster to the shadow cluster, alongside topics, ACLs, consumer group offsets, and Schema Registry data. This ensures equivalent RBAC is in place on the shadow cluster prior to failover. Configure role filters to select which roles to sync.
(we call them 'cluster roles' in Cloud to to clarify in the Cloud context these roles apply to things within a single cluster, so might as well stick to that term for the noun)
| == Shadowing: migrate schemas from Confluent Schema Registry | ||
|
|
||
| Shadowing can now replicate schemas over the Schema Registry HTTP API, including from a Confluent Schema Registry. A shadow link continuously replicates subjects, versions, and compatibility settings into the shadow cluster's Schema Registry, so your applications keep working after cutover without a separate schema migration step. You can also replicate only selected contexts or subjects, and map source contexts to different destination contexts. | ||
|
|
There was a problem hiding this comment.
@Feediver1
Let's add "Both Confluent Cloud and Confluent Platform are supported"
|
|
||
| == Fetch read coalescing | ||
|
|
||
| When many consumers fetch the same partitions, each broker repeats the same read work for every consumer. Fetch read coalescing merges these redundant reads on each shard, reducing read CPU and fetch-response memory under high consumer fan-out. This Enterprise feature is disabled by default: enable it with the `kafka_fetch_read_coalescing_enabled` cluster property. |
There was a problem hiding this comment.
^^ Not sure where this applies @mattschumpert ? Do you want the heading revised here on line 30? Seems unrelated.
|
|
||
| == Kafka 4.x client compatibility | ||
|
|
||
| Redpanda version 26.2 validates a broader set of non-Java Apache Kafka® clients at their current versions that support Kafka 4.x, in addition to the Apache Kafka Java client. Newly validated clients include `confluent-kafka-go` and Sarama for Go, and `kafka-python` and `confluent-kafka-python` for Python. Validation confirms connectivity and correctness across core Kafka APIs, such as produce, consume, and transaction operations. |
There was a problem hiding this comment.
kafka-python was already supported (for a long time), though the current docs say 'kafka-python-ng'. can you advise @nguyen-andrew ?
|
|
||
| == Per-entity client quota metrics | ||
|
|
||
| Aggregate quota metrics can confirm that throttling is happening, but not which client is throttled. Redpanda can now label throttle-time and throughput metrics with the identity of the throttled entity, so you can identify throttled clients by name and right-size quota values based on observed use. These metrics are disabled by default: enable them with the `kafka_per_entity_quota_metrics` cluster property. |
There was a problem hiding this comment.
"Aggregate quota metrics can confirm that throttling is happening at a broker level, but don't reveal which user, client, or group of clients is utilizing a quota, and/or being throttled. Redpanda can now label throttle-time and throughput metrics with the identity of the throttled entity, so you can identify throttled users and clients by name and right-size quota values based on observed use. These metrics are disabled by default: enable them with the kafka_per_entity_quota_metrics cluster property.
(you may also want to update this language in the feature docs page @Feediver1 )
There was a problem hiding this comment.
Same for this one @mattschumpert --which feature does this apply to? It's right after the Shadowing: role synchronization heading, but refers to metrics.
There was a problem hiding this comment.
Ah--so it looks like it applies to == Per-entity client quota metrics below, on line 54. Right?
Order the DOC-2395 entries as requested: Shadowing (Confluent SR migration, role sync) ahead of Kafka 4.x, then fetch read coalescing, per-entity quota metrics, and Cloud Topics enabled by default. Beta's surrounding entries (Iceberg, cluster health, Tiered Storage v2, new configuration properties) keep their positions. Co-Authored-By: Claude Fable 5 <[email protected]>
|
Updated in
Beta's surrounding entries keep their positions: the Iceberg pair and cluster health metrics lead the page, Tiered Storage v2 (#1813) and the new-configuration-properties section close it. 🤖 Generated with Claude Code |
kbatuigas
left a comment
There was a problem hiding this comment.
No blockers, but please double check if this needs a fresh rebase on beta!
Resolves https://redpandadata.atlassian.net/browse/DOC-2395
Adds five 26.2 entries to What's New in Redpanda (
get-started/release-notes/redpanda.adoc) for features whose docs have already merged tobetawithout an entry:cloud_storage_enabled;cloud_topics_enableddeprecated.kafka_fetch_read_coalescing_enabled.kafka_per_entity_quota_metrics; links to the Track quota use per entity section.The existing Kafka 4.x client compatibility entry is unchanged and stays last.
Review notes
beta(#role-filtering,#track-quota-use-per-entity,#cloud_storage_enabled).🤖 Generated with Claude Code
Preview pages