Subject:
Schema Registry failures when using the Confluent Java client for Schema Registry and protobuf schemas.
Summary:
An update to the 3rd party C++ protobuf library resulted in stricter enforcement of the protobuf protocol. This caused protobufs containing maps and generated by the Confluent Java client for Schema Registry (or its derivatives) to fail getting decoded by Redpanda's Schema Registry.
Customers using the Java client for Schema Registry in conjunction with protobuf schemas containing maps should not install these versions and upgrade directly to 24.2.17 and 24.3.5.
Severity:
Medium
Redpanda Products Affected:
- Redpanda Dedicate Cloud
- Redpana BYOC
- Redpanda Self Hosted - Community
- Redpanda Self Hosted - Enterprise
Release Affected:
Redpanda 24.2.16, 24.3.3, and 24.3.4
Identification:
You can identify if you are impacted by checking your Redpanda version against the affected versions above, and confirm if you are using the Confluent Java client for Schema Registry (or it's derivatives) with the Redpanda Schema Registry
If on an impacted version and are experiencing issues, you can check your Redpanda logs for the following error or similar errors.
Failed to decode schema <schema subject name>: error: line: '-1', col: '0', msg: 'map_entry should not be set explicitly. Use map<KeyType, ValueType> instead.'
Impact:
This issue could cause failures to decode schemas, potentially leading to issues producing and consuming.
Action required:
Redpanda Cloud
Redpanda BYOC and Dedicated cloud customers will automatically have their impacted clusters upgraded to Redpanda Versions 24.2.17 and 24.3.5.
Any cloud cluster not on an impacted version has had its upgrade plan proactively paused until the fixed versions are released.
Redpanda Self Hosted
Self Hosted customers on an impacted version and using Confluent Java client for Schema Registry (or its derivatives) should upgrade to 24.2.17 or 24.3.5 immediately.
Self Hosted customers not on an impacted version should avoid upgrading to 24.2.16, 24.3.3, or 24.3.4 and should upgrade to 24.2.17 or 24.3.5 directly.
For customers not using the Java client for Schema Registry or Schema Registry, but on the impacted versions, we recommend you stay up to date on the latest version.
Questions? If you have any questions on this TSB, or need further guidance, please contact support@redpanda.com