Aerospike Connect for Kafka - Outbound Release Notes
-
Release Date: May 5, 2022
Improvements
- [CONNECTOR-341] - Performance and stability improvements.
- [CONNECTOR-342] - Vulnerability scanning and dependency upgrades.
- [CONNECTOR-343] - Single installer for HTTP and XDR 5.0 wire protocol connector.
- [CONNECTOR-348] - Add support for only metadata, no-bins schemas in AvroMap and AvroRecord formats. The
no-bins
bin policy was introduced in Aerospike server version 6.0.0.0.
-
Release Date: February 4, 2022
New Features
- [CONNECTOR-319] - Add support to plugin custom code through the Custom transformer API.
- [CONNECTOR-321] - Add support for port-based configuration.
Improvements
- [CONNECTOR-320] - Support Java 17 runtime.
- [CONNECTOR-323] - Add a routing config to skip dispatching of records to the destination.
-
Release Date: May 24, 2021
- If you are using Aerospike Database Enterprise Edition version 5.6 or later, ensure that you use this version of the Kafka outbound connector or a later one.
- ATTENTION: HTTP connectors renamed from
aerospike-kafka-outbound-legacy
to aerospike-kafka-outbound-http
. Refer to documentation for installation and starting instructions.
- ATTENTION: Outbound format breaking changes.
- For Aerospike Server versions <= 4.9 that do not ship generation, expiry, and lut (last update time)
- these fields are omitted from the payload in Json, FlatJson, and Avro-Map format.
- these fields are shipped as
nil
in MessagePack format.
- these fields are shipped as
null
in Avro-Record and Kafka-Avro format.
- Last update time -
lut
has been upscaled to a Long from Int. Avro-Record and Kafka-Avro schemas specified in the config should change lut type from int
to long
.
- Deletes written with
AerospikeOutboundMetadata
schema instead of AerospikeOutboundDelete
schema in Kafka-Avro format.
New Features
- Prometheus integration support.
- Pre-packaged Grafana dashboards.
- PEM file format support in TLS configuration.
- Support for Boolean particle type introduced in Aerospike Server version 5.6.
- Official container image available on Docker Hub.
Bug Fixes
- Handling of new particle types introduced by the Aerospike Server not recognized by the connector.
- Possible incorrect handling of byte array and extension types in lists and maps in rare cases.
-
Release Date: September 11, 2020
- ATTENTION Upgrade to aerospike-kafka-outbound 4.0.0 or later when using Aerospike Server 5.6 or later.
- New Kafka Outbound Connector for Aerospike Server Enterprise Edition version 5.0 and above.
- Legacy support for versions of the Aerospike Server Enterprise Edition version 4.9 and below.
- If using Aerospike Server version 4.9 or below the Legacy connector must be used.
- WARNING: A serious flaw has been discovered for http v2 in the library used by Aerospike Server Enterprise Edition < 5.0 change notification.
http-version
MUST be set to v1
to prevent xdr and change notification from being blocked.
Improvements
- Bundle a default configuration file with the installation package.
Bug Fixes
- Fail to convert Aerospike record to MessagePack format when setname is missing.
Known Issues
- JDK-8 connector crashes when consuming records from Aerospike Server 5.6 or later.
- JDK-11 connector errors on every record consumed from Aerospike Server 5.6 or later.
-
Release Date: August 10, 2020
- ATTENTION Upgrade to aerospike-kafka-outbound 4.0.0 or later when using Aerospike Server 5.6 or later.
- New Kafka Outbound Connector for Aerospike Server Enterprise Edition version 5.0 and above.
- Legacy support for versions of the Aerospike Server Enterprise Edition version 4.9 and below.
- If using Aerospike Server version 4.9 or below the Legacy connector must be used.
- WARNING: A serious flaw has been discovered for http v2 in the library used by Aerospike Server Enterprise Edition < 5.0 change notification.
http-version
MUST be set to v1
to prevent xdr and change notification from being blocked.
Known Issues
- JDK-8 connector crashes when consuming records from Aerospike Server 5.6 or later.
- JDK-11 connector errors on every record consumed from Aerospike Server 5.6 or later.
-
Release Date: May 5, 2020
- ATTENTION Upgrade to aerospike-kafka-outbound 4.0.0 or later when using Aerospike Server 5.6 or later.
- HyperLogLog (HLL) bins are handled and forwarded as BLOBs.
- Fixed BLOB bin conversion for Flat JSON format.
Known Issues
- JDK-8 connector crashes when consuming records from Aerospike Server 5.6 or later.
- JDK-11 connector errors on every record consumed from Aerospike Server 5.6 or later.
-
Release Date: April 17, 2020
- ATTENTION Upgrade to aerospike-kafka-outbound 4.0.0 or later when using Aerospike Server 5.6 or later.
- Support for numeric map keys for JSON, Flat JSON and Avro.
- Fixed incorrect re-logging of parsing errors.
- Log key of the Aerospike record on parsing error.
- Added logging for the skipped records.
Known Issues
- JDK-8 connector crashes when consuming records from Aerospike Server 5.6 or later.
- JDK-11 connector errors on every record consumed from Aerospike Server 5.6 or later.
-
Release Date: March 13, 2020
- ATTENTION Upgrade to aerospike-kafka-outbound 4.0.0 or later when using Aerospike Server 5.6 or later.
- Support for Avro, Flat JSON, Kafka Avro (with schema registry) serialization.
- Support for configuring Aerospike record bin mapping.
- Support to specify bin-mapping, routing and format at set, namespace level.
Known Issues
- JDK-8 connector crashes when consuming records from Aerospike Server 5.6 or later.
- JDK-11 connector errors on every record consumed from Aerospike Server 5.6 or later.
-
Release Date: October 10, 2019
- ATTENTION Upgrade to aerospike-kafka-outbound 4.0.0 or later when using Aerospike Server 5.6 or later.
- Aerospike Kafka Connector (Outbound)
- No changes except version number bump.
- WARNING: A serious flaw has been discovered for http v2 in the library used by change notification.
http-version
MUST be set to v1
to prevent xdr and change notification from being blocked.
Known Issues
- JDK-8 connector crashes when consuming records from Aerospike Server 5.6 or later.
- JDK-11 connector errors on every record consumed from Aerospike Server 5.6 or later.
-
Release Date: May 22, 2019
- ATTENTION Upgrade to aerospike-kafka-outbound 4.0.0 or later when using Aerospike Server 5.6 or later.
- Outbound connector
- Removed feature key check.
- Fixed json conversion exceptions with record bins having empty lists and maps.
- WARNING: A serious flaw has been discovered for http v2 in the library used by change notification.
http-version
MUST be set to v1
to prevent xdr and change notification from being blocked.
Known Issues
- JDK-8 connector crashes when consuming records from Aerospike Server 5.6 or later.
- JDK-11 connector errors on every record consumed from Aerospike Server 5.6 or later.
-
Release Date: March 12, 2019
- ATTENTION Upgrade to aerospike-kafka-outbound 4.0.0 or later when using Aerospike Server 5.6 or later.
- Initial GA release
- WARNING: A serious flaw has been discovered for http v2 in the library used by change notification.
http-version
MUST be set to v1
to prevent xdr and change notification from being blocked.
Known Issues
- JDK-8 connector crashes when consuming records from Aerospike Server 5.6 or later.
- JDK-11 connector errors on every record consumed from Aerospike Server 5.6 or later.