Aerospike Connect for Kafka - Outbound Release Notes

  • 5.0.0
    Release Date: May 5, 2022

    Improvements

    • [CONNECTOR-341] - Performance and stability improvements.
    • [CONNECTOR-342] - Vulnerability scanning and dependency upgrades.
    • [CONNECTOR-343] - Single installer for HTTP and XDR 5.0 wire protocol connector.
    • [CONNECTOR-348] - Add support for only metadata, no-bins schemas in AvroMap and AvroRecord formats. The no-bins bin policy was introduced in Aerospike server version 6.0.0.0.

  • 4.1.0
    Release Date: February 4, 2022

    New Features

    • [CONNECTOR-319] - Add support to plugin custom code through the Custom transformer API.
    • [CONNECTOR-321] - Add support for port-based configuration.

    Improvements

    • [CONNECTOR-320] - Support Java 17 runtime.
    • [CONNECTOR-323] - Add a routing config to skip dispatching of records to the destination.

  • 4.0.0
    Release Date: May 24, 2021
    • If you are using Aerospike Database Enterprise Edition version 5.6 or later, ensure that you use this version of the Kafka outbound connector or a later one.
    • ATTENTION: HTTP connectors renamed from aerospike-kafka-outbound-legacy to aerospike-kafka-outbound-http. Refer to documentation for installation and starting instructions.
    • ATTENTION: Outbound format breaking changes.
      • For Aerospike Server versions <= 4.9 that do not ship generation, expiry, and lut (last update time)
        • these fields are omitted from the payload in Json, FlatJson, and Avro-Map format.
        • these fields are shipped as nil in MessagePack format.
        • these fields are shipped as null in Avro-Record and Kafka-Avro format.
      • Last update time - lut has been upscaled to a Long from Int. Avro-Record and Kafka-Avro schemas specified in the config should change lut type from int to long.
      • Deletes written with AerospikeOutboundMetadata schema instead of AerospikeOutboundDelete schema in Kafka-Avro format.

    New Features

    • Prometheus integration support.
    • Pre-packaged Grafana dashboards.
    • PEM file format support in TLS configuration.
    • Support for Boolean particle type introduced in Aerospike Server version 5.6.
    • Official container image available on Docker Hub.

    Bug Fixes

    • Handling of new particle types introduced by the Aerospike Server not recognized by the connector.
    • Possible incorrect handling of byte array and extension types in lists and maps in rare cases.

  • 3.0.1
    Release Date: September 11, 2020
    • ATTENTION Upgrade to aerospike-kafka-outbound 4.0.0 or later when using Aerospike Server 5.6 or later.
    • New Kafka Outbound Connector for Aerospike Server Enterprise Edition version 5.0 and above.
    • Legacy support for versions of the Aerospike Server Enterprise Edition version 4.9 and below.
      • If using Aerospike Server version 4.9 or below the Legacy connector must be used.
      • WARNING: A serious flaw has been discovered for http v2 in the library used by Aerospike Server Enterprise Edition < 5.0 change notification. http-version MUST be set to v1 to prevent xdr and change notification from being blocked.

    Improvements

    • Bundle a default configuration file with the installation package.

    Bug Fixes

    • Fail to convert Aerospike record to MessagePack format when setname is missing.

    Known Issues

    • JDK-8 connector crashes when consuming records from Aerospike Server 5.6 or later.
    • JDK-11 connector errors on every record consumed from Aerospike Server 5.6 or later.

  • 3.0.0
    Release Date: August 10, 2020
    • ATTENTION Upgrade to aerospike-kafka-outbound 4.0.0 or later when using Aerospike Server 5.6 or later.
    • New Kafka Outbound Connector for Aerospike Server Enterprise Edition version 5.0 and above.
    • Legacy support for versions of the Aerospike Server Enterprise Edition version 4.9 and below.
      • If using Aerospike Server version 4.9 or below the Legacy connector must be used.
      • WARNING: A serious flaw has been discovered for http v2 in the library used by Aerospike Server Enterprise Edition < 5.0 change notification. http-version MUST be set to v1 to prevent xdr and change notification from being blocked.

    Known Issues

    • JDK-8 connector crashes when consuming records from Aerospike Server 5.6 or later.
    • JDK-11 connector errors on every record consumed from Aerospike Server 5.6 or later.

  • 2.0.2
    Release Date: May 5, 2020
    • ATTENTION Upgrade to aerospike-kafka-outbound 4.0.0 or later when using Aerospike Server 5.6 or later.
    • HyperLogLog (HLL) bins are handled and forwarded as BLOBs.
    • Fixed BLOB bin conversion for Flat JSON format.

    Known Issues

    • JDK-8 connector crashes when consuming records from Aerospike Server 5.6 or later.
    • JDK-11 connector errors on every record consumed from Aerospike Server 5.6 or later.

  • 2.0.1
    Release Date: April 17, 2020
    • ATTENTION Upgrade to aerospike-kafka-outbound 4.0.0 or later when using Aerospike Server 5.6 or later.
    • Support for numeric map keys for JSON, Flat JSON and Avro.
    • Fixed incorrect re-logging of parsing errors.
    • Log key of the Aerospike record on parsing error.
    • Added logging for the skipped records.

    Known Issues

    • JDK-8 connector crashes when consuming records from Aerospike Server 5.6 or later.
    • JDK-11 connector errors on every record consumed from Aerospike Server 5.6 or later.

  • 2.0.0
    Release Date: March 13, 2020
    • ATTENTION Upgrade to aerospike-kafka-outbound 4.0.0 or later when using Aerospike Server 5.6 or later.
    • Support for Avro, Flat JSON, Kafka Avro (with schema registry) serialization.
    • Support for configuring Aerospike record bin mapping.
    • Support to specify bin-mapping, routing and format at set, namespace level.

    Known Issues

    • JDK-8 connector crashes when consuming records from Aerospike Server 5.6 or later.
    • JDK-11 connector errors on every record consumed from Aerospike Server 5.6 or later.

  • 1.0.2
    Release Date: October 10, 2019
    • ATTENTION Upgrade to aerospike-kafka-outbound 4.0.0 or later when using Aerospike Server 5.6 or later.
    • Aerospike Kafka Connector (Outbound)
      • No changes except version number bump.
      • WARNING: A serious flaw has been discovered for http v2 in the library used by change notification. http-version MUST be set to v1 to prevent xdr and change notification from being blocked.

    Known Issues

    • JDK-8 connector crashes when consuming records from Aerospike Server 5.6 or later.
    • JDK-11 connector errors on every record consumed from Aerospike Server 5.6 or later.

  • 1.0.1
    Release Date: May 22, 2019
    • ATTENTION Upgrade to aerospike-kafka-outbound 4.0.0 or later when using Aerospike Server 5.6 or later.
    • Outbound connector
      • Removed feature key check.
      • Fixed json conversion exceptions with record bins having empty lists and maps.
      • WARNING: A serious flaw has been discovered for http v2 in the library used by change notification. http-version MUST be set to v1 to prevent xdr and change notification from being blocked.

    Known Issues

    • JDK-8 connector crashes when consuming records from Aerospike Server 5.6 or later.
    • JDK-11 connector errors on every record consumed from Aerospike Server 5.6 or later.

  • 1.0.0
    Release Date: March 12, 2019
    • ATTENTION Upgrade to aerospike-kafka-outbound 4.0.0 or later when using Aerospike Server 5.6 or later.
    • Initial GA release
    • WARNING: A serious flaw has been discovered for http v2 in the library used by change notification. http-version MUST be set to v1 to prevent xdr and change notification from being blocked.

    Known Issues

    • JDK-8 connector crashes when consuming records from Aerospike Server 5.6 or later.
    • JDK-11 connector errors on every record consumed from Aerospike Server 5.6 or later.