When upgrading LTS from 2021 to 2023 we can encounter some Avro errors because schemas are missing:
WARN Fingerprint: 928262057085755687 not found, no schema matching *-0xCE1D96C3B11E127.avsc
ERROR Computation: bulk/indexCompletion fails last record: bulk-done-00:+1226791, after retries.
org.apache.avro.message.MissingSchemaException: Cannot resolve schema for fingerprint: 928262057085755687
at org.apache.avro.message.BinaryMessageDecoder.getDecoder(BinaryMessageDecoder.java:142) ~[avro-1.11.3.jar:1.11.3]
at org.apache.avro.message.BinaryMessageDecoder.decode(BinaryMessageDecoder.java:160) ~[avro-1.11.3.jar:1.11.3]
at org.apache.avro.message.MessageDecoder$BaseDecoder.decode(MessageDecoder.java:148) ~[avro-1.11.3.jar:1.11.3]
at org.nuxeo.lib.stream.codec.AvroMessageCodec.decode(AvroMessageCodec.java:78) ~[nuxeo-stream-2023.5.17.jar:?]
at org.nuxeo.elasticsearch.bulk.IndexCompletionComputation.processRecord(IndexCompletionComputation.java:62) ~[nuxeo-elasticsearch-core-2023.5.17.jar:?]
at
...
In the above case this is the BulkStatus schema put in 2021.38 that is not present in the 2023 distribution.
We need to make sure that all 2021 avro schemas are present in 2023 to avoid such errors.
- is related to
-
NXP-32492 Record Codec on Internal streams are not backward compatible
- Resolved