Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-32491

Add all missing Avro schemas from 2021 in 2023

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2023.11
    • Component/s: Streams

      Description

      When upgrading LTS from 2021 to 2023 we can encounter some Avro errors because schemas are missing:

      WARN Fingerprint: 928262057085755687 not found, no schema matching *-0xCE1D96C3B11E127.avsc
      
      ERROR Computation: bulk/indexCompletion fails last record: bulk-done-00:+1226791, after retries.
      
      org.apache.avro.message.MissingSchemaException: Cannot resolve schema for fingerprint: 928262057085755687
      	at org.apache.avro.message.BinaryMessageDecoder.getDecoder(BinaryMessageDecoder.java:142) ~[avro-1.11.3.jar:1.11.3]
      	at org.apache.avro.message.BinaryMessageDecoder.decode(BinaryMessageDecoder.java:160) ~[avro-1.11.3.jar:1.11.3]
      	at org.apache.avro.message.MessageDecoder$BaseDecoder.decode(MessageDecoder.java:148) ~[avro-1.11.3.jar:1.11.3]
      	at org.nuxeo.lib.stream.codec.AvroMessageCodec.decode(AvroMessageCodec.java:78) ~[nuxeo-stream-2023.5.17.jar:?]
      	at org.nuxeo.elasticsearch.bulk.IndexCompletionComputation.processRecord(IndexCompletionComputation.java:62) ~[nuxeo-elasticsearch-core-2023.5.17.jar:?]
      	at 
      
      ...
      

      In the above case this is the BulkStatus schema put in 2021.38 that is not present in the 2023 distribution.

      We need to make sure that all 2021 avro schemas are present in 2023 to avoid such errors.

        Attachments

          Issue Links

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: