Uploaded image for project: 'Nuxeo AI Core'
  1. Nuxeo AI Core
  2. AICORE-390

Add sizelimit and picture views fallback in Prediction/Enrichment

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: ML Custom Model
    • Tags:
    • Upgrade notes:
      Hide

      Two new nuxeo.conf variables have been added:

      1. # Max size of blobs for conversion during predictions/exports (500MB by default)
        nuxeo.ai.conversion.maxSize=500000000
      1. Rendition title for multipicture views to return for predictions/exports (choices among Small, Medium, OriginalJpeg or custom one)
        nuxeo.ai.conversion.rendition=Small

      They are used for data prediction/enrichment/export:

      • We check first if there is a multipicture view rendition (by default the 'Small' one)
      • If yes we check it respects the dimensions minimum (299x299)
      • we check if the blob also respects the maximum size (500Mb by default)
      • If no we return the original blob and check if it respects the maximum size (500Mb by default)
      • Prediction/Enrich: if yes we proceed, if no we return no suggestion for prediction
      • Export: we return the original blob and dont convert anything
      Show
      Two new nuxeo.conf variables have been added: # Max size of blobs for conversion during predictions/exports (500MB by default) nuxeo.ai.conversion.maxSize=500000000 Rendition title for multipicture views to return for predictions/exports (choices among Small, Medium, OriginalJpeg or custom one) nuxeo.ai.conversion.rendition=Small They are used for data prediction/enrichment/export: We check first if there is a multipicture view rendition (by default the 'Small' one) If yes we check it respects the dimensions minimum (299x299) we check if the blob also respects the maximum size (500Mb by default) If no we return the original blob and check if it respects the maximum size (500Mb by default) Prediction/Enrich: if yes we proceed, if no we return no suggestion for prediction Export: we return the original blob and dont convert anything
    • Team:
      AI

      Description

      Currently, we are asking for suggestions on any file independent of size.
      Suggestions operation run on the Portal node and need to run the aiResize IM conversion when there isn't any picture:view (on upload and when the views are not created).

      This is a huge risk as if the file has a huge size, it will use all the resources of the Portal node and make the application not usable.

      Also we want to fallback on a default rendition (Small here) and ensure that is higher in dimension of 299x299

      Proposal

      **Add a new var on nuxeo.conf (ir. nuxeo.ai.sync.maxSize) where the customer can configure the max size of a file to get synchronous suggestions (in bytes).

      When a syncronous suggestions has as one of the inputs an image feature (blob) and the blog is bigger than "nuxeo.ai.sync.maxSize" we will abort the suggestion process for that model specifically.

      Today, the only sync suggestion we have is the ai.suggestion operation.

        Attachments

          Issue Links

          is required by

          Bug - A problem which impairs or prevents the functions of the product. AICORE-388 Fix ImageMagick error with command 'aiResizer'

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          Is referenced in

          [Captain Hook] PR for master-10.10: #288 PR for master-10.10: #288

          [Captain Hook] PR for master: #296 PR for master: #296

          [Captain Hook] PR for master: #457 PR for master: #457

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: