media icon indicating copy to clipboard operation
media copied to clipboard

Transformer does not work with supported image MimeTypes when the type comes from ContentResolver

Open kleiren opened this issue 1 year ago • 1 comments

When adding an image with a supported mimeType (.heic) as a mediaItem, and generating a video using the transformer, it will return an error with the message "Image format not supported by given bitmapLoader", although it should be supported.

The issue seems to be that in function isImage() from the DefaultAssetLoaderFactory, the mimeType is coming from the contentResolver directly as heic, and then checked with the function isBitmapFactorySupportedMimeType() that only checks for heif instead of heic and heif.

[...]
    if (mimeType == null) {
      if (Objects.equals(localConfiguration.uri.getScheme(), ContentResolver.SCHEME_CONTENT)) {
        ContentResolver cr = context.getContentResolver();
        mimeType = cr.getType(localConfiguration.uri);
      } else {
        mimeType = getCommonImageMimeTypeFromExtension(localConfiguration.uri);
      }
    }
[...]
    checkState(
        bitmapLoader.supportsMimeType(mimeType),
        "Image format not supported by given bitmapLoader");
[...]

If the mimetype does not come from the content resolver, it will be extracted from the file extension and "commonized" using getCommonImageMimeTypeFromExtension() In this case, if the image is heic, it will return a heif mimetype, and will pass the isBitmapFactorySupportedMimeType() check. Of course this should happen with many other image types.

My question is, is there any way of skipping this check? I have tried setting the mimetype directly to the mediaItem, but it seems to be ignored for this case. Maybe this is a bug and supportsMimeType() should "commonize" all mimetypes.

Thanks!

kleiren avatar May 14 '24 10:05 kleiren

It seems there is a bug in the fact that the checkState throws in this case. I'll submit a fix for this.

There is a few ways to surpass the check. you can set the mimetype to be image/heif instead of image/heic which passes the supportsMimeType check for the default bitmap loader.

Alternatively, you can pass a BitmapLoader implementation, for which bitmapLoader.supportsMimeType("image/heic") returns true (possibly just by wrapping the default DataSourceBitmapLoader and changing the relevant method) the bitmapLoader can be passed an an argument for the DefaultAssetLoaderFactory, which can then be passed into Transformer

tof-tof avatar May 14 '24 15:05 tof-tof