ARFoundation With OpenCVForUnity Example

• An example of integrating ARFoundation with OpenCVForUnity.
• An example of replacing WebCamTextureToMatHelper with ARFoundationCameraToMatHelper.
• An example of ArUco marker detection from an ARFoundation camera image.

Environment

• Android (Pixel, Galaxy S10+) / iOS (iPhoneSE2)
• Unity >= 2020.3.38f1+
• Scripting backend MONO / IL2CPP
• [AR Foundation] 4.1.13+
• [ARCore XR Plugin] 4.1.13+
• [ARKit XR Plugin] 4.1.13+
• OpenCV for Unity 2.5.1+

Demo

• Android ARFoundationWithOpenCVForUnityExample.apk

Setup

1. Download the latest release unitypackage. ARFoundationWithOpenCVForUnityExample.unitypackage
2. Create a new project. (ARFoundationWithOpenCVForUnityExample)
3. Install AR Foundation from Package Manager.
4. Install ARCore XR Plugin from Package Manager.
5. Install ARKit XR Plugin from Package Manager.
6. Import OpenCVForUnity.
   • Setup the OpenCVForUnity. (Tools > OpenCV for Unity > Set Plugin Import Settings)
7. Import the ARFoundationWithOpenCVForUnityExample.unitypackage.
8. Change the "Player Settings (Androd)" Inspector as follows.
   • Graphics APIs : OpenGLES 3 (Remove "Vulkan" from the Graphics APIs list)
   • Minimum API Level : Android 7.0 (API Level 24)
9. Open the menu "Edit => Project Settings => XR Plug-in Management (Android)" and check "ARCore".
10. Change the "Player Settings (iOS)" Inspector as follows.
    • Camera Usage Description : "Required for augmented reality support."
    • Target minimum iOS Version : 12.0
    • Architecture : ARM64
11. Open the menu "Edit => Project Settings => XR Plug-in Management (iOS)" and check "ARKit".
12. Add the "Assets/ARFoundationWithOpenCVForUnityExample/*.unity" files to the "Scenes In Build" list in the "Build Settings" window.
13. Build and Deploy to Android and iOS.
    • (Print the AR marker "CanonicalMarker-d10-i1-sp500-bb1.pdf" on an A4 size paper)

ScreenShot