Would like ability to use Augmented Faces on the rear facing camera

[jpeltone]

Are there plans to support also the back camera for AugementedFace, that would provide much more use cases than front camera only?

Thanks, Jouni

[timneill40]

Yip- I will second that.

Just spending a lot of time trying to get ARCore AugmentedFace working on backcamera with limited success.

Has anyone had any luck?

Thanks,

tim

[jjaslow]

I too would appreciate that ability.

[timneill40]

Thanks Jason,

It would seem logical that Google ARCore will have the ability to use Augmented Faces on back camera in near future but in the meantime I have been have been building with Unity ARFoundation with limited success (even though unity AR Foundation does not fully support Face Tracking, their equivalent of AR Augmented Faces, on Android yet. I believe IOS is supported though so that may be a option for you?).

I think the decision, without knowing too much, by Google AR Core to not support back camera on Android is the configuration of cameras and sensors (and therefore the ability of the phone's position) will be different for front and rear cameras. However 2D Target Tracking (Augmented Images) works fine on back camera. So maybe the reason for lack of support is due to data protection of other peoples faces?

Anyway, as a dentist, I am working on a neat project that make measurements of peoples face and jaws/teeth for application in dentistry that will make clinical life easier for clinical staff and most importantly patients. To have the back camera working on ARCore would make life so much easier. But I will find a way around it in the meantime. Just going to take a while.......

Take care,

tim.

On Mon, 13 May 2019 at 03:56, Jason Jaslow [email protected] wrote:

I too would appreciate that ability.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/google-ar/arcore-android-sdk/issues/714#issuecomment-491659469, or mute the thread https://github.com/notifications/unsubscribe-auth/ALWU4QDTJ3GKGABHMY42NYTPVDKF3ANCNFSM4GYBYZ6A .

[kokostar123]

Could you use OpenCV to track faces with the ARCore camera instead of ARCore faces?

[GUILLALAB]

I'am also really interested to use the rear camera for augmented faces. I'm on Unity and hope it will be possible soon. Maybe is there already a way to use it?

[GUILLALAB]

Any news about this possibility?

[m3h0w]

Bump

[manxjason]

Any update?

[timneill40]

nothing 🙁

On Thu, 17 Sep 2020 at 10:24, Jason Callister [email protected] wrote:

Any update?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/google-ar/arcore-android-sdk/issues/714#issuecomment-694111296, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALWU4QGTK6DTTCAAH3PNSWLSGHITPANCNFSM4GYBYZ6A .

[timneill40]

Anyone used and IOS api for face tracking on rear camera yet?

On Thu, 17 Sep 2020, 17:10 Timothy Neill, [email protected] wrote:

nothing 🙁

On Thu, 17 Sep 2020 at 10:24, Jason Callister [email protected] wrote:

Any update?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/google-ar/arcore-android-sdk/issues/714#issuecomment-694111296, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALWU4QGTK6DTTCAAH3PNSWLSGHITPANCNFSM4GYBYZ6A .

[southernpacificoceanfisher]

Is there any way to do that?

[timneill40]

Tbh- I am looking at SparkAR (Facebook) just to build prototype but not sure if working on rear camera yet. Message me back on here in a couple of weeks and I should have an answer :)

On Fri, 20 Dec 2019, 16:13 GUILLALAB, [email protected] wrote:

I'am also really interested to use the rear camera for augmented faces. I'm on Unity and hope it will be possible soon. Maybe is there already a way to use it?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/google-ar/arcore-android-sdk/issues/714?email_source=notifications&email_token=ALWU4QFQPXTYELKL3KEJ2KLQZTVMNA5CNFSM4GYBYZ6KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEHNK2TA#issuecomment-567979340, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALWU4QFS456VEJLGCNNNNFDQZTVMNANCNFSM4GYBYZ6A .

[GUILLALAB]

I checked everywhere, It seems it has not progress on this side in the arcore SDK.

• With Spark AR, I created a Face filter usable with the rear camera. I wonder what AR technology Facebook is using.

[timneill40]

Cool. Any chance I can have a quick chat on Skype with you. Would you kindly message me on "bluefinchdentalcare" ? Many thanks

[SunitRoy2703]

From the above conversation it looks like Spark AR is the answer

[GUILLALAB]

Spark AR is an alternative to create AR solutions, for face with rear camera it works well but its not destinated to be use in complex application (its a solution for instagram & Facebook)

Spark AR is not a library and cannot be integrated within your development flow.

Le mer. 11 nov. 2020 à 11:25, Sunit [email protected] a écrit :

From the above conversation it looks like Spark AR is the answer

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/google-ar/arcore-android-sdk/issues/714#issuecomment-725339679, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADY2PNPWA72BJMCXA6XTUYLSPJRANANCNFSM4GYBYZ6A .

[SunitRoy2703]

Oh NO ! than is there alternative ? I can see banuda offering some but it's not free !

[SunitRoy2703]

Guys I want to know if i can use the spark ar filter or lens filters (snapchat) in a arcore android app

[timneill40]

I believe not at this stage.

I have only used Spark AR for communication concepts without full functionality.

I agree with earlier comment- Banuba is very expensive.

[SunitRoy2703]

Thank you!

[SunitRoy2703]

By the way i think mlkit is a good alternative for overlaying texture on the face, and it works in both sides

[G0Thommy]

Are there any updates? I was quite dissapointed when I found out that this is not possible. There are so many interesting use cases for this.

[timneill40]

Nothing at my end but I have not looked at it for last 9 months or so :(

On Thu, 10 Nov 2022 at 11:02, G0Thommy @.***> wrote:

Are there any updates? I was quite dissapointed when I found out that this is not possible. There are so many interesting use cases for this.

— Reply to this email directly, view it on GitHub https://github.com/google-ar/arcore-android-sdk/issues/714#issuecomment-1310112792, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALWU4QAMGCN7J6NSZMTGYUTWHTI3BANCNFSM4GYBYZ6A . You are receiving this because you commented.Message ID: @.***>

[jaswant-iotric]

I've achieved using MLKit + ARCore. MLKit provides face detection, I provide ARCore frames to the face detector and get the face location and use Sceneform to place augmentation on the position/translate.

[timneill40]

On rear-view/world camera?

On Tue, 3 Oct 2023 at 12:52, Jaswant Singh @.***> wrote:

I've achieved using MLKit + ARCore. MLKit provides face detection, I provide ARCore frames to the face detector and get the face location and use Sceneform to place augmentation on the position/translate.

— Reply to this email directly, view it on GitHub https://github.com/google-ar/arcore-android-sdk/issues/714#issuecomment-1744808451, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALWU4QAXWMJIXJO6KYUQLYLX5P36RAVCNFSM4GYBYZ6KU5DIOJSWCZC7NNSXTN2JONZXKZKDN5WW2ZLOOQ5TCNZUGQ4DAOBUGUYQ . You are receiving this because you commented.Message ID: @.***>