InMoov icon indicating copy to clipboard operation
InMoov copied to clipboard

How to Setup Software+Hardware

Open rut00 opened this issue 2 years ago • 11 comments

I want to make speech module up and running with this code. I am beginner in this field. Please guide me with the setup.

PS: I have extracted the .jar file and server is running.

rut00 avatar Dec 18 '23 06:12 rut00

Hello, Have you followed this tutorial already? It explains how to set the brain(chatBot), ear(webkitSpeechRecognition), and mouth(TTS). https://inmoov.fr/inmoov2-in-nixie/

Gael Langevin Creator of InMoov InMoov Robot http://www.inmoov.fr @inmoov http://twitter.com/inmoov

Le lun. 18 déc. 2023 à 07:41, Rutika Mehta @.***> a écrit :

I want to make speech module up and running with this code. I am beginner in this field. Please guide me with the setup.

PS: I have extracted the .jar file and server is running.

— Reply to this email directly, view it on GitHub https://github.com/MyRobotLab/InMoov/issues/207, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACAXNRZSCQSA2UDSSC7EMQLYJ7QRNAVCNFSM6AAAAABAZASS7GVHI2DSMVQWIX3LMV43ASLTON2WKOZSGA2DKOBUG4ZDIMI . You are receiving this because you are subscribed to this thread.Message ID: @.***>

hairygael avatar Dec 18 '23 10:12 hairygael

I have followed the steps mentioned in the link. On executing myrobotlab.bat, I am getting stuck after: java -jar ivy-2.5.2.jar -settings libraries/ivysettings.xml -ivy libraries/ivy.xml -retrieve libraries/jar/[originalname].[ext] -warn

rut00 avatar Dec 18 '23 10:12 rut00

It explains how to set the brain(chatBot), ear(webkitSpeechRecognition), and mouth(TTS).

The tutorial provided are for Virtual environment or Hardware? How do I configure with Arduino ?

rut00 avatar Dec 18 '23 10:12 rut00

Hello, it is not stucked, it is retrieving/downloading all the necessary dependencies. You need to be patient, especially if your internet or PC is a bit slow. The link explains how to configure the Arduino. You need to upload the MRLComm.ino to your arduino provided once Myrobotlab is installed. resource/arduino/MrlComm/MrlComm.ino Once MRL is installed, in runtime tab you can either run in virtual mode or real hardware mode. [image: Capture d’écran 2023-12-18 120722.png]

Gael Langevin Creator of InMoov InMoov Robot http://www.inmoov.fr @inmoov http://twitter.com/inmoov

Le lun. 18 déc. 2023 à 11:55, Rutika Mehta @.***> a écrit :

It explains how to set the brain(chatBot), ear(webkitSpeechRecognition), and mouth(TTS).

The tutorial provided are for Virtual environment or Hardware? How do I configure with Arduino ?

— Reply to this email directly, view it on GitHub https://github.com/MyRobotLab/InMoov/issues/207#issuecomment-1860135707, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACAXNR6LGC2XTGRF4HLWCIDYKAOJJAVCNFSM6AAAAABAZASS7GVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNRQGEZTKNZQG4 . You are receiving this because you commented.Message ID: @.***>

hairygael avatar Dec 18 '23 11:12 hairygael

Thank you for the instructions. I have successfully done setup of MyRobotLab. I now have the question, on how to check the Vision with the simulator? And for face recognition, how do I train model on custom pictures?

Thank you so much for your prompt answer.

rut00 avatar Dec 19 '23 10:12 rut00

The simulator is mainly used to test or create gestures on your robot with the servoMixer service. [image: Capture d’écran 2023-12-19 115428.png]

You can of course start the vision located within the head service. You need to start the opencv service. You can then train the robot for face recognition by clicking the TRAIN button. The chatBot will request a name and then approval. Then it will start capture and take a picture, then it will start training the face recognizer. [image: Capture d’écran 2023-12-19 115043.png]

Gael Langevin Creator of InMoov InMoov Robot http://www.inmoov.fr @inmoov http://twitter.com/inmoov

Le mar. 19 déc. 2023 à 11:38, Rutika Mehta @.***> a écrit :

Thank you for the instructions. I have successfully done setup of MyRobotLab. I now have the question, on how to check the Vision with the simulator? And for face recognition, how do I train model on custom pictures?

Thank you so much for your prompt answer.

— Reply to this email directly, view it on GitHub https://github.com/MyRobotLab/InMoov/issues/207#issuecomment-1862517728, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACAXNR4PX4FZYCGWSBU7VEDYKFVC3AVCNFSM6AAAAABAZASS7GVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNRSGUYTONZSHA . You are receiving this because you commented.Message ID: @.***>

hairygael avatar Dec 19 '23 10:12 hairygael

For face recognition, can I add my custom python code? If so, how do I do that?

rut00 avatar Dec 19 '23 13:12 rut00

Yes you can either paste your code in data/InMoov2/InMoovCustom.py which will be read automatically when InMoov starts. Or you can add your code in resource/InMoov2/gestures. It is less recommended to tweak files in the resource directory.

Gael Langevin Creator of InMoov InMoov Robot http://www.inmoov.fr @inmoov http://twitter.com/inmoov

Le mar. 19 déc. 2023 à 14:02, Rutika Mehta @.***> a écrit :

For face recognition, can I add my custom python code? If so, how do I do that?

— Reply to this email directly, view it on GitHub https://github.com/MyRobotLab/InMoov/issues/207#issuecomment-1862719373, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACAXNR2P6FLH6NS7R7SNNRLYKGF5LAVCNFSM6AAAAABAZASS7GVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNRSG4YTSMZXGM . You are receiving this because you commented.Message ID: @.***>

hairygael avatar Dec 19 '23 15:12 hairygael

Note that many of the scripts located in resource/InMoov2/gestures are used with vocal commands of the chatBot or the UI

Gael Langevin Creator of InMoov InMoov Robot http://www.inmoov.fr @inmoov http://twitter.com/inmoov

Le mar. 19 déc. 2023 à 16:04, gael langevin @.***> a écrit :

Yes you can either paste your code in data/InMoov2/InMoovCustom.py which will be read automatically when InMoov starts. Or you can add your code in resource/InMoov2/gestures. It is less recommended to tweak files in the resource directory.

Gael Langevin Creator of InMoov InMoov Robot http://www.inmoov.fr @inmoov http://twitter.com/inmoov

Le mar. 19 déc. 2023 à 14:02, Rutika Mehta @.***> a écrit :

For face recognition, can I add my custom python code? If so, how do I do that?

— Reply to this email directly, view it on GitHub https://github.com/MyRobotLab/InMoov/issues/207#issuecomment-1862719373, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACAXNR2P6FLH6NS7R7SNNRLYKGF5LAVCNFSM6AAAAABAZASS7GVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNRSG4YTSMZXGM . You are receiving this because you commented.Message ID: @.***>

hairygael avatar Dec 19 '23 15:12 hairygael

I have few questions:

Can I access camera feed using just the Python Script? Can you please guide me for the same? How to continuously keep Camera feed on, so that it can recognize people continuously? How do I enable Human Head Tracking? For QnA, I want the question to be directly searched in GPT3, how can I do this?

Thank you for the help.

rut00 avatar Dec 20 '23 06:12 rut00

Here below I assume that you are using the InMoov service. You can do it via python this way: i01_opencv.startCapture() i01_opencv.stopCapture()

To keep the face recognition on continuously: facerecognizer() To stop it: stopFaceRecognizer()

You can enable the headTracking in three ways: 1-in python TrackingHumans() To stop it: stopTrackHumans() 2-with voice command in ear, brain, mouth: SEARCH HUMANS To stop it: STOP YOUR TRACKING 3-In the InMoov UI: head-->opencv start-->headTracking-->enable/disable

To get your questions directly searched in GPT3 without the chatBot interfering: -use the voice command in ear, brain, mouth: GPT COMMUNICATION To stop it: STOP GPT

Gael Langevin Creator of InMoov InMoov Robot http://www.inmoov.fr @inmoov http://twitter.com/inmoov

Le mer. 20 déc. 2023 à 07:49, Rutika Mehta @.***> a écrit :

I have few questions:

Can I access camera feed using just the Python Script? Can you please guide me for the same? How to continuously keep Camera feed on, so that it can recognize people continuously? How do I enable Human Head Tracking? For QnA, I want the question to be directly searched in GPT3, how can I do this?

Thank you for the help.

— Reply to this email directly, view it on GitHub https://github.com/MyRobotLab/InMoov/issues/207#issuecomment-1863940059, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACAXNR54QTMRSPT4HYNR7GTYKKC63AVCNFSM6AAAAABAZASS7GVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNRTHE2DAMBVHE . You are receiving this because you commented.Message ID: @.***>

hairygael avatar Dec 22 '23 15:12 hairygael