Training OpenPose with Custom Keypoints

[justvasq]

Posting rules

1. Duplicated posts will not be answered. Check the FAQ section, other GitHub issues, and general documentation before posting. E.g., low-speed, out-of-memory, output format, 0-people detected, installation issues, ...).
2. Fill the Your System Configuration section (all of it or it will not be answered!) if you are facing an error or unexpected behavior. Feature requests or some other type of posts might not require it.
3. No questions about 3rd party libraries:
   • Caffe errors/issues, check Caffe documentation.
   • CUDA check failed errors: They are usually fixed by re-installing CUDA, then re-installing the proper cuDNN version, and then re-compiling (or re-installing) OpenPose. Otherwise, check for help in CUDA forums.
   • OpenCV errors: Install the default/pre-compiled OpenCV or check for online help.
4. Set a proper issue title: add the Ubuntu/Windows keyword and be specific (e.g., do not call it: Error).
5. Only English comments. Posts which do not follow these rules will be ignored, closed, or reported with no further clarification.

Issue Summary

I'm trying to train OpenPose with my own dataset that only has 23 keypoints (some intersection between Body25 keypoints + new keypoints). I tried modifying pose_training.prototxt and pose_deploy.prototxt to have 23 ouputs instead of 25 but I get a dimension error. Are there any resources on how to reconfigure the OpenPose training routine for different keypoint numbers?

Executed Command (if any)

Note: add --logging_level 0 --disable_multi_thread to get higher debug information.

OpenPose Output (if any)

Errors (if any)

F0428 10:25:22.296805 743 eltwise_layer.cpp:34] Check failed: bottom[0]->shape() == bottom[i]->shape() bottom[0]: 10 23 46 46 (486680), bottom[1]: 10 25 46 46 (529000)

Type of Issue

You might select multiple topics, delete the rest:

• Question

Your System Configuration

1. Whole console output (if errors appeared), paste the error to PasteBin and then paste the link here: LINK

2. OpenPose version: Latest GitHub code? Or specific commit (e.g., d52878f)? Or specific version from Release section (e.g., 1.2.0)?

3. General configuration:

   • Installation mode: CMake, sh script, manual Makefile installation, ... (Ubuntu); CMake, ... (Windows); ...?
   • Operating system (lsb_release -a in Ubuntu):
   • Operating system version (e.g., Ubuntu 16, Windows 10, ...):
   • Release or Debug mode? (by default: release):
   • Compiler (gcc --version in Ubuntu or VS version in Windows): 5.4.0, ... (Ubuntu); VS2015 Enterprise Update 3, VS2017 community, ... (Windows); ...?

4. Non-default settings:

   • 3-D Reconstruction module added? (by default: no):
   • Any other custom CMake configuration with respect to the default version? (by default: no):

5. 3rd-party software:

   • Caffe version: Default from OpenPose, custom version, ...?
   • CMake version (cmake --version in Ubuntu):
   • OpenCV version: pre-compiled apt-get install libopencv-dev (only Ubuntu); OpenPose default (only Windows); compiled from source? If so, 2.4.9, 2.4.12, 3.1, 3.2?; ...?

6. If GPU mode issue:

   • CUDA version (cat /usr/local/cuda/version.txt in most cases):
   • cuDNN version:
   • GPU model (nvidia-smi in Ubuntu):

7. If CPU-only mode issue:

   • CPU brand & model:
   • Total RAM memory available:

8. If Python API:

   • Python version: 2.7, 3.7, ...?
   • Numpy version (python -c "import numpy; print numpy.version.version" in Ubuntu):

9. If Windows system:

   • Portable demo or compiled library?

10. If speed performance issue:

    • Report OpenPose timing speed based on this link.

[chaitree]

I also would like to train openPose on custom keypoints. Could someone please guide on how to do it?