TEN-Agent
TEN-Agent copied to clipboard
TEN-framework
[Bug] publish_video core dump
Is your feature request related to a problem? Please describe.
I enabled publish_video in camera.va.openai.azure, and it causing core dump.
The diff:
diff --git a/agents/property.json b/agents/property.json
index 880241c..f366694 100644
--- a/agents/property.json
+++ b/agents/property.json
@@ -1389,6 +1389,7 @@
"subscribe_audio": true,
"subscribe_video": true,
"publish_audio": true,
+ "publish_video": true,
"publish_data": true,
"enable_agora_asr": true,
"agora_asr_vendor_name": "microsoft",
@@ -1408,7 +1409,7 @@
{
"type": "extension",
"extension_group": "chatgpt",
- "addon": "openai_chatgpt_python",
+ "addon": "openai_chatgpt",
"name": "openai_chatgpt",
"property": {
"base_url": "",
@@ -2161,4 +2162,4 @@
}
]
}
-}
\ No newline at end of file
+}
log
root@b51b1ea7ffa4:/app# cat /tmp/app-d133ca3be3fe31997a05f8565d77df8c-1727525170160575863.log
[agora_swllrv] 2024-09-28 12:06:12,557 - polly_tts - INFO - 8875 - [__init__.py:5] - polly_tts extension loaded
[agora_swllrv] 2024-09-28 12:06:12,566 - openai_chatgpt_python - INFO - 8875 - [__init__.py:4] - openai_chatgpt_python extension loaded
[agora_swllrv] 2024-09-28 12:06:12,582 - llama_index_chat_engine - INFO - 8875 - [__init__.py:4] - llama_index_chat_engine extension loaded
[agora_swllrv] 2024-09-28 12:06:12,738 - transcribe_asr_python - INFO - 8875 - [__init__.py:5] - transcribe_asr_python extension loaded
[agora_swllrv] 2024-09-28 12:06:12,745 - interrupt_detector_python - INFO - 8875 - [__init__.py:4] - interrupt_detector_python extension loaded
[agora_swllrv] 2024-09-28 12:06:12,753 - bedrock_llm_python - INFO - 8875 - [__init__.py:4] - bedrock_llm_python extension loaded
[agora_swllrv] 2024-09-28 12:06:12,761 - message_collector - INFO - 8875 - [__init__.py:11] - message_collector extension loaded
[agora_swllrv] 2024-09-28 12:06:12,771 - gemini_llm_python - INFO - 8875 - [__init__.py:6] - gemini_llm_python extension loaded
[agora_swllrv] 2024-09-28 12:06:12,778 - aliyun_analyticdb_vector_storage - INFO - 8875 - [__init__.py:4] - aliyun_analyticdb_vector_storage extension loaded
[agora_swllrv] 2024-09-28 12:06:12,792 - http_server_python - INFO - 8875 - [__init__.py:4] - http_server_python extension loaded
[agora_swllrv] 2024-09-28 12:06:12,798 - qwen_llm_python - INFO - 8875 - [__init__.py:4] - qwen_llm_python extension loaded
[agora_swllrv] 2024-09-28 12:06:12,803 - chat_transcriber_python - INFO - 8875 - [__init__.py:4] - chat_transcriber_python extension loaded
[agora_swllrv] 2024-09-28 12:06:12,812 - aliyun_text_embedding - INFO - 8875 - [__init__.py:4] - aliyun_text_embedding extension loaded
[agora_swllrv] 2024-09-28 12:06:12,819 - file_chunker - INFO - 8875 - [__init__.py:4] - file_chunker extension loaded
[agora_swllrv] 2024-09-28 12:06:12,825 - elevenlabs_tts_python - INFO - 8875 - [__init__.py:6] - elevenlabs_tts_python extension loaded
[agora_swllrv] 2024/09/28 12:06:12 INFO chat_transcriber extension init extension=CHAT_TRANSCRIBER_EXTENSION
[agora_swllrv] 2024/09/28 12:06:12 ten OnInitDone
[agora_swllrv] 2024/09/28 12:06:12 INFO interrupt_detector extension init extension=INTERRUPT_DETECTOR_EXTENSION
[agora_swllrv] 2024/09/28 12:06:12 ten OnInitDone
[agora_swllrv] 2024/09/28 12:06:12 INFO elevenlabs_tts extension init extension=ELEVENLABS_TTS_EXTENSION
[agora_swllrv] 2024/09/28 12:06:12 ten OnInitDone
[agora_swllrv] 2024/09/28 12:06:12 INFO init
[agora_swllrv] 2024/09/28 12:06:12 ten OnInitDone
[agora_swllrv] 2024/09/28 12:06:13.048131 ten OnInitDone
[agora_swllrv] 2024-09-28 12:06:13,162 - message_collector - INFO - 8875 - [addon.py:21] - MessageCollectorExtensionAddon on_create_instance
[agora_swllrv] 2024-09-28 12:06:13,172 - message_collector - INFO - 8875 - [extension.py:37] - MessageCollectorExtension on_init
[agora_swllrv] 2024/09/28 12:06:13.174944 ten OnInitDone
[agora_swllrv] 2024/09/28 12:06:13.179543 ten OnInitDone
[agora_swllrv] 09-28 12:06:13.195 8875 8901 I TEN_RUNTIME [email protected]:213 [message_collector] `_ten` section is not found in the property, skip.
[agora_swllrv] 09-28 12:06:13.199 8875 8899 I TEN_RUNTIME [email protected]:213 [openai_chatgpt] `_ten` section is not found in the property, skip.
[agora_swllrv] 09-28 12:06:13.217 8875 8900 I TEN_RUNTIME [email protected]:213 [azure_tts] `_ten` section is not found in the property, skip.
[agora_swllrv] 09-28 12:06:13.225 8875 8898 I TEN_RUNTIME [email protected]:213 [agora_rtc] `_ten` section is not found in the property, skip.
[agora_swllrv] 09-28 12:06:13.238 8875 8898 I TEN_RUNTIME [email protected]:213 [interrupt_detector] `_ten` section is not found in the property, skip.
[agora_swllrv] 09-28 12:06:13.240 8875 8901 I TEN_RUNTIME [email protected]:937 [message_collector] on_start().
[agora_swllrv] 09-28 12:06:13.240 8875 8900 I TEN_RUNTIME [email protected]:937 [azure_tts] on_start().
[agora_swllrv] 09-28 12:06:13.240 8875 8898 I TEN_RUNTIME [email protected]:937 [agora_rtc] on_start().
[agora_swllrv] 09-28 12:06:13.240 8875 8900 I AZURE_TTS_EXTENSION [email protected]:32 start
[agora_swllrv] 09-28 12:06:13.240 8875 8899 I TEN_RUNTIME [email protected]:937 [openai_chatgpt] on_start().
[agora_swllrv] 2024-09-28 12:06:13,241 - message_collector - INFO - 8875 - [extension.py:41] - MessageCollectorExtension on_start
[agora_swllrv] 2024/09/28 12:06:13.243118 INFO OnStart extension=OPENAI_CHATGPT_EXTENSION
[agora_swllrv] 09-28 12:06:13.243 8875 8901 I TEN_RUNTIME ten_extension_on_start_done@on_xxx.c:71 [message_collector] on_start() done.
[agora_swllrv] 2024/09/28 12:06:13.268763 WARN GetProperty optional presence_penalty failed, err: err_no: 1, err_msg: extension=OPENAI_CHATGPT_EXTENSION
[agora_swllrv] 2024/09/28 12:06:13.269728 WARN GetProperty optional temperature failed, err: err_no: 1, err_msg: extension=OPENAI_CHATGPT_EXTENSION
[agora_swllrv] 2024/09/28 12:06:13.269906 WARN GetProperty optional top_p failed, err: err_no: 1, err_msg: extension=OPENAI_CHATGPT_EXTENSION
[agora_swllrv] 2024/09/28 12:06:13.293041 INFO newOpenaiChatGPT succeed with max_tokens: 512, model: gpt-4o extension=OPENAI_CHATGPT_EXTENSION
[agora_swllrv] 2024/09/28 12:06:13.326715 INFO greeting [TEN agent connected. How can I help you today?] sent extension=OPENAI_CHATGPT_EXTENSION
[agora_swllrv] 09-28 12:06:13.327 8875 8899 I TEN_RUNTIME ten_extension_on_start_done@on_xxx.c:71 [openai_chatgpt] on_start() done.
[agora_swllrv] 2024-09-28 12:06:13,329 - message_collector - INFO - 8875 - [extension.py:75] - on_data
[agora_swllrv] 2024-09-28 12:06:13,330 - message_collector - WARNING - 8875 - [extension.py:92] - on_data get_property_bool is_final error: Failed to find property: is_final
[agora_swllrv] 2024-09-28 12:06:13,331 - message_collector - WARNING - 8875 - [extension.py:99] - on_data get_property_int stream_id error: Failed to find property: stream_id
[agora_swllrv] 09-28 12:06:13.468 8875 8900 I AZURE_TTS_EXTENSION [email protected]:19 speech_synthesizer created
[agora_swllrv] 09-28 12:06:13.479 8875 8900 I AZURE_TTS_EXTENSION [email protected]:24 speech_synthesizer opened
[agora_swllrv] 09-28 12:06:13.486 8875 8918 I AZURE_TTS_EXTENSION operator()@tts.cc:32 tts_thread started
[agora_swllrv] 09-28 12:06:13.486 8875 8900 I TEN_RUNTIME ten_extension_on_start_done@on_xxx.c:71 [azure_tts] on_start() done.
[agora_swllrv] 09-28 12:06:13.486 8875 8900 I AZURE_TTS_EXTENSION [email protected]:95 start done
[agora_swllrv] 09-28 12:06:13.489 8875 8900 I AZURE_TTS_EXTENSION [email protected]:135 input text: [TEN agent connected. How can I help you today?]
[agora_swllrv] 09-28 12:06:13.777 8875 8898 I TEN_RUNTIME [email protected]:937 [interrupt_detector] on_start().
[agora_swllrv] 09-28 12:06:13.778 8875 8898 I TEN_RUNTIME ten_extension_on_start_done@on_xxx.c:71 [interrupt_detector] on_start() done.
[agora_swllrv] 09-28 12:06:13.996 8875 8902 I AGORA_RTC_EXTENSION prepare_to_recv@rtc_connection.cc:913 video frame observer set
[agora_swllrv] 09-28 12:06:14.033 8875 8902 I AGORA_RTC_EXTENSION connect@rtc_connection.cc:321 Connect to Agora channel(agora_swllrv) with user id(1234), token(007eJxSYMg5uIFj5025I937pP4f7V3z5Lrf/QIfmYNbNh1fwqDI/65W....)
[agora_swllrv] 09-28 12:06:14.110 8875 8905 I AGORA_RTC_EXTENSION onConnecting@connection_observer.cc:102 onConnecting: id 0, channelId agora_swllrv, localUserId 1234, reason 0
[agora_swllrv]
[agora_swllrv] qemu: uncaught target signal 4 (Illegal instruction) - core dumped
[agora_swllrv] Illegal instruction
root@b51b1ea7ffa4:/app#
Additional context
uname -a
Darwin seven-3.local 23.3.0 Darwin Kernel Version 23.3.0: Wed Dec 20 21:30:44 PST 2023; root:xnu-10002.81.5~7/RELEASE_ARM64_T6000 arm64
I use orbstack
orb version
Version: 1.7.2 (1070200)
Commit: 50f93373f351fe839fd72948e6aad032774c0f6c (v1.7.2)
This is because OrbStack's support for AVX/AVX2 instruction sets is incomplete. I'm not certain about the version of QEMU being used. It's recommended to use Docker Desktop instead, which should work normally.
looks like it's responded with fix. i'm closing the issue, please reopen i fthe issue presists.
