OpenAdapt
OpenAdapt copied to clipboard
Published
4 months ago
•
OpenAdaptAI
OpenAdaptAI
[Bug]: `QWindowsContext: OleInitialize() failed` error on running: `python -m openadapt.app.visualize`
Describe the bug
(.venv) PS P:\OpenAdapt> python -m openadapt.app.visualize
2024-07-21 11:25:44.667 | INFO | openadapt.events:get_events:74 - num_process_iters=0 num_action_events=2600 num_window_events=1 num_screenshots=179
2024-07-21 11:25:44.669 | INFO | openadapt.events:process_events:825 - before num_action_events=2600 num_window_events=1 num_screenshots=179 num_total=2780
2024-07-21 11:25:44.710 | INFO | openadapt.events:merge_consecutive_action_events:757 - name='redundant_mouse_move' num_events_removed=66
2024-07-21 11:25:44.733 | INFO | openadapt.events:get_group_idx_tups:529 - len(to_merge)=10 group_idx_tups=[(0, 8), (8, 10)]
2024-07-21 11:25:44.977 | INFO | openadapt.events:get_group_idx_tups:529 - len(to_merge)=38 group_idx_tups=[(0, 8), (8, 10), (10, 22), (22, 24), (24, 28), (28, 31), (31, 34), (34, 36), (36, 38)]
2024-07-21 11:25:44.999 | INFO | openadapt.events:get_group_idx_tups:529 - len(to_merge)=18 group_idx_tups=[(0, 2), (2, 6), (6, 8), (8, 10), (10, 12), (12, 14), (14, 16), (16, 18)]
2024-07-21 11:25:45.048 | INFO | openadapt.events:merge_consecutive_action_events:757 - name='keyboard' num_events_removed=47
2024-07-21 11:25:45.069 | INFO | openadapt.events:merge_consecutive_action_events:757 - name='mouse_move' num_events_removed=2415
2024-07-21 11:25:45.069 | INFO | openadapt.events:merge_consecutive_action_events:757 - name='mouse_scroll' num_events_removed=0
2024-07-21 11:25:45.072 | INFO | openadapt.events:merge_consecutive_action_events:757 - name='mouse_click' num_events_removed=14
2024-07-21 11:25:45.072 | INFO | openadapt.events:process_events:873 - after num_action_events_=58 num_window_events_=1 num_screenshots_=52 num_total_=111
2024-07-21 11:25:45.072 | INFO | openadapt.events:process_events:877 - pct_action_events=0.022307692307692306 pct_window_events=1.0 pct_screenshots=0.2905027932960894 pct_total=0.039928057553956835
2024-07-21 11:25:45.073 | INFO | openadapt.events:get_events:127 - duration=2.549567461013794
2024-07-21 11:25:45.386 | INFO | __main__:main:154 - event_dicts=
[{'children': [{'id': 243,
'mouse_x': 1257,
'mouse_y': 652,
'screenshot_id': 11,
'screenshot_timestamp': 1721569972.3549984,
'timestamp': 1721569972.3864052},
{'id': 244,
'mouse_x': 1254,
'mouse_y': 652,
'screenshot_id': 11,
'screenshot_timestamp': 1721569972.3549984,
'timestamp': 1721569972.3908093},
{'id': 245,
'mouse_x': 1245,
'mouse_y': 653,
'screenshot_id': 11,
'screenshot_timestamp': 1721569972.3549984,
'timestamp': 1721569972.40064},
{'id': 246,
'mouse_x': 1242,
'mouse_y': 653,
'screenshot_id': 11,
'screenshot_timestamp': 1721569972.3549984,
'timestamp': 1721569972.4023662},
{'id': 247,
'mouse_x': 1239,
'mouse_y': 653,
'screenshot_id': 11,
'screenshot_timestamp': 1721569972.3549984,
'timestamp': 1721569972.4231231},
{'id': 248,
'mouse_x': 1232,
'mouse_y': 653,
'screenshot_id': 11,
'screenshot_timestamp': 1721569972.3549984,
'timestamp': 1721569972.4339736},
{'id': 249,
'mouse_x': 1232,
'mouse_y': 652,
'screenshot_id': 12,
'screenshot_timestamp': 1721569975.5022848,
'timestamp': 1721569975.5144775},
{'id': 250,
'mouse_x': 1234,
'mouse_y': 645,
'screenshot_id': 12,
'screenshot_timestamp': 1721569975.5022848,
'timestamp': 1721569975.5282133},
{'id': 251,
'mouse_x': 1272,
'mouse_y': 583,
'screenshot_id': 12,
'screenshot_timestamp': 1721569975.5022848,
'timestamp': 1721569975.5507956},
{'id': 252,
'mouse_x': 1275,
'mouse_y': 575,
'screenshot_id': 12,
'screenshot_timestamp': 1721569975.5022848,
'timestamp': 1721569975.5543833},
{'id': 253,
'mouse_x': 1279,
'mouse_y': 567,
'screenshot_id': 12,
'screenshot_timestamp': 1721569975.5022848,
'timestamp': 1721569975.5824442},
{'id': 254,
'mouse_x': 1291,
'mouse_y': 559,
'screenshot_id': 12,
'screenshot_timestamp': 1721569975.5022848,
'timestamp': 1721569975.5831692},
{'children': [{'id': 255,
'screenshot_id': 12,
'screenshot_timestamp': 1721569975.5022848,
'timestamp': 1721569975.586228},
{'id': 256,
'screenshot_id': 13,
'screenshot_timestamp': 1721569995.8832257,
'timestamp': 1721569995.9327462}],
'id': 257,
'mouse_x': 1290,
'mouse_y': 559,
'screenshot_id': 13,
'screenshot_timestamp': 1721569995.8832257,
'timestamp': 1721569975.6031942},
{'id': 258,
'mouse_x': 1289,
'mouse_y': 555,
'screenshot_id': 13,
'screenshot_timestamp': 1721569995.8832257,
'timestamp': 1721569975.6038504},
{'id': 259,
'mouse_x': 1289,
'mouse_y': 554,
'screenshot_id': 13,
'screenshot_timestamp': 1721569995.8832257,
'timestamp': 1721569975.6065505},
{'id': 260,
'mouse_x': 1289,
'mouse_y': 552,
'screenshot_id': 13,
'screenshot_timestamp': 1721569995.8832257,
'timestamp': 1721569975.6224337},
{'id': 261,
'mouse_x': 1289,
'mouse_y': 549,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.625444},
{'id': 262,
'mouse_x': 1289,
'mouse_y': 550,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.6386862},
{'children': [{'id': 263, 'timestamp': 1721569995.9923966},
{'id': 264, 'timestamp': 1721569996.0092666}],
'id': 265,
'mouse_x': 1287,
'mouse_y': 557,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.640003},
{'id': 266,
'mouse_x': 1286,
'mouse_y': 558,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.6418583},
{'id': 267,
'mouse_x': 1284,
'mouse_y': 561,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.6455777},
{'id': 268,
'mouse_x': 1281,
'mouse_y': 565,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.6496458},
{'id': 269,
'mouse_x': 1278,
'mouse_y': 568,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.6545453},
{'id': 270,
'mouse_x': 1274,
'mouse_y': 576,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.657772},
{'id': 271,
'mouse_x': 1272,
'mouse_y': 581,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.6616013},
{'id': 272,
'mouse_x': 1270,
'mouse_y': 588,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.6656053},
{'id': 273,
'mouse_x': 1268,
'mouse_y': 594,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.6695735},
{'id': 274,
'mouse_x': 1267,
'mouse_y': 599,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.6741111},
{'id': 275,
'mouse_x': 1267,
'mouse_y': 606,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.6818907},
{'id': 276,
'mouse_x': 1263,
'mouse_y': 614,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.6998923},
{'id': 277,
'mouse_x': 1247,
'mouse_y': 663,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.7018683},
{'id': 278,
'mouse_x': 1240,
'mouse_y': 680,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.7030241},
{'id': 279,
'mouse_x': 1233,
'mouse_y': 694,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.7056851},
{'id': 280,
'mouse_x': 1228,
'mouse_y': 705,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.7095895},
{'id': 281,
'mouse_x': 1226,
'mouse_y': 715,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.715115},
{'id': 282,
'mouse_x': 1222,
'mouse_y': 726,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.7177162},
{'id': 283,
'mouse_x': 1220,
'mouse_y': 736,
'screenshot_id': 14,
'screenshot_timestamp': 1721569995.974621,
'timestamp': 1721569975.7216306},
{'id': 284,
'mouse_x': 1215,
'mouse_y': 747,
'screenshot_id': 14,
'screenshot_timestamp':QWindowsContext: OleInitialize() failed: "COM error 0x80010106: Cannot change thread mode after it is set."
qt.qpa.window: SetProcessDpiAwarenessContext() failed: The operation completed successfully.
Qt's default DPI awareness context is DPI_AWARENESS_CONTEXT_PER_MONITOR_AWARE_V2. If you know what you are doing, you can overwrite this default using qt.conf (https://doc.qt.io/qt-6/highdpi.html#configuring-windows).
2024-07-21 11:25:47.482 | INFO | __main__:main:258 - len(action_events)=58
Generating Visualization: 0%| | 0/58 [00:00<?, ?event/s]
--- Logging error in Loguru Handler #1 ---
Record was: None
Traceback (most recent call last):
File "P:\OpenAdapt\.venv\lib\site-packages\loguru\_handler.py", line 272, in _queued_writer
message = queue.get()
File "P:\Program Files\Python310\lib\multiprocessing\queues.py", line 367, in get
return _ForkingPickler.loads(res)
File "av\\enum.pyx", line 130, in av.enum._unpickle
File "av\\enum.pyx", line 58, in av.enum.EnumType.__getitem__
KeyError: 'ERRORTYPE_2'
--- End of logging error ---
(.venv) PS P:\OpenAdapt>
To Reproduce
I use Windows 11 OS.
Step 1: Setup OpenAdapt.
Step 2: Record a small clip with clicking on calculator app and type 10 - 2 = operation. Then, I open chrome. And there as well I typed, 10 - 2. FInally, stop the recording. I wait for the record to finish successfully.
Step 3: Run python -m openadapt.app.visualize.
Thank you for reporting this @KrishPatel13. Can you please run poetry update av and try again?
As per the pair-programming session between @abrichr and me,
poetry remove av
poetry add av
worked for me. The old av version was 11.0.0 and the new version was: 12.3.0
Closing in light of: https://github.com/OpenAdaptAI/OpenAdapt/issues/862#issuecomment-2241706739.
This is still happening in the macOS Sonoma. I've updated the AV library and using the latest master https://github.com/PyAV-Org/PyAV/issues/991#issuecomment-1706713466 I followed the above to fix it
Reported by Bach Vu on Discord:
Last login: Fri Sep 20 13:53:00 on ttys000
macbook@May-tinh-xach-tay-cua-Macbook ~ % cd OpenAdapt
macbook@May-tinh-xach-tay-cua-Macbook OpenAdapt % poetry shell
Spawning shell within /Users/macbook/Library/Caches/pypoetry/virtualenvs/openadapt-o9nVgTAt-py3.10
macbook@May-tinh-xach-tay-cua-Macbook OpenAdapt % emulate bash -c '. /Users/macbook/Library/Caches/pypoetry/virtualenvs/openadapt-o9nVgTAt-py3.10/bin/activate'
(openadapt-py3.10) macbook@May-tinh-xach-tay-cua-Macbook OpenAdapt % python -m openadapt.entrypoint
2024-09-20 13:58:08.465 | INFO | openadapt.config:print_config:417 - Reading from /Users/macbook/OpenAdapt/openadapt/data/config.json
2024-09-20 13:58:08.465 | INFO | openadapt.config:print_config:421 - ROOT_DIR_PATH=/Users/macbook/OpenAdapt/openadapt
2024-09-20 13:58:08.465 | INFO | openadapt.config:print_config:421 - PRIVATE_AI_API_KEY=******************Y>
2024-09-20 13:58:08.465 | INFO | openadapt.config:print_config:421 - REPLICATE_API_TOKEN=*******************N>
2024-09-20 13:58:08.465 | INFO | openadapt.config:print_config:421 - DEFAULT_SEGMENTATION_ADAPTER=ultralytics
2024-09-20 13:58:08.465 | INFO | openadapt.config:print_config:421 - OPENAI_API_KEY=***************>
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - ANTHROPIC_API_KEY=******************>
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - GOOGLE_API_KEY=***************>
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - CACHE_DIR_PATH=.cache
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - CACHE_ENABLED=True
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - CACHE_VERBOSITY=0
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - DB_ECHO=False
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - ERROR_REPORTING_ENABLED=True
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - OPENAI_MODEL_NAME=gpt-3.5-turbo
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - EVENT_BUFFER_QUEUE_SIZE=100
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - RECORD_WINDOW_DATA=False
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - RECORD_READ_ACTIVE_ELEMENT_STATE=False
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - RECORD_VIDEO=True
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - RECORD_AUDIO=True
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - RECORD_BROWSER_EVENTS=False
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - RECORD_FULL_VIDEO=False
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - RECORD_IMAGES=False
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - LOG_MEMORY=False
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - REPLAY_STRIP_ELEMENT_STATE=True
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - VIDEO_ENCODING=libx264
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - VIDEO_PIXEL_FORMAT=yuv444p
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - VIDEO_DIR_PATH=/Users/macbook/OpenAdapt/openadapt/data/videos
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - STOP_SEQUENCES=[['o', 'a', '.', 's', 't', 'o', 'p'], ['ctrl', 'ctrl', 'ctrl']]
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - BROWSER_WEBSOCKET_SERVER_IP=localhost
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - BROWSER_WEBSOCKET_PORT=8765
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - BROWSER_WEBSOCKET_MAX_SIZE=4194304
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - IGNORE_WARNINGS=False
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - MAX_NUM_WARNINGS_PER_SECOND=5
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - WARNING_SUPPRESSION_PERIOD=1
2024-09-20 13:58:08.466 | INFO | openadapt.config:print_config:421 - MESSAGES_TO_FILTER=['Cannot pickle Objective-C objects']
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - ACTION_TEXT_SEP=-
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - ACTION_TEXT_NAME_PREFIX=<
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - ACTION_TEXT_NAME_SUFFIX=>
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - PLOT_PERFORMANCE=True
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - DATABASE_FILE_PATH=/Users/macbook/OpenAdapt/openadapt/data/openadapt.db
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - APP_DARK_MODE=False
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - SCRUB_ENABLED=False
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - SCRUB_CHAR=*
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - SCRUB_LANGUAGE=en
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - SCRUB_FILL_COLOR=255
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - SCRUB_KEYS_HTML=['text', 'canonical_text', 'title', 'state', 'task_description', 'key_char', 'canonical_key_char', 'key_vk', 'children']
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - SCRUB_CONFIG_TRF={'nlp_engine_name': 'spacy', 'models': [{'lang_code': 'en', 'model_name': 'en_core_web_trf'}]}
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - SCRUB_PRESIDIO_IGNORE_ENTITIES=[]
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - VISUALIZE_DARK_MODE=False
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - VISUALIZE_RUN_NATIVELY=True
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - VISUALIZE_DENSE_TREES=True
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - VISUALIZE_ANIMATIONS=True
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - VISUALIZE_EXPAND_ALL=False
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - VISUALIZE_MAX_TABLE_CHILDREN=10
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - SAVE_SCREENSHOT_DIFF=False
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - SPACY_MODEL_NAME=en_core_web_trf
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - DASHBOARD_CLIENT_PORT=5173
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - DASHBOARD_SERVER_PORT=8080
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - SOM_SERVER_URL=<SOM_SERVER_URL>
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - UNIQUE_USER_ID=785a6a0b-4db2-4b77-a16e-41ff3354194c
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - REDIRECT_TO_ONBOARDING=False
2024-09-20 13:58:08.467 | INFO | openadapt.config:print_config:421 - DEFAULT_ADAPTER=openai
2024-09-20 13:58:08.467 | INFO | openadapt.error_reporting:configure_error_reporting:18 - config.ERROR_REPORTING_ENABLED=True
2024-09-20 13:58:08.480 | INFO | openadapt.error_reporting:configure_error_reporting:26 - active_branch_name='main'
2024-09-20 13:58:08.480 | INFO | openadapt.error_reporting:configure_error_reporting:28 - is_reporting_branch=True
DB_URL=sqlite:////Users/macbook/OpenAdapt/openadapt/data/openadapt.db
INFO [alembic.runtime.migration] Context impl SQLiteImpl.
INFO [alembic.runtime.migration] Will assume non-transactional DDL.
> [email protected] dev
> concurrently "npm run next-dev" "npm run fastapi-dev"
[1]
[1] > [email protected] fastapi-dev
[1] > python3 -m uvicorn api.index:app --port $DASHBOARD_SERVER_PORT --reload
[1]
[0]
[0] > [email protected] next-dev
[0] > next dev -p $DASHBOARD_CLIENT_PORT
[0]
[1] INFO: Will watch for changes in these directories: ['/Users/macbook/OpenAdapt/openadapt/app/dashboard']
[1] INFO: Uvicorn running on http://127.0.0.1:8080 (Press CTRL+C to quit)
[1] INFO: Started reloader process [78076] using WatchFiles
[0] ⚠ Specified "rewrites" will not automatically work with "output: export". See more info here: https://nextjs.org/docs/messages/export-no-custom-routes
[0] ⚠ Specified "rewrites" will not automatically work with "output: export". See more info here: https://nextjs.org/docs/messages/export-no-custom-routes
[0] ▲ Next.js 14.1.4
[0] - Local: http://localhost:5173
[0]
[0] ⚠ Specified "rewrites" will not automatically work with "output: export". See more info here: https://nextjs.org/docs/messages/export-no-custom-routes
[0] ⚠ Specified "rewrites" will not automatically work with "output: export". See more info here: https://nextjs.org/docs/messages/export-no-custom-routes
[0] ✓ Ready in 1641ms
[1] INFO: Started server process [78078]
[1] INFO: Waiting for application startup.
[1] INFO: Application startup complete.
[0] ○ Compiling /recordings ...
[0] Browserslist: caniuse-lite is outdated. Please run:
[0] npx update-browserslist-db@latest
[0] Why you should do it regularly: https://github.com/browserslist/update-db#readme
[0] ✓ Compiled /recordings in 4.7s (2342 modules)
[0] ○ Compiling /not-found ...
2024-09-20 13:58:19.273 Python[77979:10136758] Warning: Window move completed without beginning
[0] ✓ Compiled /favicon.ico in 2.3s (2347 modules)
[0] ✓ Compiled (2377 modules)
2024-09-20 13:58:26.480 | INFO | openadapt.app.tray:_replay:296 - strategy_names=['NaiveReplayStrategy', 'VisualReplayStrategy', 'SegmentReplayStrategy', 'StatefulReplayStrategy', 'VanillaReplayStrategy']
2024-09-20 13:58:30.385 | INFO | openadapt.app.tray:_replay:398 - kwargs=
{'instructions': 'Copy all person commented in the facebook post to Notion '
'database'}
2024-09-20 13:58:30.397 | INFO | openadapt.app.tray:handle_recording_signal:197 - Received signal: {'type': 'replay.starting'}
2024-09-20 13:58:31.416 | INFO | openadapt.error_reporting:configure_error_reporting:18 - config.ERROR_REPORTING_ENABLED=True
2024-09-20 13:58:31.421 | INFO | openadapt.error_reporting:configure_error_reporting:26 - active_branch_name='main'
2024-09-20 13:58:31.421 | INFO | openadapt.error_reporting:configure_error_reporting:28 - is_reporting_branch=True
2024-09-20 13:58:31.981 | INFO | openadapt.app.tray:handle_recording_signal:197 - Received signal: {'type': 'replay.started'}
2024-09-20 13:58:31.981 | INFO | openadapt.replay:replay:71 - strategy_name='VisualReplayStrategy'
2024-09-20 13:58:35.412 | INFO | openadapt.replay:replay:84 - strategy_class=<class 'openadapt.strategies.visual.VisualReplayStrategy'>
2024-09-20 13:58:35.921 | INFO | openadapt.browser:add_screen_tlbr:200 - Finished processing all browser events for screen coordinates.
0%| | 0/109 [00:00<?, ?it/s]2024-09-20 13:58:35.923 | INFO | openadapt.browser:assign_browser_events:688 - Left Click: 88 action events, 0 browser events
2024-09-20 13:58:35.923 | INFO | openadapt.browser:evaluate_alignment:483 - Alignment for Left Click Events
2024-09-20 13:58:35.924 | INFO | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
2024-09-20 13:58:35.924 | INFO | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
2024-09-20 13:58:35.924 | INFO | openadapt.browser:assign_browser_events:688 - Right Click: 6 action events, 0 browser events
2024-09-20 13:58:35.925 | INFO | openadapt.browser:evaluate_alignment:483 - Alignment for Right Click Events
2024-09-20 13:58:35.925 | INFO | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
2024-09-20 13:58:35.925 | INFO | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
4%|█▌ | 4/109 [00:00<00:25, 4.09it/s]2024-09-20 13:58:36.900 | INFO | openadapt.browser:assign_browser_events:688 - Key Press A: 2 action events, 0 browser events
2024-09-20 13:58:36.900 | INFO | openadapt.browser:evaluate_alignment:483 - Alignment for Key Press A Events
2024-09-20 13:58:36.900 | INFO | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
2024-09-20 13:58:36.900 | INFO | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
2024-09-20 13:58:36.935 | INFO | openadapt.browser:assign_browser_events:688 - Key Press C: 4 action events, 0 browser events
2024-09-20 13:58:36.935 | INFO | openadapt.browser:evaluate_alignment:483 - Alignment for Key Press C Events
2024-09-20 13:58:36.935 | INFO | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
2024-09-20 13:58:36.935 | INFO | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
20%|████████▍ | 22/109 [00:01<00:03, 26.07it/s]2024-09-20 13:58:37.253 | INFO | openadapt.browser:assign_browser_events:688 - Key Press V: 6 action events, 0 browser events
2024-09-20 13:58:37.253 | INFO | openadapt.browser:evaluate_alignment:483 - Alignment for Key Press V Events
2024-09-20 13:58:37.254 | INFO | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
2024-09-20 13:58:37.254 | INFO | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
37%|███████████████▍ | 40/109 [00:01<00:01, 44.04it/s]2024-09-20 13:58:37.556 | INFO | openadapt.browser:assign_browser_events:688 - Key Press CTRL: 3 action events, 0 browser events
2024-09-20 13:58:37.556 | INFO | openadapt.browser:evaluate_alignment:483 - Alignment for Key Press CTRL Events
2024-09-20 13:58:37.556 | INFO | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
2024-09-20 13:58:37.556 | INFO | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
2024-09-20 13:58:37.590 | INFO | openadapt.browser:assign_browser_events:688 - Key Press ESC: 2 action events, 0 browser events
2024-09-20 13:58:37.590 | INFO | openadapt.browser:evaluate_alignment:483 - Alignment for Key Press ESC Events
2024-09-20 13:58:37.590 | INFO | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
42%|█████████████████▋ | 46/109 [00:01<00:01, 47.93it/s]2024-09-20 13:58:37.590 | INFO | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
48%|████████████████████ | 52/109 [00:01<00:01, 50.94it/s]2024-09-20 13:58:37.792 | INFO | openadapt.browser:assign_browser_events:688 - Key Release A: 2 action events, 0 browser events
2024-09-20 13:58:37.792 | INFO | openadapt.browser:evaluate_alignment:483 - Alignment for Key Release A Events
2024-09-20 13:58:37.792 | INFO | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
53%|██████████████████████▎ | 58/109 [00:01<00:00, 53.38it/s]2024-09-20 13:58:37.793 | INFO | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
2024-09-20 13:58:37.826 | INFO | openadapt.browser:assign_browser_events:688 - Key Release C: 4 action events, 0 browser events
2024-09-20 13:58:37.826 | INFO | openadapt.browser:evaluate_alignment:483 - Alignment for Key Release C Events
2024-09-20 13:58:37.826 | INFO | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
2024-09-20 13:58:37.826 | INFO | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
70%|█████████████████████████████▎ | 76/109 [00:02<00:00, 57.43it/s]2024-09-20 13:58:38.144 | INFO | openadapt.browser:assign_browser_events:688 - Key Release V: 6 action events, 0 browser events
2024-09-20 13:58:38.144 | INFO | openadapt.browser:evaluate_alignment:483 - Alignment for Key Release V Events
2024-09-20 13:58:38.144 | INFO | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
2024-09-20 13:58:38.144 | INFO | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
87%|████████████████████████████████████▌ | 95/109 [00:02<00:00, 58.98it/s]2024-09-20 13:58:38.446 | INFO | openadapt.browser:assign_browser_events:688 - Key Release CTRL: 3 action events, 0 browser events
2024-09-20 13:58:38.446 | INFO | openadapt.browser:evaluate_alignment:483 - Alignment for Key Release CTRL Events
2024-09-20 13:58:38.446 | INFO | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
2024-09-20 13:58:38.446 | INFO | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
2024-09-20 13:58:38.480 | INFO | openadapt.browser:assign_browser_events:688 - Key Release ESC: 2 action events, 0 browser events
2024-09-20 13:58:38.480 | INFO | openadapt.browser:evaluate_alignment:483 - Alignment for Key Release ESC Events
2024-09-20 13:58:38.480 | INFO | openadapt.browser:evaluate_alignment:542 - Total Matches: 0
2024-09-20 13:58:38.480 | INFO | openadapt.browser:evaluate_alignment:543 - Total Mismatches: 0
100%|█████████████████████████████████████████| 109/109 [00:02<00:00, 39.76it/s]
2024-09-20 13:58:38.663 | WARNING | openadapt.browser:assign_browser_events:745 - name='Remote' time_differences=[]
2024-09-20 13:58:38.663 | WARNING | openadapt.browser:assign_browser_events:745 - name='Local' time_differences=[]
2024-09-20 13:58:38.663 | WARNING | openadapt.browser:assign_browser_events:772 - axis='X' mouse_differences=[]
2024-09-20 13:58:38.664 | WARNING | openadapt.browser:assign_browser_events:772 - axis='Y' mouse_differences=[]
2024-09-20 13:58:38.664 | INFO | openadapt.browser:assign_browser_events:806 - Total Errors Across All Events: 0
2024-09-20 13:58:38.664 | INFO | openadapt.browser:log_stats:817 - event_stats['match_count']=0
2024-09-20 13:58:38.664 | INFO | openadapt.browser:log_stats:818 - event_stats['mismatch_count']=0
2024-09-20 13:58:38.664 | INFO | openadapt.browser:log_stats:819 - event_stats['unmatched_browser_events']=0
2024-09-20 13:58:39.043 | INFO | openadapt.events:get_events:80 - num_process_iters=0 num_action_events=3345 num_window_events=63 num_screenshots=475num_browser_events=0
2024-09-20 13:58:39.043 | INFO | openadapt.events:merge_events:849 - before num_action_events=3345 num_window_events=63 num_screenshots=475 num_browser_events=0 num_total=3883
2024-09-20 13:58:39.072 | INFO | openadapt.events:merge_consecutive_action_events:782 - name='redundant_mouse_move' num_events_removed=75
2024-09-20 13:58:39.102 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=2 group_idx_tups=[(0, 2)]
2024-09-20 13:58:39.102 | WARNING | openadapt.events:get_group_idx_tups:534 - Key.cmd not in pressed_keys=set()
2024-09-20 13:58:39.103 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.103 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.123 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.124 | WARNING | openadapt.events:get_group_idx_tups:534 - Key.esc not in pressed_keys=set()
2024-09-20 13:58:39.124 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.124 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=2 group_idx_tups=[(0, 2)]
2024-09-20 13:58:39.136 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=4 group_idx_tups=[(0, 2), (2, 4)]
2024-09-20 13:58:39.137 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.137 | WARNING | openadapt.events:get_group_idx_tups:534 - Key.ctrl not in pressed_keys=set()
2024-09-20 13:58:39.137 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.156 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.157 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.157 | WARNING | openadapt.events:get_group_idx_tups:534 - Key.cmd not in pressed_keys=set()
2024-09-20 13:58:39.157 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=2 group_idx_tups=[(0, 2)]
2024-09-20 13:58:39.161 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=2 group_idx_tups=[(0, 2)]
2024-09-20 13:58:39.162 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.162 | WARNING | openadapt.events:get_group_idx_tups:534 - Key.cmd not in pressed_keys=set()
2024-09-20 13:58:39.162 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.184 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=3 group_idx_tups=[(0, 3)]
2024-09-20 13:58:39.185 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.204 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.206 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.207 | WARNING | openadapt.events:get_group_idx_tups:534 - Key.cmd not in pressed_keys=set()
2024-09-20 13:58:39.207 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=2 group_idx_tups=[(0, 2)]
2024-09-20 13:58:39.210 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=6 group_idx_tups=[(0, 6)]
2024-09-20 13:58:39.228 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=2 group_idx_tups=[(0, 2)]
2024-09-20 13:58:39.228 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.229 | WARNING | openadapt.events:get_group_idx_tups:534 - Key.cmd not in pressed_keys=set()
2024-09-20 13:58:39.229 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.252 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.253 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.254 | WARNING | openadapt.events:get_group_idx_tups:534 - Key.cmd not in pressed_keys=set()
2024-09-20 13:58:39.254 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.254 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=1 group_idx_tups=[]
2024-09-20 13:58:39.259 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=6 group_idx_tups=[(0, 6)]
2024-09-20 13:58:39.278 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=2 group_idx_tups=[(0, 2)]
2024-09-20 13:58:39.279 | WARNING | openadapt.events:get_group_idx_tups:534 - Key.cmd not in pressed_keys=set()
2024-09-20 13:58:39.279 | INFO | openadapt.events:get_group_idx_tups:554 - len(to_merge)=2 group_idx_tups=[(0, 2)]
2024-09-20 13:58:39.301 | INFO | openadapt.events:merge_consecutive_action_events:782 - name='keyboard' num_events_removed=41
2024-09-20 13:58:39.330 | INFO | openadapt.events:merge_consecutive_action_events:782 - name='mouse_move' num_events_removed=3049
2024-09-20 13:58:39.330 | INFO | openadapt.events:merge_consecutive_action_events:782 - name='mouse_scroll' num_events_removed=2
2024-09-20 13:58:39.334 | INFO | openadapt.events:merge_consecutive_action_events:782 - name='mouse_click' num_events_removed=33
2024-09-20 13:58:39.335 | INFO | openadapt.events:merge_events:910 - after num_action_events_=145 num_window_events_=34 num_screenshots_=121 num_browser_events_=0 num_total_=300
2024-09-20 13:58:39.335 | INFO | openadapt.events:merge_events:916 - pct_action_events=0.043348281016442454 pct_window_events=0.5396825396825397 pct_screenshots=0.25473684210526315 pct_browser_events=None pct_total=0.07725985063095545
2024-09-20 13:58:39.335 | INFO | openadapt.events:get_events:142 - duration=3.8551647663116455
--- Logging error in Loguru Handler #1 ---
Record was: None
Traceback (most recent call last):
File "/Users/macbook/Library/Caches/pypoetry/virtualenvs/openadapt-o9nVgTAt-py3.10/lib/python3.10/site-packages/loguru/_handler.py", line 272, in _queued_writer
message = queue.get()
File "/opt/homebrew/Cellar/[email protected]/3.10.14_1/Frameworks/Python.framework/Versions/3.10/lib/python3.10/multiprocessing/queues.py", line 367, in get
return _ForkingPickler.loads(res)
File "av/enum.pyx", line 122, in av.enum._unpickle
File "av/enum.pyx", line 54, in av.enum.EnumType.__getitem__
KeyError: 'ERRORTYPE_2'
--- End of logging error ---
2024-09-20 13:58:39.347 | INFO | openadapt.strategies.visual:__del__:254 - action_history=
[]