server-client-python icon indicating copy to clipboard operation
server-client-python copied to clipboard

Incorrect size stats showed when publishing datasource

Open KulykDmytro opened this issue 1 year ago • 1 comments

Describe the bug

Incorrect size stats showed when publishing datasource. Fractions of MB showed however stands for fractions of TB Looks like wrong unit conversion happened when logging (division by 1024 instead of multiplication)

Versions Details of your environment, including:

  • Tableau Server version 2024.2.2
  • Python 3.12.6
  • TSC 0.34

To Reproduce

create datasource file with meaningful size (>128MB)

        job: JobItem = server.datasources.publish(
            datasource_item=DatasourceItem(project_id='foo', name='bar'),
            file='path/to/file.tdsx',
            mode='Overwrite',
            as_job=True,
        )

Results

[2025-01-21, 03:34:13 UTC] {tableau_hyper.py:246} INFO - Prepared hyper file size 13.2 GB
[2025-01-21, 03:34:14 UTC] {hyper.py:288} INFO - Overwrite datasource All report statistics.
[2025-01-21, 03:34:14 UTC] {datasources_endpoint.py:272} INFO - Publishing all_reports_statistics.hyper to server with chunking method (datasource over 64MB, chunk size 50MB)
[2025-01-21, 03:34:14 UTC] {fileuploads_endpoint.py:24} INFO - Initiated file upload session (ID: 18356:7d671b0f9c0a40beaab72d6b0ed7f4dc-1:0)
[2025-01-21, 03:34:15 UTC] {fileuploads_endpoint.py:31} INFO - Uploading a chunk to session (ID: 18356:7d671b0f9c0a40beaab72d6b0ed7f4dc-1:0)
[2025-01-21, 03:34:15 UTC] {fileuploads_endpoint.py:59} INFO - 	03:34:15 Published 4.9591064453125e-05MB
[2025-01-21, 03:34:16 UTC] {fileuploads_endpoint.py:31} INFO - Uploading a chunk to session (ID: 18356:7d671b0f9c0a40beaab72d6b0ed7f4dc-1:0)
[2025-01-21, 03:34:16 UTC] {fileuploads_endpoint.py:59} INFO - 	03:34:16 Published 0.00010013580322265625MB
...
[2025-01-21, 03:39:41 UTC] {fileuploads_endpoint.py:31} INFO - Uploading a chunk to session (ID: 18356:7d671b0f9c0a40beaab72d6b0ed7f4dc-1:0)
[2025-01-21, 03:39:41 UTC] {fileuploads_endpoint.py:59} INFO - 	03:39:41 Published 0.012607574462890625MB
[2025-01-21, 03:39:41 UTC] {fileuploads_endpoint.py:60} INFO - File upload finished (ID: 18356:7d671b0f9c0a40beaab72d6b0ed7f4dc-1:0)

KulykDmytro avatar Jan 21 '25 08:01 KulykDmytro

based on this fileUploads response contains fileSize in MB units already

KulykDmytro avatar Jan 21 '25 08:01 KulykDmytro

This fix was merged and included in release 0.37 https://github.com/tableau/server-client-python/releases/tag/v0.37

bcantoni avatar May 23 '25 05:05 bcantoni