bigquery-utils icon indicating copy to clipboard operation
bigquery-utils copied to clipboard

Too many subqueries or query is too complex for "Job Concurrency Slow"

Open charlibot opened this issue 4 years ago • 4 comments

Hi, I've successfully copied over most of the data sources for BigQuery System Tables Reports but hit an issue with the "Job Concurrency Slow" datasource. When I swap the INFORMATION_SCHEMA_PUBLIC_V2 references for `region-{region_name}`.INFORMATION_SCHEMA and reconnect I see the error:

Resources exceeded during query execution: Not enough resources for query planning - too many subqueries or query is too complex.

Is this expected? Is there a simplified query I can use instead?

charlibot avatar Jan 03 '22 15:01 charlibot

I have the same issue with that query.

NotSoCleverLogin avatar Mar 21 '22 17:03 NotSoCleverLogin

I got the same, but solved it by moving the job_info part out into a temp table like this:

CREATE TEMP TABLE job_info AS (  
  SELECT
    creation_time,
    end_time,
    project_id,
    reservation_id
  FROM
    `region-us`.INFORMATION_SCHEMA.JOBS_BY_ORGANIZATION
  WHERE
    job_id = @job_param
);  

WITH
   organization_capacity AS (....

But then I get this error instead Screenshot 2022-04-05 at 10 57 26

torbjornvatn avatar Apr 05 '22 08:04 torbjornvatn

I'm getting this error also!

Also tried the workaround above but got a different error, still not able to reconnect.

ipv1337 avatar May 07 '22 11:05 ipv1337

We had slot commitment and to fix this issue I had to add additional 200 flex slots, but later once everything got stable I removed the flex slots i have added (kept those slots for 24 hours or so) Vijay Pudukkudi @.*** [image: linkedin] https://www.linkedin.com/company/freestar [image: facebook] https://www.facebook.com/freestario [image: twitter] https://twitter.com/publisherfirst [image: instagram] https://www.instagram.com/publisherfirst/ https://try.freestar.com/q2-2022/?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature https://try.freestar.com/q2-2022/?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature *Coming to a City Near You: * Book a Meet Up With Us! https://try.freestar.com/q2-2022/?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature

On Sat, May 7, 2022 at 5:08 PM James H. Nguyen @.***> wrote:

I'm getting this error also!

Also tried the workaround above but got a different error, still not able to reconnect.

— Reply to this email directly, view it on GitHub https://github.com/GoogleCloudPlatform/bigquery-utils/issues/275#issuecomment-1120193895, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQ5NEU4CJX5PE7ACVAPXH2TVIZI3XANCNFSM5LFNW3MA . You are receiving this because you are subscribed to this thread.Message ID: @.***>

vjfreestar avatar May 07 '22 11:05 vjfreestar