initialization-actions icon indicating copy to clipboard operation
initialization-actions copied to clipboard

[hue] Enable Hive on 1.5 and 2.0 images

Open DKbyo opened this issue 3 years ago • 3 comments

Hive is not enabled on hue 4.8.0 due wrong interpreter name

  • Includes test case to validate hive interpreter in hue config using HUE REST API

Internal bug

b/225389567

DKbyo avatar Mar 18 '22 19:03 DKbyo

/gcbrun

medb avatar Apr 06 '22 02:04 medb

Test fails with error:

FAILED (failures=1)
================================================================================
==================== Test output for //hue:test_hue (shard 1 of 3):
Running tests under Python 3.8.10: /usr/bin/python3
[ RUN      ] HueTestCase.test_hue('SINGLE', ['m'])
[  FAILED  ] HueTestCase.test_hue('SINGLE', ['m'])
======================================================================
FAIL: test_hue('SINGLE', ['m']) (__main__.HueTestCase)
test_hue('SINGLE', ['m']) (__main__.HueTestCase)
test_hue('SINGLE', ['m'])
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test
    test_method(self, *testcase_params)
  File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/hue/test_hue.py", line 47, in test_hue
    self.verify_instance("{}-{}".format(self.getClusterName(),
  File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/hue/test_hue.py", line 28, in verify_instance
    self._run_hue_test_script(instance_name)
  File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/hue/test_hue.py", line 32, in _run_hue_test_script
    self.upload_test_file(
  File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 226, in upload_test_file
    self.assert_command('gcloud compute scp {} {}: --zone={}'.format(
  File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 305, in assert_command
    self.assertEqual(
AssertionError: 1 != 0 : Failed to execute command:
gcloud compute scp /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/hue/test_hue_with_hive.sh test-hue-single-1-5-20220407-220535-px68-m: --zone=us-central1-f
STDOUT:

STDERR:
/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/hue/test_hue_with_hive.sh: No such file or directory
ERROR: (gcloud.beta.compute.scp) [/usr/bin/scp] exited with return code [1].

May you fix it? I think you can find in other tests how they reference test files, if this is the issue.

medb avatar Apr 08 '22 00:04 medb

@medb

May you fix it? I think you can find in other tests how they reference test files, if this is the issue.

Done, fixed py_test

DKbyo avatar Apr 08 '22 21:04 DKbyo