cli icon indicating copy to clipboard operation
cli copied to clipboard

Difference in output when tests fails or succeeds when running fga model test with --verbose flag.

Open magnusart opened this issue 1 year ago • 0 comments

Checklist

  • [X] I have looked into the README and have not found a suitable solution or answer.
  • [X] I have looked into the documentation and have not found a suitable solution or answer.
  • [X] I have searched the issues and have not found a suitable solution or answer.
  • [X] I have upgraded to the latest version of OpenFGA and the issue still persists.
  • [X] I have searched the OpenFGA Community and have not found a suitable solution or answer.
  • [X] I agree to the terms within the OpenFGA Code of Conduct.

Description

When I run the command fga model test --test=.. I get the output:

# Test Summary #
Tests 24/24 passing
Checks 62/62 passing

When I run the command fga model test --test=.. --verbose I get the output:

[
 ... JSON output ...
]
# Test Summary #
Tests 24/24 passing
Checks 62/62 passing

However if I make a change to a test so one test fails and run the same command fga model test --test=.. --verbose I get the output:

[
 ... JSON output ...
]

Expectation

  1. The test summary should not be included when using the --verbose flag.
  2. The output should be identical in structure when using the --verbose flag regardless if the test suite fails or succeeds.

This creates problems when running the CLI tool from build scripts and I want to interpret the output.

Reproduction

  1. fga model test --test=.. --verbose
  2. Check output
  3. Make test fail
  4. Compare output

OpenFGA version

0.4.0 (latest from homebrew)

How are you running OpenFGA?

As a binary

What datastore are you using?

In-Memory

OpenFGA Flags

Nope

Logs

No

magnusart avatar May 22 '24 09:05 magnusart