scancode.io icon indicating copy to clipboard operation
scancode.io copied to clipboard

Turn off "One or more of the required fields have no value" errors

Open tdruez opened this issue 4 years ago • 3 comments

Those Project issues are not particularly useful and there's often too much of those. It has the bad effect of hiding more important errors that happened during pipeline runs.

Screenshot 2021-10-07 at 9 58 57 AM

@pombredanne any good reasons to keep creating those?

tdruez avatar Oct 07 '21 06:10 tdruez

  • Not creating these as packages may mean we skip on useful things.
  • The error messages are problematic.
  • IMHO we should have something that would be some way to provide a warning: here is a Windows executable and we do not have full information on its origin and license. You should look into this

pombredanne avatar Oct 07 '21 07:10 pombredanne

Not creating these as packages may mean we skip on useful things.

They cannot be created as packages (only resources) at the DB level since those are missing mandatory fields...

tdruez avatar Oct 07 '21 07:10 tdruez

Packages that are incomplete can or cannot be created (may be they could) when they are missing some key fields BUT in all cases these are warnings and not errors. I suggest these updates

  • rename the ProjectError model to ProjectMessage
  • add a "severity" field to each error as a choice of "error", "warning", "info".
  • the packages that are missing some key fields should de tagged as "warning" rather than error.
  • we could display the counters of info/warning/messages rather than only errors.
  • later, we could have a way to resolve errors with a new "resolution" field that would store a resolution note when the error is resolved. For instance this kind of error:
ERROR: for scanner: licenses: ERROR: Processing interrupted: timeout after 120 seconds. 	
id: 21457001
md5: 43e47161986663a8d308c08907c21931
name: TestListSkus
path: azure-sdk-for-net-64c6c3b957bd22fb0664bb3b7500c046aaa87ddc.zip-extract/azure-sdk-for-net-64c6c3b957bd22fb0664bb3b7500c046aaa87ddc/sdk/compute/Microsoft.Azure.Management.Compute/tests/SessionRecords/ListSkuTests/TestListSkus.json

could be resolved automatically as "not important" as this is a large (15MB) JSON data files that times out, adn is further a test file.

Also it would be useful to:

  • keep a link to the corresponding Resource(s) or Package to help with the investigation.
  • always create these packages even if not complete or missing some key information

There also bugs and improvement issues to have fewer errors and messages:

  • https://github.com/nexB/scancode-toolkit/issues/2732
  • https://github.com/nexB/scancode-toolkit/issues/2733
  • https://github.com/nexB/scancode-toolkit/issues/2734

pombredanne avatar Oct 12 '21 13:10 pombredanne