In case the kinematics cuts completely exclude some datasets, validphys still tries to build the theory covmat for them. This generates an error, since there are no predictions for these excluded datasets in order to build the relevant covmat. I know that such a situation is very unlikely (very high cuts), but it might be useful for some consistency checks (for instance, in the Higher twist project).

You should be able to reproduce this error using the following runcard and the master branch:

Runcard

#
# Configuration file for n3fit
#
######################################################################################
description: Runcard for issue ...
######################################################################################
dataset_inputs:
- {dataset: NMC_NC_NOTFIXED_EM-F2, frac: 0.75, variant: legacy_dw}
- {dataset: NMC_NC_NOTFIXED_P_EM-SIGMARED, frac: 0.75, variant: legacy}
- {dataset: SLAC_NC_NOTFIXED_P_EM-F2, frac: 0.75, variant: legacy_dw}
- {dataset: SLAC_NC_NOTFIXED_D_EM-F2, frac: 0.75, variant: legacy_dw}
- {dataset: BCDMS_NC_NOTFIXED_P_EM-F2, frac: 0.75, variant: legacy_dw}
- {dataset: BCDMS_NC_NOTFIXED_D_EM-F2, frac: 0.75, variant: legacy_dw}
- {dataset: CHORUS_CC_NOTFIXED_PB_NU-SIGMARED, frac: 0.75, variant: legacy_dw}
- {dataset: CHORUS_CC_NOTFIXED_PB_NB-SIGMARED, frac: 0.75, variant: legacy_dw}
- {dataset: NUTEV_CC_NOTFIXED_FE_NU-SIGMARED, cfac: [MAS], frac: 0.75, variant: legacy_dw}
- {dataset: NUTEV_CC_NOTFIXED_FE_NB-SIGMARED, cfac: [MAS], frac: 0.75, variant: legacy_dw}
- {dataset: HERA_NC_318GEV_EM-SIGMARED, frac: 0.75, variant: legacy}
- {dataset: HERA_NC_225GEV_EP-SIGMARED, frac: 0.75, variant: legacy}
- {dataset: HERA_NC_251GEV_EP-SIGMARED, frac: 0.75, variant: legacy}
- {dataset: HERA_NC_300GEV_EP-SIGMARED, frac: 0.75, variant: legacy}
- {dataset: HERA_NC_318GEV_EP-SIGMARED, frac: 0.75, variant: legacy}
- {dataset: HERA_CC_318GEV_EM-SIGMARED, frac: 0.75, variant: legacy}
- {dataset: HERA_CC_318GEV_EP-SIGMARED, frac: 0.75, variant: legacy}
- {dataset: HERA_NC_318GEV_EAVG_CHARM-SIGMARED, frac: 0.75, variant: legacy}
- {dataset: HERA_NC_318GEV_EAVG_BOTTOM-SIGMARED, frac: 0.75, variant: legacy}
- {dataset: DYE866_Z0_800GEV_DW_RATIO_PDXSECRATIO, frac: 0.75, variant: legacy}
- {dataset: DYE866_Z0_800GEV_PXSEC, frac: 0.75, variant: legacy}
- {dataset: DYE605_Z0_38P8GEV_DW_PXSEC, frac: 0.75, variant: legacy}
- {dataset: DYE906_Z0_120GEV_DW_PDXSECRATIO, frac: 0.75, cfac: [ACC], variant: legacy}
- {dataset: CDF_Z0_1P96TEV_ZRAP, frac: 0.75, variant: legacy}
- {dataset: D0_Z0_1P96TEV_ZRAP, frac: 0.75, variant: legacy}
- {dataset: D0_WPWM_1P96TEV_ASY, frac: 0.75, variant: legacy}
- {dataset: ATLAS_WPWM_7TEV_36PB_ETA, frac: 0.75, variant: legacy}
- {dataset: ATLAS_Z0_7TEV_36PB_ETA, frac: 0.75, variant: legacy}
- {dataset: ATLAS_Z0_7TEV_49FB_HIMASS, frac: 0.75, variant: legacy}
- {dataset: ATLAS_Z0_7TEV_LOMASS_M, frac: 0.75, variant: legacy}
- {dataset: ATLAS_WPWM_7TEV_46FB_CC-ETA, frac: 0.75, variant: legacy}
- {dataset: ATLAS_Z0_7TEV_46FB_CC-Y, frac: 0.75, variant: legacy}
- {dataset: ATLAS_Z0_7TEV_46FB_CF-Y, frac: 0.75, variant: legacy}
- {dataset: ATLAS_Z0_8TEV_HIMASS_M-Y, frac: 0.75, variant: legacy}
- {dataset: ATLAS_Z0_8TEV_LOWMASS_M-Y, frac: 0.75, variant: legacy}
- {dataset: ATLAS_Z0_13TEV_TOT, frac: 0.75, cfac: [NRM], variant: legacy}
- {dataset: ATLAS_WPWM_13TEV_TOT, frac: 0.75, cfac: [NRM], variant: legacy}
- {dataset: ATLAS_WJ_8TEV_WP-PT, frac: 0.75, variant: legacy}
- {dataset: ATLAS_WJ_8TEV_WM-PT, frac: 0.75, variant: legacy}
- {dataset: ATLAS_Z0J_8TEV_PT-M, frac: 0.75, variant: legacy_10}
- {dataset: ATLAS_Z0J_8TEV_PT-Y, frac: 0.75, variant: legacy_10}
- {dataset: ATLAS_TTBAR_7TEV_TOT_X-SEC, frac: 0.75, variant: legacy}
- {dataset: ATLAS_TTBAR_8TEV_TOT_X-SEC, frac: 0.75, variant: legacy}
- {dataset: ATLAS_TTBAR_13TEV_TOT_X-SEC, frac: 0.75, variant: legacy}
- {dataset: ATLAS_TTBAR_8TEV_LJ_DIF_YT-NORM, frac: 0.75, variant: legacy}
- {dataset: ATLAS_TTBAR_8TEV_LJ_DIF_YTTBAR-NORM, frac: 0.75, variant: legacy}
- {dataset: ATLAS_TTBAR_8TEV_2L_DIF_YTTBAR-NORM, frac: 0.75, variant: legacy}
- {dataset: ATLAS_1JET_8TEV_R06_PTY, frac: 0.75, variant: legacy_decorrelated}
- {dataset: ATLAS_2JET_7TEV_R06_M12Y, frac: 0.75, variant: legacy}
- {dataset: ATLAS_PH_13TEV_XSEC, frac: 0.75, cfac: [EWK], variant: legacy}
- {dataset: ATLAS_SINGLETOP_7TEV_TCHANNEL-XSEC, frac: 0.75, variant: legacy}
- {dataset: ATLAS_SINGLETOP_13TEV_TCHANNEL-XSEC, frac: 0.75, variant: legacy}
- {dataset: ATLAS_SINGLETOP_7TEV_T-Y-NORM, frac: 0.75, variant: legacy}
- {dataset: ATLAS_SINGLETOP_7TEV_TBAR-Y-NORM, frac: 0.75, variant: legacy}
- {dataset: ATLAS_SINGLETOP_8TEV_T-RAP-NORM, frac: 0.75, variant: legacy}
- {dataset: ATLAS_SINGLETOP_8TEV_TBAR-RAP-NORM, frac: 0.75, variant: legacy}
- {dataset: CMS_WPWM_7TEV_ELECTRON_ASY, frac: 0.75}
- {dataset: CMS_WPWM_7TEV_MUON_ASY, frac: 0.75, variant: legacy}
- {dataset: CMS_Z0_7TEV_DIMUON_2D, frac: 0.75}
- {dataset: CMS_WPWM_8TEV_MUON_Y, frac: 0.75, variant: legacy}
- {dataset: CMS_Z0J_8TEV_PT-Y, frac: 0.75, cfac: [NRM], variant: legacy_10}
- {dataset: CMS_2JET_7TEV_M12Y, frac: 0.75}
- {dataset: CMS_1JET_8TEV_PTY, frac: 0.75, variant: legacy}
- {dataset: CMS_TTBAR_7TEV_TOT_X-SEC, frac: 0.75, variant: legacy}
- {dataset: CMS_TTBAR_8TEV_TOT_X-SEC, frac: 0.75, variant: legacy}
- {dataset: CMS_TTBAR_13TEV_TOT_X-SEC, frac: 0.75, variant: legacy}
- {dataset: CMS_TTBAR_8TEV_LJ_DIF_YTTBAR-NORM, frac: 0.75, variant: legacy}
- {dataset: CMS_TTBAR_5TEV_TOT_X-SEC, frac: 0.75, variant: legacy}
- {dataset: CMS_TTBAR_8TEV_2L_DIF_MTTBAR-YT-NORM, frac: 0.75, variant: legacy}
- {dataset: CMS_TTBAR_13TEV_2L_DIF_YT, frac: 0.75, variant: legacy}
- {dataset: CMS_TTBAR_13TEV_LJ_2016_DIF_YTTBAR, frac: 0.75, variant: legacy}
- {dataset: CMS_SINGLETOP_7TEV_TCHANNEL-XSEC, frac: 0.75, variant: legacy}
- {dataset: CMS_SINGLETOP_8TEV_TCHANNEL-XSEC, frac: 0.75, variant: legacy}
- {dataset: CMS_SINGLETOP_13TEV_TCHANNEL-XSEC, frac: 0.75, variant: legacy}
- {dataset: LHCB_Z0_7TEV_DIELECTRON_Y, frac: 0.75}
- {dataset: LHCB_Z0_8TEV_DIELECTRON_Y, frac: 0.75}
- {dataset: LHCB_WPWM_7TEV_MUON_Y, frac: 0.75, cfac: [NRM]}
- {dataset: LHCB_Z0_7TEV_MUON_Y, frac: 0.75, cfac: [NRM]}
- {dataset: LHCB_WPWM_8TEV_MUON_Y, frac: 0.75, cfac: [NRM]}
- {dataset: LHCB_Z0_8TEV_MUON_Y, frac: 0.75, cfac: [NRM]}
- {dataset: LHCB_Z0_13TEV_DIMUON-Y, frac: 0.75}
- {dataset: LHCB_Z0_13TEV_DIELECTRON-Y, frac: 0.75}

################################################################################
datacuts:
t0pdfset: 240701-02-rs-nnpdf40-baseline
q2min: 50.0
w2min: 3.24

################################################################################
# NNLO QCD TRN evolution
theory:
theoryid: 708

theorycovmatconfig:
point_prescriptions: ["7 point"]
pdf: 240701-02-rs-nnpdf40-baseline
use_thcovmat_in_fitting: true
use_thcovmat_in_sampling: true
resample_negative_pseudodata: false

# For fits <= 4.0 multiplicative and additive uncertainties were sampled separately
# and thus the flag `separate_multiplicative` needs to be set to True
# sampling:
#   separate_multiplicative: True

################################################################################
trvlseed: 591866982
nnseed: 945709987
mcseed: 519562661
genrep: true

################################################################################
parameters: # This defines the parameter dictionary that is passed to the Model Trainer
nodes_per_layer: [25, 20, 8]
activation_per_layer: [tanh, tanh, linear]
initializer: glorot_normal
optimizer:
  clipnorm: 6.073e-6
  learning_rate: 2.621e-3
  optimizer_name: Nadam
epochs: 17000
positivity:
  initial: 184.8
  multiplier:
integrability:
  initial: 10
  multiplier:
stopping_patience: 0.1
layer_type: dense
dropout: 0.0
threshold_chi2: 3.5

fitting:
fitbasis: EVOL
savepseudodata: True
basis:
- {fl: sng, trainable: false, smallx: [1.089, 1.119], largex: [1.475, 3.119]}
- {fl: g, trainable: false, smallx: [0.7504, 1.098], largex: [2.814, 5.669]}
- {fl: v, trainable: false, smallx: [0.479, 0.7384], largex: [1.549, 3.532]}
- {fl: v3, trainable: false, smallx: [0.1073, 0.4397], largex: [1.733, 3.458]}
- {fl: v8, trainable: false, smallx: [0.5507, 0.7837], largex: [1.516, 3.356]}
- {fl: t3, trainable: false, smallx: [-0.4506, 0.9305], largex: [1.745, 3.424]}
- {fl: t8, trainable: false, smallx: [0.5877, 0.8687], largex: [1.522, 3.515]}
- {fl: t15, trainable: false, smallx: [1.089, 1.141], largex: [1.492, 3.222]}

################################################################################
positivity:
posdatasets:
# Positivity Lagrange Multiplier
- {dataset: NNPDF_POS_2P24GEV_F2U, maxlambda: 1e6}
- {dataset: NNPDF_POS_2P24GEV_F2D, maxlambda: 1e6}
- {dataset: NNPDF_POS_2P24GEV_F2S, maxlambda: 1e6}
- {dataset: NNPDF_POS_2P24GEV_FLL, maxlambda: 1e6}
- {dataset: NNPDF_POS_2P24GEV_DYU, maxlambda: 1e10}
- {dataset: NNPDF_POS_2P24GEV_DYD, maxlambda: 1e10}
- {dataset: NNPDF_POS_2P24GEV_DYS, maxlambda: 1e10}
- {dataset: NNPDF_POS_2P24GEV_F2C, maxlambda: 1e6}
# Positivity of MSbar PDFs
- {dataset: NNPDF_POS_2P24GEV_XUQ, maxlambda: 1e6}
- {dataset: NNPDF_POS_2P24GEV_XUB, maxlambda: 1e6}
- {dataset: NNPDF_POS_2P24GEV_XDQ, maxlambda: 1e6}
- {dataset: NNPDF_POS_2P24GEV_XDB, maxlambda: 1e6}
- {dataset: NNPDF_POS_2P24GEV_XSQ, maxlambda: 1e6}
- {dataset: NNPDF_POS_2P24GEV_XSB, maxlambda: 1e6}
- {dataset: NNPDF_POS_2P24GEV_XGL, maxlambda: 1e6}

added_filter_rules:
- dataset: NNPDF_POS_2P24GEV_FLL
  rule: "x > 5.0e-7"
- dataset: NNPDF_POS_2P24GEV_F2C
  rule: "x < 0.74"
- dataset: NNPDF_POS_2P24GEV_XGL
  rule: "x > 0.1"
- dataset: NNPDF_POS_2P24GEV_XUQ
  rule: "x > 0.1"
- dataset: NNPDF_POS_2P24GEV_XUB
  rule: "x > 0.1"
- dataset: NNPDF_POS_2P24GEV_XDQ
  rule: "x > 0.1"
- dataset: NNPDF_POS_2P24GEV_XDB
  rule: "x > 0.1"
- dataset: NNPDF_POS_2P24GEV_XSQ
  rule: "x > 0.1"
- dataset: NNPDF_POS_2P24GEV_XSB
  rule: "x > 0.1"

integrability:
integdatasets:
- {dataset: NNPDF_INTEG_3GEV_XT8, maxlambda: 1e2}
- {dataset: NNPDF_INTEG_3GEV_XT3, maxlambda: 1e2}

################################################################################
debug: false
maxcores: 8

Error log

Using Keras backend
[WARNING]: Output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_ Overwriting contents
[WARNING]: Using q2min from runcard
[WARNING]: Using w2min from runcard
[INFO]: All requirements processed and checked successfully. Executing actions.
[INFO]: Filtering real data.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/NMC_NC_NOTFIXED_EM-F2 Overwriting contents
[INFO]: 12/260 datapoints in NMC_NC_NOTFIXED_EM-F2 passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/NMC_NC_NOTFIXED_P_EM-SIGMARED Overwriting contents
[INFO]: 3/292 datapoints in NMC_NC_NOTFIXED_P_EM-SIGMARED passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/SLAC_NC_NOTFIXED_P_EM-F2 Overwriting contents
[INFO]: 0/211 datapoints in SLAC_NC_NOTFIXED_P_EM-F2 passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/SLAC_NC_NOTFIXED_D_EM-F2 Overwriting contents
[INFO]: 0/211 datapoints in SLAC_NC_NOTFIXED_D_EM-F2 passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/BCDMS_NC_NOTFIXED_P_EM-F2 Overwriting contents
[INFO]: 118/351 datapoints in BCDMS_NC_NOTFIXED_P_EM-F2 passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/BCDMS_NC_NOTFIXED_D_EM-F2 Overwriting contents
[INFO]: 109/254 datapoints in BCDMS_NC_NOTFIXED_D_EM-F2 passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CHORUS_CC_NOTFIXED_PB_NU-SIGMARED Overwriting contents
[INFO]: 35/607 datapoints in CHORUS_CC_NOTFIXED_PB_NU-SIGMARED passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CHORUS_CC_NOTFIXED_PB_NB-SIGMARED Overwriting contents
[INFO]: 35/607 datapoints in CHORUS_CC_NOTFIXED_PB_NB-SIGMARED passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/NUTEV_CC_NOTFIXED_FE_NU-SIGMARED Overwriting contents
[INFO]: 5/45 datapoints in NUTEV_CC_NOTFIXED_FE_NU-SIGMARED passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/NUTEV_CC_NOTFIXED_FE_NB-SIGMARED Overwriting contents
[INFO]: 2/45 datapoints in NUTEV_CC_NOTFIXED_FE_NB-SIGMARED passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/HERA_NC_318GEV_EM-SIGMARED Overwriting contents
[INFO]: 159/159 datapoints in HERA_NC_318GEV_EM-SIGMARED passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/HERA_NC_225GEV_EP-SIGMARED Overwriting contents
[INFO]: 119/209 datapoints in HERA_NC_225GEV_EP-SIGMARED passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/HERA_NC_251GEV_EP-SIGMARED Overwriting contents
[INFO]: 142/260 datapoints in HERA_NC_251GEV_EP-SIGMARED passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/HERA_NC_300GEV_EP-SIGMARED Overwriting contents
[INFO]: 41/112 datapoints in HERA_NC_300GEV_EP-SIGMARED passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/HERA_NC_318GEV_EP-SIGMARED Overwriting contents
[INFO]: 216/485 datapoints in HERA_NC_318GEV_EP-SIGMARED passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/HERA_CC_318GEV_EM-SIGMARED Overwriting contents
[INFO]: 42/42 datapoints in HERA_CC_318GEV_EM-SIGMARED passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/HERA_CC_318GEV_EP-SIGMARED Overwriting contents
[INFO]: 39/39 datapoints in HERA_CC_318GEV_EP-SIGMARED passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/HERA_NC_318GEV_EAVG_CHARM-SIGMARED Overwriting contents
[INFO]: 18/52 datapoints in HERA_NC_318GEV_EAVG_CHARM-SIGMARED passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/HERA_NC_318GEV_EAVG_BOTTOM-SIGMARED Overwriting contents
[INFO]: 13/27 datapoints in HERA_NC_318GEV_EAVG_BOTTOM-SIGMARED passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/DYE866_Z0_800GEV_DW_RATIO_PDXSECRATIO Overwriting contents
[INFO]: 15/15 datapoints in DYE866_Z0_800GEV_DW_RATIO_PDXSECRATIO passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/DYE866_Z0_800GEV_PXSEC Overwriting contents
[INFO]: 89/184 datapoints in DYE866_Z0_800GEV_PXSEC passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/DYE605_Z0_38P8GEV_DW_PXSEC Overwriting contents
[INFO]: 85/119 datapoints in DYE605_Z0_38P8GEV_DW_PXSEC passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/DYE906_Z0_120GEV_DW_PDXSECRATIO Overwriting contents
[INFO]: 6/6 datapoints in DYE906_Z0_120GEV_DW_PDXSECRATIO passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CDF_Z0_1P96TEV_ZRAP Overwriting contents
[INFO]: 28/28 datapoints in CDF_Z0_1P96TEV_ZRAP passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/D0_Z0_1P96TEV_ZRAP Overwriting contents
[INFO]: 28/28 datapoints in D0_Z0_1P96TEV_ZRAP passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/D0_WPWM_1P96TEV_ASY Overwriting contents
[INFO]: 9/10 datapoints in D0_WPWM_1P96TEV_ASY passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_WPWM_7TEV_36PB_ETA Overwriting contents
[INFO]: 22/22 datapoints in ATLAS_WPWM_7TEV_36PB_ETA passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_Z0_7TEV_36PB_ETA Overwriting contents
[INFO]: 8/8 datapoints in ATLAS_Z0_7TEV_36PB_ETA passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_Z0_7TEV_49FB_HIMASS Overwriting contents
[INFO]: 5/13 datapoints in ATLAS_Z0_7TEV_49FB_HIMASS passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_Z0_7TEV_LOMASS_M Overwriting contents
[INFO]: 6/6 datapoints in ATLAS_Z0_7TEV_LOMASS_M passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_WPWM_7TEV_46FB_CC-ETA Overwriting contents
[INFO]: 22/22 datapoints in ATLAS_WPWM_7TEV_46FB_CC-ETA passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_Z0_7TEV_46FB_CC-Y Overwriting contents
[INFO]: 24/24 datapoints in ATLAS_Z0_7TEV_46FB_CC-Y passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_Z0_7TEV_46FB_CF-Y Overwriting contents
[INFO]: 15/15 datapoints in ATLAS_Z0_7TEV_46FB_CF-Y passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_Z0_8TEV_HIMASS_M-Y Overwriting contents
[INFO]: 48/48 datapoints in ATLAS_Z0_8TEV_HIMASS_M-Y passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_Z0_8TEV_LOWMASS_M-Y Overwriting contents
[INFO]: 60/84 datapoints in ATLAS_Z0_8TEV_LOWMASS_M-Y passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_Z0_13TEV_TOT Overwriting contents
[INFO]: 1/1 datapoints in ATLAS_Z0_13TEV_TOT passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_WPWM_13TEV_TOT Overwriting contents
[INFO]: 2/2 datapoints in ATLAS_WPWM_13TEV_TOT passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_WJ_8TEV_WP-PT Overwriting contents
[INFO]: 15/16 datapoints in ATLAS_WJ_8TEV_WP-PT passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_WJ_8TEV_WM-PT Overwriting contents
[INFO]: 15/16 datapoints in ATLAS_WJ_8TEV_WM-PT passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_Z0J_8TEV_PT-M Overwriting contents
[INFO]: 44/64 datapoints in ATLAS_Z0J_8TEV_PT-M passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_Z0J_8TEV_PT-Y Overwriting contents
[INFO]: 48/120 datapoints in ATLAS_Z0J_8TEV_PT-Y passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_TTBAR_7TEV_TOT_X-SEC Overwriting contents
[INFO]: 1/1 datapoints in ATLAS_TTBAR_7TEV_TOT_X-SEC passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_TTBAR_8TEV_TOT_X-SEC Overwriting contents
[INFO]: 1/1 datapoints in ATLAS_TTBAR_8TEV_TOT_X-SEC passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_TTBAR_13TEV_TOT_X-SEC Overwriting contents
[INFO]: 1/1 datapoints in ATLAS_TTBAR_13TEV_TOT_X-SEC passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_TTBAR_8TEV_LJ_DIF_YT-NORM Overwriting contents
[INFO]: 4/5 datapoints in ATLAS_TTBAR_8TEV_LJ_DIF_YT-NORM passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_TTBAR_8TEV_LJ_DIF_YTTBAR-NORM Overwriting contents
[INFO]: 4/5 datapoints in ATLAS_TTBAR_8TEV_LJ_DIF_YTTBAR-NORM passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_TTBAR_8TEV_2L_DIF_YTTBAR-NORM Overwriting contents
[INFO]: 4/5 datapoints in ATLAS_TTBAR_8TEV_2L_DIF_YTTBAR-NORM passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_1JET_8TEV_R06_PTY Overwriting contents
[INFO]: 171/171 datapoints in ATLAS_1JET_8TEV_R06_PTY passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_2JET_7TEV_R06_M12Y Overwriting contents
[INFO]: 90/90 datapoints in ATLAS_2JET_7TEV_R06_M12Y passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_PH_13TEV_XSEC Overwriting contents
[INFO]: 53/53 datapoints in ATLAS_PH_13TEV_XSEC passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_SINGLETOP_7TEV_TCHANNEL-XSEC Overwriting contents
[INFO]: 1/1 datapoints in ATLAS_SINGLETOP_7TEV_TCHANNEL-XSEC passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_SINGLETOP_13TEV_TCHANNEL-XSEC Overwriting contents
[INFO]: 1/1 datapoints in ATLAS_SINGLETOP_13TEV_TCHANNEL-XSEC passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_SINGLETOP_7TEV_T-Y-NORM Overwriting contents
[INFO]: 3/3 datapoints in ATLAS_SINGLETOP_7TEV_T-Y-NORM passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_SINGLETOP_7TEV_TBAR-Y-NORM Overwriting contents
[INFO]: 3/3 datapoints in ATLAS_SINGLETOP_7TEV_TBAR-Y-NORM passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_SINGLETOP_8TEV_T-RAP-NORM Overwriting contents
[INFO]: 3/3 datapoints in ATLAS_SINGLETOP_8TEV_T-RAP-NORM passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/ATLAS_SINGLETOP_8TEV_TBAR-RAP-NORM Overwriting contents
[INFO]: 3/3 datapoints in ATLAS_SINGLETOP_8TEV_TBAR-RAP-NORM passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CMS_WPWM_7TEV_ELECTRON_ASY Overwriting contents
[INFO]: 11/11 datapoints in CMS_WPWM_7TEV_ELECTRON_ASY passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CMS_WPWM_7TEV_MUON_ASY Overwriting contents
[INFO]: 11/11 datapoints in CMS_WPWM_7TEV_MUON_ASY passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CMS_Z0_7TEV_DIMUON_2D Overwriting contents
[INFO]: 110/132 datapoints in CMS_Z0_7TEV_DIMUON_2D passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CMS_WPWM_8TEV_MUON_Y Overwriting contents
[INFO]: 22/22 datapoints in CMS_WPWM_8TEV_MUON_Y passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CMS_Z0J_8TEV_PT-Y Overwriting contents
[INFO]: 28/50 datapoints in CMS_Z0J_8TEV_PT-Y passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CMS_2JET_7TEV_M12Y Overwriting contents
[INFO]: 54/54 datapoints in CMS_2JET_7TEV_M12Y passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CMS_1JET_8TEV_PTY Overwriting contents
[INFO]: 185/239 datapoints in CMS_1JET_8TEV_PTY passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CMS_TTBAR_7TEV_TOT_X-SEC Overwriting contents
[INFO]: 1/1 datapoints in CMS_TTBAR_7TEV_TOT_X-SEC passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CMS_TTBAR_8TEV_TOT_X-SEC Overwriting contents
[INFO]: 1/1 datapoints in CMS_TTBAR_8TEV_TOT_X-SEC passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CMS_TTBAR_13TEV_TOT_X-SEC Overwriting contents
[INFO]: 1/1 datapoints in CMS_TTBAR_13TEV_TOT_X-SEC passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CMS_TTBAR_8TEV_LJ_DIF_YTTBAR-NORM Overwriting contents
[INFO]: 9/10 datapoints in CMS_TTBAR_8TEV_LJ_DIF_YTTBAR-NORM passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CMS_TTBAR_5TEV_TOT_X-SEC Overwriting contents
[INFO]: 1/1 datapoints in CMS_TTBAR_5TEV_TOT_X-SEC passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CMS_TTBAR_8TEV_2L_DIF_MTTBAR-YT-NORM Overwriting contents
[INFO]: 15/16 datapoints in CMS_TTBAR_8TEV_2L_DIF_MTTBAR-YT-NORM passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CMS_TTBAR_13TEV_2L_DIF_YT Overwriting contents
[INFO]: 10/10 datapoints in CMS_TTBAR_13TEV_2L_DIF_YT passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CMS_TTBAR_13TEV_LJ_2016_DIF_YTTBAR Overwriting contents
[INFO]: 11/11 datapoints in CMS_TTBAR_13TEV_LJ_2016_DIF_YTTBAR passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CMS_SINGLETOP_7TEV_TCHANNEL-XSEC Overwriting contents
[INFO]: 1/1 datapoints in CMS_SINGLETOP_7TEV_TCHANNEL-XSEC passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CMS_SINGLETOP_8TEV_TCHANNEL-XSEC Overwriting contents
[INFO]: 1/1 datapoints in CMS_SINGLETOP_8TEV_TCHANNEL-XSEC passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/CMS_SINGLETOP_13TEV_TCHANNEL-XSEC Overwriting contents
[INFO]: 1/1 datapoints in CMS_SINGLETOP_13TEV_TCHANNEL-XSEC passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/LHCB_Z0_7TEV_DIELECTRON_Y Overwriting contents
[INFO]: 9/9 datapoints in LHCB_Z0_7TEV_DIELECTRON_Y passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/LHCB_Z0_8TEV_DIELECTRON_Y Overwriting contents
[INFO]: 17/17 datapoints in LHCB_Z0_8TEV_DIELECTRON_Y passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/LHCB_WPWM_7TEV_MUON_Y Overwriting contents
[INFO]: 14/16 datapoints in LHCB_WPWM_7TEV_MUON_Y passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/LHCB_Z0_7TEV_MUON_Y Overwriting contents
[INFO]: 15/17 datapoints in LHCB_Z0_7TEV_MUON_Y passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/LHCB_WPWM_8TEV_MUON_Y Overwriting contents
[INFO]: 14/16 datapoints in LHCB_WPWM_8TEV_MUON_Y passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/LHCB_Z0_8TEV_MUON_Y Overwriting contents
[INFO]: 16/18 datapoints in LHCB_Z0_8TEV_MUON_Y passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/LHCB_Z0_13TEV_DIMUON-Y Overwriting contents
[INFO]: 16/18 datapoints in LHCB_Z0_13TEV_DIMUON-Y passed kinematic cuts.
[WARNING]: Dataset output folder exists: /Users/s2569857/Codes/NNPDF4.0/tmp/pc_runcard_2025/issue_/filter/LHCB_Z0_13TEV_DIELECTRON-Y Overwriting contents
[INFO]: 15/17 datapoints in LHCB_Z0_13TEV_DIELECTRON-Y passed kinematic cuts.
[INFO]: 240701-02-rs-nnpdf40-baseline T0 checked.
[INFO]: Verifying positivity tables:
[INFO]: NNPDF_POS_2P24GEV_F2U checked, 20/20 datapoints passed kinematic cuts.
[INFO]: NNPDF_POS_2P24GEV_F2D checked, 20/20 datapoints passed kinematic cuts.
[INFO]: NNPDF_POS_2P24GEV_F2S checked, 20/20 datapoints passed kinematic cuts.
[INFO]: NNPDF_POS_2P24GEV_FLL checked, 19/20 datapoints passed kinematic cuts.
[INFO]: NNPDF_POS_2P24GEV_DYU checked, 20/20 datapoints passed kinematic cuts.
[INFO]: NNPDF_POS_2P24GEV_DYD checked, 20/20 datapoints passed kinematic cuts.
[INFO]: NNPDF_POS_2P24GEV_DYS checked, 20/20 datapoints passed kinematic cuts.
[INFO]: NNPDF_POS_2P24GEV_F2C checked, 17/20 datapoints passed kinematic cuts.
[INFO]: NNPDF_POS_2P24GEV_XUQ checked, 10/20 datapoints passed kinematic cuts.
[INFO]: NNPDF_POS_2P24GEV_XUB checked, 10/20 datapoints passed kinematic cuts.
[INFO]: NNPDF_POS_2P24GEV_XDQ checked, 10/20 datapoints passed kinematic cuts.
[INFO]: NNPDF_POS_2P24GEV_XDB checked, 10/20 datapoints passed kinematic cuts.
[INFO]: NNPDF_POS_2P24GEV_XSQ checked, 10/20 datapoints passed kinematic cuts.
[INFO]: NNPDF_POS_2P24GEV_XSB checked, 10/20 datapoints passed kinematic cuts.
[INFO]: NNPDF_POS_2P24GEV_XGL checked, 10/20 datapoints passed kinematic cuts.
[INFO]: Summary: 2635/6166 datapoints passed kinematic cuts.
[CRITICAL]: Bug in setup-fit ocurred. Please report it.
Traceback (most recent call last):
  File "/opt/homebrew/Caskroom/miniconda/base/envs/nnpdf/lib/python3.10/site-packages/pandas/core/indexes/base.py", line 3805, in get_loc
    return self._engine.get_loc(casted_key)
  File "index.pyx", line 167, in pandas._libs.index.IndexEngine.get_loc
  File "index.pyx", line 196, in pandas._libs.index.IndexEngine.get_loc
  File "pandas/_libs/hashtable_class_helper.pxi", line 7081, in pandas._libs.hashtable.PyObjectHashTable.get_item
  File "pandas/_libs/hashtable_class_helper.pxi", line 7089, in pandas._libs.hashtable.PyObjectHashTable.get_item
KeyError: 'SLAC_NC_NOTFIXED_P_EM-F2'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/Users/s2569857/Codes/NNPDF4.0/nnpdf_clone/nnpdf/n3fit/src/n3fit/scripts/vp_setupfit.py", line 203, in run
    super().run()
  File "/Users/s2569857/Codes/NNPDF4.0/nnpdf_clone/nnpdf/validphys2/src/validphys/app.py", line 150, in run
    super().run()
  File "/opt/homebrew/Caskroom/miniconda/base/envs/nnpdf/lib/python3.10/site-packages/reportengine/app.py", line 406, in run
    rb.execute_sequential()
  File "/opt/homebrew/Caskroom/miniconda/base/envs/nnpdf/lib/python3.10/site-packages/reportengine/resourcebuilder.py", line 210, in execute_sequential
    result = self.get_result(callspec.function,
  File "/opt/homebrew/Caskroom/miniconda/base/envs/nnpdf/lib/python3.10/site-packages/reportengine/resourcebuilder.py", line 380, in get_result
    fres = function(**kwdict)
  File "/Users/s2569857/Codes/NNPDF4.0/nnpdf_clone/nnpdf/validphys2/src/validphys/theorycovariance/construction.py", line 327, in theory_covmat_custom_per_prescription
    slicer = procs_index.get_locs((procname, datasetname))
  File "/opt/homebrew/Caskroom/miniconda/base/envs/nnpdf/lib/python3.10/site-packages/pandas/core/indexes/multi.py", line 3536, in get_locs
    lvl_indexer = self._get_level_indexer(k, level=i, indexer=indexer)
  File "/opt/homebrew/Caskroom/miniconda/base/envs/nnpdf/lib/python3.10/site-packages/pandas/core/indexes/multi.py", line 3391, in _get_level_indexer
    idx = self._get_loc_single_level_index(level_index, key)
  File "/opt/homebrew/Caskroom/miniconda/base/envs/nnpdf/lib/python3.10/site-packages/pandas/core/indexes/multi.py", line 2980, in _get_loc_single_level_index
    return level_index.get_loc(key)
  File "/opt/homebrew/Caskroom/miniconda/base/envs/nnpdf/lib/python3.10/site-packages/pandas/core/indexes/base.py", line 3812, in get_loc
    raise KeyError(key) from err
KeyError: 'SLAC_NC_NOTFIXED_P_EM-F2'

Description

The problem originates from the function theory_covmat_custom_per_prescription in construction.py. Specifically, the following line https://github.com/NNPDF/nnpdf/blob/4da53ad2bec4fdb478fbc15636b5eaab71355351/validphys2/src/validphys/theorycovariance/construction.py#L327 produces the mentioned error. The problem is that procs_index does not contain the datasets whose datapoints are excluded from the cuts, whereas process_info does.

CC @scarlehoff @RoyStegeman

Jan 27 '25 11:01 achiefa

I believe that in the experimental covmat this problem "doesn't seem to occur" because the pandas code is such that it creates a 0x0 empty Matrix, and then when that is found nothing is done in various places:

https://github.com/NNPDF/nnpdf/blob/4da53ad2bec4fdb478fbc15636b5eaab71355351/validphys2/src/validphys/covmats.py#L581

I guess the quickest fix in this case is just to check when you get a dataset that will have no data and return an empty matrix for it (or an empty slicer, 0:0 might work?)

Jan 27 '25 11:01 scarlehoff

I tried, but then n3fit complains

[CRITICAL]: Bug in n3fit ocurred. Please report it.
Traceback (most recent call last):
  File "/Users/s2569857/Codes/NNPDF4.0/nnpdf_clone/nnpdf/n3fit/src/n3fit/scripts/n3fit_exec.py", line 315, in run
    super().run()
  File "/Users/s2569857/Codes/NNPDF4.0/nnpdf_clone/nnpdf/validphys2/src/validphys/app.py", line 150, in run
    super().run()
  File "/opt/homebrew/Caskroom/miniconda/base/envs/nnpdf/lib/python3.10/site-packages/reportengine/app.py", line 406, in run
    rb.execute_sequential()
  File "/opt/homebrew/Caskroom/miniconda/base/envs/nnpdf/lib/python3.10/site-packages/reportengine/resourcebuilder.py", line 210, in execute_sequential
    result = self.get_result(callspec.function,
  File "/opt/homebrew/Caskroom/miniconda/base/envs/nnpdf/lib/python3.10/site-packages/reportengine/resourcebuilder.py", line 380, in get_result
    fres = function(**kwdict)
  File "/Users/s2569857/Codes/NNPDF4.0/nnpdf_clone/nnpdf/validphys2/src/validphys/n3fit_data.py", line 110, in tr_masks
    mask = np.concatenate([np.ones(trmax, dtype=bool), np.zeros(ndata - trmax, dtype=bool)])
ValueError: negative dimensions are not allowed

Jan 27 '25 15:01 achiefa

If there is no quick solution, please just remove the datasets from the runcard - it's not as if this is a problem we'll face regularly.

Jan 27 '25 15:01 RoyStegeman

You have to find where you can return this dimension 0 so that it works in the same way as the experimental one (or what piece you have to skip). n3fit does not distinguish theory and experimental covmat, the problem here is when validphys tries to prepare the data

Jan 27 '25 16:01 scarlehoff

Theory covmat with datasets excluded by cuts

Description