smc-python icon indicating copy to clipboard operation
smc-python copied to clipboard

Error while creating URL-List

Open Alrexxar opened this issue 6 years ago • 4 comments

I try to create a dynamically updated URL-List to handle some Emotet outbreaks. For that im using the following online blacklist: 'https://urlhaus.abuse.ch/downloads/text_online/' Apparently some of the URLs in there are seen as invalid for the SMC. Is there a way to ignore invalid URLs while doing an URLListApplication.update_or_create?

Best Regards Alrexxar

Alrexxar avatar Jan 29 '20 12:01 Alrexxar

Hi Alrexxar,

Do you have a couple sample URLs that do not work by chance? There are a couple ways we could potentially solve this (i.e. client vs. server side).

Thank you,

David

gabstopper avatar Jan 29 '20 19:01 gabstopper

The following Urls are incorrect: 24.54.106.17/invoice/invoice.zip?bkdlpescehu=bobtayl@highway1.? doc-04-5g-docs.googleusercontent.com/docs/securesc/ha0ro937gcuc7l7deffksulhg5h7mbp1/1kcrg4durrlvq45ha3mg62i6sj1i70er/1580277600000/12277769630439086412/*/16-YdjYX1lpawpPUzh-mMlICQ45WSxzaS?e=download

There were a couple of the google docs links and i guess the asterisk is the char that makes it invalid.

Alrexxar avatar Jan 30 '20 08:01 Alrexxar

Are you able to get the Regex which validates the URL in the SMC? Maybe you could add a flag like --ignore invalid or something

Alrexxar avatar Jan 30 '20 09:01 Alrexxar

Do you have any news already? Or would it help you to open a ticket at the partner portal too?

Alrexxar avatar Feb 05 '20 09:02 Alrexxar