Deleting a dataset while it indexes

[AndyMik90]

Self Checks

• [X] I have searched for existing issues search for existing issues, including closed ones.
• [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
• [X] Pleas do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing?

When a bigger PDF is indexing, if one deletes it, the API server continues trying to index it, giving 404: console/api/datasets/63dc9133-3589-4985-991c-e864bd54ff6a/documents/8ce44fcf-085c-4b06-93f5-e0ac7dc1e110/indexing-status HTTP/1.1" 404 - and can sometime continue until it times out.

2. Describe the feature you'd like to see

Add some type of check/logic in the celery/api to prevent this from happending.

3. How will this feature improve your workflow or experience?

Reduces the possiblity for errors and elimitate que on server resources.

4. Additional context or comments

No response

5. Can you help us with this feature?

• [ ] I am interested in contributing to this feature.

[dosubot[bot]]

It seems like you've got this under control, if you want help or have specific questions, let me know what I can do for you!

About Dosu

This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

If you want to continue the conversation, start your reply with @dosu-bot.

[JohnJyong]

@JzoNgKVO pls take a look. for the 'console/api/datasets/63dc9133-3589-4985-991c-e864bd54ff6a/documents/8ce44fcf-085c-4b06-93f5-e0ac7dc1e110/indexing-status' endpoint, if this endpoint reports an error, the call should be stopped. @AndyMik90 thanks for your suggestion.

[JohnJyong]

@AndyMik90 support by this PR： https://github.com/langgenius/dify/pull/3156