reader
reader copied to clipboard
jina-ai
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
Error: ```javascript $ npm run build > build > tsc -p . src/cloud-functions/crawler.ts:3:79 - error TS2307: Cannot find module '../shared' or its corresponding type declarations. 3 import { CloudHTTPv2, Ctx,...
@hanxiao Could you please give some advice for this issue? ``` `https://r.jina.ai/https://www.msn.com/en-us/news/technology/the-best-ai-search-engines-and-tools-you-can-use-to-search-the-web/ar-BB1kbzFL` {"code":500,"status":50000,"message":"Failed to execute 'setAttribute' on 'Element': '}' is not a valid attribute name.","name":"DOMException"} ```
Could you please add support for docker deployment to streamline setting up and running the project?
npm WARN EBADENGINE Unsupported engine { npm WARN EBADENGINE package: undefined, npm WARN EBADENGINE required: { node: '20' }, npm WARN EBADENGINE current: { node: 'v21.7.3', npm: '10.5.0' } npm...
Hi! This looks interesting. I wonder if you could convert the Pile dataset taken from respective urls in the jina reader format to experiment with LLM pre-training?
First of all, this is amazing! I tested it out a website I was looking at converting and it dind't work. https://r.jina.ai/https://repairpal.com/honda/civic/radiator-fan-not-working Original: https://repairpal.com/honda/civic/radiator-fan-not-working Thoughts?
Recently, some AI companies have given website administrators the option of opting out of AI training by using configuration options in [robots.txt](https://www.eff.org/deeplinks/2023/12/no-robotstxt-how-ask-chatgpt-and-google-bard-not-use-your-website-training). While this project is for prompting and RAG...
访问的时候产生了报错：{"data":null,"cause":{},"code":422,"name":"AssertionFailureError","status":42206,"message":"Failed to goto https://ddjjjc.gov.cn/pages/news.asp?id=4173: Error: net::ERR_CERT_COMMON_NAME_INVALID at https://ddjjjc.gov.cn/pages/news.asp?id=4173","readableMessage":"AssertionFailureError: Failed to goto https://ddjjjc.gov.cn/pages/news.asp?id=4173: Error: net::ERR_CERT_COMMON_NAME_INVALID at https://ddjjjc.gov.cn/pages/news.asp?id=4173"} 我是用requests请求的，这是i请求代码： import requests headers = { 'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36...
