Albert Namaev

Twisted and asyncio

10

Do you guys have/had thoughts for migrating to native asyncio? What are your thoughts about Twisted? Isn’t it feels deprecated?

Fix parsing of invalid JS object, handling forward slash instead of comma

3

I'm currently extracting the following data from a tag on the website: ``` var a = { 'compositions': [ 'Shell: Cotton 100%' / 'Pocket lining:Cotton 100%' ] } ``` However,...

Add support for js object parser?

1

https://github.com/Nykakin/chompjs Wouldn't it be nice to access data contained in script tags directly from Selector? E.g. `sample_selector.css("path to script").js().jmespath("foo.bar")`

add support for returning type of urllib.parse.ParseResult

1

Could resolve #2 Performance impact: Yes, using `namedtuple` + acquiring `scheme, netloc, path, params, query, fragment` at creation time reduces performance slightly, but this implementation is still significantly faster than...

Is Valkey support being considered as an alternative to Redis in the future?

Python 3.14 has been released and 3.9 has reached its end of life

Tests and project manager

4

I’m really interested in contributing to this project — it’s been incredibly helpful to me, and I really appreciate the feedback from @Nykakin ! Would you mind if I added...

Optimise `SitemapSpider` memory usage

13

Also see #6985 #605 Could resolve #3529 Benchmarks with real running spider: - latest release branch: https://github.com/abebus/sitemap - patch branch: https://github.com/abebus/sitemap/tree/patch TL;DR: peak memusage dropped from 4.169GB to 1.828GB Text...

Reducing memory footprint of `Request` object: __slots__ and lazy evaluation

7

This PR makes such changes: 1. Python’s `dict` objects are fairly heavy, even when empty. The `Request` object had a few of them. This PR makes their creation lazy (along...

Drop support for python 3.9, move from 3.14-rc to 3.14

2

Python 3.14 has been released and 3.9 reached his end of life/support