Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

37 Open 131 Closed
37 Open 131 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀
[docs] Chinese documentation documentation good first issue help wanted
#243 opened Apr 5, 2022 by LuckyPigeon
1 task
Is there a way to stop spider check duplicate with redis ? feature improvement question
#242 opened Apr 2, 2022 by milkeasd
5
[docs] Move docs to github Wiki documentation
#224 opened Mar 6, 2022 by LuckyPigeon
[FEATURE] Finish TODO tasks feature good first issue improvement
#219 opened Jan 14, 2022 by LuckyPigeon
[IMPROVEMENT] Add template to issues and PRs improvement
#213 opened Jan 5, 2022 by LuckyPigeon
4 tasks
[RFC]A new journey feature
#203 opened Oct 21, 2021 by whg517
4 of 6 tasks
@whg517
14
When does the crawler stop improvement question
#182 opened Dec 25, 2020 by forgeries
4
Logs report a warning: Spider.make_requests_from_url method is deprecated... help wanted improvement
#181 opened Dec 11, 2020 by LittleHello
2
Item pipelines are slowed down improvement question
#174 opened Jul 22, 2020 by Rossil2012
2
Looking for co-maintainers! help wanted
#171 opened Jun 5, 2020 by rmax
8
Should we auto reconnect to redis? feature help wanted
#167 opened May 1, 2020 by botzill
2
define redis record as url +parameters and access parameters in parse method feature
#156 opened Nov 4, 2019 by ni-pixel
Scrapy-redis automatically helps create a xxx:request request queue in both libraries of the redis database question
#153 opened Aug 16, 2019 by hewm
The distributed scrappy crawler idling after requesting for a while and still having a list of requests in redis question
#152 opened Aug 16, 2019 by hewm
scrapy wouldn't create new request after i pause crawl and resume crawl, and redis wouldn't create spidername:requests set again, even i set SCHEDULER_PERSIST = True at settings.py. bug question
#149 opened Jul 24, 2019 by Vickey-Wu
My scrapy program cannot keep pulling data from redis queue bug question
#148 opened Jun 25, 2019 by Cehae
1
How do I receive url from redis more quickly ? improvement question
#147 opened Apr 26, 2019 by CoderZHV
1
2019-04-03 12:25:25 [scrapy.extensions.logstats] INFO: Crawled 18852 pages (at 0 pages/min), scraped 1762 items (at 0 items/min) bug improvement question
#145 opened Apr 3, 2019 by python-D
2
Is possible to use bloom filter on scrapy-redis? improvement question
#144 opened Mar 26, 2019 by zhangslob
4
Update pipeline document documentation good first issue help wanted
#139 opened Jan 12, 2019 by LuckyPigeon
3
Read one entry from redis queue feature
#136 opened Dec 4, 2018 by t75bernd
Whether scrapy-redis can handle this situation - request urls have priority? question
#121 opened Apr 9, 2018 by sunnypandas
2
can have a support to ignore some url with ignore information in request.meta question
#120 opened Apr 4, 2018 by jipengzhu
2
Suggesting new way to schedule requests feature
#119 opened Apr 1, 2018 by botzill
3
Why is scrapy_redis generated in redis that the requests queue is zset type instead of list type question
#113 opened Dec 17, 2017 by smartXiaoxie
ProTip! Adding no:label will show everything without a label.