Scrapy
@ScrapyProject
The most popular open source web scraping framework in Python.
You might like
“scrapy” became my alter ego. it all started with my first ever python project, a simple web scraper that pulled headlines from top news sites. i used the scrapy library by @ScrapyProject. it wasn’t much, just a script. but it was the first thing i built that actually worked.…
10 years after the release of 1.0, Scrapy has become table stakes for modern web scraping projects. Creator Shane Evans talks through Scrapy's current position in the industry. #ScrapyAnniversary #OpenSource #WebScraping
Scrapy didn’t start in a lab. It started in a startup. From solving real-world data problems to becoming one of the most trusted scraping frameworks out there—here’s how it all began. 👉 zyte.com/blog/the-rise-… #ScrapyAnniversary #OpenSource #Python
Scrapy 2.8.0 is out. This is a maintenance release, with minor features, bug fixes, and cleanups. See the full changelog at docs.scrapy.org/en/latest/news…
Have you got what it takes to be called a web scraping whizz? Join the @ExtractSummit 2022 Coding Contest to find out!
Join us for the Extract Summit 2022 Coding Contest and stand a chance to win bragging rights plus awesome prizes! Register for free - hubs.li/Q01mcYkL0 #coding #webdata #dataextraction #webscraping #scrapy #python
Dive into the world of web data! Register for Extract Summit.
Scrapy 2.6.2 and 1.8.3 are out, addressing a security issue: docs.scrapy.org/en/2.6/news.ht… 2.6.2 also addresses the remaining regressions of 2.6.0.
Scrapy 2.6.1 is out, with security fixes around cookies also backported to Scrapy 1.8.2. But it is not just security fixes! There is official Python 3.10 support, asyncio support no longer being experimental, and new features for feed exports: docs.scrapy.org/en/latest/news…
Have you not tried Playwright and Scrapy together yet? Get started in 10 minutes! youtube.com/watch?v=0wO7K-… Thank you, @jhnwr!!!
youtube.com
YouTube
How to Scrape JavaScript Websites with Scrapy and Playwright
We have released Scrapy 2.5.1 and Scrapy 1.8.1, which fix a security issue that could lead to the leak of HTTP authentication credentials to target websites. Find out more in the release notes: docs.scrapy.org/en/2.5/news.ht…
An introduction to Scrapy from @bsekiewicz , winner of the Extract Summit 2021 Coding Contest: worksmarter.pl/en/post/webscr…
Ready!
Extract Summit 2021 Live Coding Contest starts in 10 mins! Everyone ready?
Join Extract Summit for a day dedicated to web data extraction.
Today's the day! @ExtractSummit will start in 1 hour. We have 17 awesome talks lined up for you. Can't wait to hear from all the amazing speakers! hubs.li/H0YvRNb0 #ExtractSummit2021 #webdata #dataextraction #bigdata
There are prizes for the first 3 people with all data correctly scraped. The solutions must run on Scrapy Cloud. #scrapy #scraping #Python
Are you ready to show off your web scraping skills?💪🏼 Our devs created a coding contest EXCLUSIVELY for Extract Summit attendees. Sign up for Extract Summit and join us for the challenge. 👇🏼 hubs.li/H0Y3V8L0
Thanks to @NoelTautges, itemadapter 0.3.0 makes it possible to use #pydantic models as Scrapy items!
We have moved our IRC channel to Libera.Chat: web.libera.chat/?channel=#scra… Mind, however, that you’ll probably find more people on Discord: discord.gg/fbCHpAm6KM
United States Trends
- 1. Friendly 63.6K posts
- 2. SNAP 739K posts
- 3. Mac McClung 1,646 posts
- 4. Grokipedia 7,162 posts
- 5. Big Dom 1,996 posts
- 6. #ChiefsKingdom 2,898 posts
- 7. James Wiseman N/A
- 8. #JUNGKOOKXCALVINKLEIN 64.1K posts
- 9. Jessica 28.3K posts
- 10. Jamaica 118K posts
- 11. Riley Gaines 38.2K posts
- 12. Monday Night Football 7,578 posts
- 13. #OTGala6 167K posts
- 14. Runza N/A
- 15. #Crew96 N/A
- 16. Hofer 1,676 posts
- 17. 7 Democrats 5,755 posts
- 18. Cher 17.5K posts
- 19. MRIs 9,586 posts
- 20. Game 3 61.6K posts
You might like
-
Zyte
@zytedata -
Columbia University
@Columbia -
Django
@djangoproject -
Apify
@apify -
Jerry Parker
@rjpjr12 -
Webscraping.pro
@ExtractWebData -
Pablo San Emeterio
@psaneme -
Adrian Denkiewicz
@a_denkiewicz -
Security4all
@security4all -
Kuyi Mobile
@kuyimobile -
The Codidact Network
@CodidactQA -
Grégory BOUGEARD
@gbougeard
Something went wrong.
Something went wrong.