Skip to main content
It's a good day to launch a Twitter page scraping library
Sean Coates
Sean Coates  
•
call it Toot Suite.
Jeff Noxon
Jeff Noxon  
•
good luck getting Twitter to show the tweets you're after!
Shoq
Shoq  
•
Didn't Nitter do that already? 😀
Nemo_bis 🌈
Nemo_bis 🌈  
•
Can start from #Nitter.
https://github.com/zedeus/nitter/issues/389

Document Nitter's use of Twitter's internal APIs · Issue #389 · zedeus/nitter

@zedeus has done a great deal of reverse engineering Twitter's internal API, and I believe it would be very useful if it were documented somewhere. This would allow others (e.g. me) to build up...
GitHub
#Nitter
Evan Prodromou
Evan Prodromou  
•
I mean, all the smart security pros who can detect and prevent scrapers were laid off or quit. You'd literally have the run of the place.
Craig Maloney ☕
Craig Maloney ☕  
•
There's a subtle irony there if someone could reconstruct the Twitter firehose from scraping.

We're talking circle-of-life levels of irony.
stephen judkins
stephen judkins  
•
I'd say they could just pay cloudflare but at their scale...
Evan Prodromou
Evan Prodromou  
•
@stephenjudkins does CF help with scrapers? I just figured they'd get your pages to scrapers extra fast.
@stephen judkins
stephen judkins
stephen judkins  
•
they do bot protection and they're very good (though not perfect) at it
Atheist Art
Atheist Art  
•
You've given this old school fool a new phrase and please and thank you.

Was deep in the throes of retrieving and (hoping to) sort and save about two million JPG's and PNG's. I'm PDS'ing.
⇧