Best language for automated post scrape?

[futureawesome]

I want to do a little post snatching for wp blogs and asian bbs (login). What language would you recommend me to attempt this in?

I was thinking php, perl, or python but I'm open to others. With preference I hope to just cron the script later on.

Any favourite packages( XML parser ? ) for organizing blog posts and going through html?

Thanks

futureawesome Reviewed by futureawesome on 24th Jul 2011. Best language for automated post scrape? I want to do a little post snatching for wp blogs and asian bbs (login). What language would you recommend me to attempt this in? I was thinking php, perl, or python but I'm open to others. With preference I hope to just cron the script later on. Any favourite packages( XML parser ? ) for organizing blog posts and going through html? Thanks Rating: 5

[SalmanAbbas007]

PHP, Using the DOM Extension

[futureawesome]

Thanks for the input, and I assume I just use curl for the login?

[kris]

You can use 'Simple HTML DOM' for PHP.It have many features and easy to use.

http://simplehtmldom.sourceforge.net/manual.htm

Examples are included in download pack.

Regards
Mohan

[SalmanAbbas007]

Simple HTML DOM Sucks! Don't use this crap. DOM which is much more powerful and comes bundled with PHP.

Thanks for the input, and I assume I just use curl for the login?

Yeah

[Robin H]

Regex?

[SalmanAbbas007]

Really?


......

[futureawesome]

Alright when I have time I'll look into DOM and the php implementation. Thanks SalmanAbbas007, didn't know you couldn't parse an html page with regex.

[SalmanAbbas007]

lol, You're welcome.