Serverless PhantomJS with IronWorker

http://blog.iron.io/2012/07/phantomjs-in-2-minutes.html?utm_source=twitterfeed&utm_medium=twitter

by carimura • 14 years ago

50 16 14 years ago

blog.iron.io

malandrew• 14 years ago

What about a CasperJs version as well?

heretohelp2• 14 years ago

casperjs is pretty unreliable, I wouldn't bother. Even for relatively trivial frontend testing we were using it for, it would crash ~50% of the time on Linux and Mac.

zhodge• 14 years ago

Really? I actually found it to be quite stable for a scrape project I had; it was rather trivial too though.

My only gripe is with the cryptic error messages I was receiving when executing JavaScript in a casper browser. But that could have just been my ignorance and unfamiliarity.

jonpaul2• 14 years ago

That's not CasperJS that's unreliable. That's PhantomJS crashing. Which version of PhantomJS where you using?

baudehlo• 14 years ago

PhantomJS 1.6 is massively unstable. Downgrade to 1.5. I'm really surprised this hasn't been fixed yet - there are bugs in their tracker related to it.

carimura4• 14 years ago

Haven't worked with Casper yet but I'd be happy to build a similar example in our examples repo using Casper.

Additionally you could install it using the build() command in the .worker file very similar to the way PhantomJS is installed.

jonpaul2• 14 years ago

Since CasperJS is just a set of JavaScript files that run on PhantomJS, you shouldn't have any problems running it.

carimura4• 14 years ago

Here ya go: https://github.com/iron-io/iron_worker_examples/tree/master/...

I just included the whole CasperJS library with the worker package and followed the getting started example from the Casper site.

dentldir2• 14 years ago

On the iron_worker upload crawler step:

ERROR -- IronWorkerNG: Can't find src with path='node_modules'

enlighten_user• 14 years ago

Did you copy node_modules directory from repo?

carimura4• 14 years ago

Hey Dentldir, make sure you get everything from that phantom-nodejs folder.... Try a git clone https://github.com/iron-io/iron_worker_examples

and then follow the directions from /binary/phantom-nodejs

dentldir2• 14 years ago

Much better. I manually downloaded the files the first time and missed the directory. Thanks.

LogicX• 14 years ago

I'll echo another - how about wkhtmltopdf ?

carimura4• 14 years ago

Hey LogicX,

https://github.com/iron-io/iron_worker_examples/tree/master/...

then follow the blog post.

Let me know if you have any questions or issues. I'll try and do something more exciting later like grab 100 sites, create pdfs, and store them in S3 all in parallel.

Serverless PhantomJS with IronWorker

Related Stories