PhantomJS 1.5 released (headless WebKit with JavaScript API)

http://code.google.com/p/phantomjs/wiki/ReleaseNotes

by andrevoget • 14 years ago

179 43 14 years ago

code.google.com

skeletonjelly• 14 years ago

Awesome. Was just looking for something like this yesterday to facilitate screenshots for an uptime script.

vitovito• 14 years ago

Wow. Congrats on finally going completely headless on Linux. That's a big deal.

This makes it the first modern browser replacement for our old moz-headless-screenshot branch, which is effectively Firefox 3.6. It's really a shame no-one's picked up that work for modern FF builds. Couldn't even find someone to hire for it...

davedx• 14 years ago

Could you explain what this means exactly, going "headless"?

gurraman• 14 years ago

That you can operate the software without the normal i/o devices (monitor/screen, mouse, keyboard etc).

With browsers, it's commonly used to programmatically take screenshots of web sites.

boundlessdreamz5• 14 years ago

"headless" - Without a display. Most programs which need an X display, can be run on Xvfb

"completely headless" - Xvfb is also not required.

wildmXranat2• 14 years ago

As previous comments state, you don't need a display, which is a bit of a half truth. Some instances, like running headless Selenium testing with Firefox, would still require a virtual screen to draw to. We do some our browser testing this way, on servers that don't have a screen.

boundlessdreamz5• 14 years ago

Can phantomJS be run as a daemon?

dkhenry• 14 years ago

I don't think it works like that. You write scripts for it and can use it to excersize web pages. I have used it extensively to test web sites.

boundlessdreamz5• 14 years ago

Yeah. That's how I have used it. But it would be great if phantomjs can be launched as a daemon and then you pass a script for it to process. Or launch it with a script which runs forever and accepts input (phantomjs has an inbuilt web server).

I think it ay be possible but wanted to know for sure.

meow• 14 years ago

I usually use another controller program to launch it with required data..

DanielRibeiro• 14 years ago

No more support for Flash and other plugins

So sad to hear this. That was my main motivation for using PhantomJS. Fortunately 1.4 still supports it.

alexchamberlain• 14 years ago

What do you use it for?

look_lookatme• 14 years ago

I use to get a daily overview of ads on a bunch of publisher's sites, fortunately the older version with flash support will continue to work just fine for this case.

veidr3• 14 years ago

While it does kinda suck if your usecase needs Flash, I think the reasoning was solid. Being able to truly run headless in a barebones command line environment is more important than supporting Flash, in its waning years.

Then, of course, there's also this:

    Issues are reported but nobody volunteers to analyze or fix them

hengli• 14 years ago

I need to do some web crawling, how does this compare to jsdom on node.js? I'm using node.js of course.

MatthewPhillips• 14 years ago

Those are just scraping tools. phantom is a browser, what your scripts see are exactly what the user would see. Makes it great for test automation. Casperjs is a fork focusing on testing.

jeromeparadis• 14 years ago

For example, if you need to scrape the DOM content for content loaded dynamically by JavaScript, PhantomJS will allow you to do the job. Or take snapshots of Web sites as they appear to users.

lazerwalker2• 14 years ago

In my experience, using jsdom (and other similar node.js DOM libraries) is fine for scraping static content, but tends to fall down when you're dealing with anything that requires executing client-side JS. That's a big deal if you're scraping sites that load in content via XHR, or manipulate CSRF tokens in JS specifically to throw off static scrapers. Both of these are use cases that PhantomJS has handled beautifully for me in the past.

weego• 14 years ago

I built a scraper that was nodejs and nowjs that sent instructions to a javascript bot I injected into the page rendered by phantomjs, the bot then scraped and sent snippets back to the server again via nowjs. The real win for me was it was a comet + ajax target which is usually hard to scrape efficiently but I just synced the bot with the comet updates and away we go. Also being headless I could just spin up 20 instances without any performance problems on a cheap rack server.

antrover• 14 years ago

Congrats to PhantomJS!

CasperJS is built on top of PhantomJS and adds some cool assertions: http://casperjs.org/

programminggeek• 14 years ago

This looks incredibly useful for browser based unit testing.

ZitchDog• 14 years ago

And screen scraping!

LogicX• 14 years ago

Anyone have a cheat sheet on using phantomjs as a drop-in replacement for wkhtmltopdf? http://code.google.com/p/wkhtmltopdf/

For the superior completely headless qualities? There was a post on HN almost 400 days ago where someone claimed wkhtmltopdf's PDF output quality was superior to phantomjs - anyone know if that's changed with this release?

boundlessdreamz5• 14 years ago

It is there in the linked page

http://code.google.com/p/phantomjs/wiki/ReleaseNotes

Search for "rasterization"

veidr3• 14 years ago

I have been surprised that this project has seemed to fly under the radar for so long. It's extremely useful in a variety of scenarios, and as far as I know, it is unique in its capabilities.

I've used it to allow modern applications to interface with legacy systems that have no mechanism of extension, and no API other than their web interfaces. Just about anything you can control via a web interface, you (or your software) can control using PhantomJS.

mk4p2• 14 years ago

Could you give some examples? I'm very curious about these types of uses..

andrewjshults• 14 years ago

We're currently using it to generate static map images for a powerpoint export feature we introduced a little while ago. We initially were going to use Google's static maps API but quickly ran into limits (only 5 custom markers, needing a different set of code to actually generate the maps) and decided to take screenshots of the map in our existing application. Besides actually being able to generate maps the way we want them, the other big advantage is that since it's sharing the same code base as our web product it's much easier to catch issues if they crop up. Being able to run headless on linux is amazing (on OS X you download the binary and it just works, getting 1.4 to run cleanly took a little bit of playing around to get Xvfb to play nice).

veidr3• 14 years ago

One example is a company I worked with that has this ancient legacy groupware system. Shared calendar, reporting, workflow, etc. The UI is based on tables and frames, the backend is some kind of compiled perl modules or something, and it has no API. And it uses some kind of weird database format, maybe intentionally obfuscated.

The system does not work well with iPads, which were being deployed to sales. A new modern iPad-savvy reporting UI for sales staff was wanted, but the data had to end up in the legacy system during the multi-year transition that would phase it out.

We wrote a Rails app for the backend, and a native iOS client that ran on the iPads. Real straightfoward, the client app sends JSON to the rails backend. Upon submission of a report, the rails app then used PhantomJS to log into the legacy system as the user in question, navigate throught the multiple-page process, manipulating the popups and checkboxes and textfields, and input the data into the legacy system just as if the user had sat down at a PC and done it themselves.

Kludgetastic, definitely, but without something like PhantomJS there'd be no way at all to get data into this legacy system programatically.

ricardobeat• 14 years ago

It hasn't, it's well known around the javascript community.

scriptproof• 14 years ago

After having read the installation guide on Windows for Phantom.js and WebServer, that is embedded in it, apparently installing the first to use the second is a lot simpler!

wildmXranat2• 14 years ago

When I use Selenium, I know the browser supports everything that the end user will and that includes, javascript evaluation, plugin loading, whatever.

To make a comparison for our heavy Selenium use, I can't clearly see what is lacking in PhantomJS that would be a show stopper.

Does anybody know if other than lack of Flash support, it covers all aspects of what the end user would experience ?

lazerwalker2• 14 years ago

The main advantage of Selenium is that it allows you to test cross-platform compatibility, since it can be configured to run on pretty much every major browser/OS combo.

For everything other than that, though, PhantomJS is fantastic. It's infinitely more pleasant to deal with than Selenium.

maslam• 14 years ago

So has anyone successfully deployed this on Heroku?

rgarcia• 14 years ago

I had the same question, and it looks like you need to roll your own buildpack. This looks promising (although it's for phantom v1.4): https://github.com/jessefulton/heroku-buildpack-nodejs-phant....

iamleppert• 14 years ago

If you're looking for a great PhantomJS based testing library, check out CasperJS. It's awesome. http://casperjs.org/

sxtxixtxcxh2• 14 years ago

we're upgrading to 1.5 now; be sure to read the build notes for linux, specifically: "do not simply copy the executable as it won't work."

sxtxixtxcxh2• 14 years ago

also, if you had built from the source previously, be sure to do a `git clean -xfd .` before running the ./build.sh

metafeather• 14 years ago

If you are currently using Rhino to run Javascript then PhantomJS makes for an excellent and more functional replacement.

In addition to running library unit tests in a 'real' browser environment it can also be used to test apis and visual components, and then save results as files and screenshots for use with other systems such as Hudson.

I use it extensively for our web app build and test cycle at work (Causata.com) and to save time for anyone interested in rolling their own have made the code available on Github at https://github.com/metafeather/phantomjs-yuitest

PhantomJS 1.5 released (headless WebKit with JavaScript API)

Related Stories