TestCafé: Web Testing Framework

http://testcafe.devexpress.com

by jolt • 13 years ago

25 30 13 years ago

testcafe.devexpress.com

jolt3• 13 years ago

Haven't used it myself, but i would love to hear from someone who has used this, or something similar. How useful is this kind of testing? I'm thinking that tests would have to be re-recorded a lot, if this is used while developing the site.

janekk4• 13 years ago

I'm in the 'something similar' camp. This is functional testing. I use Selenium, an open source library for automating browsers via plugins.

Personally I find it much more useful than unit/integration tests because while those test the programmer's understanding of his own code, functional tests actually drive the app, perform normal user actions by driving the GUI. For example, you could have all of your unit tests passing but without functional tests, your OK button may appear off-screen and you wouldn't know.

It is annoying when you make changes to your app because test runs take much longer than unit tests, so I have one general test that I run after a refactor, and then a full suite that runs after commit.

hugs5• 13 years ago

It sounds like their approach is the same one we took with the first version of Selenium. The approach is JavaScript injection through an HTTP proxy. Because of the same origin policy and JavaScript security model, we abandoned this approach when moving to Selenium 2. Selenium 2 goes for the most native approach for clicks and key events. (Continuing in that native-is-better approach, I'm now experimenting with robots, but that's another story.) I'm amazed they think their approach is better.

I'm surprised they think the Selenium 1 JavaScipt proxy-injection model is a better approach. But hey, I'm getting old... Get off my lawn, yadda, yadda, yadda. But I'm stunned they think it's better and trying to patent it. I really hope I'm missing some new key insight here. Please enlighten me, people.

jolt3• 13 years ago

Thank you. From what i have gathered here in the comments, it seems that I need to look into Selenium.

pedalpete• 13 years ago

I'm currently watching the 27minute video. I was expecting a quick sample of what TestCafe does, but it is a full-on tutorial of using all their features. Also it goes into a VERY deep yet simple level (like here's how to change the port#).

I'd recommend a shorter, marketing style video just showing why TestCafe is great. I haven't gotten there yet, at more than 5 minutes in...

janekk4• 13 years ago

I agree, I don't care about config files, just want to see them write a simple test and see it run.

wusatiuk• 13 years ago

definitly, if you want to push the product with a video, it should not be longer than 2, max. 3 minutes and you should only show the key aspects.

additionally, you could have a look at some conversion rate bascis (I cannot find a call to action button above the fold,...) or SaaS marketing tips on how to push your product out.

janekk4• 13 years ago

I like the visual method of writing scripts, but having used Selenium + SauceLabs.com on a real app and dealing with functional browser tests every day, I'm concerned about:

* Timing issues; most of the time spent writing functional tests is knowing when to wait for the next click (e.g. waiting for AJAX response and change in a certain DOM element)... and doing this in a clean way (e.g. WebDriverWait conditions instead of putting Sleep(1000) everywhere).

* Ability to expand the tests to do other things; for example, Selenium can take screenshots of the browser window because it works at a lower level. We use this for regression testing our web pages.

IanCal2• 13 years ago

Timing issues; most of the time spent writing functional tests is knowing when to wait for the next click (e.g. waiting for AJAX response and change in a certain DOM element)... and doing this in a clean way (e.g. WebDriverWait conditions instead of putting Sleep(1000) everywhere).

This can be answered in a fairly simple way. How does your user know when to proceed? What changes?

janekk4• 13 years ago

Ian, I agree that's the right mind frame to be in, but I notice they (DevExpress) didn't address it in their demo or docs.

They have a 'wait' function that waits for a period of time, but this is just a sign of bad test writing and something sure to break when testing against different browsers or environments (localhost v.s. staging).

hugs5• 13 years ago

"Yes, we've filed for a patent"

"TestCafé loads websites via a proxy, thus allowing its engine to inject scripts that can access and manipulate the Document Object Model"

That's exactly how Selenium 1 worked when we created it 9 years ago. It also sounds like the approach used in Sahi, Windmill, JsTestDriver -- other web testing tools. Not cool.

"While loading via proxy is not a new idea, our implementation is unique. Our framework is the only one that automatically configures that proxy and allows direct communication with the page via JavaScript."

I look forward to reading your patent application.

wildmXranat• 13 years ago

I have written spiders and test tools that perform , inject and test in the very same way. There must be a plethora of prior implemenation out there.

locusm• 13 years ago

I found it very odd a web tools company highlighted the patent bit. I wonder how companies like this go in the javascript space given the range of choice in OSS alternatives.

frankblizzard• 13 years ago

I stopped reading after "Yes, we filed for a patent" Also, the voice of the presenter in the video sounds like from some tele-shopping channel.

davidjgraph• 13 years ago

The US patent office does not care/have the resources/have a clue how to enforce that patents are non-novel and/or obvious. It is an entirely corrupt system driven by a mass of lawyers, all encouraging their clients to build patent portfolios for "defence".

If you want to combat a patent, the best stage to do this is during the application stage, it's far harder to combat it after it's approved.

For those that aren't aware of the StackExchange patents site [0], this is the best site I'm currently aware of for collecting evidence against patent applications. I would encourage you to actively seek out this patent application, start a thread on it and submit evidence against it.

The US needs a cultural change on patents, to make it clear that the patent system is corrupt and companies that file software related/non-original patents as an excuse to not having to innovate any further/at all need to be shunned.

[0] http://patents.stackexchange.com/

nilliams• 13 years ago

Agree and if anyone else has any information on how we would go about combating this patent please share it.

hugs5• 13 years ago

Thanks, I'll look into it. This is a serious issue.

boggzPit• 13 years ago

I don't understand their video at all and the voice is annoying.

wldlyinaccurate• 13 years ago

I skim-read their website and watched a good chunk of their video. I still have no idea what this actually is, and why I would use it over my existing toolset (Behat, Selenium + WebDriver, CasperJS, etc).

If any DevExpress guys/gals are reading this, please consider making a shorter (2-3 min) video showing some tests being written and run.

hugs5• 13 years ago

I'd also recommend they reach out to Selenium developers and having a conversation with them to see if what they've done is really patentable. [Disclosure: I created Selenium]

polyvisual2• 13 years ago

Thanks for creating Selenium hugs.

sergiotapia2• 13 years ago

Thank you for your hard work! Hugs from Bolivia!

polyvisual2• 13 years ago

We're on the verge of running a Selenium Grid server with a ~1000 Selenium nodes connected to it.

I'd like to see how their offering stands up to that.

(Actually, I don't know how Selenium will stand up to that... maybe I should have left this comment until I've got the results!)

arunoda• 13 years ago

Where is the 2 min intro?

sergiotapia2• 13 years ago

We've been using Selenium to test a large enterprise ASP.Net webforms application and it's been kind of a hassle. Configuration was horrible but once that's out of the way it's sort of straightforward.

What benefits does TestCafe bring against Selenium? What's the elevator pitch?

jolt3• 13 years ago

What was the hassle you had with using Selenium. Only the configuration?

Kiro• 13 years ago

"Yes, we've filed for a patent"

Instant boycott.

TestCafé: Web Testing Framework

Related Stories