Show HN: Wasted hours on Unit tests, so I built VS Code ext for AI tests

https://marketplace.visualstudio.com/items?itemName=snippethubio.snippethubx

by fmdz • 3 years ago

15 15 3 years ago

marketplace.visualstudio.com

Hey guys,

I'm investing a ton of time on writing unit tests, for both enterprise and personal projects.

I came up with the idea to make extension for AI-generated tests and cases within a VS Code.

Happy to hear feedback, both positive and negative.

graypegg2• 3 years ago

Anyone made the opposite product? Human written tests, that an AI tries to make green?

fmdz5• 3 years ago

We are writting ton of such tests, on daily basis haha.

That is infinite process, we're all stuck within :-)

darkteflon• 3 years ago

That’s actually a really interesting idea. Particularly if you take care to add docstrings and comments to the tests. Thanks!

graypegg2• 3 years ago

Keep me posted if you get that working! Would be really interesting to see! Might mess around with it myself sometime too.

8note2• 3 years ago

Given the "ai Mario just pauses the game and calls it a win"

I'd expect that the ai written code doesn't do the right thing outside of the given test cases

ramon156• 3 years ago

Watch out, we'll end up writing unit tests 40 hrs a week

lnxg33k13• 3 years ago

Is there a place where to see the code you’re trying to test? My primary use of unit tests is to understand if its clean and maintainable code, so im likely your last user case, but wanted to see what kind of code took hours to test

fmdz5• 3 years ago

Do you mean within overview page of extension, on examples gif/images or within real flow in VS Code?

lnxg33k13• 3 years ago

Just some code examples of what was being tested

8note2• 3 years ago

I don't really understand what the test cases will do? Is the code expected to already correct, and the tests are documentation?

If I imagine a workflow of

1. Updating some code (with a regression) 2. Running the ai to generate tests 3. The tests pass

How do I know that the ai didn't assume the regression is expected? Do I read the explanation of the test cases?

fmdz5• 3 years ago

There are positive, negative and edge cases.

They are generated by AI, so unit tests will be implemented by case definitions.

bicepjai• 3 years ago

IMHO, Testing is one thing that needs to be inspected when it comes to AI code generation

fmdz5• 3 years ago

It is, I agree.

You have full control over generated tests. Also, I put focus on putting as much control as possible, so you can set different inputs to reach higher quality of generated tests.

At the end, you add or append file with generated tests, so you have full control over them.

Show HN: Wasted hours on Unit tests, so I built VS Code ext for AI tests

Related Stories