virtuallyvivek

Gentrace | TypeScript + React | Hybrid (Williamsburg, Brooklyn & San Francisco)

Gentrace helps the most impactful companies in the world like Quizlet systematically test and evaluate their AI applications. We recently raised an $8M Series A from Matrix Partners.

Ideal candidate profile: - We use TypeScript and React heavily. We prefer candidates with strong experience with modern web technologies. - 4+ years experience working in a full stack capacity.

Role info: https://gentrace.ai/eng Email: jobs@gentrace.ai

Gentrace | TypeScript + React | Hybrid (Williamsburg, Brooklyn & San Francisco)

Gentrace helps the most impactful companies in the world like Quizlet systematically test and evaluate their AI applications. We recently raised an $8M Series A from Matrix Partners.

Ideal candidate profile: - We use TypeScript and React heavily. Although not required, we prefer candidates with strong experience with modern web technologies. - 4+ years experience working in a full stack capacity. Role info: https://gentrace.ai/eng Email: jobs@gentrace.ai

Gentrace | TypeScript + React | Hybrid (Williamsburg, Brooklyn & San Francisco)

Gentrace helps the most impactful companies in the world like Quizlet systematically test and evaluate their AI applications. We recently raised an $8M Series A from Matrix Partners.

Ideal candidate profile: - We use TypeScript and React heavily. Although not required, we prefer candidates with strong experience with modern web technologies. - 4+ years experience working in a full stack capacity.

Role info: https://gentrace.ai/eng Email: jobs@gentrace.ai

Gentrace | TypeScript + React | Hybrid (Williamsburg, Brooklyn & San Francisco) Gentrace helps the most impactful companies in the world like Quizlet systematically test and evaluate their AI applications. We recently raised an $8M Series A from Matrix Partners.

Ideal candidate profile:

- We use TypeScript and React heavily. Although not required, we prefer candidates with strong experience with modern web technologies.

- 4+ years experience working in a full stack capacity.

Role info: https://gentrace.ai/eng Email: jobs@gentrace.ai

Gentrace | TypeScript + React | Hybrid (Williamsburg, Brooklyn & San Francisco)

Gentrace helps the most impactful companies in the world like Quizlet and Webflow systematically test and evaluate their AI applications. We recently raised an $8M Series A from Matrix Partners.

Ideal candidate profile:

- We use TypeScript and React heavily. Although not required, we prefer candidates with strong experience with modern web technologies.

- 4+ years experience working in a full stack capacity.

Role info: https://gentrace.ai/eng

When building evaluation infrastructure for generative AI systems at Gentrace [1], we needed a task queue that could handle thousands of tasks per day while remaining simple to self-host.

We considered traditional options like RabbitMQ and Kafka but wanted to avoid the operational overhead for our self-hosted customers. That's when we turned to PostgreSQL.

Using PostgreSQL's FOR UPDATE SKIP LOCKED, we built a task queue that supports retries, parallelism, and large payloads, all without adding new infrastructure. Sometimes, PostgreSQL really is all you need!

It's been running in production at Gentrace, handling 8-10k tasks daily with peaks of 45k during large-scale evaluations. The architecture is simple, reliable, and easy to maintain.

We decided to open-source a version of this implementation as Simple Task Queue. It includes:

- A task queue built on PostgreSQL - Type-safe task definitions and scheduling in TypeScript - Support for retries, parallel processing, and scheduled tasks

We also wrote a deep dive about how we built it on our blog: https://gentrace.ai/blog/task-queue-simplification

We'd love feedback! Try it out, and let us know how it works for you.

- Vivek

[1] https://gentrace.ai/

Excited to give this a try! A visual environment seems like a natural fit for chained LLM calls.

Have you considered supporting OSS LLMs? Inference servers like LocalAI or vLLM expose APIs for various OSS models with OpenAI-compatible endpoints, so might not be much more work to integrate.

Gentrace co-founder here.

That's an interesting use. We don't have that currently, since we haven't had anyone request workflows only using our evaluators as a service.

That said, we would like every part of our application to be controllable through API requests eventually, which would naturally support your use case.

Would you be open to diving deeper into your requirements? The best way to reach us is at support@gentrace.ai

JavaScript and the library is Observable Plot

Link: https://observablehq.com/plot/

Cool - I'm glad to see more tech similar to Firebase pop up that's self hosted.

The big request would be mobile. I mostly use FB for the web but knowing that I could create a mobile version using the same platform would be great.

Yeah... the idea was that urgent meant a site outage or customer P0. I'd like to think that would qualify, no?

Thanks ydb! Small world but that status would have been super relevant for me today :)

I experienced something similar with Electron applications too. If you're an Electron dev, do NOT handle authentication within Electron. Handle it in their default browser.

"We don’t want to get back to judge people by how much time they spend working, but by the quality of their output."

Super important to mention this when advocating for more team building. If anything, remote workers have a tough time unplugging.

Ooo, that's definitely an interesting idea. Might be interesting to see if there's publicly available data for the largest companies that are active in that area.

An observation mostly! We definitely plan to add more graphs and charts comparing those two factors directly in the future!!

Stay tuned :)

Thanks so much :) We're excited for the results.

Eek, that's not good! Would you mind sending me a screen capture at vivek@pragli.com? Sorry about that!!

Yep, Asana was on the right hand side and Pragli was on the left.

Made it a bit easier to screen capture!

Had to Google "Field of Dreams" haha. Love the term.

Yeah classic marketing strategies of pitching value and getting an entire team to buy in is no longer going to work for communications products like these...

It's all about capturing enough single user joy to incentivize user invitation.

Glad you liked it, gumby! Stay tuned for similar experiments to promote adoption. :)

Of course! Stay tuned for more updates :)

Yep - definitely helps to build up a feeling of attachment and delight to the product :)

Haha, thanks! From what people have been telling us - naming the problem definitely helped to frame the problem better.

We see a drastic improvement in engagement when even 2 people are in the team. That's by far the best.

Of course, in longer tail usage patterns, the more users that we have, the higher engagement we normally see.

Thanks! Not sure - but I really think more communication and collaboration products should try out more out-of-the-box engagement features like games.

Yes! In the article, we mentioned that we were considering collectible avatars to include into the game.

Some out-of-the-box ideas include extending our Spotify integration to audio channels so people can collaboratively play music together.

Thanks for the compliment! We just pushed it out, but after a few days we'll update the blog post to reveal some interesting insights.

Stay tuned :)