shutty

TLDR: we didn't pick rust because we're a Java shop.

I originally thought it was a joke, but it's not.

Surprisingly, 3GB is a real practical RAM limit for aws lambdas in 2025: you can only have more than that if you submit a support ticket. But it's not really mentioned anywhere in the docs.

Building a search engine on top of Apache Lucene and S3 block storage. Think Elasticsearch done right: https://github.com/nixiesearch/nixiesearch

https://github.com/nixiesearch/nixiesearch

A Lucene-based search engine on top of S3 block storage.

Index schema is immutable (but supports migrations), so you cannot just screw up your index.

Separate indexer/searcher tiers, so heavy indexing load does not affect search latency.

And embedding/reranker local inference, so you can run the whole AI search within a single docker container.

Wow, I perhaps need a kubernetes cluster just for a demo:

    CONTAINER ID   IMAGE                                                    
    0f2f86615ea5   nvcr.io/ohlfw0olaadg/ea-participants/nv-ingest:24.10     
    de44122c6ddc   otel/opentelemetry-collector-contrib:0.91.0              
    02c9ab8c6901   nvcr.io/ohlfw0olaadg/ea-participants/cached:0.2.0        
    d49369334398   nvcr.io/nim/nvidia/nv-embedqa-e5-v5:1.1.0                
    508715a24998   nvcr.io/ohlfw0olaadg/ea-participants/nv-yolox-structured-images-v1:0.2.0
    5b7a174a0a85   nvcr.io/ohlfw0olaadg/ea-participants/deplot:1.0.0                                                                     
    430045f98c02   nvcr.io/ohlfw0olaadg/ea-participants/paddleocr:0.2.0                                                                  
    8e587b45821b   grafana/grafana                                                         
    aa2c0ec387e2   redis/redis-stack                                                       
    bda9a2a9c8b5   openzipkin/zipkin                                                       
    ac27e5297d57   prom/prometheus:latest

It would be great to see this approach as a part of PEFT library, so you don’t need to rely on custom code

Looks like a wrapper on top of a couple of popular Huggingface libraries. All the heavy-lifting is done with TRL, Transformers and PEFT.

Xwayland is maintained by Xorg

https://youtrack.jetbrains.com/issue/JBR-3206/Native-Wayland...

It was a typo, sorry, meant docker hub. But:

If you don’t upgrade to a paid subscription, Docker will retain your organization data for 30 days, after which it will be subject to deletion. During that time, you will maintain access to any images in your public repositories, though rate limitations will apply.

Doesn't it mean that in 60 days all the public repos for the org will be wiped completely?

Sorry, a typo. Was quite nervous about my future opportunity to pay 300$/month for each open-source project I maintain.

Hiring Without Whiteboards

but ironically,

Discussing a real world problem (with or without whiteboard) is +1

So I guess the problem is not with whiteboards, but with tasks being asked during the interview.

For example, Grafana has an opt-out usage tracking in the open-source version: <https://grafana.com/docs/grafana/latest/setup-grafana/config...>, so it seems to be somehow acceptable in general in the industry.

Findify | Lead DevOps Engineer | CET/CEST +-2 ONLY | EU REMOTE | https://www.findify.io/

Findify is a small and stable scaleup doing ML based search and personalization for e-commerce. We’re a fully remote company with an engineering team distributed across a number of different countries in CET +-2 time zones.

This is a great role for somebody who wants to have a lot of impact and take a lot of ownership over the work. We are seeking an open minded and enthusiastic DevOps engineer to lead and scale our DevOps team, the infrastructure and developer experience, and to help our clients (1500 stores in more than 50 countries) succeed.

Responsibilities will include managing a mix of multi-tenant and single-tenant microservices, leveraging GitOps and Kubernetes heavily; building and maintaining Findify's monitoring, alerting, CI and CD flows; expanding and improving our Terraform and Ansible efforts; planning our infrastructure roadmap, designing, developing and rolling out new services and changes.

Tech Stack includes: Kubernetes, AWS (EC2, EKS, VPC), Terraform, Ansible, GitOps.

Contact: maria@findify.io

Learn more and apply at https://careers.findify.io/jobs/1660768-senior-lead-devops-e...

The same question can be asked about JavaScript, but it's still one of the most popular languages in the world :) It's a common wisdom to use a language you know best for an MVP - that's the main reason it's Scala.

And it's not a framework, so you don't really need to write/read any Scala to play with it.

As people with heavy e-commerce background, we feel that the main pain point of typical old-school offline personalization solutions is that 80% of customers in medium-sized online stores are coming only once:

* you have a very short window to adapt your store, as the visitor will never come back in the future.

* even if you have zero past knowledge about a new visitor, there is still something to compare with other similar visitors: are they from mobile? Is it ios or android? Are they US? Is it a holiday now? Did they come from google search or facebook ad?

* this knowledge is ephemeral and makes sense only within their current session. But a visitor can still do a couple of interactions like browsing different collections of items or clicking on search results, and it can also be taken into account.

But compared to Amazon and Google, it's you who define which features should be used for the ranking and how long they are stored (see the "ttl" option on all feature extractors in our docs for details).

For example, here is https://github.com/metarank/metarank/blob/master/src/test/re... the config of features used in the movie recommendations demo - in a most privacy-sensitive setup you can just drop all the "interacted_with" extractors and will get zero private data stored for each visitor.

According to the code on https://github.com/MetaMask/eth-phishing-detect/blob/45ea5cf..., looks like that everything within Levenstein distance of 3 from whitelisted hosts (like "metamask.*") is blocked.

Metarank and Metamask have the distance of 3. I've made a ticket some time ago in their github repo (https://github.com/MetaMask/eth-phishing-detect/issues/6855), but it seems that it was lost in thousands of similar tickets.

This is actually part of our CI process: https://github.com/metarank/metarank/blob/master/run_e2e.sh . This script runs on every PR to retrain the model used on a demo and confirms that it's working fine.

So you can just download the jar file from releases page and run ./run_e2e.sh <jar file> in the checked-out repository, it should do the job.

Right now it runs in a dev-mode on a single EC2 t3.large instance with loadavg ~0.30, but the inference load is quite tiny right now: around 3-4 reranking requests per second. And yes, as a typical open-source project it still crashes from time to time :)

The training dataset is not that huge (see https://github.com/metarank/ranklens/ for details, it's open-source), so we do a full retraining directly on the node right after the deployment, and it takes around 1 minute to finish. We also run the same process inside the CI: https://github.com/metarank/metarank/blob/master/run_e2e.sh

There is an option to run this thing in a distributed mode:

* training is done using a separate batch job running on Apache Flink (and on k8s using flink's integration)

* feature updates are done in a separate streaming Flink job, writing everything in Redis

* The API fetches latest feature values from Redis and runs the ML model.

The dev-mode I've mentioned earlier is when all these three things are bundled together in a single process to make it easier to play with the tool. But we didn't spent much time testing distributed setup, as this thing is still a hobby side-project and we're limited in time spent developing it.

I’m one of the contributors to this project. The idea of the tool is to focus on typical ML feature engineering challenges. It takes a stream of business events like clicks and impressions, and computes a ton of common ML features on top:

* Parse User-Agent field, make a GeoIP lookup

* Count number of clicks over different items on multiple time windows, like 1-2-3-4 weeks

* Conversion and CTR rates

* Basic customer profiling, like “you clicked on a red item in the past, and this item is also red”

There is just a LambdaMART with xgboost inside, no rocket science. It won’t replace an in-house highly-focused solution, but building everything from scratch may take a ton of time. With Metarank you can quickly hack a good enough solution in a day, hopefully :)

Can anyone explain me like I'm five, why this major transition from PulseAudio to PipeWire is happening during the last year?

Findify | EU, UTC +/- 3 | Remote | Full-time

Findify is an eCommerce focused personalized search solution.

We are looking for DevOps specialists to help us build our evolving stack. At Findify, we make extensive use of data-collection, processing and machine learning algorithms to help our merchants provide better search and recommendations to their customers. You will be responsible for maintaining and improving the current infrastructure and setting up processes to make the stack more reliable and the team more productive.

We strive to take the most pragmatic choice when it comes to choosing technology. Always weighing complexity and cost of our choices. Our backend is written in mostly in Scala, with some Node.js. We use Flink for data processing and to power our machine learning algorithms. Node is used as an api gateway between our search engine (Scala) and the end users.

  * We're deploying to Kubernetes, managed by AWS (eks). We use managed solutions where it makes sense, but are not afraid to manage open source solutions ourselves, when hosted ones don't fit the bill.
  * We have CI/CD pipelines set up via CircleCI and ArgoCD.
  * We like to embrace new technologies and processes that are helping our engineers be more productive.
  * We’re not afraid to challenge our choices, we love open source and above all, we’re a product driven company so technology is at the core of everything we do.
  * We care about monitoring, alerting and security. You will get to work with amazing engineers.

  * Own and lead operational aspects of our product, ranging from automation, monitoring to evaluating tech choices
  * Work with other engineers to innovate and improve the reliability of our service
  * Manage our CI/CD pipelines, including designing and evolving a canary release strategy that fits our multi tenant environment
  * Improve daily workflows and processes of the engineering team

  * Extensive experience with AWS (EC2, VPC, networking, IAM, etc.)
  * Extensive experience with Kubernetes (cluster administration, monitoring, auto-scaling and advanced settings)
  * Previous experience with Docker, Prometheus, Grafana
  * Experience with a configuration management tool like Ansible or Terraform
  * Experience setting up applications monitoring (telemetry, alerting, reporting)
  * 4+ years of industry experience.

Findify | Sales and business development intern | EU/US | Full-time, Remote

Findify is a Machine Learning powered search & Discovery solution for e-commerce sites. We have 1000+ e-commerce businesses in more than 50 countries around the world deliver a better experience to their customers, and increase their sales.

Are you a dynamic and energetic individual who is interested in gaining first-hand experience in sales and marketing at a fast growing SaaS startup? Do you consider yourself a great communicator and someone who can get stuff done?

If so, join us in revolutionizing e-commerce!

The ideal candidate will:

* Have excellent communication skills.

* Have the ability to understand the product and articulate the benefits to customers.

* Be well organized and able to meet goals and achieve targets.

* Be a self-driven and motivated individual who's looking to get stuff done!

Beyond the basics – what would really impress us:

* A side project, or something you built yourself that you’d proud of

* Don’t take no for an answer

Apply here: https://findify.io/careers/sales-intern/

Findify | Sales Development Representative | US | Full-time, Remote

Findify is a Machine Learning powered search & Discovery solution for e-commerce sites. We have 1000+ e-commerce businesses in more than 50 countries around the world deliver a better experience to their customers, and increase their sales.

This role in Findify is more than the classic SDR definition. The Sales Development Representative (SDR) holds a critical position at the top of the sales funnel for the entire company. The SDR is often our customer’s first experience with Findify. Lead generation, relationship building and effective communication is key in this role.

Responsibilities:

– Prospect, educate, qualify leads, identify key players and develop target accounts.

– Articulate the Findify business value proposition to decision makers to assess buying interest.

– Work closely with the Findify sales team to accelerate sales cycle and to extend reach into target accounts

– Accurately track customer interaction in with the client base to ensure efficient lead management

Required Experience:

– 2+ years in a phone-based sales position, SaaS sales is a plus

– Good working knowledge of e-commerce, social media and its influence on business today

– Energetic and social team player with excellent verbal and written communication skills

– Ability to build client relationships over the phone / video conference

– Advanced level of prospecting and qualification experience within sales

– Must be organized and detail process oriented

– Must be a self-starter with the ability to work independently or in a team environment

Apply here: https://findify.io/careers/sales-development-rep/

Findify | Front End Developer | EU | Full-time, Remote

Findify is a Machine Learning powered search & Discovery solution for e-commerce sites. We have 1000+ e-commerce businesses in more than 50 countries around the world deliver a better experience to their customers, and increase their sales.

We’re looking for a Mid / Senior Frontend Developer. If you’re always on top of the latest technologies, have a keen eye for design and you love creating scalable frontend architectures then read along!

The most important thing we are looking for in a candidate is proven passion for programming and problem solving: a Github/Stackoverflow account, an interesting project you can share, or a blog you write will go a long way.

Skills we need from the ideal candidate:

* Have solid experience with HTML5, CSS3, React/Redux and related libraries

* Have strong Typescript/Flow and ES6 skills, and able to deliver Interface based design

* Think with responsive design

* Be proficient with modern frontend build tools and the ability to create build processes

* Understand the core principles of functional programming and immutable state handling

* Be good at explaining complex technological topics – for sharing knowledge within the team and being able to provide advanced support to our top merchants

Beyond the basics (what would really impress us):

* Experience with functional programming (FP/FRP)

* Experience with full-stack development (Express, child process management, fs)

* Experience with AWS management

Apply here: https://findify.io/careers/mid-senior-frontend-developer/

Findify | EU, Remote | full-time

We are looking for a junior to mid-level Frontend developer to join our stellar engineering team and help us bring our offering to the next level. Findify is an intelligent, on-site search engine for online stores, and we’re making search smarter. We are using machine learning and big data to provide accurate & relevant search results. By improving product findability, end-consumers can find what they’re looking for, and we can help online merchants increase their revenue between 10-30%. Our engineering environment

What we’re looking for: The most important thing we are looking for in a candidate is proven passion for programming and problem solving: a Github/Stackoverflow account, an interesting project you can share, or a blog you write will go a long way. We are a distributed team, so you can work from anywhere you want, as long as it’s 2 hours +/- from GMT+2. (The timezone is an important requirement for us at this stage) It’s really important to us that you have the ability to adapt to the company’s work processes using the agile-scrum methodology, and using tools such as Trello and Slack. Not only because of our remote working culture, but even more so because of this, you need to be really awesome at communicating, and to be organized and self-driven. Oh, and you need to want to have fun.

The basics:

– HTML5, CSS3

– SASS or LESS

– Experience with responsive design

– Angular.js, React.js

– Git

– Good eye for design

Beyond the basics (what would really impress us):

– Understand the difference between two-way and one-way UI data binding

– Understand commonJS modules and/or ES6 modules

– Understand passing by value/reference in JS

– Experience with Typescript

To apply for this position If you’re interested in joining our team, and you have the skills, please get in touch with your CV and work samples! Also, be sure to give us an idea of what kind of person you are in addition to your skills, because cultural fit is as important to us as your front end development abilities!

JoinUs+Frontend@findify.io

Findify | EU, Remote | full-time

We are looking for a junior to mid-level Frontend developer to join our stellar engineering team and help us bring our offering to the next level. Findify is an intelligent, on-site search engine for online stores, and we’re making search smarter. We are using machine learning and big data to provide accurate & relevant search results. By improving product findability, end-consumers can find what they’re looking for, and we can help online merchants increase their revenue between 10-30%. Our engineering environment

What we’re looking for: The most important thing we are looking for in a candidate is proven passion for programming and problem solving: a Github/Stackoverflow account, an interesting project you can share, or a blog you write will go a long way. We are a distributed team, so you can work from anywhere you want, as long as it’s 2 hours +/- from GMT+2. (The timezone is an important requirement for us at this stage) It’s really important to us that you have the ability to adapt to the company’s work processes using the agile-scrum methodology, and using tools such as Trello and Slack. Not only because of our remote working culture, but even more so because of this, you need to be really awesome at communicating, and to be organized and self-driven. Oh, and you need to want to have fun.

The basics: – HTML5, CSS3 – SASS or LESS – Experience with responsive design – Angular.js, React.js – Git – Good eye for design

Beyond the basics (what would really impress us): – Understand the difference between two-way and one-way UI data binding – Understand commonJS modules and/or ES6 modules – Understand passing by value/reference in JS – Experience with Typescript

To apply for this position If you’re interested in joining our team, and you have the skills, please get in touch with your CV and work samples! Also, be sure to give us an idea of what kind of person you are in addition to your skills, because cultural fit is as important to us as your front end development abilities! JoinUs+Frontend@findify.io