HN user

viig99

10 karma
Posts3
Comments39
View on HN

Said engineer, said 1000 RPC calls are not the issue, and when questioned further on proving a tracepath / perf result casually exited the conversation, to me it looks like they are not ready to do better or listen to valid criticism, leading conversations on semantics is just creating noise instead of acting on signals.

Also 1000 RPC's are a very valid performance bottleneck, 1000 * latency caused by serde+ network can compounds easily based on data locality + container network orchestration, no data was provided otherwise even when asked for.

Location: Toronto, Canada

Remote: Yes, (Open to Hybrid and in-office)

Willing to relocate: Yes

Technologies: Machine Learning, Pytorch, C++

Résumé/CV: https://viig99.github.io/

Email: accio.arjun@gmail.com

GitHub: https://github.com/viig99

--------------------------------- Applied Machine Learning Engineer with 11+ years experience in backend engineering and machine learning.

I have experience in solving for end to end machine learning problems, robust data collection & cleaning, distributed training on GPU clusters, building custom model & training recipes on domain specific problems, model calibration, scalable and low latency inference pipelines in C++ / python (GRPC, k8), monitoring and hard negative mining, Model specific inference optimizations (Quantization, Pruning, Torch Dynamo etc) and have worked on various domain problems like: Search & Ranking, Cold start recommendations, Constraint based optimization, Speech (Speech to text, text to speech), Vision (Segmentation, Classification, OCR), NLP (Doc QA, Classification, Entity Recognition) etc

TBH high levels skills on C++-20 is not what these companies are looking for, instead on C++-14 or so, meanwhile anyone learning C++ in 2022 would rather want to pickup C++-20 ++ with its niceties, old C++ is too tiresome without extra rewards.

August 15th 1971, President Richard Nixon announces that the United States will no longer convert dollars to gold at a fixed value, effectively ending the Bretton Woods system. He also imposes a 90-day freeze on wages, prices and rents.

Meh, trump's gonna whine democrats stole the election, media is constantly talk about him for next 4 years, he will win again in 2024 and nothing is going to change. Meanwhile climate change, economy and social media nonsensence will keep getting worse, why ? because nobody wants to really fight for the little guy.

SymSpell port for python using c++-pybind11, is 3x-40x faster than symspellpy the current best symspell port in python and maintains same api structure.

ML engineer here, team started as a research team, now that we have things in production and have a lot of devops, engineering work, we bifurcated into pods and work on specific bits and pieces, lot of constant fire-fighting though. Re-wrote entire stack from python to C++ threadpool async grpc (is thrift the only good threadpool server implementation available ?), deployed on openshift, used vector + influx + grafana for dashboards / internal model monitors, elastic search for loggings, lot of other tools for validation, filtering for potential training candidates etc. Right now working CI/CD for ml, during training if model finds a better model based on different validation sets, have one click deployment ready for approval etc

Modern c++ is surprisingly easy to pickup especially for developers coming from other languages, very easy to focus on the good parts and totally disregard the messy bits, working with older libraries is still a pain though.

Lee sedol is a pretty cool guy and a normal human being, albeit the crazy ability to remember games likes maps, do watch the latest episode of 'master in the house' a korean variety show which featured lee sedol as the guest.