HN user

antonmks

629 karma

antonmks@gmail.com

Posts11
Comments39
View on HN

Spotify and the three main major record labels sue Anna’s Archive for $13trillion for “brazen theft of millions of files containing nearly all of the world’s commercial sound recordings”.

NVIDIA executives allegedly authorized the use of millions of pirated books from Anna's Archive to fuel its AI training. In an expanded class-action lawsuit that cites internal NVIDIA documents, several book authors claim that the trillion-dollar company directly reached out to Anna's Archive, seeking high-speed access to the shadow library data.

It is pretty strange that a country doesn't control what is going in and what is going out. In a small European country I'm most familiar with, everything is checked by customs officers. Dogs, x-rays, customs declarations, import taxes.

I'm experienced in building high-performance data pipelines using Python and JAX, specializing in low-level optimizations like JIT compilation, vectorization, parallelization, and operator fusion. My solutions run seamlessly on CPUs, GPUs, and TPUs, consistently outperforming traditional tools like pandas and polars in both speed and scalability. If you need blazing-fast, scalable data processing leveraging modern hardware and cutting-edge compiler tech, let’s connect!

https://github.com/antonmks https://substack.com/@antonmks

antonmks@gmail.com

Very interesting ! I looked at the repo and it seems that Sirius uses cudf as an engine. So it is not like relational operations were written from scratch. Also, TPCH SF=100 would fit nicely into GPU memory. Would be interesting to see comparisons of something like SF=1000.

[dead] 1 year ago

How we can use tensor operations—typically used in deep learning—for fast, parallel data processing tasks.

SEEKING WORK | Worldwide | Remote

Location: Israel

Remote: OK

Willing to relocate: Yes if necessary

Technologies:

- Python/Polars/JAX/CUDA/C++/SQL

- ClickHouse, DuckDB

- Other (AWS, GCP)

- Whisper, STT, TTS

Email: theberlinbird@gmail.com

Database engineer(Python, SQL, High Performance apps) experienced in building voice recognition apps with Whisper on gpu and tpu.

SEEKING WORK

Location: Berlin, Germany

Remote: Yes, any timezone.

Willing to relocate: Depends on location.

Technologies: Python Flutter, Dart, SQL, relational databases, AI, LLM, speech-to-text, text-to_speech

GitHub: https://github.com/antonmks Google Play : https://play.google.com/store/apps/details?id=com.berlin.bir... - app that helps you learn foreign languages.

Email: See my HN profile.

I'm a developer with 20+ years of professional experience. I develop AI, speech-to-text and text to speech solutions for startups and established companies.

Rate : $10/hour

SEEKING WORK

Location: Berlin, Germany

Remote: Yes, any timezone.

Willing to relocate: Depends on location.

Technologies: Flutter, Dart, Python, SQL, AI, LLM, speech-to-text, text-to_speech

GH: https://github.com/antonmks

Email: See my HN profile.

Hi there. I'm a developer with 20+ years of professional experience. I like developing AI, speech-to-text and text to speech solutions for startups and established companies. I can code MVP with advanced AI capabilities for your startup in a relatively short period of time.

"significant reductions in diversity at 415, 322, 300, 145 and 33 Myr ago" - it seems that periods between extinctions events are so large that you can easily fit there hundreds and even thousands of civilizations like ours. So not much to worry about, we will have plenty of opportunities to kill ourselves before a comet does us in.

Could be a good idea for Windows 10 - blocking all ads by default, including those delivered through browsers. It could seriously affect and even kill many current and potential Microsoft competitors like Google and Facebook.

Sorry if you are misled :-) The program does parses selected fields, there are strings-to-binaries procedures.

I tested this approach on multiterabyte files, take a look at my alenka project, it uses the same method to load large CSV files into databases. It just have to be done in chunks.

The program compiles fine, that pull request was referring to incorrect earlier version of test.cu file.

Test it for yourself, see if you get similar results.

Thrust CUDA calls are synchronous to each other. You can add an explicit synchronization call cudaDeviceSynchronize() and there won't be a difference in results.

Doesn't look like it uses any kind of vectorized execution. So the only advantage one gets is reduced amount of data to process. It also doesn't mention execution on compressed data so it has to decompress the data which doesn't come cheap.

Disk time matters only when you read your data first time. The following queries won't have to read from the disk. The compressed data may sit in memory for days and the queries won't touch the disk. Now, if your compressed data doesn't fit into memory, then disk speeds of course would matter a lot, on this I agree with you.