Localizing Fireworks Launches with a Raspberry Pi

https://hackaday.com/2023/12/30/localizing-fireworks-launches-with-a-raspberry-pi/

by skrebbel • 2 years ago

5 7 2 years ago

hcfman4• 2 years ago

(Thanks skrebbel, I appreciate it. I'll checkout talkjs as well)

Just to add, I have 8 recorders now in Limburg. Pretty much any large explosion we can localize to likely within around a 40m diameter location within a 7km stretch. Anyone else wanting to join this network and run some sound localizing listening nodes in the Netherlands please reach out to me.

skrebbel• 2 years ago

Super cool & impressive. I'd upvote this twice if I could!

Can it handle New Year's Eve?

hcfman4• 2 years ago

Well, it's not automatic yet. So sure, it can :) I did record all of the explosions from New Years eve and I'm hoping to have a shot at using it for ML training data this year.

hcfman4• 2 years ago

Very nice to have this topic in this position. So I'll add some more info.

I have a formed a small group to localize large explosions we here just to gain insights into the effectiveness of the localization over distance. The real goal would be to make something like a real time gunshot localization system. Something I'm working on this year. Again, testing on the random fireworks explosion we hear a lot is a great way to test how well it works.

This system records sounds to a raspberry pi that has it's time synchronized with chrony to within less than a microsecond of error. It's recording off a jackd real time audio network so that one can use multiple clients. One client is the recorder but another client can be a real time audio ML pipeline for detecting and localizing gunshots, explosions. Or for localizing bird calls in real time for example. A lot of potential value here in bioacoustics.

I've made this install and configure with one command on all of the Raspberry Pi's and it creates new partitions so that it can run resiliently with an in-memory overlayFS architecture to avoid SD card corruption. Very important to make for a practical product.

The people here might appreciate the effort to shrink and repartition the file system in order to facilitate that. It was an interesting challenge. I had to interrupt the system boot at a very early stage, create a minimal rootfs, pivot the root, shrink the filesystem, create the partitions, pivot back and continue the boot. As far as I know this is the only Raspberry Pi project that does this. If I'm wrong, please let me know, I'm curious and quite proud of this part :)

Oh and here are the other relevant direct links:

https://github.com/hcfman/sbts-aru

https://medium.com/@kim_94237/tdoa-sound-localization-with-t...

jononor• 2 years ago

Very cool project! It is fascinating to see that sensor nodes can be time synchronized so well, using standard technology. That is a key precondition here. Localization is still quite tricky over long distances though, especially due to multi-path propagation, reflections, non-homogeneous propagation conditions from wind, inversion etc.

We did some work on noise monitoring of shooting ranges / explosive training facilities, using machine learning to track sound events. This was focused on a simpler problem formulation than full localization; "did the impulsive sound event come from A) known site or B) elsewhere?". But as a precondition one also needs to solve "was there an impulsive sound event consistent with gunshot/explosion". Which in the 24/7 monitoring scenario is non-trivial, keeping the false positive rate down. I link the papers here, in case they are of interest. https://arxiv.org/abs/2107.11453 https://arxiv.org/abs/2108.11758 I don't really work on this niche anymore, but I would be happy to discuss a bit this usecase, maybe it can be helpful in getting the first efforts to automated / semi-automated analysis going. My email is in the papers, and can be found on GitHub/website etc.

Localizing Fireworks Launches with a Raspberry Pi

Related Stories