subscreen.app — working on an app that synchronizes with the movie/show you watch and displays subtitles on your phone (in the original language or a language of your choice).
Tech stack: - Python + opensubtitles.org for the data pipeline - Whisper for speech recognition - React Native for the mobile client
Current state: tech demo. The app works fine and already helps a lot — for me and my wife (both non-native English speakers) it makes watching movies in Dutch cinemas much easier, by showing English subtitles on our phones instead of the Dutch ones provided by the theater.
The biggest issue now is subtitle quality and legal status. Opensubtitles provides a lot of data, but the quality is often questionable, and the legal status is rather gray/black.
Any legal or data-related advice would be appreciated!