Ask HN: Best way to monitor data incosistency in a distributed system

We have a distributed system where multiple services interact with each other, and we often run into inconsistent data states due to one or more services failing. What sort of methodologies can we use to identify such inconsistencies (e.g. anomaly detection systems)