Ask HN: Wouldn't it be trivial for ISP to determine site via traffic patterns?

Even if you're using a VPN, shouldn't an ISP have access to more than enough data to determine that X packets of roughly Y size, sent with roughly Z timing is 99% likely to be S service? They have the training data...Am I fundamentally misunderstanding some part of how ISPs work?