Something like this is already being done for made-to-measure apparel, e.g. https://www.mtailor.com/ for men's clothes and https://www.topologyeyewear.com/ for glasses (also - does anyone know if there's a service like this for women's clothing?). I do wonder how they're determining scale - seems fairly simple if you have two focal lengths, but these services seem to support single-camera phones as well. Are they getting data from the accelerometer to see how much you move your phone when you move it around your body/face?
The main problem now seems to be fully automating clothing manufacturing - it would be pretty cool to be able to scan your body and have a machine print out perfectly fitting clothes, no human required.