Tom Riddle actually needed glasses very badly. Unfortunately, the orphanage couldn’t spend money to buy him any, and only when he arrived at Hogwarts was he given a pair. He was astounded by the difference they made, but a few years after discarded them after he decided they didn’t work in his favor with his appearance. He stopped being so vain after he gathered his followers and lost most of his human qualities, but by then he had neither a nose or proper ears. Again, he could not wear his desperately needed glasses.
The struggle of living with all the pain and annoyance of not being able to see correctly made him harbor a lot of hate for those who didn’t have the problem. That hate spread to just about everyone.
Harry needed glasses because the piece of Voldemort’s soul in him made his eye sight weak. He never felt any pain that Voldemort had felt because of the lack of them, and never had any reason to hate them or anyone else. He even kept them, without lenses, after they became unnecessary and after he found this out, both because they were so familiar to him, and because they were a reminder that even something small could change something big.
