Yes, so i orgasmed once when i got fingered but cant orgasm when we are having vaginal sex

So every time me and my boyfriend have sex I can’t orgasm at all I’ve only orgasmed once through out or relationship and im very comfortable with him and all that but once he fingers me i orgasm off of him fingering me. I don’t know why it cant be both. Whats wrong with me