As I may have noted, those seals have a steel frame inside the rubber seal. I do not know this for sure, but unless you know the history there (with the seals, or the car), it is possible that the internal metal frame of the seal is bent enough to cause the gap that you note (?). I do not know that for sure. (Yes, your car could be bent). These seals are not as hard to remove as you might think. You could pull one and take a look. I've removed them before.
Second, another consideration,...I think...I think (and I am not near my car to confirm my assumption) ...that on that pop out latch, there may be a tension adjustment- tighter or looser (?), somewhere. Have a look. An adjustment might make a tighter fit (seal) for you. That is a consideration not necessarily based upon factual, or corroborated experience. I do know that those internal frame seals can get bent. That may or may not be your issue.