Debugging the edit mode selection I realized the vertices are often occluded by edges with the same depth. Sometime it can be the center pixel of a vertex point and that can lead to some selection issue. So I increased the offset a bit for the vertices and it seems to fix it.