That's a face
.
Select the 4 verts in vert mode, then switch to surface mode and press delete, that should fix it.
FYI, this won't be seen in a game or a render (at least not the game I'm modeling for.), but it's cleaner and less recourse hogging to remove all unnecessary polygons.