[Andy]

This is normal. At the moment, there's no solution for simplifying the surface left around a hole (or multiple holes) in a single polygon (because the result is not a single polygon).

For this situation, triangulate (or divide) the original surface before the boolean, you'll then get a clean hole with less polygons. Note that this is better practice anyway, since concave polygons with lots of vertices are less efficient.