[Andy]

Perhaps duplicate the surfaces around the frame, then thicken that (Object-Thicken)

If you only have a single surface thickness to your plane skin, select the vertices around the window and Vertex->extrude edges then move the selection a bit, to create some border surfaces. You can then cut them away and thicken to make your frame.