if I am not sure of the Poi size, I always put a storage box on the opposite side of the road.
also, an easy trick you can do before starting a quest is to make a line of frame blocks from the edge of a building outward. when you reset the POI, all the frames that are inside the POI tile will be destroyed.