Rectangles tile perfectly with no gaps and their right angles make construction trivially easy
Right angles let you use a simple plumb line to build straight walls. Rectangles stack and tile without wasted space. Paper is rectangular because it's cut from rectangular sheets.
