The zest of the orange comes from the peel as you suggested.
When you peel the skin there is a white underside of the peel, This is called the "pith" You want to run a pairing knife to remove this,it is bitter. The zest of an orange has very fragret oils that lend themselves to many preparations
cc