I will always opt to keep the peel on and remove it after baking, by hand, despite whatever burns the heat may cause me. I also delude myself into thinking this helps seal in moisture, which may or may not be true. Feel free to peel the kabocha squash before, if you're adept with a knife and a roundish squash