Preheat the oven to 350 degrees Fahrenheit with your pizza stone inside. Line a baking sheet with parchment paper.
Trim the top and bottom off the yellow squash. Using a mandoline (or a very sharp knife), thinly slice the squash lengthwise.
Toss the squash slices with enough olive oil to generously coat, along with salt and pepper to taste.
Arrange the squash slices in a single layer on the parchment-lined baking sheet. Bake at 350 degrees Fahrenheit for 20 to 25 minutes, until tender and beginning to brown on a few edges, turning once halfway through.
As soon as the squash is done, remove it from the oven and turn the heat up to 550 degrees Fahrenheit.