Preheat the oven to 380F.
With a sharp knife slice the cauliflower into ⅓ inch "steaks". Some will separate and crumble, don't worry about that.
Arrange the cauliflower pieces on a baking sheet. Arrange the garlic between. Add the olive oil all over. Season with salt and fresh ground pepper.
Bake for about 45 min or until cauliflower is golden and lightly crispy at the edges and soft in the middle. Half way check it out, and give it a light. Sometimes I flip the pieces so they can get golden all over.
In a separate bowl mix 2 tbsp extra virgin olive oil, the juice of one lemon, and a handful of capers. Do a taste test in case you need more lemon juice to balance it. Add a generous amount of fresh ground pepper. Set aside.
Remove from heat and carefully place the cauliflower in a large bowl. Add the lemon-olive oil-caper dressing on top. Sprinkle a generous amount of shaved parmesan cheese. Serve immediately.