Preheat the oven to 400°F (200°C). Line a baking tray with parchment paper if desired.
Toss the potatoes with olive oil, garlic cloves, oregano, salt, and black pepper in a mixing bowl until well coated.
Spread the potatoes evenly on the baking tray. Nestle the block of feta in the center.
Bake in the preheated oven for 30–35 minutes, or until the potatoes are golden and fork-tender, and the feta is softened and slightly golden at the edges.
Optional: Drizzle with lemon juice and sprinkle with chopped parsley before serving.
Serve hot as a side dish or a light vegetarian main.