In a large skillet, heat the olive oil over medium-high heat. Add the lemon slices and cook for 3 to 4 minutes, until softened. Remove the lemons from the pan and set aside. They'll be very soft and will start to come apart. That's ok!
Add the peas and leeks to the skillet; stir fry 3 to 4 minutes or until the pea pods are crisp tender. Stir in the dill and the lemon slices. Season with salt and pepper and serve immediately.