Add the olive oil, garlic, and chili pepper flakes to a small saucepan. Bring the oil to a low boil and then quickly reduce the heat to low. Simmer for 20 to 30 minutes and then remove from the heat. Allow to cool and then store in a glass jar for up to a month in the fridge.
Add the tomatoes to a bowl or plate and drizzle with the chili oil mix. Sprinkle with salt + pepper. Serve alongside the chicken.
Heat 2 tablespoons of olive oil in a medium-sized Dutch oven or large skillet set on medium-high heat.
Once hot, add the chicken, garlic, balsamic vinegar, smoked paprika, salt, and pepper. Toss the chicken to coat and then cook until the chicken is browned all over and cooked through, about 5 minutes. Stir in the oregano and cook for another minute. Remove the chicken from the pan and place it on a plate.
To the same pan, add another tablespoon of olive oil, the bell peppers, and a pinch of salt + pepper. Sear the peppers until just beginning to caramelize on the edges, about 3 to 4 minutes.
Add the orzo and another tablespoon of olive oil. Stir the pasta with the peppers, then pour in 2 and a half cups of water. Cook until almost all the water is absorbed and the orzo is creamy. Taste the orzo to make sure it is soft in the middle; if needed, add another half cup of water and continue cooking the orzo until soft. It is important to stir the orzo often, as it wants to stick to the bottom of the pan.
Once the orzo is cooked, slide the chicken and olives into the orzo and remove from the heat. Allow the chicken to warm through for about 3 minutes.
Serve the dish topped with feta cheese and a side of tomatoes in chili oil.