Stack the tortillas two high, to make 4 two-layer quesadillas. Top each with another tortilla, brush with oil, and sprinkle with chili powder. Grill oiled-side-down until golden brown, 3 to 4 minutes.