This paper presents a real-time teacher dashboard optimized to support agile classroom orchestration based on a Kanban board. The implemented prototype allows teachers to prepare and implement lessons and monitor student progress in real-time. Teachers can easily duplicate Kanban boards for multiple groups and identify groups of students who are falling behind or excelling and may need special support. Students can access and use the prepared Kanban boards in a privacy friendly way, raise their hand virtually, and upload their work for review. The prototype was used and evaluated in two case studies. The results indicate that the developed prototype with its features including the dashboard is usable and helpful for preparing, implementing, and reviewing lessons. Implications and future work are discussed.