Medicine poses a unique challenge due to the complexity and range of tasks required to treat patients. We propose an approach to reduce the gap between computer scientists and medical doctors to design relevant interactive agents to assist physicians in their daily work. We demonstrate that an interactive one-hour meeting is enough to equip physicians with enough knowledge and understanding of interactive agents to propose relevant and feasible ideas. Physicians also demonstrated a real interest in designing such systems to assist them in their work.