The COVID-19 pandemic and measures and mechanisms set in place to combat the spread of the virus have had far-reaching consequences on the lives of refugees and asylum seekers across the world. Refugees and forcibly displaced persons have particularly suffered from the discriminatory restrictions on access to health and other social services. But it is perhaps in the area of education that refugees and forcibly displaced persons have experienced extreme effects of the pandemic. It has particularly exacerbated the inequalities in access to education, which refugees and forcibly displaced persons were already facing. The closure of educational institutions has also affected refugee learners. In this paper I assess the impact of COVID-19 on refugee education, focusing on two refugee hosting countries in the Horn of Africa—Kenya and Uganda. I particularly examine the attempts made by the two countries to roll out digital learning programmes to mitigate the effect of the pandemic on education. I assess the capacities of the countries to mobilize the required infrastructure for digital learning and to effectively manage digital learning. Most importantly I seek to establish the measures and innovative actions instituted by these countries to ensure that the refugees they host continue to enjoy adequate access to education.