India is a booming market for app-based food and goods delivery services with motorized two-wheelers (MTW) being the dominant mode of mobility for last-mile delivery. While ubiquity of MTWs makes them suitable for last-mile delivery, MTW-riders account for the largest share of fatalities due to road accidents in India. Therefore, this study examined challenges for MTW-based last-mile delivery personnel with a goal to reduce on-road distractions and increase rider safety. Naturalistic observation studies helped gain insights about on-road distractions due to use of screen-based applications (control). Insights from research led to the development of a tactile interaction (intervention) which was tested with MTW-riders in real-world conditions. Comparison between intervention and control for gaze duration on-road and instances of handlebar disengagement revealed significant reduction in unsafe conditions for the intervention. Future work includes fine-tuning the tactile interaction to develop safe and intuitive motorized two-wheeler dashboard solutions tailored to meet rider-safety needs of last-mile delivery personnel.