This paper has presented an intelligent tongue image collection system for traditional Chinese medicine (TCM) diagnosis. On one hand, an improved lightweight detection network was proposed to identify the real-time images captured by the camera and store the qualified tongue images. On the other hand, the age and gender detection module was introduced to determine individual differences in the collected images, thereby providing additional information for subsequent diagnostic processes. Finally, the collected images and additional information can be stored in a specific format, contributing important data resources to the construction of high-quality tongue diagnosis datasets. Experimental results show that the proposed collection system is feasible and effective, capable of obtaining qualified tongue images through intelligent methods, and providing solid technical support for achieving intelligent tongue diagnosis in the future.