Ultrasound imaging is a valuable tool in the detection of breast lesions, and the breast imaging and reporting data system (BI-RADS) guides the ultrasound diagnosis of breast lesion to improve the diagnosis accuracy. The research of breast ultrasound computer-aided diagnosis (CAD) with BI-RADS-US is a hot topic now. In this paper, we reviewed the research progress of breast ultrasound CAD with BI-RADS-US, summarized the present problems, and discussed the future development.