We studied the role of proteases in apoptosis using a cell-free system prepared from a human leukemia cell line. HL60 cells are p53 null and extremely sensitive to a variety of apoptotic stimuli including DNA damage induced by the topoisomerase I inhibitor, camptothecin. We measured DNA fragmentation induced in isolated nuclei by cytosolic extracts using a filter elution assay. Cytosol from camptothecin-treated HL60 cells induced internucleosomal DNA fragmentation in nuclei from untreated cells. This fragmentation was suppressed by serine protease inhibitors. Serine proteases (trypsin, endoproteinase Glu-C, chymotrypsin A, and proteinase K) and papain by themselves induced DNA fragmentation in naive nuclei. This effect was enhanced in the presence of cytosol from untreated cells. Cysteine protease inhibitors (E-64, leupeptin, Ac-YVAD-CHO [ICE inhibitor]) did not affect camptothecin-induced DNA fragmentation. The apopain/Yama inhibitor, Ac-DEVD-CHO, and the proteasome inhibitor, MG-132, were also inactive both in the cell-free system and in whole cells. Interleukin-1 beta converting enzyme (ICE) or human immunodeficiency virus protease failed to induce DNA fragmentation in naive nuclei. Together, these results suggest that DNA damage activates serine protease(s) which in turn activate(s) nuclear endonuclease(s) during apoptosis in HL60 cells.