Background Host malignant stromal cells induced by glioma stem/progenitor cells were revealed to be more radiation-resistant than the glioma stem/progenitor cells themselves after malignant transformation in nude mice. However, the mechanism underlying this phenomenon remains unclear. Methods Malignant stromal cells induced by glioma stem/progenitor cell 2 (GSC-induced host brain tumor cells, ihBTC2) were isolated and identified from the double color-coded orthotopic glioma nude mouse model. The survival fraction at 2 Gy (SF2) was used to evaluate the radiation resistance of ihBTC2, the human glioma stem/progenitor cell line SU3 and its radiation resistant sub-strain SU3-5R and the rat C6 glioma cell line. The mRNA of Notch 1 and Hes1 from ihBTC2 cells were detected using qPCR before and after 4 Gy radiation. The expression of the Notch 1, pAkt and Bcl-2 proteins were investigated by Western blot. To confirm the role of the Notch pathway in the radiation resistance of ihBTC2, Notch signaling blocker gamma secretase inhibitors (GSIs) were used. Results The ihBTC2 cells had malignant phenotypes, such as infinite proliferation, hyperpentaploid karyotype, tumorigenesis in nude mice and expression of protein markers of oligodendroglia cells. The SF2 of ihBTC2 cells was significantly higher than that of any other cell line (P<0.05, n = 3). The expression of Notch 1 and Hes1 mRNAs from ihBTC2 cells was significantly increased after radiation. Moreover, the Notch 1, pAkt and Bcl-2 proteins were significantly increased after radiation (P<0.05, n = 3). Inhibition of Notch signaling markedly enhanced the radiosensitivity of ihBTC2 cells. Conclusions In an orthotopic glioma model, the malignant transformation of host stromal cells was induced by glioma stem/progenitor cells. IhBTC2 cells are more radiation-resistant than the glioma stem/progenitor cells, which may be mediated by activation of the Notch signaling pathway.