Smooth muscle tumors represent the second most common mural mesenchymal neoplasm in the gastrointestinal tract, but established criteria for prognostic assessment of these tumors are lacking. A large cohort of surgically resected intramural gastrointestinal smooth muscle tumors from 31 institutions was analyzed to identify potential prognostic features. Pathologic features were assessed by expert gastrointestinal and/or soft tissue pathologists at each center. Immunohistochemical confirmation was required. A total of 407 cases from the esophagus (n = 97, 24%), stomach (n = 180, 44%), small bowel (n = 74, 18%), and colorectum (n = 56, 14%) were identified. Patients ranged in age from 19 to 92 years (mean 55 years), with a slight female predominance (57%). Mean tumor size was 5.4 cm, with the largest tumor measuring 29 cm. Disease progression following surgery, defined as local recurrence, metastasis, or disease-related death, occurred in 56 patients (14%). Colorectal tumors were most likely to progress, followed by small bowel and gastric tumors. None of the esophageal tumors in this series progressed. Receiver operator characteristic analysis identified optimal cutoffs of 9.8 cm and 3 mitoses/5 mm2 for discriminating between progressive and non-progressive tumors. Histologic features strongly associated with progression by univariate analysis included moderate-to-severe atypia, high cellularity, abnormal differentiation (defined as differentiation not closely resembling that of normal smooth muscle), tumor necrosis, mucosal ulceration, lamina propria involvement, and serosal involvement (P < 0.0001 for all features). Age, sex, and margin status were not significantly associated with progression (P = 0.23, 0.82, and 0.07, respectively). A risk assessment table was created based on tumor site, size, and mitotic count, and Kaplan-Meier plots of progression-free survival for each subgroup revealed progression-based tiers. Based on our findings, it appears that nonesophageal gastrointestinal smooth muscle tumors measuring >10 cm and/or showing ≥3 mitoses/5 mm2 may behave aggressively, and therefore close clinical follow-up is recommended in these cases.