Glioma, characterized by neoplastic growth in the brain, is a life-threatening condition that, in most cases, ultimately leads to death. Typical analysis of glioma development involves observation of brain tissue in the form of a histology slide under a microscope. Although brain histology images have much potential for predicting patient outcomes such as overall survival (OS), they are rarely used as the sole predictors due challenges presented by unique characteristics of brain tissue histology. However, utilizing histology in predicting overall survival can be useful for treatment and quality-of-life for patients with early-stage glioma. In this study, we investigate the use of deep learning models on histology slides combined with simple descriptor data (age and glioma subtype) as a predictor of (OS) in patients with low-grade glioma (LGG). Using novel clinical data, we show that models which are more attentive to discriminative features of the image will confer better predictions than generic models (82.7 and 65.3 AUC RFD-Net and Baseline VGG16 model, respectively). Additionally, we show that adding age and subtype information to a histology image-based model may provide greater robustness in the model than using the image alone (3.8 and 4.3 stds for RFD-Net and Baseline VGG16 model with 3-fold CV, respectively), while a model based on image and age but not subtype may confer the best predictive results (83.7 and 82.0 AUC for RFD-Net + age and RFD-Net + age + subtype, respectively). Clinical relevance- This study establishes important criteria for deep learning models which predict OS using histology and basic clinical data from LGG patients.