Water-solubility is an important physicochemical property in pharmaceutical and environmental studies. We assessed the performance of five predictive computer models: ACD/PhysChem History, ADMET Predictor, T.E.S.T., EPI Suite-WSKOWWIN and EPI Suite-WATERNT; two of them are commercial, the others are free. We used more than 4000 compounds with experimental values to evaluate the models, considering the chemicals inside and outside the applicability domain of the models, those used to build up the model (training set) and those not present in it (prediction set). We also evaluated their ability to predict continuous solubility values, and solubility classes. Overall, considering the whole data set, some models gave a good statistical performance, with R² up to 0.88.