Atopic dermatitis (AD), also known as eczema, is one of themost common chronic skin diseases. AD severity is primarily evaluatedbased on visual inspections by clinicians, but is subjective and has largeinter- and intra-observer variability in many clinical study settings. Toaid the standardisation and automating the evaluation of AD severity,this paper introduces a CNN computer vision pipeline, EczemaNet, thatfirst detects areas of AD from photographs and then makes probabilisticpredictions on the severity of the disease. EczemaNet combines trans-fer and multitask learning, ordinal classification, and ensembling overcrops to make its final predictions. We test EczemaNet using a set of im-ages acquired in a published clinical trial, and demonstrate low RMSEwith well-calibrated prediction intervals. We show the effectiveness of us-ing CNNs for non-neoplastic dermatological diseases with a medium-sizedataset, and their potential for more efficiently and objectively evaluatingAD severity, which has greater clinical relevance than mere classification.