We have performed ultrafast optical microscopy on single flakes of atomically thin CVD-grown molybdenum disulfide, using non-degenerate femtosecond pump-probe spectroscopy to excite and probe carriers above and below the indirect and direct band gaps. These measurements reveal the influence of layer thickness on carrier dynamics when probing near the band gap. Furthermore, fluence-dependent measurements indicate that carrier relaxation is primarily influenced by surface-related defect and trap states after above-bandgap photoexcitation. The ability to probe femtosecond carrier dynamics in individual flakes can thus give much insight into light-matter interactions in these two-dimensional nanosystems.