Implanted electrodes provide one of the most important neurotechniques for fundamental and translational neurosciences by permitting time-resolved electrical detection of individual neurons in vivo. However, conventional rigid electrodes typically cannot provide stable, long-lasting recordings. Numerous interwoven biotic and abiotic factors at the tissue-electrode interface lead to short- and long-term instability of the recording performance. Making neural electrodes flexible provides a promising approach to mitigate these challenges on the implants and at the tissue-electrode interface. Here we review the recent progress of ultraflexible neural electrodes and discuss the engineering principles, the material properties, and the implantation strategies to achieve stable tissue-electrode interface and reliable unit recordings in living brains.