Graphene has high electrical conductivity, making it an attractive material for thermoelectric applications. However, its high thermal conductivity is a major challenge, and initial studies indicate that using pristine graphene alone cannot achieve optimal thermoelectric performance. Therefore, researchers are exploring ways to improve thermoelectric materials by either leveraging graphene's high intrinsic electrical conductivity or compounding graphene with additives to reduce the intrinsic thermal conductivity of the materials. Therefore, the research focus is now being shifted to graphene composites, primarily with polymer/organic conductors. One promising avenue of research is the development of graphene composites with polymer or organic conductors, which have shown some improvements in thermoelectric performance. However, the achieved “dimensionless figure of merit (ZT)” values of these composites are still far lower than those of common inorganic semiconductors. An alternative approach involves incorporating a very small amount of graphene into inorganic materials to improve their overall thermoelectric properties. These new concepts have successfully addressed the detrimental effects of graphene's intrinsic thermal conductivity, with the added interfaces in the matrix due to the presence of graphene layers working to enhance the properties of the host material. The use of graphene presents a promising solution to the longstanding challenge of developing high-performance and cost-effective thermoelectric materials. This paper discusses these innovative research ideas, highlighting their potential for revolutionizing the field of thermoelectric materials.