Albumin, the most abundant protein in human serum, is applied to various diseases as a drug delivery carrier because of its superior blood retention, high biocompatibility, and a wide variety of drug binding abilities. Albumin is known to distribute widely in the blood and various interstitial fluids and organs. Different albumin receptors skillfully regulate the distribution characteristics of albumin in the body. Albumin receptors are a group of diverse proteins, such as FcRn, gp60, gp18, megalin, cubilin, SPARC, and CD36. Their tissue distributions in vivo are unique, with different albumin’s recognition sites. Therefore, the distribution of albumin in vivo is ingeniously controlled by these multiple albumin receptors. Reevaluation of these albumin receptors opens up new possibilities for applying albumin as a drug delivery carrier. If the tissue distributions of albumin receptors were known and the albumin recognition site of the receptor was identified, organ-specific active targeting would be possible. In this review, we would like to scrutinize what is currently known and share information to develop next-generation albumin carriers that focus on interactions with albumin receptors.