Skarvhøi is a mountain in Lom Municipality in Innlandet county, Norway. The 1739 m tall mountain is located in the Jotunheimen mountains about 9 km southeast of the village of Fossbergom and about 21 km southwest of the village of Vågåmo. The mountain is surrounded by several other notable mountains including Eisteinhovde and Veslekjølen to the southwest; Ilvetjørnhøi to the south; Gråvåhø, Grjothovden, and Saukampen to the southeast; and Kvitingskjølen to the south. The name loosely translates to "Scarf Hill" in English.