The 78-year-old man from Baden-Württemberg was hiking with his family on the Geißspitze mountain in the western state of Vorarlberg at the weekend when he slipped and fell down a steep slope, according to police.
The relatives who saw the man slip called mountain rescue services and, along with another hiker, climbed down to where their relative had landed.
Emergency services arriving on the scene were unable to save the man, whose family are now being cared for by a police crisis intervention team.
In a separate incident in Styria, a 15-year-old boy had to be rescued by emergency services on Monday after falling 20 metres on Schladming mountain.
The boy had been hiking in the region when he fell and crashed on rocky terrain below.
He was lightly injured in the fall and had to be taken to hospital by helicopter, although weather conditions initially made it difficult for emergency services to reach him.