Don't follow the objective path and you will locate the ladder easily. This card is near the orange skull altar.