Quirrel could have never gotten the stone.

I have just realised that Harry risking his, Hermione's and Ron's lives for the stone ended up being pointless. Quirrel would have never been able to retrieve the stone from the mirror of erised. Dumbledore tells Harry in the hospital wing that only a person who wanted to get the stone, but not use it, would receive it. So there was no real danger... was there?