I fucked it up, didnt i?

So i wanted to get Bull Goat armor set, looked up on the wiki. It said i need to get letter from patches at volcano manor. The thing is i met with patches in Murkwater Cave, but didnt progress his story. He kicked me off a cliff in Mt. Gelmir, but i didnt open a chest that was supposed to teleport me somewhere. When i saw him at Volcano Manor again, he didnt give me the letter. I think i fucked it up.