what are the Exact Hardware Requirements for GPT-2 1.5 B
I want to train Gpt-2 over a very large amount of data (Terabytes of text data), what hardware I will require for it, there is no issue with the budget, I want to train it in the best and fastest way possible, please help me with your best advice :)