How to know if gpu memory is enough before starting training?

Beginners
1

Are there any available code to be used directly?

2

There is this: https://huggingface.co/transformers/benchmarks.html, which you can use to test memory usage amongst other things.