Infrastructure required to fine tune bloom 176B model on downstream tasks
#196
by
rajabmondal7
- opened
How much GPU memory required to fine tune bloom 176B model on downstream tasks ?
How much gpu memory do i need to fine tune Bloom 176B on a100 gpus?
You need at least 3 a100 80gb's