"The whole goal is, of course, to provide the capabilities to be able to train very, very large, accurate models. If you look at the current landscape of computing capabilities, mostly dominated by GPUs, what you need is many, many GPUs because of the limited amount of memory that each of the GPUs can have."