Current issues of integrating science and practice in the context of transforming socio-economic systems
- Authors:
- Копыркин Николай Андреевич, Anna D. Sudakova
- Work direction:
- Развитие информационных технологий в условиях трансформации социально-экономических систем
- Abstract:
- The article discusses which hardware accelerators are advisable to use if you need to train large language models on your own servers, rather than in the cloud. The main types of accelerators are analyzed — GPU, ASIC, FPGA and others. The cost of ownership of different solutions for local use when installing 256 accelerators is compared separately. As a result, it is concluded that the choice of equipment should take into account not only the speed of calculations, but also the costs of electricity, cooling and software compatibility.
- Keywords:
- large language models, hardware accelerators, scalable architectures, total cost of ownership, local deployment