Data Centre Magazine June 2024 | Page 91

KOVE

People have needs that exceed the limits of what a data centre can physically hold , and the only way to do it is either to be more clever on the software stack or to control the memory surface

for use by other servers and jobs , increasing memory utilisation .
“ Better utilisation of data centre resources can significantly enhance overall performance , by maximising the efficiency of existing infrastructure and reducing the need for hardware upgrades .”
Which brings Overton to a crucial subject : sustainability . Kove : SDM™ means fewer servers are required , which reduces cooling needs and energy consumption , yet still delivers greater processing power . In short , it ’ s something of a sustainability Holy Grail . Providing a real-world example of this carbon-crunching solution at work , Overton mentions Red Hat and Supermicro , who conducted extensive memory utilization testing using Kove : SDM™ on Red Hat Openshift . He says that Kove : SDM™ consistently delivered power savings of “ between 12 % and 54 %, with zero code changes ”.
“ I think it ’ s the future of computing ,” says Overton . “ You cannot deliver on the promises of AI without understanding the memory surface . Talk to anyone doing big-pharma gene-sequencing , or people training LLMs . The biggest limiting factor is always memory .”
He adds : “ Because of the speed of light and the distance of cables , the current solution is to bond the timing and the speed of memory to compute . You buy that in a size that you need , and then you multiply that in parallel as many times as you can . And when you take that approach , you need to buy power systems big enough to power cities .
“ At Kove , we ’ re looking at software infrastructure that uses less power . It ’ s not about more tightly coupled chip design but rather the commodification of chip design . When you understand the memory surface that Kove : SDM™ provides then you can change everything .”
In a world of rapid change , most of which is technology-driven , Overton points out how important it is that progress is not hobbled by the limitations of statically defined hardware .
“ Our solution allows organisations ’ data scientists to be more productive and to increase the performance of whatever they ’ re trying to accomplish , all while reducing energy consumption .”
He adds that in a world full of volatility and uncertainty , anything that ups performance levels while controlling energy costs is a competitive advantage .
“ You could run circles around your competitors , and be more environmentally responsible while doing so . Who would not want to cut data centre energy usage by 50 % while being more productive ? It ’ s a real win-win .” datacentremagazine . com 91