Nvidia Announces Launch Of Tensorrt 8 Designed For Chatbots Recommendations And Search
Tensor RT is used by hundreds of companies for things like search engines, ad recommendations, and chatbots. Siddharth Sharma, head of the product marketing team for Nvidia’s AI software, told reporters on Monday that it has been downloaded more than 2.5 million times and is in use by companies like American Express, Verizon, LG, Ford, SK Telecom, KLA, Naver, GE Healthcare and USPS. “TensorRT 8 is twice as powerful as 7, twice as accurate as TensorRT 7, and it supports sparsity which can dramatically reduce the amount of compute and memory needed for running applications,” Sharma said....