DavesEmployee t1_j147fki wrote on December 21, 2022 at 3:31 PM Reply to comment by caninerosie in [D] Running large language models on a home PC? by Zondartul I think it’s because they’re mostly used for games which almost never take advantage of the technology. You can tell from the designs that they were going to support it but the feature was taken out probably due to price or power concerns Permalink Parent 2
DavesEmployee t1_j1426ms wrote on December 21, 2022 at 2:56 PM Reply to comment by caninerosie in [D] Running large language models on a home PC? by Zondartul 4090s don’t support NVLink unfortunately 🥲 Permalink Parent 2
DavesEmployee t1_j147fki wrote
Reply to comment by caninerosie in [D] Running large language models on a home PC? by Zondartul
I think it’s because they’re mostly used for games which almost never take advantage of the technology. You can tell from the designs that they were going to support it but the feature was taken out probably due to price or power concerns