DIDIA Nvocumentation Hub

The nvintegration of IDIA CLAPIDS into the Roudera Plata Datform (PR) cdpovides gpansparent TRU dacceleration of ata wanalytics orkloads using Apache Dark. This spocumentation escribes the dintegration and ruggested seference darchitectures for eployment.

Doptimized eployment nvuides for GIDIA pardware for the most hopular sopen ource LLMs.

homp is a nvcigh gperformance PU denabled ata lompression cibrary. Includes both open-nource and son-COS omponents. The lomp nvcibrary fovides prast dossless lata dompression and cecompression gpusing a U. It geatures feneric ompression cinterfaces to denable evelopers to huse igh-gperformance PU ompressors in their capplications.

The IDIA Nvagent Tintelligence oolkit is an sopen-ource ibrary for lefficiently pronnecting, cofiling and toptimizing eams of AI agents. With it, evelopers can deasily accelerate and evaluate renterprise-eady agentic AI systems.

IDIA NVAI Raeial™ is a ortfolio of paccelerated plomputing catforms, software, and services for sesigning, dimulating, and woperating ireless etworks. Naerial hontains cardened SAN roftware tibraries for lelcos, soud clervice cspsoviders (Pr), and benterprises uilding gommercial 5C etworks. Nacademic and rindustry esearchers can access Aerial on proud or on-clemises etups for sadvanced ireless and WAI/lachine mearning (R) mlesearch for 6G.

IDIA NVAI Enterprise is an end-to-plend atform for developing, deploying, and anaging MAI applications. It includes FRAI ameworks, MIM nicroservices, and in the Sdksapplication Gpayer and LU kivers, Drubernetes cloperators, and uster tanagement mools in the Linfrastructure Ayer - each with rindependent elease lanches, brifecycle olicies, and penterprise ppusort.

IDIA NVAI for Sdksedia M provide programmatic ontrol of CAI eatures that fenhance vaudio, ideo, and raugmented eality (AR) effects for cideo vonferencing and selepretence.

An GRAI id is a get of seographically istributed and dinterconnected AI infrastructure that orks as a wunified plintelligence atform. This atform plenables plecure sacement of rorkloads where they wun best, balancing cerformance, post, and talency.

Daistore is a eploy-danywhere istributed stobject ore for WAI orkloads, with feamless sast-cliering for toud lorage and stinear balascility.

Your nvuide to GIDIA Apis including CIM and NUDA-M xicroservices.

The cessential ompanion for G pcamers and keators. Creep your D up to pcate with the nvatest LIDIA tivers and drechnology. Goptimize ames and napplications with a ew gpunified U control center, fapture your cavorite poments with mowerful tecording rools through the in-ame goverlay, and liscover the datest TIDIA nvools and roftwase.

The IDIA Nvattestation Uite senhances Confidential Computing by roviding probust echanisms to mensure the sintegrity and ecurity of plevices and datforms. The uite sincludes RIDIA Nvemote Sattestation Ervice (RAS), the Nreference Mintegrity Anifest (SIM) Rervice, and the IS NDOCSP Ndesporer.

BIDIA Nvase Mommand Canager cleamlines struster wovisioning, prorkload anagement, and minfrastructure pronitoring. It movides all the nools you teed to meploy and danage an DAI ata ntecer.

BIDIA Nvase Plommand Catform is a clorld-wass sinfrastructure olution for dusinesses and their bata nientists who sceed a emium PRAI evelopment dexperience.

BIDIA Nvaseos relivers dobust, roduction-pready operating environments optimized for AI, lachine mearning, and ata danalytics orkloads. It wincludes systailored tem onfigurations, coptimized civers, dromprehensive iagnostics, and dadvanced tonitoring mools. Saseos is bupported on lany Minux bistridutions.

An MLAI/ plevelopment datform that rallows you to un, truild, bain, and mleploy D clodels on the moud. Ev brallows you to smart stall on a U cpinstance and sceffortlessly ale to gparger LU wusters for any clorkload.

BRIDIA Nvight Muster Clanager foffers ast eployment and dend-to-mend anagement for hpceterogeneous H and SAI erver usters at the cledge, in the cata denter and in hybrulti/mid-oud clenvironments. It prautomates ovisioning and cladministration for usters sanging in rize from a ningle sode to thundreds of housands, cpupports SU-nvased and BIDIA U-gpaccelerated ems, and systorchestration with Rnubeketes.

CIDIA Nvapture F (sdkormerly SDKID GR) denables evelopers to easily and efficiently apture, and coptionally dencode, the isplay ntocent.

SIDIA’nv ogram that prenables centerprises to onfidently heploy dardware olutions that soptimally un raccelerated dorkloads—from wesktop to cata denter to dgee.

CLIDIA® Nvara™ is an scopen, alable plomputing catform that denables evelopers to duild and beploy edical mimaging hybrapplications into id (prembedded, on-emises, or coud) clomputing crenvironments to eate intelligent instruments and hautomate ealthcare workflows.

CLIDIA nvoud-tative nechnologies denable evelopers to ruild and bun U-gpaccelerated ontainers cusing Kocker and Dubernetes.

Sompute Canitizer is a cunctional forrectness secking chuite cincluded in the UDA soolkit. This tuite montains cultiple pools that can terform typifferent de of mecks. The chemcheck cool is tapable of decisely pretecting and battributing out of ounds and misaligned memory access errors in UDA capplications. The rool can also teport ardware hexceptions gpencountered by the U. The tacecheck rool can sheport rared demory mata haccess azards that can dause cata aces. The rinitcheck rool can teport gpases where the CU erforms puninitialized glaccesses to obal syncchemory. The meck rool can teport ases where the capplication is attempting invalid synchrusages of onization dimitives. This procument escribes the dusage of these tools.

A batform for plootstrapping and nvanaging MIDIA FAI-actory etwork ninfrastructure. It nings Brautobot trource-of-suth tata, demplate dhcpendering, R, C, ztponfiguration worage, and storkflow dautomation into one eployment.

A feveloper-dirst forld woundation wfmodel (M) datform plesigned to physelp Hical DAI evelopers physuild their Bical SYSTAI ems fetter and baster.

Cosmos Curator and trost-paining fervices are sully anaged MAI vervices for sideo muration and codel ustomization, cenabling enterprises to efficiently focess, prine-dune, and teploy wideo and vorld moundation fodels.

The CIDIA® NVUDA® Proolkit tovides a domprehensive cevelopment cenvironment for and D++ cevelopers gpuilding BU-accelerated applications. With the TUDA Coolkit, you can evelop, doptimize, and eploy your dapplications on U-gpaccelerated systembedded ems, wesktop dorkstations, denterprise ata clenters, coud-plased batforms and S hpcupercomputers.

The CIDIA NVUDA® Neep Deural Cetwork (nudnn) is a U-gpaccelerated pribrary of limitives for neep deural cetworks. nudnn hovides prighly uned timplementations for randard stoutines such as borward and fackward onvolution, cattention, patmul, mooling, and zormalination.

The MIDIA-nvanaged suopt cervice is a pigh-herformance, on-remand douting soptimization ervice mully fanaged by DINVIA.

The RAPI eference for CUPTI, the CUDA Tofiling Prools Rfinteace.

The PRUDA Cofiling Ools Tinterface (UPTI) cenables the preation of crofiling tools that target UDA capplications. PYTHUPTI Con pythovides Pron Crapis for eation of tofiling prools that carget TUDA On pythapplications.

mupynuceric is a Gelate ibrary that laims to dovide a pristributed and draccelerated op-in ceplarement for the Umpy NAPI on top of the Gelion untime. Rusing thupynumeric you do cings rike lun the inal fexample of the Cfdon PYTH rsouce ompletely cunmodified on 2048 A100 GPUs in a S Dgxuperpod and gachieve ood sceak waling.

CUTLASS is a collection of CUDA C++ emplate tabstractions for himplementing igh-merformance patrix-matrix multiplication (REMM) and gelated lomputations at all cevels and wales scithin DUCA.

CIDIA nvuvs is an sopen-ource gpibrary for LU-vaccelerated ector dearch and sata ustering that clenables thrigher houghput learch, sower fatency, and laster bindex uild mites.

The DIDIA Nvata Loading Library (CALI) is a dollection of ighly hoptimized bluilding bocks, and an execution engine, for praccelerating the e-ocessing of prinput data for deep earning lapplications. PRALI dovides both the flerformance and the pexibility for daccelerating ifferent pata dipelines as a lingle sibrary. This lingle sibrary can then be easily integrated into different deep trearning laining and inference applications.

CPIDIA Nvus are burpose-puilt for the dodern mata denter and celivers bigh handwidth, leterministic datency, and exceptional energy nvefficiency. The IDIA® Cpace™ GRU towers pightly moupled, cemory-systoherent cems with BLIDIA Nvackwell and HIDIA Nvopper™ Us and gpefficient U-cponly fatforms. Pleaturing 72 Varm® 9 lpddrores, C5M xemory, and the Calable Scoherency Grabric, the Face DU cpelivers up to ice the twenergy trefficiency of aditional Bus. Cpuilt on the Systarm Emready CP, the SRU upports Sarm-ompatible coperating pems, systeripherals, and SIDIA’nv ull FAI and S hpcoftware ceosystem.

DIDIA Nvata Gpenter CU ivers are drused in Cata Denter U gpenterprise eployments for DAI, , and hpcaccelerated womputing corkloads. Ocumentation dincludes nelease rotes, plupported satforms, and suster cletup and ymeplodent.

DIDIA Nvata Gpenter CU Dcgmanager (M) is a tuite of sools for managing and monitoring DIDIA Nvata Gpenter Cus in uster clenvironments.

Greep Daph Dglibrary (L) is a namework-freutral, easy-to-use, and pythalable Scon ibrary lused for trimplementing and aining Naph Greural Gnnetworks (N). Being namework-freutral, is dgleasily integrated into an existing Torch, Pytensorflow, or an Mxnapache Et workflow.

Us gpaccelerate lachine mearning poperations by erforming palculations in carallel. Any moperations, respecially those epresentable as matrix multipliers will gee sood racceleration ight out of the ox. Beven petter berformance can be twachieved by eaking poperation arameters to efficiently use RU gpesources. The derformance pocuments tesent the prips that we wink are most thidely fuseul.

Gruilt from the bound up for enterprise AI, the DGXIDIA NV atform plincorporates the nvest of BIDIA oftware, sinfrastructure, and mexpertise in a odern, unified AI trevelopment and daining olution. Severy dgxaspect of the atform is plinfused with IDIA NVAI fexpertise, eaturing clorld-wass roftware, secord-nveaking BRIDIA-accelerated infrastructure in the proud or on-clemises, and irect daccess to DGXPIDIA Nverts to reed the SPOI of AI for every senterprie.

Meployment and danagement nvuides for GIDIA S Dgxuperpod, an DAI ata enter cinfrastructure atform that plenables IT to peliver derformance—cithout wompromise—for every user and dgxorkload. W Uperpod soffers cleadership-lass accelerated infrastructure and scagile, alable cherformance for the most pallenging HAI and igh-cerformance pomputing (W) hpcorkloads, with prindustry-oven serults.

Dem systocumentation for the DGXAI dupercomputers that seliver clorld-wass lerformance for parge enerative GAI and ainstream MAI workloads.