cuda-gen: Add CUDA Graph capture and replay for composite operators#1987

Open

Nafees01 wants to merge 15 commits into

Nafees01:cuda-graph-dev

Commits on Jul 25, 2025

CUDA graph implemented
Nafees01
committed

Commits on Aug 6, 2025

Commits on Aug 7, 2025

add vector pointer tracking to detect memory changes in Graph
Nafees01
committed

Commits on Aug 19, 2025

Add PETSc vector setup for CUDA Graph compatibility in CUDA-gen backend
Nafees01
committed

Commits on Aug 21, 2025

Clean CUDA-graph implementation
Nafees01
committed

Commits on Aug 26, 2025

Simple and clean implementation of CUDA graph but numerically incorrect
Nafees01
committed

Commits on Sep 11, 2025

per-operator CUDA Graph implementation
Nafees01
committed

Commits on Sep 25, 2025

replace cudaMemset with cudaMemsetAsync
Nafees01
committed

Commits on Oct 21, 2025

Auto-detect graph capture and use async memset with cudaStreamPerThread
Nafees01
committed

Commits on Oct 28, 2025

Commits on Jul 7, 2026

cuda-gen: CUDA Graph capture and replay working for composite operators
Nafees01
committed

Commits on Jul 8, 2026