$ sudo apt-get update
$ sudo apt-get install nvidia-cuda-gdb 

nvidia-cuda-gdb is installed in your system.

Make ensure the nvidia-cuda-gdb package were installed using the commands given below,

$ sudo dpkg-query -l | grep nvidia-cuda-gdb *

You will get with nvidia-cuda-gdb package name, version, architecture and description in a table

nvidia-cuda-gdb package basic information: