1. Only the EXE file will have the host functions, but both the PTX and EXE will contain the GPU code.
2. cuCtxDestory.
3. printf with arbitrary input parameters. (Try looking up the printf prototype.)
4. With a Ctypes c_void_p object.
5. This will allow us to link to the function with its original name from Ctypes.
6. Device memory allocations and memcopies between device/host are automatically synchronized by CUDA.