CUDA 9.0 couldn't compile

Hi,
When I’m trying to compile with CUDA, it keeps telling errors

fatal error: cuda_runtime.h: No such file or directory
     #include "cuda_runtime.h"
                              ^
compilation terminated.
Makefile:85: recipe for target 'obj/gemm.o' failed
make: *** [obj/gemm.o] Error 1

My which nvcc result is

/usr/local/cuda-9.0/bin/nvcc

echo $PATH result is

/usr/local/cuda-9.0/bin:/home/intuitive_comp/anaconda2/bin:/opt/ros/kinetic/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin

And nvidia-smi as follows:
±----------------------------------------------------------------------------+
| NVIDIA-SMI 384.90 Driver Version: 384.90 |
|-------------------------------±---------------------±---------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
|===============================+======================+======================|
| 0 Quadro K620 Off | 00000000:01:00.0 On | N/A |
| 34% 33C P8 1W / 30W | 253MiB / 1992MiB | 0% Default |
±------------------------------±---------------------±---------------------+

±----------------------------------------------------------------------------+
| Processes: GPU Memory |
| GPU PID Type Process name Usage |
|=============================================================================|
| 0 1202 G /usr/lib/xorg/Xorg 150MiB |
| 0 1924 G compiz 58MiB |
| 0 2195 G …-token=CDC6BC8A470099F3368479AC56DF40EC 41MiB |
±----------------------------------------------------------------------------+
I would be much appreciate if anyone could help me out of this.
Thank you!