I worked a bit with CUDA, and a lot with the CPU, and i\'m trying to understand what is the difference between the two. My I5 processor has 4 cores and cost $200 and my NVid
Cuda cores are more lanes of a vector unit, gathered into warps. In essence cuda cores are entries in a wider AVX or VSX or NEON vector.
The closest to a CPU core is an SMX. It can handle multiple contexts (warps, hyper threading, SMT), and has several parallel execution pipelines (6 FP32 for Kepler, 2 on Haswell, 2 on Power 8). And each SMX is independent, just as any core or a general purpose CPU.
This analogy is detailed further here: https://stackoverflow.com/a/36812922/6218300.