How to detect fake users ( crawlers ) and cURL

Question

Some other website use cURL and fake http referer to copy my website content. Do we have any way to detect cURL or not real web browser ?

Answer 1

put this into root folder as .htaccess file. it may help. I found it on one webhosting provider site but dunno what that means :)

SetEnvIf User-Agent ^Teleport graber   
SetEnvIf User-Agent ^w3m graber    
SetEnvIf User-Agent ^Offline graber   
SetEnvIf User-Agent Downloader graber  
SetEnvIf User-Agent snake graber  
SetEnvIf User-Agent Xenu graber   
Deny from env=graber