I\'d like to write a program able to \"use\" other programs by taking control of the mouse/keyboard and being able to \"see\" what\'s on the screen.
I used AutoIt to
If you are comfortable with pascal, a really powerful keyboard/mouse/screen-reading program is SCAR: http://freddy1990.com/index.php?page=product&name=scar It can do OCR, bitmap finding, color finding, etc. It's often used for automating online games, but it can be used for any situation where you want to simulate a human reading the screen and giving input.