automatic mouse click and character recognition

Discussion in 'Programmer's Corner' started by praondevou, Oct 26, 2013.

  1. praondevou

    Thread Starter AAC Fanatic!

    Jul 9, 2011
    2,936
    488
    Hi !

    What programming language (that works on windows 7 or XP) would I have to learn that can create a program that can:

    - recognize a certain symbol/character/number on the screen at a certain position
    - take an appropriate action like clicking on a certain position on the screen, once or several times

    In short: a robot that can recognize characters and click on buttons automatically. There are some auto mouse clickers but they are too simplistic.
    What would be my best option: Visual Basic, Visual C or any other?

    Thanks guys
     
  2. ErnieM

    AAC Fanatic!

    Apr 24, 2011
    7,394
    1,606
    VB could do this, I prefer it over VC for quickie windows apps.
     
    praondevou likes this.
  3. praondevou

    Thread Starter AAC Fanatic!

    Jul 9, 2011
    2,936
    488
    Thanks. Are there any other open source programming languages that are suited?
     
  4. John P

    AAC Fanatic!

    Oct 14, 2008
    1,634
    224
    " recognize a certain symbol/character/number on the screen at a certain position" ???

    Do you mean via optical character recognition? That's very complicated, and not a beginner project in any language. If there's some kind of software running that draws the characters, much better to make that program tell you what it's putting where.
     
    praondevou likes this.
  5. praondevou

    Thread Starter AAC Fanatic!

    Jul 9, 2011
    2,936
    488

    Ok, let's say I have a software that was done long time ago. No access to the source code. No contact to the programmer.

    If we take an example, it could also just recognize if there was a change in one or more small fields the size of a character (not recognizing the character). AND it needs to click automatically on certain positions on the screen. But this seems to be the easier part. So VB is a viable option?
     
  6. BMorse

    Senior Member

    Sep 26, 2009
    2,675
    234
    I have used VB before for this kind of stuff, I had to interface to another application that was written by someone else, there is a way to use windows API's to interface to other apps in the way you want to do it. You can use a "class spy" to determine which control has the focus or to determine the text in a text box on a form.... see this for an example >> http://www.planet-source-code.com/vb/scripts/ShowCode.asp?txtCodeId=1424&lngWId=1
     
    praondevou likes this.
  7. praondevou

    Thread Starter AAC Fanatic!

    Jul 9, 2011
    2,936
    488
    Out of curiosity, this wouldn't work for Java Or Flash applications, would it?
     
  8. tr_escape

    New Member

    Jul 22, 2010
    3
    1
  9. BMorse

    Senior Member

    Sep 26, 2009
    2,675
    234
    It should work on any application running in a windows environment.
     
  10. sirch2

    Well-Known Member

    Jan 21, 2013
    1,008
    351
    Have a look at the Microsoft accessibility framework, it allows you to access the underlying windows objects and read their values. You would probably have to program it in C++ though
     
Loading...