An evaluation method for panoramic understanding of programming by comparison with visual examples

In recent years, professionals in different fields have become able to do programming by using simplified software tools, as a consequence of this they are becoming able to understand programming in a general or “panoramic” way. This understanding is not evaluated by current programming abilities testing methods such as written paper tests or practical programming. This paper proposes a Programmed Visual Contents Comparison Method to assess programming ability, and additionally, a testing system based on this method. With this method, by comparing 2 displayed images and interactive animations produced by programming samples (a question) a subject must decide which one of the programs is more difficult to build with programming than the other, or, if the difficulty is similar for both of them. The validity of the method is confirmed by comparing the ability reported by programming teachers with the results of an experiment performed with a testing system.