Towards Machines for Measuring Creativity: The Use of Computational Tools in Storytelling Activities

Until now, significant R&D effort in the field of Computational Creativity, has been devoted towards understudying the elements of the creative process from idea conception to production, or towards designing machines which exhibit human level creativity without merely mimicking the human creative process. However, in the effort to determine if an artefact is creative by human standards, it is also important to examine the perception of creativity by humans and to which extend this perception can be formalized and applied on the evaluation of creative works. In this paper, we investigate how the human perception for creativity exhibited in text artefacts can be predicted using appropriate formulations of computational creativity metrics. To this end, we designed and executed a storytelling experiment assisted by the usage of computational tools. We subsequently exploited human-provided rankings of the stories in order to train a model for evaluating creativity as a combination of various characteristics of the produced stories.