• DocumentCode
    610377
  • Title

    Logical provenance in data-oriented workflows?

  • Author

    Ikeda, Ryohei ; Das Sarma, Akash ; Widom, J.

  • Author_Institution
    Stanford Univ., Stanford, CA, USA
  • fYear
    2013
  • fDate
    8-12 April 2013
  • Firstpage
    877
  • Lastpage
    888
  • Abstract
    We consider the problem of defining, generating, and tracing provenance in data-oriented workflows, in which input data sets are processed by a graph of transformations to produce output results. We first give a new general definition of provenance for general transformations, introducing the notions of correctness, precision, and minimality. We then determine when properties such as correctness and minimality carry over from the individual transformations´ provenance to the workflow provenance. We describe a simple logical-provenance specification language consisting of attribute mappings and filters. We provide an algorithm for provenance tracing in workflows where logical provenance for each transformation is specified using our language. We consider logical provenance in the relational setting, observing that for a class of Select-Project-Join (SPJ) transformations, logical provenance specifications encode minimal provenance. We have built a prototype system supporting the features and algorithms presented in the paper, and we report a few preliminary experimental results.
  • Keywords
    graph grammars; specification languages; attribute mappings; correctness notion; correctness properties; data-oriented workflows; filters; general transformations; logical provenance specification language; minimality notion; minimality properties; precision notion; provenance tracing; select-project-join transformations; transformation provenance; workflow provenance; Data mining; Debugging; Educational institutions; IP networks; Integrated circuits; Portable computers; Writing;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Data Engineering (ICDE), 2013 IEEE 29th International Conference on
  • Conference_Location
    Brisbane, QLD
  • ISSN
    1063-6382
  • Print_ISBN
    978-1-4673-4909-3
  • Electronic_ISBN
    1063-6382
  • Type

    conf

  • DOI
    10.1109/ICDE.2013.6544882
  • Filename
    6544882