• DocumentCode
    2480699
  • Title

    Transfer of Supervision for Improved Address Standardization

  • Author

    Kothari, G. ; Faruquie, Tanveer A. ; Subramaniam, L. Venkata ; Prasad, K. Hima ; Mohania, Mukesh K.

  • Author_Institution
    IBM Res. India, New Delhi, India
  • fYear
    2010
  • fDate
    23-26 Aug. 2010
  • Firstpage
    2178
  • Lastpage
    2181
  • Abstract
    Address Cleansing is very challenging, particularly for geographies with variability in writing addresses. Supervised learners can be easily trained for different data sources. However, training requires labeling large corpora for each data source which is time consuming and labor intensive to create. We propose a method to automatically transfer supervision from a given labeled source to a target unlabeled source using a hierarchical dirichlet process. Each dirichlet process models data from one source. The shared component distribution across these dirichlet processes captures the semantic relation between data sources. A feature projection on the component distributions from multiple sources is used to transfer supervision.
  • Keywords
    data handling; geographic information systems; learning (artificial intelligence); statistical distributions; stochastic processes; address cleansing; address standardization; hierarchical Dirichlet process; shared component distribution; supervised learner; Adaptation model; Buildings; Clustering algorithms; Data models; Roads; Semantics; Training; HDP; address cleansing; address standardization; transfer learning;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Pattern Recognition (ICPR), 2010 20th International Conference on
  • Conference_Location
    Istanbul
  • ISSN
    1051-4651
  • Print_ISBN
    978-1-4244-7542-1
  • Type

    conf

  • DOI
    10.1109/ICPR.2010.533
  • Filename
    5595945