Title :
Efficient discovery of functional and approximate dependencies using partitions
Author :
Huhtala, Ykä ; Kärkkäinen, Juha ; Porkka, Pasi ; Toivonen, Hannu
Author_Institution :
Dept. of Comput. Sci., Helsinki Univ., Finland
Abstract :
Discovery of functional dependencies from relations has been identified as an important database analysis technique. We present a new approach for finding functional dependencies from large databases, based on partitioning the set of rows with respect to their attribute values. The use of partitions makes the discovery of approximate functional dependencies easy and efficient, and the erroneous or exceptional rows can be identified easily. Experiments show that the new algorithm is efficient in practice. For benchmark databases the running times are improved by several orders of magnitude over previously published results. The algorithm is also applicable to much larger datasets than the previous methods
Keywords :
database theory; knowledge acquisition; relational databases; search problems; software performance evaluation; very large databases; approximate dependency discovery; attribute values; benchmark databases; data mining; database analysis technique; database partitions; functional dependency discovery; large databases; relational databases; relations; rows; search; Computer science; Data analysis; Data mining; Databases; Engineering management; Knowledge management; Partitioning algorithms; Read only memory; Reverse engineering;
Conference_Titel :
Data Engineering, 1998. Proceedings., 14th International Conference on
Conference_Location :
Orlando, FL
Print_ISBN :
0-8186-8289-2
DOI :
10.1109/ICDE.1998.655802