Maximum-entropy parameter estimation for the k-NN modified value-difference kernel

I.H.E. Hendrickx, A. van den Bosch

    Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

    Abstract

    We introduce an extension of the modified value-difference kernel of $k$-nn by replacing the kernel's default class distribution matrix with the matrix produced by the maximum-entropy learning algorithm. This hybrid algorithm is tested on fifteen machine learning benchmark tasks, comparing the hybrid to standard $k$-nn classification and maximum-entropy-based classification. Results show that the hybrid typically outperforms the lower-scoring of the two other algorithms, often significantly; in a majority of cases the hybrid yields the highest accuracy of the three algorithms. Error analysis indicates that the hybrid's errors overlap more with $k$-nn than with maximum entropy modeling
    Original languageEnglish
    Title of host publicationProceedings of the 16th Belgian-Dutch Conference on Artificial Intelligence (BNAIC 2004), 21-22 october 2004, Groningen, The Netherlands
    EditorsR. Verbruggen, N. Taatgen, L. Schomaker
    Place of Publication[s.l]
    Publisher[s.n.]
    Pages19-26
    Number of pages8
    Volume16
    Publication statusPublished - 2004

    Publication series

    Name
    Volume16

    Fingerprint

    Dive into the research topics of 'Maximum-entropy parameter estimation for the k-NN modified value-difference kernel'. Together they form a unique fingerprint.
    • Algorithm development for memory models of language

      Hendrickx, I. H. E., Daelemans, W. M. P. & van den Bosch, A.

      1/09/011/09/05

      Project: Research project

    • Memory models of language

      van den Bosch, A.

      1/07/011/07/06

      Project: Research project

    Cite this