Using n-grams to rapidly characterise the evolution of software code

A. Rainer, P.C.R. Lane, J. Malcolm, S. Scholz

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    2 Citations (Scopus)


    Text-based approaches to the analysis of software evolution are attractive because of the fine-grained, token-level comparisons they can generate. The use of such approaches has, however, been constrained by the lack of an efficient implementation. In this paper we demonstrate the ability of Ferret, which uses ngrams of 3 tokens, to characterise the evolution of software code. Ferret’s implementation operates in almost linear time and is at least an order of magnitude faster than the diff tool. Ferret’s output can be analysed to reveal several characteristics of software evolution, such as: the lifecycle of a single file, the degree of change between two files, and possible regression. In addition, the similarity scores produced by Ferret can be aggregated to measure larger parts of the system being analysed.
    Original languageEnglish
    Title of host publicationProcs 23rd IEEE/ACM Int Conf on Automated Software Engineering
    Subtitle of host publicationASE Workshops 2008
    PublisherInstitute of Electrical and Electronics Engineers (IEEE)
    Number of pages10
    ISBN (Print)978-1-4244-2776-5
    Publication statusPublished - 2008

    Cite this