Computational bioacoustics with deep learning: a review and roadmap

    Research output: Contribution to journalReview articlepeer-review

    165 Citations (Scopus)

    Abstract

    Animal vocalisations and natural soundscapes are fascinating objects of study, and contain valuable evidence about animal behaviours, populations and ecosystems. They are studied in bioacoustics and ecoacoustics, with signal processing and analysis an important component. Computational bioacoustics has accelerated in recent decades due to the growth of affordable digital sound recording devices, and to huge progress in informatics such as big data, signal processing and machine learning. Methods are inherited from the wider field of deep learning, including speech and image processing. However, the tasks, demands and data characteristics are often different from those addressed in speech or music analysis. There remain unsolved problems, and tasks for which evidence is surely present in many acoustic signals, but not yet realised. In this paper I perform a review of the state of the art in deep learning for computational bioacoustics, aiming to clarify key concepts and identify and analyse knowledge gaps. Based on this, I offer a subjective but principled roadmap for computational bioacoustics with deep learning: topics that the community should aim to address, in order to make the most of future developments in AI and informatics, and to use audio data in answering zoological and ecological questions.
    Original languageEnglish
    Article numbere13152
    Pages (from-to)1-46
    Number of pages46
    JournalPEERJ
    Volume10
    DOIs
    Publication statusPublished - 21 Mar 2022

    Keywords

    • Acoustics
    • Animal Vocal Behaviour
    • Bioacoustics
    • Call
    • Classification
    • Deep Learning
    • Forest
    • Information
    • Machine Learning
    • Network
    • Passive Acoustic Monitoring
    • Recognition
    • Segmentation
    • Sound Event Detection
    • Sound
    • Tools

    Fingerprint

    Dive into the research topics of 'Computational bioacoustics with deep learning: a review and roadmap'. Together they form a unique fingerprint.

    Cite this