<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="henderson-2020-unstoppable">
    <titleInfo>
        <title>The Unstoppable Rise of Computational Linguistics in Deep Learning</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">James</namePart>
        <namePart type="family">Henderson</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2020-07</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Dan</namePart>
            <namePart type="family">Jurafsky</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Joyce</namePart>
            <namePart type="family">Chai</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Natalie</namePart>
            <namePart type="family">Schluter</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Joel</namePart>
            <namePart type="family">Tetreault</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Online</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>In this paper, we trace the history of neural networks applied to natural language understanding tasks, and identify key contributions which the nature of language has made to the development of neural network architectures. We focus on the importance of variable binding and its instantiation in attention-based models, and argue that Transformer is not a sequence model but an induced-structure model. This perspective leads to predictions of the challenges facing research in deep learning architectures for natural language understanding.</abstract>
    <identifier type="citekey">henderson-2020-unstoppable</identifier>
    <identifier type="doi">10.18653/v1/2020.acl-main.561</identifier>
    <location>
        <url>https://aclanthology.org/2020.acl-main.561/</url>
    </location>
    <part>
        <date>2020-07</date>
        <extent unit="page">
            <start>6294</start>
            <end>6306</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T The Unstoppable Rise of Computational Linguistics in Deep Learning
%A Henderson, James
%Y Jurafsky, Dan
%Y Chai, Joyce
%Y Schluter, Natalie
%Y Tetreault, Joel
%S Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
%D 2020
%8 July
%I Association for Computational Linguistics
%C Online
%F henderson-2020-unstoppable
%X In this paper, we trace the history of neural networks applied to natural language understanding tasks, and identify key contributions which the nature of language has made to the development of neural network architectures. We focus on the importance of variable binding and its instantiation in attention-based models, and argue that Transformer is not a sequence model but an induced-structure model. This perspective leads to predictions of the challenges facing research in deep learning architectures for natural language understanding.
%R 10.18653/v1/2020.acl-main.561
%U https://aclanthology.org/2020.acl-main.561/
%U https://doi.org/10.18653/v1/2020.acl-main.561
%P 6294-6306

Markdown (Informal)

[The Unstoppable Rise of Computational Linguistics in Deep Learning](https://aclanthology.org/2020.acl-main.561/) (Henderson, ACL 2020)

• The Unstoppable Rise of Computational Linguistics in Deep Learning (Henderson, ACL 2020)

ACL

• James Henderson. 2020. The Unstoppable Rise of Computational Linguistics in Deep Learning. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 6294–6306, Online. Association for Computational Linguistics.