Linguistic roots of connectionism

A preprint claims that “ideas from theoretical linguistics have played no role in [NLP]”. Outside the confines of Chomskyan linguistics folks have long been working on incorporating storage, retrieval, gating and attention in theories of language, with direct relevance to computational models. The only way to give any content to the claim is by giving the notion “theoretical linguistics” the narrowest conceivable reading.

Continue Reading →

Large language models and the unstoppable tide of uninformation

Large language models make it entirely trivial to generate endless amounts of seemingly plausible text. The web is about to be engulfed in unending waves of algorithmically tuned AI-generated uninformation. This builds a feedback loop of uninformation feeding on uninformation. Counterintuitively, there was never a better time to be a scholar.

Continue Reading →

Concrete reasons to be skeptical about an ‘Abstract Wikipedia’

Wikidata is an ambitious enterprise, but social ontologies are never language-agnostic — so the project risks perpetuating rather than transcending the worldviews most prevalent in current Wikipedia databases, which means broadly speaking global north, Anglo, western, white cishet male worldviews. I think Wikidata is perhaps promising for brute physical facts like the periodic table and biochemistry. But the social facts we live with —from politics to personhood and kinship to currency— are never fully language-independent, so any single ontology will be biased & incomplete.

Continue Reading →

What is ‘non-lexical’? Notes on non-lexical vocalisations, II

I have always had a fondness for things considered marginal in linguistics. The tide may be turning for at least some marginalia: work on ideophones is clearly on the rise, and initiatives such as Martina Wiltschko’s Eh lab at UBC and a new nonlexical vocalizations project at Linköping University show there is significant interest in this area. Part II from my notes on a workshop on ‘Ideophones and non-lexical vocalizations’, in which I make a distinction between (iconic) depictions and (indexical) displays, and point out the issue of lexicality is orthogonal to this.

Continue Reading →

A variety of vocal depictions: Notes on non-lexical vocalisations, I

I have always had a fondness for things considered marginal in linguistics. The tide may be turning for at least some marginalia: work on ideophones is clearly on the rise, and initiatives such as Martina Wiltschko’s Eh lab at UBC and a new nonlexical vocalizations project at Linköping University show there is significant interest in this area. Part I from my notes on a workshop on ‘Ideophones and non-lexical vocalizations’.

Continue Reading →