I get really sick of hearing about OpenAI and the rest of the LLM crowd making absurd claims about LLMs like ChatGPT being AGI. LLMs are not even close to AGI. If you want to see real research into AGI, watch this video on Chris Eliasmith's Spaun (semantic pointer architecture unified network). It may not look as snazzy and consumer-ready as all these hallucinating LLMs being marketed to us, but this is the real deal: A single system that can do lots of different things the brain does and that LLMs can never do.

https://youtu.be/I5h-xjddzlY?si=a-dS3yUPtioypa7P

#Spaun
#ArtificialGeneralIntelligence #AGI #AI #ML
#SemanticPointerArchitecture #SPA
#Nengo
#Hypervectors
#VectorSymbolicArchitecture #VSA
#HyperdimensionalComputing #HDC
#HolographicReducedRepresentation #HRR
#OpenAI #ChatGPT #LLM #LLMs

@root The closest technologies we have to how the human brain works are not LLMs, but some less well-known ones: reinforcement learning algorithms and hyperdimensional computing. If you want to see what HDC is capable of, check out this video:

https://youtu.be/P_WRCyNQ9KY?si=JgAuOJQmsQ6tVIiO

#HDC #HyperdimensionalComputing
#VSA #VectorSymbolicArchitecture
#HRR #HolographicReducedRepresentation
#SpikingNeuralNetworks
#AGI #ArtificialGeneralIntelligence
#LLM

The schedule for the next VSAonline webinar series (January to June 2025) is published at:

https://sites.google.com/view/hdvsaonline/spring-2025

There are 11 talks around #VectorSymbolicArchitecture / #HyperdimensionalComputing

The talks are (almost always) recorded and published online, in case you can't participate in the live session.

@cogsci
#VSA #HDC #CompCogScii #MathPsych #AI #neuromorphic #neurosymbolic #ComputationalNeuroscience #ComputationalCognitiveScience #MathematicalPsychology

I was looking through the VSAonline website (https://sites.google.com/view/hdvsaonline/home) and saw that by the end of this year there will be 96 recorded webinars plus the recordings from the Midnight Sun 2023 workshop.

So, if you're interested in #VectorSymbolicArchitecture / #HyperdimensionalComputing or just #VSA / #HDC -curious, the VSAonline website is the place to go (or head over to https://www.hd-computing.com/home, where there's a wider range of resources, including publication lists).

#CognitiveScience #CogSci #ComputationalCognitiveScience #CompCogSci #AI #ArtificialIntelligence #ML #MachineLearning #neuromorphic #ComputationalNeuroscience

**Submission deadline extended to 2024-01-29**

Antonello Rosato (Sapienza University of Rome) has organised a half-day workshop on Vector Symbolic Architectures / Hyperdimensional Computing, to be held in Valencia, Spain, on 27 March 2024 as part of the Design, Automation and Test in Europe Conference (DATE24):
https://www.date-conference.com/workshop/w05
#VSA #VectorSymbolicArchitecture #HDC #HyperdimensionalComputing
#CogSci #CognitiveScience #CogRob #CognitiveRobotics #AI #ArtificialIntelligence #neuromorphic

Here's a really interesting (long) paper on what a theory of computing based on arbitrary physical substrates might look like: http://arxiv.org/abs/2307.15408

"Toward a formal theory for computing machines made out of whatever physics offers: extended version"

Herbert Jaeger, Beatriz Noheda, Wilfred G. van der Wiel (2023)

@bnoheda

#NewPaper #TheoreticalComputerScience #neuromorphic #CogSci #CognitiveScience #VSA #VectorSymbolicArchitecture #HDC #HyperdimensionalComputing #AnalogComputing

@thezerobit for fielded devices I gotta agree. However, for algorithmic explanation of an approach to computing that might *actually* be well suited to memristors (and other proposed noisy hardware technologies) there's a reasonable amount of activity in the Vector Symbolic Architecture / Hyperdimensional Computing space:

https://duckduckgo.com/?t=h_&q=memristor+%22vector+symbolic+architecture%22+&ia=web

https://duckduckgo.com/?t=h_&q=memristor+hyperdimensional+&ia=web

#memristor #neuromorphic #VSA #VectorSymbolicArchitecture #HDC #HyperdimensionalComputing

The videos of the talks from the Midnight Sun Workshop on Vector Symbolic Architectures and Hyperdimensional Computing are now online at:

https://sites.google.com/ltu.se/midnightvsa/abstracts?authuser=0

#VSA #VectorSymbolicArchitecture #HDC #HyperdimensionalComputing #CogSci #CognitiveScience #neuromorphic #UnconventionalComputing

Clojure Conj talk by @gigasquid on Vector Symbolic Architectures is up: https://www.youtube.com/watch?v=ByzaFEVlaq

#VSA #VectorSymbolicArchitecture #HDC #HyperdimensionalComputing #clojure

Thanks @hosford42 for reminding me of this half-day tutorial on Vector Symbolic Architectures / Hyperdimensional Computing. The authors have been applying HDC/VSA to place recognition in robotics, but the tutorial coverage is much wider.

https://www.tu-chemnitz.de/etit/proaut/workshops_tutorials/hdc_ki19/index.html

#VSA #VectorSymbolicArchitecture #HDC #HyperdimensionalComputing #CogRob #CognitiveRobotics #CompCogSci #ComputationalCognitiveScience #CogSci #CognitiveScience #MathPsych #MathematicalPsychology

@hosford42 I'd be interested to see a description of what you've done for reinforcement learning with hyperdimensional computing.

#HDC #HyperdimensionalComputing #VSA #VectorSymbolicArchitecture

Here are two high level articles that mention Vector Symbolic Architecure / HyperDimensional Computing in the more "popular" end of the technical press:

https://www.quantamagazine.org/a-new-approach-to-computation-reimagines-artificial-intelligence-20230413/

https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=10098176

#VSA #VectorSymbolicArchitecture #HDC #HyperdimensionalComputing #CompCogSci #ComputationalCognitiveScience #CogSci #CognitiveScience #MathPsych #MathematicalPsychology

High level piece on hyperdimensional computing / Vector Symbolic Architecture in Quanta Magazine:
https://www.quantamagazine.org/a-new-approach-to-computation-reimagines-artificial-intelligence-20230413/

#VSA #VectorSymbolicArchitecture #HDC #HyperdimensionalComputing #CompCogSci #CogSci #CognitiveScience

Antonello Rosato has organised a half-day workshop on Vector Symbolic Architectures / Hyperdimensional Computing, to be held in Antwerp, Belgium, as part of the Design, Automation and Test in Europe Conference (DATE23). The details are on LinkedIn (I'm really sorry about that):
https://www.linkedin.com/posts/rossgayler_log-in-to-easychair-activity-7019452856017539072-69GB?utm_source=share&utm_medium=member_desktop
#VSA #VectorSymbolicArchitecture #HDC #HyperdimensionalComputing

@DrYohanJohn
@cogsci

Boosting for my followers - see original post in the thread above.

The BBS target article on the Language of Thought Hypothesis states:

"We outline six core properties of
LoTs: (i) discrete constituents; (ii) role-filler independence; (iii) predicate-argument
structure; (iv) logical operators; (v) inferential promiscuity; and (vi) abstract content."

It's interesting to think about the extent to which those properties are directly enabled by neural representations using Vector Symbolic Architectures / Hyperdimensional Computing. It hadn't occurred to me to draw a line between LoT and VSA/HDC.

#CogSci #CognitiveScience #CompCogSci #ComputationalCognitiveScience #VSA #VectorSymbolicArchitecture #HDC #HyperdimensionalComputing

@matspike Focusing on your final couple of points: linguistics needs structural representation & PDEs (continuous maths models) offer nothing for structure - You might want to take a look at Hyperdimensional Computing (HDC) / Vector Symbolic Architectures (VSA), which are all about how to represent and manipulate composite structures (trees, graphs, etc.) by simple arithmetic on high dimensional vector spaces (as a model of, say, the firing rates of a large group of neurons). Mostly it's algebraic, but PDEs are optional if you wanted to model the dynamics of a VSA/HDC system.

Early VSA paper referring to the Jackendoff example you use: https://arxiv.org/abs/cs/0412059

Me droning on about VSA as analogue computing for discrete structures: https://archive.org/details/Redwood_Center_2013_06_14_Ross_Gayler

A recent survey of the topic: https://arxiv.org/abs/2111.06077

#VSA #HDC
#VectorSymbolicArchitecture
#HyperdimensionalComputing