Can a Bucket of Water Translate? Exploring the Encoding–Decoding Ability of Randomly Initialized Neuro-Symbolic Transformers by Dr. Arghya Pal
Bharti 501 IIT Campus, Hauz Khas, New DelhiVenue: Bhart501 Abstract: There is a growing interest in developing artificial neural networks through the training of large models. But what lies hidden in an overparameterized neural network with random weights? If the distribution is properly scaled, such a network contains a subnetwork that can perform well without ever modifying its weights. The number of… Read More »Can a Bucket of Water Translate? Exploring the Encoding–Decoding Ability of Randomly Initialized Neuro-Symbolic Transformers by Dr. Arghya Pal
