Ulrike Hahn replied to Ulrike Hahn's status
2/2 this means also that "patterns' have a whole new route for potential efficacy/realism.
Again, it's not particularly well-articulated in the book, but I think there might genuinely be something there.
Imagine a NN that, due to context vectors, becomes sensitive to the possibility of long range dependencies in language.
That is starting to feel like expanding the 'rule set' in some way, and making patterns more real