How to integrate RMT with Conformer #21
pfeatherstone
started this conversation in
General
Replies: 1 comment
-
|
@pfeatherstone the memories need to be excised before the convolutions. the convolutions will also need to be causal it is all around tricky and requires non trivial engineering work |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
If i were to integrate RMT inside Conformer, would there be any extra states, e.g. from the convolutional layers, that would have to be cached for the next time steps. I can't see how one would do that. Or would caching the memories from RMT be sufficient?
Beta Was this translation helpful? Give feedback.
All reactions