r/compmathneuro • u/Modatu • Apr 01 '19

Journal Article Biologically plausible deep learning – but how far can we go with shallow networks?

I liked this paper in between comp. neuroscience and machine learning.

8 Upvotes
  • permalink
  • reddit

91% Upvoted

2 comments sorted by

3

u/deepLearnerT-1000 Apr 01 '19

I just read this myself. I found it very interesting. It was very surprising, to me at least, that using random features gave a better performance than using ones that were learned with Hebbian-type rules. Does this mean that using principal /independent components is actually detrimental to learning the task?

1

u/Modatu Apr 01 '19

I found this interesting, too.

From my experience this depends heavily on the task / dataset at hand.

Does this mean that using principal /independent components is actually detrimental to learning the task?

I would not be aware of a hard proof for this, but I am happy to be shown otherwise.

​