Deep RON + Memory Capacity test - #5

Open

yumetsuro wants to merge 19 commits into

EU-EMERGE:mainfrom

yumetsuro:multilayer-ron

Commits on Dec 10, 2024

implemented class StackedRON for trying stacking Ron, plus some adjustment to make it work properly
yumetsuro
committed
7272cee

Commits on Dec 15, 2024

Commented code + adjusted name to DeepRON and added concat to the last states for memory test
yumetsuro
committed
284b007
Finishing to implement memory capacity task
yumetsuro
committed
d85d280

Commits on Dec 16, 2024

still implementing memory capacity need to further debug it
yumetsuro
committed
18be430

Commits on Dec 20, 2024

added weights and biases logging support
yumetsuro
committed
85c4756

Commits on Dec 21, 2024

finished implementing memory capacity, and tested on ESN single layer 100 units
yumetsuro
committed
51c1e79

Commits on Dec 22, 2024

Memory capacity implemented with some testing and logging
yumetsuro
committed
b83c711
adjusted plots
yumetsuro
committed
53e746b
fixed bug where memory capacity was counted two times
yumetsuro
committed
ddcfd1a

Commits on Feb 6, 2025

fixed problems with compatibility and precalculated activation for MC task
yumetsuro
committed
ce578e3

Commits on Feb 10, 2025

Added conversion for double in esn, adjusted inter input scaling in ron and added experiment for perturbation between states
yumetsuro
committed
e86cdcf

Commits on Feb 13, 2025

Fix deepron reservoir scaler, init of reservoir to -1,+1 and implemented a grid search with bayesian search, added ron to state perturbation experiments
yumetsuro
committed
9ad8697

Commits on Feb 15, 2025

added seeding for reproducibility
yumetsuro
committed
14617b4

Commits on Feb 17, 2025

add wandb logging to ray tune and tweaked some parameters
yumetsuro
committed
88e2cf4
adjusted parameters for perturbation
yumetsuro
committed
fa50c3a

Commits on Feb 18, 2025

fixed h2h matrix initialization
yumetsuro
committed
fa286af
added requirements
yumetsuro
committed
127767e

Commits on Feb 25, 2025

init ron recurrent back to -2 +2 as in the paper, adapter adiac for deepron
yumetsuro
committed
4c75c5d

Commits on Feb 26, 2025

add some flags to memcap
yumetsuro
committed
b4b9eab