rnnlibrary. I have two modules one a sequencer module around
FASTLSTMand other a linear layer layer followed by softmax. Both the modules are enclosed in Sequential containers. How should i combine parameters from both the modules so that i can use it with optim package. Currently i am using the following code from Oxford CS ML. Is this the right way to go?
nn.SelectTable(-1), which gets the last item in the table returned by the sequencer (ideally, the RNN state at the last time step) and feed it to the linear layer, so that you have everything in a single container and don't need to do any parameter combination
hey everyone, i'm getting two weird results when using the alexnet.lua script to fine tune a model on some data. (it is a simple classification experiment and i will share my script gladly)
Does anyone have any ideas where to start looking for the bugs? I'm open to suggestions!
for example, I would like to change
asd = nn.ParallelTable() asd:add(nn.Linear(2,2)) asd:add(nn.Linear(4,4)) asd:add(nn.JoinTable(1,2))
to something like
asd = nn.ParallelTable() asd:add(nn.Linear(2,2)) asd:add(nn.Linear(4,4)) asd:printOutputShape() asd:add(nn.JoinTable(1,2))
because I easily get confused about how the shape of my input gets changed as it goes through my network
th> a = nn.Linear(2,2) th> a.output:size() [torch.LongStorage of size 0]