Cells

AntisymmetricRNNCell(in_dims => out_dims, [activation];
    init_weight = nothing, init_recurrent_weight = nothing,
    bias = true, epsilon=1.0)

Antisymmetric recurrent cell.

Arguments

• input_size => hidden_size: input and inner dimension of the layer
• activation: activation function. Default is tanh

Keyword arguments

• init_weight: initializer for the input to hidden weights
• init_recurrent_weight: initializer for the hidden to hidden weights
• bias: include a bias or not. Default is true
• epsilon: step size. Default is 1.0.
• gamma: strength of diffusion. Default is 0.0

Equations

\[h_t = h_{t-1} + \epsilon \tanh \left( (W_h - W_h^T - \gamma I) h_{t-1} + V_h x_t + b_h \right),\]