Output Layer
Specialization of the Layer for Output.
Usage
eLayer/Output"
Configuration
These are settings required by this module.
- Transformation Mask
Usage: e[“Transformation Mask”] = List of string
Description: Indicates a transformation to be performed to the output at the last layer of the neural network. [Order of application on forward propagation: 1/3]
- Scale
Usage: e[“Scale”] = List of float
Description: Gives a scaling factor for each of the output values of the NN. [Order of application on forward propagation 2/3]
- Shift
Usage: e[“Shift”] = List of float
Description: Shifts the output of the NN by the values given. [Order of application on forward propagation 3/3]
- Output Channels
Usage: e[“Output Channels”] = unsigned integer
Description: Indicates the size of the output vector produced by the layer.
- Weight Scaling
Usage: e[“Weight Scaling”] = float
Description: Factor that is mutliplied by the layers’ weights.
- Engine
Usage: e[“Engine”] = string
Description: Specifies which Neural Network backend engine to use.
Options:
“Korali”: Uses Korali’s lightweight NN support. (CPU Sequential - Does not require installing third party software other than Eigen)
“OneDNN”: Uses oneDNN as NN support. (CPU Sequential/Parallel - Requires installing oneDNN)
“CuDNN”: Uses cuDNN as NN support. (GPU - Requires installing cuDNN)
- Mode
Usage: e[“Mode”] = string
Description: Specifies the execution mode of the Neural Network.
Options:
“Training”: Use for training. Stores data during forward propagation and allows backward propagation.
“Inference”: Use for inference only. Only runs forward propagation. Faster for inference.
- Layers
Usage: e[“Layers”] = knlohmann::json
Description: Complete description of the NN’s layers.
- Timestep Count
Usage: e[“Timestep Count”] = unsigned integer
Description: Provides the sequence length for the input/output data.
- Batch Sizes
Usage: e[“Batch Sizes”] = List of unsigned integer
Description: Specifies the batch sizes.
Default Configuration
These following configuration will be assigned by default. Any settings defined by the user will override the given settings specified in these defaults.
{ "Batch Sizes": [], "Engine": "Korali", "Input Values": [], "Output Channels": 0, "Scale": [], "Shift": [], "Transformation Mask": [], "Uniform Generator": { "Maximum": 1.0, "Minimum": -1.0, "Type": "Univariate/Uniform" }, "Weight Scaling": 1.0 }