Mining Model Content for Neural Network Models (Analysis Services - Data Mining)
This topic describes mining model content that is specific to models that use the Microsoft Neural Network algorithm. For an explanation of how to interpret statistics and structure shared by all model types, and general definitions of terms related to mining model content, see Mining Model Content (Analysis Services - Data Mining).
Understanding the Structure of a Neural Network Model
Each neural network model has a single parent node that represents the model and its metadata, and a marginal statistics node (NODE_TYPE = 24) that provides descriptive statistics about the input attributes. The marginal statistics node is useful because it summarizes information about inputs, so that you do not need to query data from the individual nodes.
Underneath these two nodes, there are at least two more nodes, and might be many more, depending on how many predictable attributes the model has.
The first node (NODE_TYPE = 18) always represents the top node of the input layer. Beneath this top node, you can find input nodes (NODE_TYPE = 21) that contain the actual input attributes and their values.
Successive nodes each contain a different subnetwork (NODE_TYPE = 17). Each subnetwork always contains a hidden layer (NODE_TYPE = 19), and an output layer (NODE_TYPE = 20) for that subnetwork.
.gif "structure of model content for neural networks")
The information in the input layer is straightforward: the top node for each input layer (NODE_TYPE = 18) serves as an organizer for a collection of input nodes (NODE_TYPE = 21). The content of the input nodes is described in the following table.
Each subnetwork (NODE_TYPE = 17) represents the analysis of the influence of the input layer on a particular predictable attribute. If there are multiple predictable outputs, there are multiple subnetworks. The hidden layer for each subnetwork contains multiple hidden nodes (NODE_TYPE = 22) that contain details about the weights for each transition that ends in that particular hidden node.
The output layer (NODE_TYPE = 20) contains output nodes (NODE_TYPE = 23) that each contain distinct values of the predictable attribute. If the predictable attribute is a continuous numeric data type, there is only one output node for the attribute.
Note
The logistic regression algorithm uses a special case of a neural network that has only one predictable outcome and potentially many inputs. Logistic regression does not use a hidden layer.
The easiest way to explore the structure of the inputs and subnetworks is to use the Microsoft Generic Content Tree viewer. You can click any node to expand it and see the child nodes, or view the weights and other statistics that is contained in the node.
To work with the data and see how the model correlates inputs with outputs, use the Microsoft Neural Network Viewer. By using this custom viewer, you can filter on input attributes and their values, and graphically see how they affect the outputs. The tooltips in the viewer show you the probability and lift associated with each pair of inputs and output values. For more information, see Viewing a Mining Model with the Microsoft Neural Network Viewer.
Model Content for a Neural Network Model
This section provides detail and examples only for those columns in the mining model content that have particular relevance for neural networks. For information about general-purpose columns in the schema rowset, such as MODEL_CATALOG and MODEL_NAME, that are not described here, or for explanations of mining model terminology, see Mining Model Content (Analysis Services - Data Mining).
MODEL_CATALOG
Name of the database where the model is stored.MODEL_NAME
Name of the model.ATTRIBUTE_NAME
The names of the attributes that correspond to this node.Node
Content
Model root
Blank
Marginal statistics
Blank
Input layer
Blank
Input node
Input attribute name
Hidden layer
Blank
Hidden node
Blank
Output layer
Blank
Output node
Output attribute name
NODE_NAME
The name of the node. This column contains the same value as NODE_UNIQUE_NAME.NODE_UNIQUE_NAME
The unique name of the node.For more information about how the names and IDs provide structural information about the model, see the section, Using Node Names and IDs.
NODE_TYPE
A neural network model outputs the following node types:Node Type ID
Description
1
Model.
17
Organizer node for the subnetwork.
18
Organizer node for the input layer.
19
Organizer node for the hidden layer.
20
Organizer node for the output layer.
21
Input attribute node.
22
Hidden layer node
23
Output attribute node.
24
Marginal statistics node.
NODE_CAPTION
A label or a caption associated with the node. In neural network models, always blank.CHILDREN_CARDINALITY
An estimate of the number of children that the node has.Node
Content
Model root
Indicates the count of child nodes, which includes at least 1 network, 1 required marginal node, and 1 required input layer. For example, if the value is 5, there are 3 subnetworks.
Marginal statistics
Always 0.
Input layer
Indicates the number of input attribute-values pairs that were used by the model.
Input node
Always 0.
Hidden layer
Indicates the number of hidden nodes that were created by the model.
Hidden node
Always 0.
Output layer
Indicates the number of output values.
Output node
Always 0.
PARENT_UNIQUE_NAME
The unique name of the node's parent. NULL is returned for any nodes at the root level.For more information about how the names and IDs provide structural information about the model, see the section, Using Node Names and IDs.
NODE_DESCRIPTION
A user-friendly description of the node.Node
Content
Model root
Blank
Marginal statistics
Blank
Input layer
Blank
Input node
Input attribute name
Hidden layer
Blank
Hidden node
Integer that indicates the sequence of the hidden node in the list of hidden nodes.
Output layer
Blank
Output node
If the output attribute is continuous, contains the name of the output attribute.
If the output attribute is discrete or discretized, contains the name of the attribute and the value.
NODE_RULE
An XML description of the rule that is embedded in the node.Node
Content
Model root
Blank
Marginal statistics
Blank
Input layer
Blank
Input node
An XML fragment that contains the same information as the NODE_DESCRIPTION column.
Hidden layer
Blank
Hidden node
Integer that indicates the sequence of the hidden node in the list of hidden nodes.
Output layer
Blank
Output node
An XML fragment that contains the same information as the NODE_DESCRIPTION column.
MARGINAL_RULE
For neural network models, always blank.NODE_PROBABILITY
The probability associated with this node. For neural network models, always 0.MARGINAL_PROBABILITY
The probability of reaching the node from the parent node. For neural network models, always 0.NODE_DISTRIBUTION
A nested table that contains statistical information for the node. For detailed information about the contents of this table for each node type, see the section, Understanding the NODE_DISTRIBUTION Table.NODE_SUPPORT
For neural network models, always 0.Note
Support probabilities are always 0 because the output of this model type is not probabilistic. Only the weights are meaningful for the algorithm; therefore, the algorithm does not compute probability, support, or variance.
To get information about the support in the training cases for specific values, see the marginal statistics node.
MSOLAP_MODEL_COLUMN
Node
Content
Model root
Blank
Marginal statistics
Blank
Input layer
Blank
Input node
Input attribute name.
Hidden layer
Blank
Hidden node
Blank
Output layer
Blank
Output node
Input attribute name.
MSOLAP_NODE_SCORE
For a neural network model, always 0.MSOLAP_NODE_SHORT_CAPTION
For neural network models, always blank.
Remarks
The purpose of training a neural network model is to determine the weights that are associated with each transition from an input to a midpoint, and from a midpoint to an endpoint. Therefore, the input layer of the model principally exists to store the actual values that were used to build the model. The hidden layer stores the weights that were computed, and provides pointers back to the input attributes. The output layer stores the predictable values, and also provides pointers back to the midpoints in the hidden layer.
Using Node Names and IDs
The naming of the nodes in a neural network model provides additional information about the type of node, to make it easier to relate the hidden layer to the input layer, and the output layer to the hidden layer. The following table shows the convention for the IDs that are assigned to nodes in each layer.
Node Type |
Convention for node ID |
|---|---|
Model root (1) |
00000000000000000. |
Marginal statistics node (24) |
10000000000000000 |
Input layer (18) |
30000000000000000 |
Input node (21) |
Starts at 60000000000000000 |
Subnetwork (17) |
20000000000000000 |
Hidden layer (19) |
40000000000000000 |
Hidden node (22) |
Starts at 70000000000000000 |
Output layer (20) |
50000000000000000 |
Output node (23) |
Starts at 80000000000000000 |
You can determine which input attributes are related to a specific hidden layer node by viewing the NODE_DISTRIBUTION table in the hidden node (NODE_TYPE = 22). Each row of the NODE_DISTRIBUTION table contains the ID of an input attribute node.
Similarly, you can determine which hidden layers are related to an output attribute by viewing the NODE_DISTRIBUTION table in the output node (NODE_TYPE = 23). Each row of the NODE_DISTRIBUTION table contains the ID of a hidden layer node, together with the related coefficient.
Interpreting the Information in the NODE_DISTRIBUTION Table
The NODE_DISTRIBUTION table can be empty in some nodes. However, for input nodes, hidden layer nodes, and output nodes, the NODE_DISTRIBUTION table stores important and interesting information about the model. To help you interpret this information, the NODE_DISTRIBUTION table contains a VALUETYPE column for each row that tells you whether the value in the ATTRIBUTE_VALUE column is Discrete (4), Discretized (5), or Continuous (3).
Input Nodes
The input layer contains a node for each value of the attribute that was used in the model.
Discrete attribute: The input node stores only the name of the attribute and its value in the ATTRIBUTE_NAME and ATTRIBUTE_VALUE columns. For example, if [Work Shift] is the column, a separate node is created for each value of that column that was used in the model, such as AM and PM. The NODE_DISTRIBUTION table for each node lists only the current value of the attribute.
Discretized numeric attribute: The input node stores the name of the attribute, and the value, which can be a range or a specific value. All values are represented by expressions, such as '77.4 - 87.4' or ' < 64.0' for the value of the [Time Per Issue]. The NODE_DISTRIBUTION table for each node lists only the current value of the attribute.
Continuous attribute: The input node stores the mean value of the attribute. The NODE_DISTRIBUTION table for each node lists only the current value of the attribute.
Hidden Layer Nodes
The hidden layer contains a variable number of nodes. In each node, the NODE_DISTRIBUTION table contains mappings from the hidden layer to the nodes in the input layer. The ATTRIBUTE_NAME column contains a node ID that corresponds to a node in the input layer. The ATTRIBUTE_VALUE column contains the weight associated with that combination of input node and hidden layer node. The last row in the table contains a coefficient that represents the weight of that hidden node in the hidden layer.
Output Nodes
The output layer contains one output node for each output value that was used in the model. In each node, the NODE_DISTRIBUTION table contains mappings from the output layer to the nodes in the hidden layer. The ATTRIBUTE_NAME column contains a node ID that corresponds to a node in the hidden layer. The ATTRIBUTE_VALUE column contains the weight associated with that combination of output node and hidden layer node.
The NODE_DISTRIBUTION table has the following additional information, depending on whether the type of the attribute:
Discrete attribute: The final two rows of the NODE_DISTRIBUTION table contain a coefficient for the node as a whole, and the current value of the attribute.
Discretized numeric attribute: Identical to discrete attributes, except that the value of the attribute is a range of values.
Continuous attribute: The final two rows of the NODE_DISTRIBUTION table contain the mean of the attribute, the coefficient for the node as a whole, and the variance of the coefficient.