Tuning Classification Models

When you tune a model, you select one of several ways to create a derived cost matrix. The derived cost matrix is used for any subsequent test and apply operations. When you tune a model, you select one of several ways to create a derived cost matrix. Each tuning dialog tab has a different goal in how the tuning is performed.


Note:

In order to tune models, you must test the models in the same node that you build them.

If necessary, you can Remove Tuning

Follow these steps to tune a model:

  1. Open Properties: for the build node: right-click the node and select Go to Properties from the context menu.

    Go to the Test section. Select Generate Select Test Results for Model Tuning.

  2. Run the build node. You must test the models in the build node; this is the default behavior of the classification build node.

  3. In Properties for the build node, go to the Models section. Select the models that you want to tune and click the tune icon tune selected models in the menu bar.

    Select Tune from the drop down list.

    tune menu
  4. The Tune Settings dialog is launched with all the available test results included.

    You can tune a model using one technique. For example, you can tune using costs or using lift, but not using both costs and lift at the same time.

  5. If you are tuning more than one model, select a model from the Models list in the bottom pane of the dialog. After you tune the first model, return to this pane and select another model.

  6. Click the tab for the test result that to tune. The tabs are

  7. When you finish tuning a model, go to the right-hand pane and click Tune in the upper right to generate tuning. In the Models list in the bottom pane, the Tune setting changes from Automatic to the new setting.

  8. Tune as many models in the node as you wish. Go to other tuning tabs and perform tuning from there. When you are done tuning, click OK.

  9. All models that have tuning specifications changed during the session have their test results marked as not run. When you run the node again, the new cost matrix is generated and inserted into the model, and a new test result is generated showing full test result information for the current model's behavior.

  10. Run the tuned model. After execution completes, the Models section of Properties indicates how each model was tuned. For example, if you tune a model by changing costs, the Tune entry for that model is Tune - Cost.

  11. Right-click the build node and select View Test Results for the tuned model to see the effects of the tuning.

You may have to repeat the tuning steps several times to get the desired results. If necessary, you canRemove Tuning for a model.