ROC Tuning Steps

Follow these steps to perform ROC tuning:

  1. Before you tune the model, you must select Generate Select Test Results for Model Tuning and run the node, as described in Tuning Classification Models.

  2. Open Properties: for the build node: right-click the node and select Go to Properties from the context menu.

  3. Select the models that you want to tune and click the tune icon tune selected models in the menu bar.

  4. Select Tune from the drop down menu. The Tune Settings dialog opens in a new tab. In Tune Settings, go to the ROC tab.

  5. If you are tuning more than one model, select a model from the Models list in the bottom pane. After you tune the first model, return to this pane and select another model.

  6. Select a target value. In the case of ROC, there are only two values.

  7. Select a custom operating point if you do no want to use the default point. See Select Custom Operating Point.

  8. Select the kind of Performance Matrix to use. The default is Overall Accuracy; you can also choose Average Accuracy, Custom Accuracy, or Model Accuracy.

    If you select Custom Accuracy, fill in the values for the performance matrix.

  9. Click Tune, below the Performance Matrix. New Tune Settings are displayed in the same panel as the Performance Matrix.

Examine the Derived Cost Matrix. You can continue tuning by changing any selections that you made.

To cancel the tuning, click Reset. Tuning returns to Automatic.

When you done tuning, either click OK to accept the tuning or Cancel to cancel.

To see the impact of the tuning, run the model node.