Task: Assess Model
Determine which model (s) are accurate or effective enough to be final.
Purpose

Now that you have a set of initial models, take a closer look at them to determine which are accurate or effective enough to be final. Final can mean several things, such as “ready to deploy” or “illustrating interesting patterns.” Consulting the test plan that you created earlier can help you to make this assessment from your organization’s point of view.

Relationships
RolesPrimary Performer: Additional Performers:
Process Usage
Steps
Conduct Comprehensive Model Assessment

For each model under consideration, it is a good idea to make a methodical assessment based on the criteria generated in your test plan. Here is where you may add the generated model to the stream and use evaluation charts or analysis nodes to analyze the effectiveness of the results. You should also consider whether the results make logical sense or whether they are too simplistic for your business goals (for example, a sequence that reveals purchases such as wine > wine > wine).

Once you’ve made an assessment, rank the models in order based on both objective (model accuracy) and subjective (ease of use or interpretation of results) criteria.

If you were able to address the above issues successfully and believe that the current models meet your goals, it’s time to move on to a more thorough evaluation of the models and a final deployment. Otherwise, take what you’ve learned and rerun the models with adjusted parameter settings.

Keep Track of Revised Parameters

Based on the model assessment, revise parameter settings and tune them for the next run in the Build Model task. Iterate model building and assessment until you strongly believe that you have found the best model(s). Document all such revisions and assessments.