performance of algorithm in train set
Best Answers
-
jacobcybulski Member, University ProfessorPosts:391UnicornYes, it is done commonly, especially when optimising models, to check that the algorithm still had the capacity to learn (performance on a training set) vs its practical use (performance on a validation set). Simply apply the model to both the training and validation sets, and then run each result via a performance operator. Note that you can always utilise copies of the training data which emerges on output from the trained model to immediately apply the model to it, and then a copy of the model which emerged on output from Apply Model to be applied the second time to the validation data set. If this is done in an optimisation loop, which may be iterating over some model parameter (e. g. k of knn), then typically we would also use a Log operator to log the model parameter vs the performance on training and validation.0
-
Lefteris MemberPosts:6Newbie0