问题日志ging Performance criteria or generated values in X-Validation
hi,
我有一个问题与新“交叉验证”啊perator to log certain values from the Performance (Classification) operator that is inside that CV Operator.. I want to log weighted mean precision and recall and several other valuies like margin, etc... see the question marks in screenshot:
however, in some old processes, I have stil the "old" Validation (X-Validation) operator that does not exist anymore today in Rapidminer:
and with that operator, I dont get "???" as it works:
is it possible to somehow fix the new "Cross Validation" Operator in rapidminer for all the performance (Classification) criteria? (Maybe its also the same with other performance operators, didn't try it out yet..)
Best Answers
-
jczogalla Employee, MemberPosts:144RM Engineering
Hi!
Could you attach a sample process? When I try to log inside the CV operator, it works just fine. There was a minor patch for performance criterions in 7.5.3, so maybe that is the same root cause. Which version are you using?
Cheers
0 -
jczogalla Employee, MemberPosts:144RM Engineering
I see now where the problem is.
Since the new cross validation is able to work in parallel, the inner performance operator does not hold the performance value. With the old validation (or when deavtivating parallelization), you would get only the last iterations performance. You could now either do the logging inside the CV (and get a sample for each iteration) or apply the "Performance to Data" operator on the performance output of the CV to get the average performance as an example set.Here is the the modified xml with both approaches:
Cheers
1
Answers
I also use latest version 7.5.3, however, in title bar of the program, its shown "RM Free 7.5.003", dont know if thats the reason, here is a sample process in XML and .rmp of a process where the same problem still persists: