问题日志ging Performance criteria or generated values in X-Validation

Fred12Fred12 MemberPosts:344Unicorn
edited December 2018 inHelp

hi,

我有一个问题与新“交叉验证”啊perator to log certain values from the Performance (Classification) operator that is inside that CV Operator.. I want to log weighted mean precision and recall and several other valuies like margin, etc... see the question marks in screenshot:

Unbenannt.png

however, in some old processes, I have stil the "old" Validation (X-Validation) operator that does not exist anymore today in Rapidminer:

Unbenannt2.png

and with that operator, I dont get "???" as it works:

Unbenannt3.png

is it possible to somehow fix the new "Cross Validation" Operator in rapidminer for all the performance (Classification) criteria? (Maybe its also the same with other performance operators, didn't try it out yet..)

Best Answers

  • jczogallajczogalla Employee, MemberPosts:144RM Engineering
    Solution Accepted

    Hi!

    Could you attach a sample process? When I try to log inside the CV operator, it works just fine. There was a minor patch for performance criterions in 7.5.3, so maybe that is the same root cause. Which version are you using?

    Cheers

  • jczogallajczogalla Employee, MemberPosts:144RM Engineering
    Solution Accepted

    I see now where the problem is.:)
    Since the new cross validation is able to work in parallel, the inner performance operator does not hold the performance value. With the old validation (or when deavtivating parallelization), you would get only the last iterations performance. You could now either do the logging inside the CV (and get a sample for each iteration) or apply the "Performance to Data" operator on the performance output of the CV to get the average performance as an example set.

    Here is the the modified xml with both approaches:






































































    Cheers

    MartinLiebig

Answers

  • Fred12Fred12 MemberPosts:344Unicorn

    I also use latest version 7.5.3, however, in title bar of the program, its shown "RM Free 7.5.003", dont know if thats the reason, here is a sample process in XML and .rmp of a process where the same problem still persists:







































































    test.rmp 6.9K
Sign InorRegisterto comment.