How can I specify a validation dataset for H2o Deep Learning model in RapidMiner

MlobriMlobri MemberPosts:2Newbie
inHelp
Hello,

I'm using the Deep Learning model of the H2o framework available in RapidMiner.
To perform my analyses I don't see how to control the data used for validation step at the end of each epoch.
For example, with Keras you have to specify the training set rate, and that part of your data are used for the validation.
With Pytorch, we provide the training, the validation and the test set.
How can I do with RapidMiner?
I am also wondering how to see the loss curve in order to evaluate if the model overfit with respect to the number of epochs.

Do you have an idea for any of these questions ?
Tagged:

Answers

  • MartinLiebigMartinLiebig Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University ProfessorPosts:3,362RM Data Scientist
    Hi,
    i think you want to check the Deep Learning extension which allows more complex things. This allows you to specifiy the test set manually.

    Best,
    Martin
    - Head of Data Science Services at RapidMiner -
    Dortmund, Germany
  • MlobriMlobri MemberPosts:2Newbie
    Hello Martin,

    Thanks a lot for your reply.
    Isn't there no way to do that with the operator provided by H2O ?


  • MartinLiebigMartinLiebig Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University ProfessorPosts:3,362RM Data Scientist
    you can check the expert parameters, it maybe possible. For Example:

    		 fold_column: Column name with cross-validation fold index assignment per observation. Type: column, Default: no fold column
    Which is then doing x-validation with defined batches for test.

    Best,
    Martin

    - Head of Data Science Services at RapidMiner -
    Dortmund, Germany
Sign InorRegisterto comment.