Step-Wise Regression

11011400011101140001 MemberPosts:3Contributor I
edited December 2018 inHelp

Anyone knows how to perform a Step-wise Regression with RM?
Which would be the right operator? or would I need to install a specific extension?

Thanks...

Tagged:

Answers

  • Telcontar120Telcontar120 Moderator, RapidMiner Certified Analyst, RapidMiner Certified Expert, MemberPosts:1,635Unicorn

    If you are looking for a classic stepwise regression, you can use either Forward Selection or Backward Elimination operators, which are both part of the feature selection operator folder, and use Linear Regression as the inner learner. You can set the selection logic either based on absolute change in performance or associated alpha values.

    Brian T.
    Lindon Ventures
    Data Science Consulting from Certified RapidMiner Experts
  • 11011400011101140001 MemberPosts:3Contributor I

    @Telcontar120This ise step-wise regression algortihm but I don't understand,must I use forward or backward elimination.

    Stepwise.jpg

  • Telcontar120Telcontar120 Moderator, RapidMiner Certified Analyst, RapidMiner Certified Expert, MemberPosts:1,635Unicorn

    This graphic depicts forward selection. It also envisions adding all cross-product terms (2nd order interactions) and potentially even higher-order interactions. I'm not sure where you are getting this guidance, but it certainly doesn't represent state-of-the-art best practices for model construction in modern data science, in my view. I'd be very wary of overfitting if you blindly dump all these interactions terms into a regression framework without doing any kind of feature engineering or feature selection.

    Brian T.
    Lindon Ventures
    Data Science Consulting from Certified RapidMiner Experts
    sgenzer SGolbert
Sign InorRegisterto comment.