Neural Network Toplogy

Edgar88Edgar88 MemberPosts:4Contributor I
edited July 2019 inHelp
Hi,

I was wondering if there is a way to change the Neural Network Topology (i.e. # of hidden layers, # of hidden nodes) in theOptimize Parameters (Grid)-operator. I can't find a variable for the topology, although theNeural Net-operator does have a setting for this. Any ideas?
Tagged:

Best Answer

  • yasinkayayasinkaya MemberPosts:10Contributor II
    Solution Accepted
    Marius wrote:

    No, not yet, and to be honest it does not have high priority for us. There are a number of algorithms that we prefer a lot over the Neural Networks - SVMs for instance deliver comparable results, but are way easier to configure and to optimize and at the same time have a smaller tendency to overfit.

    However, to change at least the size of a fixed number of hidden Layers, you can create Set Macro operators inside the Loop Parameters operator, iterate the macro values and use the macros to define the sizes of the layers.

    Best, Marius
    Hi Marius,

    I used Loop Parameters operator and Set Macro operator to chane size of the layers, but I get the error: "operator cannot be executed (For input string: "ilk")" "ilk" is the macro name.



    <列出关键= " hidden_layers " >



Answers

  • Edgar88Edgar88 MemberPosts:4Contributor I
    I read in an old post (2011) that this was on the to-do list, has it been implemented yet?
  • MariusHelfMariusHelf RapidMiner Certified Expert, MemberPosts:1,869Unicorn
    No, not yet, and to be honest it does not have high priority for us. There are a number of algorithms that we prefer a lot over the Neural Networks - SVMs for instance deliver comparable results, but are way easier to configure and to optimize and at the same time have a smaller tendency to overfit.

    However, to change at least the size of a fixed number of hidden Layers, you can create Set Macro operators inside the Loop Parameters operator, iterate the macro values and use the macros to define the sizes of the layers.

    Best, Marius
    Luis_Cano
  • Edgar88Edgar88 MemberPosts:4Contributor I
    Thank you Marius for the clear answer.
  • yasinkayayasinkaya MemberPosts:10Contributor II
    I solved my problem.
    I overlooked the situation "the macro should be defined before it can be used in parameter values.".

    I changed macro's position to before NN and simulation worked.

    Thanks.
  • yasinkayayasinkaya MemberPosts:10Contributor II

    Hi,

    I solved the problem same way, too.

    Thank you very much.

  • domohsendomohsen MemberPosts:9Contributor II

    hello everyone .i need some mor help! to undersatanding this solved problem.....can you share with me some xml or jpg for more describtion...

  • Thomas_OttThomas_Ott RapidMiner Certified Analyst, RapidMiner Certified Expert, MemberPosts:1,761Unicorn

    Have you tried pinging@yasinkaya?

Sign InorRegisterto comment.