Bug in number of attributes processed v9.1 Beta2

ad2045ad2045 MemberPosts:5Newbie
edited December 2018 inHelp
It appears that RapidMiner 9.1 Beta 2 will only process 100 attributes. For instance, the replace missing values operator will only show the first 100 attributes. I have noticed that this behavior of working on or showing only the first 100 attributes is common in other data manipulation processes.
Tagged:

Best Answer

  • gmeiergmeier Employee, MemberPosts:24RM Engineering
    Solution Accepted
    The reason you only see 100 attributes in the metadata (and the selectors) is that the attributes after pivot are determined by the values of your attribute CATEGORY. And in the metadata for the attribute CATEGORY there are only 100 values since this is only a preview.
    If you really want more than 100 attributes in the metadata, you have two options:
    • You can go toProcess > Synchronize Meta Data with Real Dataand then run your process until a breakpoint before Rename by Replacing
    • You can go toSettings > Preferences > Maximum number of nominal values in meta dataand increase the number there. But setting this number too high might lead to memory problems.
    In general, it is not advisable to select hundreds of attributes by hand, so Jan's regex solution is preferable. Or if you want to select all but a small number of attributes, you can also select the small number and useinvert selection. Furthermore, you can use attribute names in the selector even if they are not shown on the right side by just typing the names.

    MartinLiebig ad2045

Answers

  • jczogallajczogalla Employee, MemberPosts:144RM Engineering
    Can you provide some more details please? What do you mean by the operator only shows the first 100 attributes? Do you see only 100 attributes when you hover over the output port? Or does the resulting example set have only 100 attributes?
    Maybe you can share the process here? To do that, you have to open the XML view in Studio (e.g. by typing "XML" in the search field in the top right corner and click "Display Panel: XML". Copy everything from the XML view and then paste it here, using the "" button.
    Cheers
    Jan
  • ad2045ad2045 MemberPosts:5Newbie
    这要求。如果我选择Rename代替->Attribute Type=subset, I do not see any attributes past the 100th attribute. I have to select the filter type all to rename all attributes. My attributes are the CATEGORY, which I have 105 but only see 100.

    <参数键= " apply_pruning " value = " true " / >
    <参数键= " minimal_leaf_size”value="2"/>
  • jczogallajczogalla Employee, MemberPosts:144RM Engineering
    Are you sure you can only see the first 100 attributes? The order of the attributes is lexicographic, so the attributes att1, att10 and att100 for example would appear directly after each other. Can you see more than the first 100 attributes in the following process?


    You can also use a regex to select all relevant attributes if they already are named similar. If they look like "CATEGORY_NAME1"...."CATEGORY_NAME2", you could use "CATEGORY_.*" as a regex to select them. I'm sorry, but I don't have your data, so I cannot tell the exact names.

    Cheers
    Jan
    ad2045 sgenzer
Sign InorRegisterto comment.