FP growth produced infinite value for association rules

knichchaknichcha MemberPosts:3Contributor I
edited December 2018 inProduct Feedback - Resolved

Hello, all
As I got stuck with memory when running old version of FP-growth. Now, I'm using FP-growth ver 8.2. It's so cool that I can limit my results by setting some parameters of FP-growth-min and max items per itemset, i.e., min items per itemset = 2 and max items per itemset = 2 in order to complete the process for my memory limitations. Everything goes well, FI can go through Create Association Rules, but the confidence is shown as infinity value. How can I get the real confidence for this situation?.
(I tried to run by not setting min and max items per itemset (default = 1 and 0), the confidence values are correct)
Thank you very much in advanced.

aKe.





































Remove 1-itemset that support < "nominal useless below"














<连接from_op = from_“FP-Growth”port="frequent sets" to_op="Create Association Rules" to_port="item sets"/>




Problem (R4): Generate Report didn't work because the xls-output file is zero bytes, Solution: use Item Sets to Data and Association Rules to Exmaple to change FI and AR to example set inorder to write out to a file by using Write Excel or Write CSV



Tagged:
0
0 votes

Declined·Last Updated

一年没有更新,如果仍然法则,请评论vant

Comments

  • David_ADavid_A Administrator, Moderator, Employee, RMResearcher, MemberPosts:296RM Research
    Solution Accepted

    Hi,

    good finding.

    We are looking into it and investigating the matter. Stay posted for updates.

    Best,
    David

  • knichchaknichcha MemberPosts:3Contributor I

    Thank you so much, David for your quick response.
    I'm looking forward for your update.

  • sgenzersgenzer Administrator, Moderator, Employee, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM ModeratorPosts:2,959Community Manager
  • jczogallajczogalla Employee, MemberPosts:144RM Engineering

    Hi@knichcha!

    Sorry for the long wait. We looked into this, and everything works as expected.

    The thing about association rules is that they are calculated in an iterative manner, seeWikipediafor an explanation. If there is no support for single items (i.e. FP Growth does not return itemsets with size 1), you cannot calculate confidences for itemsets of size 2. So if you want to use the association rules operator, you need to have FP Growth calculate those single-item itemsets. I hope this helps!

    Cheers

    Jan

  • knichchaknichcha MemberPosts:3Contributor I

    Thank you for your finding.
    I understand for calucating support and confidence.
    As your team have improved FP-Growth operator to limit number of itemsets, it's very good to alleviate memory use.
    If you do this for Create Association Rule operator as well, it's will be great.
    I means that even we limit itemsets with size 2, association rules should be create from 2-itemsets and confidence should be calculated correctly.
    Thank you in advanced

  • sgenzersgenzer Administrator, Moderator, Employee, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM ModeratorPosts:2,959Community Manager

    moving to Product Ideas.

  • sgenzersgenzer Administrator, Moderator, Employee, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM ModeratorPosts:2,959Community Manager
Sign InorRegisterto comment.