Parallel execution of subprocesses
HeikoPaulheim
MemberPosts:13Contributor I
Hi RapidMiners,
I have written an operator that executes a subprocess with different subsets of the data (like Bagging does, just a bit trickier, since the metadata also changes between the runs - but I eventually got it to work).
Now, my question is: can I execute multiple instances of the subprocess in parallel? If yes, how do I do that? The problem is that there seems to be only one instance of the nested process and its ports, so if I try something like that
Any hints and/or templates?
Thank you,
Heiko
I have written an operator that executes a subprocess with different subsets of the data (like Bagging does, just a bit trickier, since the metadata also changes between the runs - but I eventually got it to work).
Now, my question is: can I execute multiple instances of the subprocess in parallel? If yes, how do I do that? The problem is that there seems to be only one instance of the nested process and its ports, so if I try something like that
in a multithreaded fashion, it breaks.
innerExampleSource.deliver(DATA_FOR_THIS_RUN);
getSubprocess(0).execute();
PredictionModel model = (PredictionModel) innerModelSink.getData(PredictionModel.class);
Any hints and/or templates?
Thank you,
Heiko
Tagged:
0
Answers
I found a way around by calling "cloneOperator". However, I am not exactly sure what is happening here (despite the documentation of said method saying "Use this method only if you sure what you are doing."),所以我仍然感谢your feedback.
Cheers,
Heiko