Radoop Nest市场篮子故障分析

asl_lestari

我在Radoop Nest做市场篮子分析。我从蜂巢取回数据。由于在Radoop Operator中没有FP-Growth和Create association Rules，我在Spark RM中运行它们，但总是发现这个问题:

进程异常失败

糟糕。你好像发现了一个bug。请在我们的社区报告https://community.www.turtlecreekpls.com．原因:ERROR: Ended Job = job_1531799644051_135092 with errors消息:ERROR while processing statement: FAILED: Execution ERROR, return code 2 from org.apache.hadoop.hive.ql.exe .mr. mapredtask

eu.radoop.exception. nostacktraceoperatoreexception: ERROR: Ended Job = job_1531799644051_135092 with errors消息:处理语句时出错:FAILED:执行错误，返回代码2从org.apache.hadoop.hive.ql.exec.m apredtask在eu.radoop.RadoopTools.formattedOperatorException(RadoopTools.java:1665) at eu.radoop.datahandler.hive.HiveHandler.runScriptsOrQueriesKillableAction(HiveHandler.java:1548) at eu.radoop.datahandler.hive.HiveHandler.lambda$runScriptsOrQueriesKillable$5(HiveHandler.java:1250) at java.security.AccessController.在org.apache.hadoop.security. usergroupinform . doas (usergroupinform .java:1807) at eu.radoop.datahandler.hive.HiveHandler.runScriptsOrQueriesKillable(HiveHandler.java:1249) at eu.radoop.datahandler.hive.HiveHandler.runScriptsKillable(HiveHandler.java:1204) at eu.radoop.datahandler.hive.HiveHandler.runScriptKillable(HiveHandler.java:1130) at .radoop.datahandler.hive. hivehandler . runscriptkillable (HiveHandler.java:1130eu.radoop.operator. meata . pushdowoperator . deliverormaterializeinputhes (pushdowoperator .java:617) at eu.radoop.operator. meata . pushdowoperator . dowork (pushdowoperator .java:236) at com. rapidminerer .operator. operator. execute(Operator.java:1004) at .radoop.datahandler.hive. hiveexampletable . materializeinfileformat (HiveExampleTable.java:383) at eu.radoop.datahandler.HadoopExampleSet.materializeInFileFormat(hadoopexampletable .java:880) at eu.radoop.datahandler. hadoopexampleset . materializeinputhes (HadoopExampleSet.java:880com.rapidminer.operator.ExecutionUnit$3.run(ExecutionUnit.java:812) at com.rapidminer.operator.ExecutionUnit$3.run(ExecutionUnit.java:807) at java.security.AccessController. accesscontroller . com.rapidminer.operator.ExecutionUnit .execute(SimpleUnitExecutor.java:77)com.rapidminer.operator.ExecutionUnit. executionunit .execute(ExecutionUnit.java: 812) at com.rapidminer.operator.OperatorChain.doWork(OperatorChain.java:428) at eu.radoop.RadoopNest.doWork(RadoopNest.java:662) at com.rapidminer.operator. operator. operator. execute(Operator.java:1004) at com.rapidminer.operator.execution.SimpleUnitExecutor.execute(SimpleUnitExecutor.java:77) at com.rapidminer.operator.ExecutionUnit$3.run(ExecutionUnit.java:812) at .rapidminer. operator.executionunit $3.run(ExecutionUnit.java:812)executionunit $3.run(ExecutionUnit.java:807) at java.security.AccessController。doPrivileged(本机方法)com.rapidminer.operator.ExecutionUnit.execute (ExecutionUnit.java: 807) com.rapidminer.operator.OperatorChain.doWork (OperatorChain.java: 428) com.rapidminer.operator.Operator.execute (Operator.java: 1004) com.rapidminer.Process.execute (Process.java: 1310) com.rapidminer.Process.run (Process.java: 1285) com.rapidminer.Process.run (Process.java: 1176) com.rapidminer.Process.run (Process.java: 1129) com.rapidminer.Process.run (Process.java: 1124)com.rapidminer.Process.run (Process.java: 1114) com.rapidminer.execution.jobcontainer.execution.SimpleExecutor.executeProcess (SimpleExecutor.java: 74) com.rapidminer.execution.jobcontainer.EngineRunner.onApplicationEvent (EngineRunner.java: 68) com.rapidminer.execution.jobcontainer.EngineRunner.onApplicationEvent (EngineRunner.java: 30) org.springframework.context.event.SimpleApplicationEventMulticaster.invokeListener (SimpleApplicationEventMulticaster.java: 167)org.springframework.context.event.SimpleApplicationEventMulticaster.multicastEvent (SimpleApplicationEventMulticaster.java: 139) org.springframework.context.support.AbstractApplicationContext.publishEvent (AbstractApplicationContext.java: 393) org.springframework.context.support.AbstractApplicationContext.publishEvent (AbstractApplicationContext.java: 347) org.springframework.boot.context.event.EventPublishingRunListener.finished (EventPublishingRunListener.java: 101) org.springframework.boot.SpringApplicationRunListeners.callFinishedListener(SpringApplicationRunListeners.java:79) at org.springframework.boot.SpringApplicationRunListeners.finished(SpringApplicationRunListeners.java:72) at org.springframework.boot.SpringApplication.run(SpringApplication.java:305) at com.rapidminer.execution.jobcontainer.Application.main(Application.java:43) Caused by: java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:297) at eu.radoop.datahandler.hive.PooledStatement.execute(PooledStatement.java:365) at eu.radoop.datahandler.hive.ContainerStatementPool$ContainerStatement.execute(ContainerStatementPool.java:67) at eu.radoop.datahandler.hive.HiveHandler.runScriptsOrQueriesKillableAction(HiveHandler.java:1465) ... 45 more

就是我不知道该怎么做请帮助

JEdward

你能和我们分享一下你的过程吗?

谢谢。

asl_lestari

你好,

附件是我在Radoop-Nest运行MBA时使用的流程截图。

asl_lestari

你好,

附件是我在Radoop-Nest运行MBA时使用的流程截图。

phellinger

你好,

主要的错误信息是一个通用的远程Hadoop错误信息，没有提供太多的细节:

"执行错误，返回代码2从org.apache.hadoop.hive.ql.exe .mr. mapredtask "

提交的作业失败了，但是这种错误只能通过检查特定的作业日志来检查，例如在资源管理器用户界面上。我希望您能够访问该接口——通常可以通过浏览器在:8088端口访问它。您可以在那里看到提交的作业，并按照作业的“Logs”链接(在右侧)进行操作，直到找到可以看到潜在错误的日志。例如，内存耗尽或其他意外问题。

如果集群上运行着许多作业，您可以通过检查RapidMiner中的Log面板(查看->显示面板->日志，然后右键单击->设置日志级别-> FINER)在进程运行期间/之后找出从Radoop提交的作业。

我希望这对你有帮助。

彼得