default.r3_add_file_v4

马- 123马- 123 成员职位:7因素二世
2018年11月编辑 在帮助

我正在连接radoop和cloudera。在运行随机森林时，我们得到错误的HiveQL问题(org.apache.hive.service.cli)。HiveSQLException:编译语句时出错:Failed:语义异常line0:-1 invalid function invalid function 'default.r3_add_file_v4'.....

错误的详细信息:

  • 例外:com.rapidminer.operator.OperatorException
  • 消息:HiveQL problem (org.apache.hive.service.cli)。编译语句时出错:FAILED:语义异常行0:-1无效函数'default.r3_add_file_v4')
  • 堆栈跟踪:
  • eu.radoop.datahandler.hive.HiveHandler.runFastScriptPrivilegedAction (HiveHandler.java: 906)
  • eu.radoop.datahandler.hive.HiveHandler.runFastScript (HiveHandler.java: 840)
  • eu.radoop.datahandler.hive.HiveHandler.runFastScriptsNoParams (HiveHandler.java: 795)
  • eu.radoop.datahandler.hive.HiveHandler.runFastScripts (HiveHandler.java: 763)
  • eu.radoop.modeling.HiveModelApplier.apply (HiveModelApplier.java: 101)
  • eu.radoop.modeling.RadoopModelApplier.doWork (RadoopModelApplier.java: 350)
  • com.rapidminer.operator.Operator.execute (Operator.java: 1004)
  • com.rapidminer.operator.execution.SimpleUnitExecutor.execute (SimpleUnitExecutor.java: 77)
  • com.rapidminer.operator.ExecutionUnit 3.美元运行(ExecutionUnit.java: 812)
  • com.rapidminer.operator.ExecutionUnit 3.美元运行(ExecutionUnit.java: 807)
  • java.security.AccessController。doPrivileged(本地方法)
  • com.rapidminer.operator.ExecutionUnit.execute (ExecutionUnit.java: 807)
  • eu.radoop.operator.meta.RadoopValidationChain.executeEvaluator (RadoopValidationChain.java: 204)
  • eu.radoop.operator.meta.RadoopValidationChain.evaluate (RadoopValidationChain.java: 349)
  • eu.radoop.operator.meta.SplitValidationChain.estimatePerformance (SplitValidationChain.java: 66)
  • eu.radoop.operator.meta.RadoopValidationChain.doWork (RadoopValidationChain.java: 299)
  • com.rapidminer.operator.Operator.execute (Operator.java: 1004)
  • com.rapidminer.operator.execution.SimpleUnitExecutor.execute (SimpleUnitExecutor.java: 77)
  • com.rapidminer.operator.ExecutionUnit 3.美元运行(ExecutionUnit.java: 812)
  • com.rapidminer.operator.ExecutionUnit 3.美元运行(ExecutionUnit.java: 807)
  • java.security.AccessController。doPrivileged(本地方法)
  • com.rapidminer.operator.ExecutionUnit.execute (ExecutionUnit.java: 807)
  • com.rapidminer.operator.OperatorChain.doWork (OperatorChain.java: 428)
  • eu.radoop.RadoopNest.doWork (RadoopNest.java: 662)
  • com.rapidminer.operator.Operator.execute (Operator.java: 1004)
  • com.rapidminer.operator.execution.SimpleUnitExecutor.execute (SimpleUnitExecutor.java: 77)
  • com.rapidminer.operator.ExecutionUnit 3.美元运行(ExecutionUnit.java: 812)
  • com.rapidminer.operator.ExecutionUnit 3.美元运行(ExecutionUnit.java: 807)
  • java.security.AccessController。doPrivileged(本地方法)
  • com.rapidminer.operator.ExecutionUnit.execute (ExecutionUnit.java: 807)
  • com.rapidminer.operator.OperatorChain.doWork (OperatorChain.java: 428)
  • com.rapidminer.operator.Operator.execute (Operator.java: 1004)
  • com.rapidminer.Process.execute (Process.java: 1315)
  • com.rapidminer.Process.run (Process.java: 1290)
  • com.rapidminer.Process.run (Process.java: 1181)
  • com.rapidminer.Process.run (Process.java: 1134)
  • com.rapidminer.Process.run (Process.java: 1129)
  • com.rapidminer.Process.run (Process.java: 1119)
  • com.rapidminer.gui.ProcessThread.run (ProcessThread.java: 65)
  • 导致
  • 例外:org.apache.hive.service.cli.HiveSQLException
  • 消息:编译语句时出错:FAILED: SemanticException Line 0:-1无效函数'default.r3_add_file_v4'
  • 堆栈跟踪:
  • org.apache.hive.jdbc.Utils.verifySuccess (Utils.java: 256)
  • org.apache.hive.jdbc.Utils.verifySuccessWithInfo (Utils.java: 242)
  • org.apache.hive.jdbc.HiveStatement.execute (HiveStatement.java: 254)
  • eu.radoop.datahandler.hive.PooledStatement.execute (PooledStatement.java: 365)
  • eu.radoop.datahandler.hive.HiveHandler.executeStatement (HiveHandler.java: 935)
  • eu.radoop.datahandler.hive.HiveHandler.runFastScriptPrivilegedAction (HiveHandler.java: 896)
  • eu.radoop.datahandler.hive.HiveHandler.runFastScript (HiveHandler.java: 840)
  • eu.radoop.datahandler.hive.HiveHandler.runFastScriptsNoParams (HiveHandler.java: 795)
  • eu.radoop.datahandler.hive.HiveHandler.runFastScripts (HiveHandler.java: 763)
  • eu.radoop.modeling.HiveModelApplier.apply (HiveModelApplier.java: 101)
  • eu.radoop.modeling.RadoopModelApplier.doWork (RadoopModelApplier.java: 350)
  • com.rapidminer.operator.Operator.execute (Operator.java: 1004)
  • com.rapidminer.operator.execution.SimpleUnitExecutor.execute (SimpleUnitExecutor.java: 77)
  • com.rapidminer.operator.ExecutionUnit 3.美元运行(ExecutionUnit.java: 812)
  • com.rapidminer.operator.ExecutionUnit 3.美元运行(ExecutionUnit.java: 807)
  • java.security.AccessController。doPrivileged(本地方法)
  • com.rapidminer.operator.ExecutionUnit.execute (ExecutionUnit.java: 807)
  • eu.radoop.operator.meta.RadoopValidationChain.executeEvaluator (RadoopValidationChain.java: 204)
  • eu.radoop.operator.meta.RadoopValidationChain.evaluate (RadoopValidationChain.java: 349)
  • eu.radoop.operator.meta.SplitValidationChain.estimatePerformance (SplitValidationChain.java: 66)
  • eu.radoop.operator.meta.RadoopValidationChain.doWork (RadoopValidationChain.java: 299)
  • com.rapidminer.operator.Operator.execute (Operator.java: 1004)
  • com.rapidminer.operator.execution.SimpleUnitExecutor.execute (SimpleUnitExecutor.java: 77)
  • com.rapidminer.operator.ExecutionUnit 3.美元运行(ExecutionUnit.java: 812)
  • com.rapidminer.operator.ExecutionUnit 3.美元运行(ExecutionUnit.java: 807)
  • java.security.AccessController。doPrivileged(本地方法)
  • com.rapidminer.operator.ExecutionUnit.execute (ExecutionUnit.java: 807)
  • com.rapidminer.operator.OperatorChain.doWork (OperatorChain.java: 428)
  • eu.radoop.RadoopNest.doWork (RadoopNest.java: 662)
  • com.rapidminer.operator.Operator.execute (Operator.java: 1004)
  • com.rapidminer.operator.execution.SimpleUnitExecutor.execute (SimpleUnitExecutor.java: 77)
  • com.rapidminer.operator.ExecutionUnit 3.美元运行(ExecutionUnit.java: 812)
  • com.rapidminer.operator.ExecutionUnit 3.美元运行(ExecutionUnit.java: 807)
  • java.security.AccessController。doPrivileged(本地方法)
  • com.rapidminer.operator.ExecutionUnit.execute (ExecutionUnit.java: 807)
  • com.rapidminer.operator.OperatorChain.doWork (OperatorChain.java: 428)
  • com.rapidminer.operator.Operator.execute (Operator.java: 1004)
  • com.rapidminer.Process.execute (Process.java: 1315)
  • com.rapidminer.Process.run (Process.java: 1290)
  • com.rapidminer.Process.run (Process.java: 1181)
  • com.rapidminer.Process.run (Process.java: 1134)
  • com.rapidminer.Process.run (Process.java: 1129)
  • com.rapidminer.Process.run (Process.java: 1119)
  • com.rapidminer.gui.ProcessThread.run (ProcessThread.java: 65)
  • 导致
  • 例外:org.apache.hive.service.cli.HiveSQLException
  • 消息:编译语句时出错:FAILED: SemanticException Line 0:-1无效函数'default.r3_add_file_v4'
  • 堆栈跟踪:
  • org.apache.hive.service.cli.operation.Operation.toSQLException (Operation.java: 400)
  • org.apache.hive.service.cli.operation.SQLOperation.prepare (SQLOperation.java: 188)
  • org.apache.hive.service.cli.operation.SQLOperation.runInternal (SQLOperation.java: 267)
  • org.apache.hive.service.cli.operation.Operation.run (Operation.java: 337)
  • org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal (HiveSessionImpl.java: 439)
  • org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync (HiveSessionImpl.java: 416)
  • sun.reflect.GeneratedMethodAccessor24。调用(未知源)
  • sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java: 43)
  • java.lang.reflect.Method.invoke (Method.java: 498)
  • org.apache.hive.service.cli.session.HiveSessionProxy.invoke (HiveSessionProxy.java: 78)
  • org.apache.hive.service.cli.session.HiveSessionProxy.access 000美元(HiveSessionProxy.java: 36)
  • org.apache.hive.service.cli.session.HiveSessionProxy 1.美元运行(HiveSessionProxy.java: 63)
  • java.security.AccessController。doPrivileged(本地方法)
  • javax.security.auth.Subject.doAs (Subject.java: 422)
  • org.apache.hadoop.security.UserGroupInformation.doAs (UserGroupInformation.java: 1796)
  • org.apache.hive.service.cli.session.HiveSessionProxy.invoke (HiveSessionProxy.java: 59)
  • com.sun.proxy Proxy20美元。executeStatementAsync(未知来源)
  • org.apache.hive.service.cli.CLIService.executeStatementAsync (CLIService.java: 282)
  • org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement (ThriftCLIService.java: 501)
  • org.apache.hive.service.cli.thrift.TCLIService处理器ExecuteStatement.getResult美元(TCLIService.java: 1313)
  • org.apache.hive.service.cli.thrift.TCLIService处理器ExecuteStatement.getResult美元(TCLIService.java: 1298)
  • org.apache.thrift.ProcessFunction.process (ProcessFunction.java: 39)
  • org.apache.thrift.TBaseProcessor.process (TBaseProcessor.java: 39)
  • org.apache.hive.service.auth.TSetIpAddressProcessor.process (TSetIpAddressProcessor.java: 56)
  • org.apache.thrift.server.TThreadPoolServer WorkerProcess.run美元(TThreadPoolServer.java: 286)
  • java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java: 1149)
  • java.util.concurrent.ThreadPoolExecutor Worker.run美元(ThreadPoolExecutor.java: 624)
  • java.lang.Thread.run (Thread.java: 748)
  • 导致
  • 例外:java.lang.RuntimeException
  • 信息:org.apache.hadoop.hive.ql.parse。无效函数default.r3_add_file_v4
  • 堆栈跟踪:
  • org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory DefaultExprProcessor.getXpathOrFuncExprNodeDesc美元(TypeCheckProcFactory.java: 836)
  • org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory DefaultExprProcessor.process美元(TypeCheckProcFactory.java: 1176)
  • org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch (DefaultRuleDispatcher.java: 90)
  • org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatchAndReturn (DefaultGraphWalker.java: 94)
  • org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch (DefaultGraphWalker.java: 78)
  • org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.walk (DefaultGraphWalker.java: 132)
  • org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking (DefaultGraphWalker.java: 109)
  • org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory.genExprNode (TypeCheckProcFactory.java: 193)
  • org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory.genExprNode (TypeCheckProcFactory.java: 146)
  • org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genAllExprNodeDesc (SemanticAnalyzer.java: 10428)
  • org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genExprNodeDesc (SemanticAnalyzer.java: 10384)
  • org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genSelectPlan (SemanticAnalyzer.java: 3777)
  • org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genLateralViewPlan (SemanticAnalyzer.java: 9814)
  • org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genLateralViewPlans (SemanticAnalyzer.java: 9758)
  • org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan (SemanticAnalyzer.java: 9613)
  • org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan (SemanticAnalyzer.java: 9538)
  • org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan (SemanticAnalyzer.java: 9565)
  • org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan (SemanticAnalyzer.java: 9551)
  • org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genOPTree (SemanticAnalyzer.java: 10024)
  • org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal (SemanticAnalyzer.java: 10035)
  • org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal (SemanticAnalyzer.java: 9915)
  • org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze (BaseSemanticAnalyzer.java: 223)
  • org.apache.hadoop.hive.ql.Driver.compile (Driver.java: 490)
  • org.apache.hadoop.hive.ql.Driver.compileInternal (Driver.java: 1276)
  • org.apache.hadoop.hive.ql.Driver.compileAndRespond (Driver.java: 1263)
  • org.apache.hive.service.cli.operation.SQLOperation.prepare (SQLOperation.java: 186)
  • org.apache.hive.service.cli.operation.SQLOperation.runInternal (SQLOperation.java: 267)
  • org.apache.hive.service.cli.operation.Operation.run (Operation.java: 337)
  • org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal (HiveSessionImpl.java: 439)
  • org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync (HiveSessionImpl.java: 416)
  • sun.reflect.GeneratedMethodAccessor24。调用(未知源)
  • sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java: 43)
  • java.lang.reflect.Method.invoke (Method.java: 498)
  • org.apache.hive.service.cli.session.HiveSessionProxy.invoke (HiveSessionProxy.java: 78)
  • org.apache.hive.service.cli.session.HiveSessionProxy.access 000美元(HiveSessionProxy.java: 36)
  • org.apache.hive.service.cli.session.HiveSessionProxy 1.美元运行(HiveSessionProxy.java: 63)
  • java.security.AccessController。doPrivileged(本地方法)
  • javax.security.auth.Subject.doAs (Subject.java: 422)
  • org.apache.hadoop.security.UserGroupInformation.doAs (UserGroupInformation.java: 1796)
  • org.apache.hive.service.cli.session.HiveSessionProxy.invoke (HiveSessionProxy.java: 59)
  • com.sun.proxy Proxy20美元。executeStatementAsync(未知来源)
  • org.apache.hive.service.cli.CLIService.executeStatementAsync (CLIService.java: 282)
  • org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement (ThriftCLIService.java: 501)
  • org.apache.hive.service.cli.thrift.TCLIService处理器ExecuteStatement.getResult美元(TCLIService.java: 1313)
  • org.apache.hive.service.cli.thrift.TCLIService处理器ExecuteStatement.getResult美元(TCLIService.java: 1298)
  • org.apache.thrift.ProcessFunction.process (ProcessFunction.java: 39)
  • org.apache.thrift.TBaseProcessor.process (TBaseProcessor.java: 39)
  • org.apache.hive.service.auth.TSetIpAddressProcessor.process (TSetIpAddressProcessor.java: 56)
  • org.apache.thrift.server.TThreadPoolServer WorkerProcess.run美元(TThreadPoolServer.java: 286)
  • java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java: 1149)
  • java.util.concurrent.ThreadPoolExecutor Worker.run美元(ThreadPoolExecutor.java: 624)
  • java.lang.Thread.run (Thread.java: 748)

谁能告诉我怎样解决这个问题?

标记:

答案

  • asimonasimon 管理员、员工、会员职位:8RM工程

    你好,

    我怀疑这是由于Hive中缺少UDF(用户定义函数)造成的默认的数据库。

    这些udf帮助Radoop操作员在集群端完成他们的工作。

    如果您确定它们已经安装在集群中(它们有一段时间没有被更改，因此同一集群的其他用户可能之前已经更改过)，那么您可能需要检查哪个数据库已经安装了它们默认的不喜欢。如果您找到了该数据库，那么您将能够配置Radoop来使用它而不是默认的在连接设置对话框．

    如果您的udf不在集群中，那么我建议遵循以下指南:

    https://docs.www.turtlecreekpls.com/latest/radoop/installation/operation-and-maintenance.html#drop-create-functions

    sgenzer phellinger
登录或注册置评。