pig错误1066:无法打开别名tweetsreduced的迭代器

dddzy1tm  于 2021-06-25  发布在  Pig
关注(0)|答案(2)|浏览(263)

我在本地模式下运行pig,我得到了这个错误。
我正在执行的脚本是:

REGISTER '/users/level3/1103816b/Desktop/HotOrNot_repo/DataMining/Pig/piggybank.jar';

venues = LOAD '/users/level3/1103816b/Desktop/HotOrNot_repo/DataMining/Pig/venues_extended.csv' USING org.apache.pig.piggybank.storage.CSVLoader();

venuesReduced = foreach venues generate venues::Name;

DUMP tweetsReduced;

错误日志:

2013-12-01 21:06:59,270 [main] ERROR org.apache.pig.tools.grunt.Grunt - org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias venuesReduced
    at org.apache.pig.PigServer.openIterator(PigServer.java:880)
    at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:774)
    at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:372)
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198)
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:173)
    at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
    at org.apache.pig.Main.run(Main.java:607)
    at org.apache.pig.Main.main(Main.java:156)
Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias venuesReduced
    at org.apache.pig.PigServer.storeEx(PigServer.java:982)
    at org.apache.pig.PigServer.store(PigServer.java:942)
    at org.apache.pig.PigServer.openIterator(PigServer.java:855)
    ... 7 more
Caused by: org.apache.pig.impl.plan.PlanValidationException: ERROR 1025: 
<file /users/level3/1103816b/Desktop/HotOrNot_repo/DataMining/Pig/venues_count.pig, line 7, column 40> Invalid field projection. Projected field [venues::Name] does not exist.
    at org.apache.pig.newplan.logical.expression.ProjectExpression.findColNum(ProjectExpression.java:191)
    at org.apache.pig.newplan.logical.expression.ProjectExpression.setColumnNumberFromAlias(ProjectExpression.java:174)
    at org.apache.pig.newplan.logical.visitor.ColumnAliasConversionVisitor$1.visit(ColumnAliasConversionVisitor.java:53)
    at org.apache.pig.newplan.logical.expression.ProjectExpression.accept(ProjectExpression.java:215)
    at org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
    at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:52)
    at org.apache.pig.newplan.logical.optimizer.AllExpressionVisitor.visit(AllExpressionVisitor.java:142)
    at org.apache.pig.newplan.logical.relational.LOInnerLoad.accept(LOInnerLoad.java:128)
    at org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
    at org.apache.pig.newplan.logical.optimizer.AllExpressionVisitor.visit(AllExpressionVisitor.java:124)
    at org.apache.pig.newplan.logical.relational.LOForEach.accept(LOForEach.java:76)
    at org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
    at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:52)
    at org.apache.pig.PigServer$Graph.compile(PigServer.java:1716)
    at org.apache.pig.PigServer$Graph.compile(PigServer.java:1708)
    at org.apache.pig.PigServer$Graph.access$200(PigServer.java:1409)
    at org.apache.pig.PigServer.storeEx(PigServer.java:977)
    ... 9 more

我不确定是什么问题我相信 CSV 文件正确。会是那个吗 CSV 那就是问题所在?它有点大,所以我不能放在这里。还有一个有趣的错误是 Invalid field projection. Projected field [venues::Name] does not exist. 但他有一个领域 CSV 像这样打电话的文件。
任何可能导致此错误发生的想法都是非常受欢迎的!

rnmwe5a2

rnmwe5a21#

看起来错误是“字段投影无效”。投影字段[场馆::名称]不存在”。这意味着您在加载数据时缺少“as”子句。
使用org.apache.pig.piggybank.storage.csvloader()加载“/input”(name:chararray, ...);

7kjnsjlb

7kjnsjlb2#

似乎您的namenode处于安全模式。使用此cmd强制将namenode移出安全模式。
hdfs dfsadmin-安全模式离开
然后使用pig拉丁语“dump”命令。

相关问题