从mysql服务器到hadoop的sqoop导入

20jt8wwn  于 2021-05-29  发布在  Hadoop
关注(0)|答案(0)|浏览(195)

我正在尝试通过sqoop将数据从mysql服务器导入hdfs。但我有一些错误:

Error: java.io.IOException: SQLException in nextKeyValue
at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:277)
at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:556)
at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80)
at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.sql.SQLException: The statement (1) has no open cursor.
    at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:2901)
    at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:773)
    at com.mysql.jdbc.MysqlIO.nextRow(MysqlIO.java:1304)
    at com.mysql.jdbc.MysqlIO.fetchRowsViaCursor(MysqlIO.java:933)
    at com.mysql.jdbc.CursorRowProvider.fetchMoreRows(CursorRowProvider.java:357)
    at com.mysql.jdbc.CursorRowProvider.hasNext(CursorRowProvider.java:291)
    at com.mysql.jdbc.ResultSet.next(ResultSet.java:2834)
    at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:237)
    ... 12 more

16/09/11 17:31:06 INFO mapreduce.Job:  map 100% reduce 0%
16/09/11 17:31:07 INFO mapreduce.Job: Job job_1473606531803_0004 failed with state FAILED due to: Task failed task_1473606531803_0004_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0

16/09/11 17:31:07 INFO mapreduce.Job: Counters: 12
    Job Counters 
        Failed map tasks=13
        Killed map tasks=3
        Launched map tasks=16
        Other local map tasks=16
        Total time spent by all maps in occupied slots (ms)=112163
        Total time spent by all reduces in occupied slots (ms)=0
        Total time spent by all map tasks (ms)=112163
        Total vcore-milliseconds taken by all map tasks=112163
        Total megabyte-milliseconds taken by all map tasks=114854912
    Map-Reduce Framework
        CPU time spent (ms)=0
        Physical memory (bytes) snapshot=0
        Virtual memory (bytes) snapshot=0
16/09/11 17:31:07 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
16/09/11 17:31:07 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 53,373 seconds (0 bytes/sec)
16/09/11 17:31:07 INFO mapreduce.ImportJobBase: Retrieved 0 records.
16/09/11 17:31:07 ERROR tool.ImportTool: Error during import: Import job failed!

以前有人见过这种行为吗?我做错什么了?请给我建议解决办法。
谢谢。

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题