如何将所有的Map器加载到hive表中?

1tu0hz3e  于 2021-04-02  发布在  Hive
关注(0)|答案(1)|浏览(455)

你好下面是用例。
下面是sqoop生成的表格statewise测试细节文件。
$ hadoop fs -ls /statewise_testing_details_23_nov/statewise_testing_details found 5 items -rrw-r-r-- 1 cloudera supergroup 0 2020-11-23 15: 38 /statewise_testing_details_23_nov/statewise_testing_details/_success -rw-r-r-- 1 cloudera supergroup 19674 2020-11-23 15:38 /statewise_testing_details_23_nov/statewise_testing_details/part-m-00000 -rw-r-r-- 1 cloudera supergroup 19716 2020-11-23 15: 38 /statewise_testing_details_23_nov/statewise_testing_details/part-m-00001 -rw-r--r-- 1 cloudera supergroup 18761 2020-11-23 15: 38 /statewise_testing_details_23_nov/statewise_testing_details/part-m-00002 -rw-r--r-- 1 cloudera supergroup 20176 2020-11-23 15:38 /statewise_testing_details_23_nov/statewise_testing_details/part-m-00003
我想把它们全部加载到hive的表中......。
我无法做到这一点...
hive : 加载数据 '/statewise_testing_details_23_nov/statewise_testing_details/part-m-00000' 到表 statewise_testing_details;
失败。
失败:parseexception第1:10行在''/statewise_testing_details_23_nov/statewise_testing_details/part-m-00000''附近缺少inpath。

bjg7j2ky

bjg7j2ky1#

似乎你在 "LOAD DATA "语句中缺少了 "INPATH",所以可以试试下面的命令。

load data inpath '/STATEWISE_TESTING_DETAILS_23_Nov/STATEWISE_TESTING_DETAILS/part-m-00000' into table STATEWISE_TESTING_DETAILS;

这样你就可以让sqoop来完成 "load data "的功能,甚至可以创建hive表。
看看这个。-
https://sqoop.apache.org/docs/1.4.7/sqoopuserguide.html#_importing_data_into_hive
https://docs.cloudera.com/hdpdocuments/hdp2/hdp-2.5.0/bk_data-access/content/using_sqoop_to_move_data_into_hive.html

相关问题