我在spark代码中创建了一个mapr db表:
case class MyLog(count: Int, message: String)
val conf = new SparkConf().setAppName("Launcher").setMaster("local[2]")
val sc = new SparkContext(conf)
val data = Seq(MyLog(3, "monmessage"))
val log_rdd = sc.parallelize(data)
log_rdd.saveToMapRDB("/tables/tablelog",createTable = true, idFieldPath = "message")
当我从spark code打印这行代码时,我在控制台中看到:
{"_id":"monmessage","count":3,"message":"monmessage"}
我想创建一个配置单元表来对此表进行选择或其他查询,因此我尝试以下操作:
CREATE EXTERNAL TABLE mapr_table_2(count int, message string)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = "message")
TBLPROPERTIES("hbase.table.name" = "/tables/tablelog");
但我得到:
Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: MetaException(message:org.apache.hadoop.hive.serde2.SerDeException Error: the HBase columns mapping contains a badly formed column family, column qualifier specification.)
我从以下链接获取了create table查询:http://maprdocs.mapr.com/home/hive/hiveandmapr-dbintegration-gettingstarted.html
顺便说一句,我不明白我需要写些什么:
hbase.columns.mapping“=您知道如何创建表吗?谢谢
暂无答案!
目前还没有任何答案,快来回答吧!