You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
unable to insert data into hive-solr external table due to Unable to create serializer "org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer" for class: com.lucidworks.hadoop.hive.LWHiveOutputFormat error
#46
Open
podiligiri opened this issue
Jun 14, 2018
· 1 comment
step 1) created hive table test
step 2 ) created external table as follows
CREATE EXTERNAL TABLE rams.solr_test (
id string,
application_date string,
first_name string,
middle_name string,
last_name string,
preferred_email string,
address string,
city string,
country string,
candidate_disposition_reason string,
candidate_disposition string,
tag_original_ats string,
hiring_manager string,
job_title string,
is_candidate_active string,
attachments string)
STORED BY 'com.lucidworks.hadoop.hive.LWStorageHandler'
LOCATION '/user/xxx/hiredesk'
TBLPROPERTIES('solr.server.url'='solr URL ',
'solr.zkhost' = 'zookeeper host name',
'solr.collection' = 'inc_hiredesk_docs',
'solr.query' = ':');
note : I created a solr collection ( 'inc_hiredesk_docs') and gave valid solr server url and zookeeper hostnames
step 3) added following jar files
add /opt/lucidworks-hdpsearch/hive/solr-hive-serde-2.2.1.jar
add jar /opt/lucidworks-hdpsearch/hive/solr-hive-serde-0.13-2.2.1.jar
step 4) trying to insert the record but getting the following erro
insert into rams.solr_test values("0001AA28-036A-40F8-A6E8-D0FA39044556","2013-11-12 22:07:16.510","Manish","test","Kumawat","[email protected]","test","Sikar","test","test","test","test","test","test","test","test")
Serialization trace:
outputFileFormatClass (org.apache.hadoop.hive.ql.plan.TableDesc)
tableInfo (org.apache.hadoop.hive.ql.plan.FileSinkDesc)
conf (org.apache.hadoop.hive.ql.exec.FileSinkOperator)
childOperators (org.apache.hadoop.hive.ql.exec.SelectOperator)
childOperators (org.apache.hadoop.hive.ql.exec.TableScanOperator)
aliasToWork (org.apache.hadoop.hive.ql.plan.MapWork))'
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. Error caching map.xml: org.apache.hive.com.esotericsoftware.kryo.KryoException: java.lang.IllegalArgumentException: Unable to create serializer "org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer" for class: com.lucidworks.hadoop.hive.LWHiveOutputFormat
Serialization trace:
outputFileFormatClass (org.apache.hadoop.hive.ql.plan.TableDesc)
tableInfo (org.apache.hadoop.hive.ql.plan.FileSinkDesc)
conf (org.apache.hadoop.hive.ql.exec.FileSinkOperator)
childOperators (org.apache.hadoop.hive.ql.exec.SelectOperator)
childOperators (org.apache.hadoop.hive.ql.exec.TableScanOperator)
aliasToWork (org.apache.hadoop.hive.ql.plan.MapWork)
The text was updated successfully, but these errors were encountered: