Spark保存到Phoenix错误:org.apache.phoenix.mapreduce.PhoenixOutputFormat not found

1)Hadoop集群:

     cdh5.13.0

2)Phoenix版本:

     4.14.0-cdh5.13.2

3)Spark版本:

     SPARK2-2.4.0.cloudera1-1.cdh5.13.3

3)代码:

 df.saveToPhoenix(Map("table" -> table_name, "zkUrl" -> zkUrl))

4)截图:

 5)解决方案:

added all of the phoenix library jar paths in /etc/spark2/conf/classpath.txt as

/opt/cloudera/parcels/APACHE_PHOENIX/lib/phoenix/phoenix-core-4.14.1-HBase-1.2.jar
/opt/cloudera/parcels/APACHE_PHOENIX/lib/phoenix/phoenix-spark-4.14.1-HBase-1.2.jar
/opt/cloudera/parcels/APACHE_PHOENIX/lib/phoenix/phoenix-4.14.0-cdh5.13.2-client.jar
/opt/cloudera/parcels/APACHE_PHOENIX/lib/phoenix/phoenix-4.14.0-cdh5.13.2-hive.jar
/opt/cloudera/parcels/APACHE_PHOENIX/lib/phoenix/phoenix-4.14.0-cdh5.13.2-queryserver.jar
/opt/cloudera/parcels/APACHE_PHOENIX/lib/phoenix/phoenix-4.14.0-cdh5.13.2-server.jar
/opt/cloudera/parcels/APACHE_PHOENIX/lib/phoenix/phoenix-4.14.0-cdh5.13.2-thin-client.jar

猜你喜欢

转载自blog.csdn.net/kanaka10/article/details/93870120