scala - Unable to connect to remote Spark Master - ROR TransportRequestHandler: Error while invoking RpcHandler#receive() for one-way message -
i posted this question time ago came out using local resources instead of remote's ones.
i have remote machine configured spark : 2.1.1
, cassandra : 3.0.9
, scala : 2.11.6
.
cassandra configured @ localhost:9032
, spark master @ localhost:7077
.
spark master set 127.0.0.1
, port 7077
.
i'm able connect cassandra remotely unable same thing spark.
when connecting remote spark master, following error:
error transportrequesthandler: error while invoking rpchandler#receive() one-way message.
here settings via code
val configuration = new sparkconf(true) .setappname("myapp") .setmaster("spark://xx.xxx.xxx.xxx:7077") .set("spark.cassandra.connection.host", "xx.xxx.xxx.xxx") .set("spark.cassandra.connection.port", 9042) .set("spark.cassandra.input.consistency.level","one") .set("spark.driver.allowmultiplecontexts", "true") val sparksession = sparksession .builder() .appname("myappex") .config(configuration) .enablehivesupport() .getorcreate()
i don't understand why cassandra works fine , spark not.
what's causing this? how can solve?
could typo? errormessage reports 8990, in connect config have port 8090 spark.
Comments
Post a Comment