Setting up Spark jobserver on YARN -
i trying setup spark job server on yarn doing
./bin/server_package.sh ec2
this make folder in /tmp/jobserver
when try ./sever_start.sh
i receive error
uncaught error thread [jobserver-akka.actor.default-dispatcher-2] shutting down jvm since 'akka.jvm-exit-on-fatal-error' enabled actorsystem[jobserver] uncaught error thread [jobserver-akka.actor.default-dispatcher-3] shutting down jvm since 'akka.jvm-exit-on-fatal-error' enabled actorsystem[jobserver] java.lang.noclassdeffounderror: ooyala/common/akka/actormetrics$$anonfun$receive$1 @ ooyala.common.akka.actormetrics$class.receive(actormetrics.scala:20) @ ooyala.common.akka.instrumentedactor.receive(instrumentedactor.scala:8) @ akka.actor.actorcell.newactor(actorcell.scala:558) @ akka.actor.actorcell.create(actorcell.scala:578) @ akka.actor.actorcell.invokeall$1(actorcell.scala:456) @ akka.actor.actorcell.systeminvoke(actorcell.scala:478) @ akka.dispatch.mailbox.processallsystemmessages(mailbox.scala:263) @ akka.dispatch.mailbox.run(mailbox.scala:219) @ akka.dispatch.forkjoinexecutorconfigurator$akkaforkjointask.exec(abstractdispatcher.scala:397) @ scala.concurrent.forkjoin.forkjointask.doexec(forkjointask.java:260) @ scala.concurrent.forkjoin.forkjoinpool$workqueue.runtask(forkjoinpool.java:1339) @ scala.concurrent.forkjoin.forkjoinpool.runworker(forkjoinpool.java:1979) @ scala.concurrent.forkjoin.forkjoinworkerthread.run(forkjoinworkerthread.java:107) uncaught error thread [jobserver-akka.actor.default-dispatcher-5] shutting down jvm since 'akka.jvm-exit-on-fatal-error' enabled actorsystem[jobserver] java.lang.noclassdeffounderror: ooyala/common/akka/actormetrics$$anonfun$receive$1 @ ooyala.common.akka.actormetrics$class.receive(actormetrics.scala:20) @ ooyala.common.akka.instrumentedactor.receive(instrumentedactor.scala:8) @ akka.actor.actorcell.newactor(actorcell.scala:558) @ akka.actor.actorcell.create(actorcell.scala:578) @ akka.actor.actorcell.invokeall$1(actorcell.scala:456) @ akka.actor.actorcell.systeminvoke(actorcell.scala:478) @ akka.dispatch.mailbox.processallsystemmessages(mailbox.scala:263) @ akka.dispatch.mailbox.run(mailbox.scala:219) @ akka.dispatch.forkjoinexecutorconfigurator$akkaforkjointask.exec(abstractdispatcher.scala:397) @ scala.concurrent.forkjoin.forkjointask.doexec(forkjointask.java:260) @ scala.concurrent.forkjoin.forkjoinpool$workqueue.runtask(forkjoinpool.java:1339) @ scala.concurrent.forkjoin.forkjoinpool.runworker(forkjoinpool.java:1979) @ scala.concurrent.forkjoin.forkjoinworkerthread.run(forkjoinworkerthread.java:107) java.lang.noclassdeffounderror: scala/runtime/abstractpartialfunction$mcvl$sp @ java.lang.classloader.defineclass1(native method) @ java.lang.classloader.defineclass(classloader.java:800) @ java.security.secureclassloader.defineclass(secureclassloader.java:142)
tried reducing version of akka no effect suggestions ?
are using same version of sbt build version spark jobserver built?
Comments
Post a Comment