Setting up Spark jobserver on YARN -


i trying setup spark job server on yarn doing

./bin/server_package.sh ec2

this make folder in /tmp/jobserver when try ./sever_start.sh

i receive error

uncaught error thread [jobserver-akka.actor.default-dispatcher-2] shutting down jvm since 'akka.jvm-exit-on-fatal-error' enabled actorsystem[jobserver] uncaught error thread [jobserver-akka.actor.default-dispatcher-3] shutting down jvm since 'akka.jvm-exit-on-fatal-error' enabled actorsystem[jobserver] java.lang.noclassdeffounderror: ooyala/common/akka/actormetrics$$anonfun$receive$1         @ ooyala.common.akka.actormetrics$class.receive(actormetrics.scala:20)         @ ooyala.common.akka.instrumentedactor.receive(instrumentedactor.scala:8)         @ akka.actor.actorcell.newactor(actorcell.scala:558)         @ akka.actor.actorcell.create(actorcell.scala:578)         @ akka.actor.actorcell.invokeall$1(actorcell.scala:456)         @ akka.actor.actorcell.systeminvoke(actorcell.scala:478)         @ akka.dispatch.mailbox.processallsystemmessages(mailbox.scala:263)         @ akka.dispatch.mailbox.run(mailbox.scala:219)         @ akka.dispatch.forkjoinexecutorconfigurator$akkaforkjointask.exec(abstractdispatcher.scala:397)         @ scala.concurrent.forkjoin.forkjointask.doexec(forkjointask.java:260)         @ scala.concurrent.forkjoin.forkjoinpool$workqueue.runtask(forkjoinpool.java:1339)         @ scala.concurrent.forkjoin.forkjoinpool.runworker(forkjoinpool.java:1979)         @ scala.concurrent.forkjoin.forkjoinworkerthread.run(forkjoinworkerthread.java:107) uncaught error thread [jobserver-akka.actor.default-dispatcher-5] shutting down jvm since 'akka.jvm-exit-on-fatal-error' enabled actorsystem[jobserver] java.lang.noclassdeffounderror: ooyala/common/akka/actormetrics$$anonfun$receive$1         @ ooyala.common.akka.actormetrics$class.receive(actormetrics.scala:20)         @ ooyala.common.akka.instrumentedactor.receive(instrumentedactor.scala:8)         @ akka.actor.actorcell.newactor(actorcell.scala:558)         @ akka.actor.actorcell.create(actorcell.scala:578)         @ akka.actor.actorcell.invokeall$1(actorcell.scala:456)         @ akka.actor.actorcell.systeminvoke(actorcell.scala:478)         @ akka.dispatch.mailbox.processallsystemmessages(mailbox.scala:263)         @ akka.dispatch.mailbox.run(mailbox.scala:219)         @ akka.dispatch.forkjoinexecutorconfigurator$akkaforkjointask.exec(abstractdispatcher.scala:397)         @ scala.concurrent.forkjoin.forkjointask.doexec(forkjointask.java:260)         @ scala.concurrent.forkjoin.forkjoinpool$workqueue.runtask(forkjoinpool.java:1339)         @ scala.concurrent.forkjoin.forkjoinpool.runworker(forkjoinpool.java:1979)         @ scala.concurrent.forkjoin.forkjoinworkerthread.run(forkjoinworkerthread.java:107) java.lang.noclassdeffounderror: scala/runtime/abstractpartialfunction$mcvl$sp         @ java.lang.classloader.defineclass1(native method)         @ java.lang.classloader.defineclass(classloader.java:800)         @ java.security.secureclassloader.defineclass(secureclassloader.java:142)

tried reducing version of akka no effect suggestions ?

are using same version of sbt build version spark jobserver built?


Comments

Post a Comment

Popular posts from this blog

php - Wordpress website dashboard page or post editor content is not showing but front end data is showing properly -

Image
recently have uploaded wordpress site onto server. have uploaded wordpress site in sub-folder under root folder ../root(domain root folder)/wordpress (where host wordpress folder). now problem content data in page or post in dashboard of wordpress admin panel not showing - see image. but data showing in front view - see image. if not browser cache issue , not issue happened tinymce editor during upgrade; try add config file: define('concatenate_scripts', false);
Read more

How to get the ip address of VM and use it to configure SSH connection dynamically in Ansible -

i trying ip address of vm , trying use establish ssh vm. following script: --- - hosts: localhost become: yes connection: local gather_facts: false serial: 1 vars_files: - createvmvars.yml tasks: - name: gathering vm info. vsphere_guest: vcenter_hostname: "{{vcenter_hostname}}" username: "{{vcenter_username}}" password: "{{vcenter_password}}" guest: "{{guest_name}}" vmware_guest_facts: yes register: var - debug: msg="{{var.ansible_facts.hw_eth0.ipaddresses[0]}}" - name: establishing ssh connection. script: /home/shasha/devops/scripts/ssh_configure.sh "{{var.ansible_facts.hw_eth0.ipaddresses[0]}}" following content of ssh_configure.sh : #!/bin/sh ssh-keygen -t rsa ssh-copy-id $1 but when running playbook, getting following error while executing third task: error! 'var' undefined but debug module(second task) printin
Read more

javascript - Get parameter of GET request -

i make request: createxhrrequest( "get", fileurl, function( err, response ) { if( err ) { alert( "error get!" ); } alert(response); }); and full response: { "status" : "ok", "message" : "jvberi0xljqkjdduxdgkmy how can jvberi0xlj ? i try response.message , response["message"]. nothing works. just simple access this: var json = json.parse(response); json.message
Read more