Restart dead accumulo tablet server -
i use single-instance accumulo database. worked fine until tried ingest multiple data (following this tutorial), tablet sever died.
i tried restart (using bin/start-all
or bin/start-here
) did not work. restarted whole server , seams, bin/start-all
starts tablet server first:
warn : using zookeeper /root/installs/zookeeper-3.4.6/zookeeper-3.4.6. use version 3.3.0 or greater avoid zookeeper deadlock bug. starting monitor on localhost warn : max open files on localhost 1024, recommend 32768 starting tablet servers .... done starting tablet server on 46.101.229.80 warn : max open files on 46.101.229.80 1024, recommend 32768 openjdk client vm warning: have loaded library /root/installs/hadoop-2.6.0/lib/native/libhadoop.so.1.0.0 might have disabled stack guard. vm try fix stack guard now. it's highly recommended fix library 'execstack -c <libfile>', or link '-z noexecstack'. 2016-01-27 04:44:18,778 [util.nativecodeloader] warn : unable load native-hadoop library platform... using builtin-java classes applicable 2016-01-27 04:44:23,770 [fs.volumemanagerimpl] warn : dfs.datanode.synconclose set false in hdfs-site.xml: data loss possible on hard system reset or power loss 2016-01-27 04:44:23,803 [server.accumulo] info : attempting talk zookeeper 2016-01-27 04:44:24,246 [server.accumulo] info : zookeeper connected , initialized, attempting talk hdfs 2016-01-27 04:44:24,802 [server.accumulo] info : connected hdfs starting master on 46.101.229.80 warn : max open files on 46.101.229.80 1024, recommend 32768 starting garbage collector on 46.101.229.80 warn : max open files on 46.101.229.80 1024, recommend 32768 starting tracer on 46.101.229.80 warn : max open files on 46.101.229.80 1024, recommend 32768
but checking monitor tablet server still dead.
the tserver_46.101.229.80.err
-log ist empty, tserver_46.101.229.80.out
-log says:
openjdk client vm warning: have loaded library /root/installs/hadoop-2.6.0/lib/native/libhadoop.so.1.0.0 might have disabled stack guard. vm try fix stack guard now. it's highly recommended fix library 'execstack -c <libfile>', or link '-z noexecstack'. # # java.lang.outofmemoryerror: java heap space # -xx:onoutofmemoryerror="kill -9 %p" # executing /bin/sh -c "kill -9 3225"...
how can tabletserver again?
i use 32-bit 14.04 linux of digitalocean, hadoop 2.6, zookeeper 3.4.6 , accuulo 1.6.4
if tabletserver repeatedly crashing outofmemoryerror, need increase jvm maximum heap size via -xmx option in accumulo_tserver_opts in accumulo-env.sh.
Comments
Post a Comment