hadoop - Issues in executing hdfs offline image viewer command -
i trying analyse contents of fsimage ...i have downloaded image , when trying execute on hortonworks sandbox following error: cmd: hdfs oiv -i /home/sudi/fsimage_0000000000372976370 -o /home/sudi/fsimage_0000000000372976370.txt
centos, 5gb ram
17/08/18 16:16:15 info offlineimageviewer.fsimagehandler: loading 1243 strings 17/08/18 16:16:15 info offlineimageviewer.fsimagehandler: loading 13337900 inodes. exception in thread "main" java.lang.outofmemoryerror: gc overhead limit exceeded @ org.apache.hadoop.hdfs.tools.offlineimageviewer.fsimageloader.loadinodesection(fsimageloader.java:231) @ org.apache.hadoop.hdfs.tools.offlineimageviewer.fsimageloader.load(fsimageloader.java:158) @ org.apache.hadoop.hdfs.tools.offlineimageviewer.webimageviewer.initserver(webimageviewer.java:90) @ org.apache.hadoop.hdfs.tools.offlineimageviewer.webimageviewer.start(webimageviewer.java:74) @ org.apache.hadoop.hdfs.tools.offlineimageviewer.offlineimageviewerpb.run(offlineimageviewerpb.java:176) @ org.apache.hadoop.hdfs.tools.offlineimageviewer.offlineimageviewerpb.main(offlineimageviewerpb.java:124)
this job failing due heap memory error. try increase heap size before executing hdfs oiv command.
export hadoop_opts="-xmx4096m" if command still failing might need move fsimage different machine/server has more memory , increase heap memory using above environment variable.
Comments
Post a Comment