hadoop - Issues in executing hdfs offline image viewer command -


i trying analyse contents of fsimage ...i have downloaded image , when trying execute on hortonworks sandbox following error: cmd: hdfs oiv -i /home/sudi/fsimage_0000000000372976370 -o /home/sudi/fsimage_0000000000372976370.txt

centos, 5gb ram

17/08/18 16:16:15 info offlineimageviewer.fsimagehandler: loading 1243 strings 17/08/18 16:16:15 info offlineimageviewer.fsimagehandler: loading 13337900 inodes. exception in thread "main" java.lang.outofmemoryerror: gc overhead limit exceeded         @ org.apache.hadoop.hdfs.tools.offlineimageviewer.fsimageloader.loadinodesection(fsimageloader.java:231)         @ org.apache.hadoop.hdfs.tools.offlineimageviewer.fsimageloader.load(fsimageloader.java:158)         @ org.apache.hadoop.hdfs.tools.offlineimageviewer.webimageviewer.initserver(webimageviewer.java:90)         @ org.apache.hadoop.hdfs.tools.offlineimageviewer.webimageviewer.start(webimageviewer.java:74)         @ org.apache.hadoop.hdfs.tools.offlineimageviewer.offlineimageviewerpb.run(offlineimageviewerpb.java:176)         @ org.apache.hadoop.hdfs.tools.offlineimageviewer.offlineimageviewerpb.main(offlineimageviewerpb.java:124) 

this job failing due heap memory error. try increase heap size before executing hdfs oiv command.

export hadoop_opts="-xmx4096m" 

if command still failing might need move fsimage different machine/server has more memory , increase heap memory using above environment variable.


Comments