首页 诗词 字典 板报 句子 名言 友答 励志 学校 网站地图
当前位置: 首页 > 教程频道 > 其他教程 > 互联网 >

hadoop有关问题记录1

2012-07-15 
hadoop问题记录1eclipse调试时遇到如下问题:12/02/09 10:06:30 INFO jvm.JvmMetrics: Initializing JVM Me

hadoop问题记录1

eclipse调试时遇到如下问题:

12/02/09 10:06:30 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=12/02/09 10:06:30 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.12/02/09 10:06:30 INFO mapred.FileInputFormat: Total input paths to process : 212/02/09 10:06:30 INFO mapred.JobClient: Running job: job_local_000112/02/09 10:06:30 INFO mapred.FileInputFormat: Total input paths to process : 212/02/09 10:06:30 INFO mapred.MapTask: numReduceTasks: 112/02/09 10:06:30 INFO mapred.MapTask: io.sort.mb = 10012/02/09 10:06:31 WARN mapred.LocalJobRunner: job_local_0001java.lang.OutOfMemoryError: Java heap spaceat org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:781)at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:350)at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)12/02/09 10:06:31 INFO mapred.JobClient:  map 0% reduce 0%12/02/09 10:06:31 INFO mapred.JobClient: Job complete: job_local_000112/02/09 10:06:31 INFO mapred.JobClient: Counters: 0java.io.IOException: Job failed!at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1252)at com.hadoop.test.Test1.main(Test1.java:50)

?解决:

修改java类的vm内存run——>config——>vm argument,添加参数: -Xmx1024m。也可以修改hadoop-env.sh中的HADOOP_HEAPSIZE配置

热点排行