hadooptoomanyfiles异常处理
内容导读
互联网集市收集整理的这篇技术教程文章主要介绍了hadooptoomanyfiles异常处理,小编现在分享给大家,供广大互联网技能从业者学习和参考。文章包含3321字,纯文字阅读大概需要5分钟。
内容图文
今天 hadoop 集群任务执行失败了。报错信息如下 2013-10-26 08:00:03,229 ERROR server.TThreadPoolServer TThreadPoolServer.java:run182 - Error occurred during processing of message. at org.apache.hadoop.hive.service.HiveServer$ThriftHiveProcess
今天hadoop集群任务执行失败了。报错信息如下
- 2013-10-26 08:00:03,229 ERROR server.TThreadPoolServer (TThreadPoolServer.java:run(182)) - Error occurred during processing of message.
- at org.apache.hadoop.hive.service.HiveServer$ThriftHiveProcessorFactory.getProcessor(HiveServer.java:553)
- at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:169)
- at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
- at java.lang.Thread.run(Thread.java:662)
- at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:277)
- at org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.init(HiveServer.java:136)
- at org.apache.hadoop.hive.service.HiveServer$ThriftHiveProcessorFactory.getProcessor(HiveServer.java:550)
- ... 4 more
- at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthorizeProviderManager(HiveUtils.java:199)
- at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:272)
- ... 6 more
- Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: /home/hadoop/hadoop-0.20.205.0/conf/mapred-site.xml (Too many open files)
- at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1231)
- at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1093)
- at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:1037)
- at org.apache.hadoop.conf.Configuration.set(Configuration.java:438)
- at org.apache.hadoop.hive.conf.HiveConf.setVar(HiveConf.java:762)
- at org.apache.hadoop.hive.conf.HiveConf.setVar(HiveConf.java:770)
- at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:169)
- at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
- at java.lang.Thread.run(Thread.java:662)
- Caused by: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: java.io.FileNotFoundException: /home/hadoop/hadoop-0.20.205.0/conf/core-site.xml (Too many open files)
- at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:277)
- at org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.init(HiveServer.java:136)
- at org.apache.hadoop.hive.service.HiveServer$ThriftHiveProcessorFactory.getProcessor(HiveServer.java:550)
- ... 4 more
- Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: java.io.FileNotFoundException: /home/hadoop/hadoop-0.20.205.0/conf/core-site.xml (Too many open files)
- at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthorizeProviderManager(HiveUtils.java:199)
- at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:272)
- ... 6 more
debian系统解决方式
- ulimit -HSn 32768
原文地址:hadoop too many files异常处理, 感谢原作者分享。
内容总结
以上是互联网集市为您收集整理的hadooptoomanyfiles异常处理全部内容,希望文章能够帮你解决hadooptoomanyfiles异常处理所遇到的程序开发问题。 如果觉得互联网集市技术教程内容还不错,欢迎将互联网集市网站推荐给程序员好友。
内容备注
版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 gblab@vip.qq.com 举报,一经查实,本站将立刻删除。
内容手机端
扫描二维码推送至手机访问。