redhat6.4上build storm 0.9.0.1
内容导读
互联网集市收集整理的这篇技术教程文章主要介绍了redhat6.4上build storm 0.9.0.1，小编现在分享给大家，供广大互联网技能从业者学习和参考。文章包含6994字，纯文字阅读大概需要10分钟。
内容图文
1.安装mvn
2.下载源代码
3.build
mvn package
过程中出现问题,clojars.org 访问不了。通过私服映射clojars.org并在pom.xml中将dependency的地址改掉。
重新运行mvn package
发现问题:
java.lang.RuntimeException: Pipe to subprocess seems to be broken! No output
read.
Shell Process
Exception:
/tmp/a3a2aead-499f-4f93-8390-0650f2d75d0f/supervisor/stormdist/test-1-1392348739/resources/storm.rb:19:in
`require‘: no such file to load -- rubygems (LoadError)
from
/tmp/a3a2aead-499f-4f93-8390-0650f2d75d0f/supervisor/stormdist/test-1-1392348739/resources/storm.rb:19
from
tester_spout.rb:19:in `require‘
from tester_spout.rb:19
at
backtype.storm.utils.ShellProcess.readString(ShellProcess.java:135)
~[classes/:na]
at
backtype.storm.utils.ShellProcess.readMessage(ShellProcess.java:81)
~[classes/:na]
at
backtype.storm.utils.ShellProcess.launch(ShellProcess.java:62)
~[classes/:na]
at
backtype.storm.spout.ShellSpout.open(ShellSpout.java:53)
~[classes/:na]
at
backtype.storm.daemon.executor$fn__3103$fn__3118.invoke(executor.clj:519)
~[classes/:na]
at
backtype.storm.util$async_loop$fn__291.invoke(util.clj:431)
~[classes/:na]
at clojure.lang.AFn.run(AFn.java:24)
[clojure-1.4.0.jar:na]
at java.lang.Thread.run(Thread.java:662)
[na:1.6.0_31]
先把系统默认安装的ruby1.8.7卸载掉
yum erase ruby
然后在下载一个ruby1.9.3下来
./configure
make
make install
重启机器就好了
在运行storm-book上的第一二章的例子时，发现如下错误:
4237 [Thread-9-EventThread] WARN backtype.storm.cluster - Received
event :disconnected::none: with disconnected Zookeeper.
4901
[Thread-9-SendThread(localhost:2000)] WARN org.apache.zookeeper.ClientCnxn
- Session 0x1442eaea3c4000b for server null, unexpected error, closing socket
connection and attempting reconnect
java.net.ConnectException: Connection
refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
~[na:1.6.0_35]
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599)
~[na:1.6.0_35]
at
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1119)
~[zookeeper-3.3.3.jar:3.3.3-1073969]
根据错误消息中看到，客户端用的zookeeper版本是3.3.3，而集群的zookeeper版本是3.4.5.从eclipse中的pom界面可以搜到是由下列依赖传递导致的：
storm-0.9.0.1-->curator-framework-1.0.1-->curator-client-1.0.1-->zookeeper-3.3.3
将zookeeper集群将为3.3.3版本
发现还是不行。后来想到我用的第2章的例子是LocalCluster,猜想应该是运行在一个节点上，而我的集群是用4个节点搭建的。而且其中zk集群为3台机器。
于是尝试将conf/storm.yaml中的
<SPAN style=‘font: 14px/15px Consolas, "Bitstream Vera Sans Mono", "Courier New", Courier, monospace; text-align: left; color: rgb(0, 0, 0); text-transform: none; text-indent: 0px; letter-spacing: normal; word-spacing: 0px; float: none; display: inline !important; white-space: normal; font-size-adjust: none; font-stretch: normal; background-color: rgb(255, 255, 255); -webkit-text-stroke-width: 0px;‘>storm.zookeeper.servers:
- jfp3-1
- jfp3-2
- jfp3-3
改为只有一条jfp3-1
并重启zk.再次启动nimbus,ui,supervisor，然后提交任务。日志如下:
[root@jfp3-1 ~]# storm jar
storm-starter-0.0.1-SNAPSHOT-jar-with-dependencies.jar
storm.starter.WordCountTopology mystorm
Running: java -client
-Dstorm.options= -Dstorm.home=/opt/storm/storm-0.9.0.1
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file=
-cp
/opt/storm/storm-0.9.0.1/storm-core-0.9.0.1.jar:/opt/storm/storm-0.9.0.1/storm-netty-0.9.0.1.jar:/opt/storm/storm-0.9.0.1/storm-console-logging-0.9.0.1.jar:/opt/storm/storm-0.9.0.1/lib/junit-3.8.1.jar:/opt/storm/storm-0.9.0.1/lib/commons-io-1.4.jar:/opt/storm/storm-0.9.0.1/lib/minlog-1.2.jar:/opt/storm/storm-0.9.0.1/lib/core.incubator-0.1.0.jar:/opt/storm/storm-0.9.0.1/lib/jetty-util-6.1.26.jar:/opt/storm/storm-0.9.0.1/lib/ring-core-1.1.5.jar:/opt/storm/storm-0.9.0.1/lib/clj-time-0.4.1.jar:/opt/storm/storm-0.9.0.1/lib/clout-1.0.1.jar:/opt/storm/storm-0.9.0.1/lib/json-simple-1.1.jar:/opt/storm/storm-0.9.0.1/lib/curator-client-1.0.1.jar:/opt/storm/storm-0.9.0.1/lib/reflectasm-1.07-shaded.jar:/opt/storm/storm-0.9.0.1/lib/disruptor-2.10.1.jar:/opt/storm/storm-0.9.0.1/lib/commons-logging-1.1.1.jar:/opt/storm/storm-0.9.0.1/lib/logback-classic-1.0.6.jar:/opt/storm/storm-0.9.0.1/lib/jgrapht-0.8.3.jar:/opt/storm/storm-0.9.0.1/lib/logback-core-1.0.6.jar:/opt/storm/storm-0.9.0.1/lib/libthrift7-0.7.0-2.jar:/opt/storm/storm-0.9.0.1/lib/httpcore-4.1.jar:/opt/storm/storm-0.9.0.1/lib/snakeyaml-1.11.jar:/opt/storm/storm-0.9.0.1/lib/commons-codec-1.4.jar:/opt/storm/storm-0.9.0.1/lib/clojure-1.4.0.jar:/opt/storm/storm-0.9.0.1/lib/servlet-api-2.5.jar:/opt/storm/storm-0.9.0.1/lib/mockito-all-1.9.5.jar:/opt/storm/storm-0.9.0.1/lib/hiccup-0.3.6.jar:/opt/storm/storm-0.9.0.1/lib/guava-13.0.jar:/opt/storm/storm-0.9.0.1/lib/commons-exec-1.1.jar:/opt/storm/storm-0.9.0.1/lib/tools.logging-0.2.3.jar:/opt/storm/storm-0.9.0.1/lib/carbonite-1.5.0.jar:/opt/storm/storm-0.9.0.1/lib/tools.macro-0.1.0.jar:/opt/storm/storm-0.9.0.1/lib/servlet-api-2.5-20081211.jar:/opt/storm/storm-0.9.0.1/lib/log4j-over-slf4j-1.6.6.jar:/opt/storm/storm-0.9.0.1/lib/clj-stacktrace-0.2.2.jar:/opt/storm/storm-0.9.0.1/lib/jline-0.9.94.jar:/opt/storm/storm-0.9.0.1/lib/ring-jetty-adapter-0.3.11.jar:/opt/storm/storm-0.9.0.1/lib/tools.nrepl-0.2.3.jar:/opt/storm/storm-0.9.0.1/lib/asm-4.0.jar:/opt/storm/storm-0.9.0.1/lib/slf4j-api-1.6.5.jar:/opt/storm/storm-0.9.0.1/lib/commons-lang-2.5.jar:/opt/storm/storm-0.9.0.1/lib/joda-time-2.0.jar:/opt/storm/storm-0.9.0.1/lib/compojure-1.1.3.jar:/opt/storm/storm-0.9.0.1/lib/ring-devel-0.3.11.jar:/opt/storm/storm-0.9.0.1/lib/curator-framework-1.0.1.jar:/opt/storm/storm-0.9.0.1/lib/httpclient-4.1.1.jar:/opt/storm/storm-0.9.0.1/lib/netty-3.6.3.Final.jar:/opt/storm/storm-0.9.0.1/lib/commons-fileupload-1.2.1.jar:/opt/storm/storm-0.9.0.1/lib/zookeeper-3.3.3.jar:/opt/storm/storm-0.9.0.1/lib/tools.cli-0.2.2.jar:/opt/storm/storm-0.9.0.1/lib/jetty-6.1.26.jar:/opt/storm/storm-0.9.0.1/lib/kryo-2.17.jar:/opt/storm/storm-0.9.0.1/lib/clojure-complete-0.2.3.jar:/opt/storm/storm-0.9.0.1/lib/math.numeric-tower-0.0.1.jar:/opt/storm/storm-0.9.0.1/lib/ring-servlet-0.3.11.jar:/opt/storm/storm-0.9.0.1/lib/objenesis-1.2.jar:/opt/storm/storm-0.9.0.1/lib/jzmq-2.1.0.jar:storm-starter-0.0.1-SNAPSHOT-jar-with-dependencies.jar:/opt/storm/storm-0.9.0.1/conf:/opt/storm/storm-0.9.0.1/bin
-Dstorm.jar=storm-starter-0.0.1-SNAPSHOT-jar-with-dependencies.jar
storm.starter.WordCountTopology mystorm
344 [main] INFO
backtype.storm.StormSubmitter - Jar not uploaded to master yet. Submitting
jar...
357 [main] INFO backtype.storm.StormSubmitter - Uploading
topology jar storm-starter-0.0.1-SNAPSHOT-jar-with-dependencies.jar to assigned
location:
/var/storm/workdir/nimbus/inbox/stormjar-c00ff052-802b-40c1-bc72-83df035c2358.jar
608
[main] INFO backtype.storm.StormSubmitter - Successfully uploaded topology
jar to assigned location:
/var/storm/workdir/nimbus/inbox/stormjar-c00ff052-802b-40c1-bc72-83df035c2358.jar
608
[main] INFO backtype.storm.StormSubmitter - Submitting topology mystorm in
distributed mode with conf {"topology.workers":3,"topology.debug":true}
1002
[main] INFO backtype.storm.StormSubmitter - Finished submitting topology:
mystorm
而且还解决了一个原来的问题，web ui访问不了。现在可以访问webui了。
原文：http://www.cnblogs.com/littlesuccess/p/3549321.html
内容总结
以上是互联网集市为您收集整理的redhat6.4上build storm 0.9.0.1全部内容，希望文章能够帮你解决redhat6.4上build storm 0.9.0.1所遇到的程序开发问题。 如果觉得互联网集市技术教程内容还不错，欢迎将互联网集市网站推荐给程序员好友。
内容备注
版权声明：本文内容由互联网用户自发贡献，该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容， 请发送邮件至 gblab@vip.qq.com 举报，一经查实，本站将立刻删除。
内容手机端
扫描二维码推送至手机访问。