brisk调试部署全纪录
brisk快速测试记录。 参考链接： http://www.datastax.com/docs/0.8/brisk/about_pig
hive
Hive derby lock及目录权限错误
FAILED: Error in metadata: javax.jdo.JDOFatalDataStoreException: Cannot get a connection, pool error Could not create a validated object, cause: A read-only user or a user in a read-only database is not permitted to disable read-only mode on a connection. NestedThrowables: org.apache.commons.dbcp.SQLNestedException: […]
Hive安装Tips
Hive安装 下载地址 http://hive.apache.org/releases.html
搭建trendingtopics
https://github.com/datawrangling/trendingtopics https://github.com/datawrangling/spatialanalytics 搭建trendingtopics,步骤。 环境准备
|
1 2 3 4 5 |
sudo apt-get install ruby sudo gem install rails -include-dependenciesgem /home/cloudera/.gem/ruby/1.8/bin git clone git://github.com/datawrangling/trendingtopics.git |
配置文件
|
1 2 3 |
cd trendingtopics cp config/config.yml.example config/config.yml cp config/database.yml.example config/database.yml |
安装
|
1 |
rake gems:install |
如果保错：undefined local variable or method `version_requirements’ vi config/environment.rb 在开头加入：
|
1 2 3 4 5 6 7 8 9 10 |
if Gem::VERSION >= "1.3.6" module Rails class GemDependency def requirement r = super (r == Gem::Requirement.default) ? nil : r end end end end |
安装mysql client和mysql gem
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 |
//解压msyql源码包 ./configure //./configure --prefix=/usr/local/mysql make install //错误error: sys/ttydefaults.h: No such file or directory'： //http://phaseshiftllc.com/archives/2008/10/26/installing-mysql-gem-on-windows-cygwin-for-rails //make distclean //./configure --without-readline CFLAGS=-O2 //./configure --prefix /usr/local/mysql --without-server --without-readline --without-libeditCFLAGS=-O2 CFLAGS=-O2 CXXFLAGS=-O2 //make install //gem install mysql cp support-files/my-medium.cnf /etc/my.cnf cd /usr/local/mysql vi /etc/my.conf [client] 中加入 protocol=TCP //ref:http://www.phpvim.net/os/windows/build-mysql-client-on-cygwin.html mysql -h localhost -u root gem install mysql -include-dependenciesgem mysqld_safe --user=mysql & mysql -h localhost -u root -p |
配置数据库连接
|
1 2 3 4 5 6 |
replace socket: /tmp/mysql.sock with username: root password: 555555 host: localhost |
安装数据库
|
1 2 |
rake db:create rake db:migrate |
生成100条文章来做demo数据
|
1 |
rake db:develop |
|
1 2 3 4 5 6 7 8 9 10 11 |
//启动server script/server //报错，缺少包，执行如下 rake gems:install gem sources -a http://gems.github.com gem install jpignata-bossman //再执行 script/server |
server启动后，访问地址http://localhost:3000/
|
1 2 3 4 5 6 7 8 |
$ script/server => Booting WEBrick => Rails 2.3.2 application starting on http://0.0.0.0:3000 => Call with -d to detach => Ctrl-C to shutdown server [2011-03-24 13:50:11] INFO WEBrick 1.3.1 [2011-03-24 13:50:11] INFO ruby 1.8.7 (2008-08-11) [i386-cygwin] [2011-03-24 13:50:11] INFO WEBrick::HTTPServer#start: pid=4760 port=3000 |
报错：
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 |
242093716 [main] bash 4404 exception::handle: Exception: STATUS_ACCESS_VIOLATION 242095173 [main] bash 4404 open_stackdumpfile: Dumping stack trace to bash.exe.s tackdump 242305333 [main] bash 2116 exception::handle: Exception: STATUS_ACCESS_VIOLATION 242306088 [main] bash 2116 open_stackdumpfile: Dumping stack trace to bash.exe.s tackdump 242617570 [main] bash 4032 exception::handle: Exception: STATUS_ACCESS_VIOLATION 242619190 [main] bash 4032 open_stackdumpfile: Dumping stack trace to bash.exe.s tackdump 243121910 [main] bash 3596 exception::handle: Exception: STATUS_ACCESS_VIOLATION 243123323 [main] bash 3596 open_stackdumpfile: Dumping stack trace to bash.exe.s tackdump 243458891 [main] bash 4968 fork: child -1 - died waiting for longjmp before init ialization, retry 0, exit code 0x600, errno 11 bash: fork: Resource temporarily unavailable |
|
1 2 3 4 5 6 7 |
//原因：temp放在虚拟磁盘，cygwin访问的权限不够 //如果是其他的原因可尝试如下方法： rebaseall: only ash processes are allowed during rebasing Exit all Cygwin processes and stop all Cygwin services. Execute ash from Start/Run... or a cmd or command window. Execute '/bin/rebaseall' from ash. from:http://cygwin.com/ml/cygwin/2005-09/msg00919.html |
创建表 CREATE TABLE raw_daily_stats_table1 (redirect_title […]