Jul 182012
 

这个题目实在太牛逼。我也没想到,我对puppet都还没怎么了解的情况下,居然对着文档用puppet把openstack装好。而且是多节点,还用上multi_host。nova volume也搞定了。

其实还是人家的文档写的好。Openstack Essex Deploy by Puppet on Ubuntu 12.04 HOWTO

我也是使用3台机器做实验

  1. node15.chenshake.com  puppet master和控制节点,同时还是计算节点:10.1.199.15/24,
  2. node16.chenshake.com  计算节点,10.1.199.16/24
  3. node17.chenshake.com  计算节点,10.1.199.17/24

对于puppet,一定要把hostname搞定。他是依赖FQDN name。下面就一步一步来。

一:准备

1:设置网络

root@node15:~# cat /etc/network/interfaces 
auto lo
iface lo inet loopback
auto eth0
iface eth0 inet static
address 10.1.199.15
hwaddress ether 00:25:90:67:ce:28  
netmask 255.255.255.0
network 10.1.199.0
gateway 10.1.199.1

auto eth1
iface eth1 inet manual
up ifconfig eth1 up

3台机器都需要设置,把eth1 up 起来。

root@node15:~# mii-tool 
eth0: negotiated 1000baseT-FD flow-control, link ok
eth1: negotiated 1000baseT-FD flow-control, link ok

2:设置hostname

root@node15:~# cat /etc/hosts
127.0.0.1       localhost
10.1.199.15     node15.chenshake.com    node15
10.1.199.16     node16.chenshake.com    node16
10.1.199.17     node17.chenshake.com    node17

# The following lines are desirable for IPv6 capable hosts
::1     ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters

3: 设置nova-volume (可选)

这个就需要你硬盘里有单独的分区,我的机器上是有专门一个分区给nova-volume使用。

 

二:Puppet

1:安装puppet agent

我们希望puppet也可以管理自己,所以3台机器都需要安装agent

aptitude -y install puppet augeas-tools

2:安装puppet master (控制节点)

这个是在node15上安装就可以

apt-get update

aptitude -y install puppetmaster sqlite3 libsqlite3-ruby libactiverecord-ruby git rake

gem install puppetlabs_spec_helper

第二条命令时间比较长,确保网络是通的。

3:启用插件pluginsync

3台机器都需要运行,注意下面的 node15.chenshake.com, 指向控制节点的机器名。

augtool << EOF
set /files/etc/puppet/puppet.conf/agent/pluginsync true
set /files/etc/puppet/puppet.conf/agent/server node15.chenshake.com
save
EOF

4: 配置数据库(控制节点)

这个就只需要在控制节点操作就可以

augtool << EOF
set /files/etc/puppet/puppet.conf/master/storeconfigs true
set /files/etc/puppet/puppet.conf/master/dbadapter sqlite3
set /files/etc/puppet/puppet.conf/master/dblocation /var/lib/puppet/server_data/storeconfigs.sqlite
save
EOF

5:创建第一个manifest (控制节点)

这是为了测试使用

cat > /etc/puppet/manifests/site.pp << EOF
node default {
  notify { "Hey ! It works !": }
}
EOF

6:重启服务(控制节点)

/etc/init.d/puppetmaster restart

7:注册节点

我们需要把3个节点都注册到puppet上。需要在3台机器都运行

puppet agent -vt --waitforcert 60

8:签发证书(控制节点)

puppetca sign –a

在各个节点,会看到类似下面的信息

info: Caching catalog for node15.chenshake.com
info: Applying configuration version '1340077073'
notice: Hey ! It works !

这个时候,重启所有节点的机器. 准备Openstack的安装

三:Openstack

1:下载puppet的openstack模块 (控制节点)

cd /etc/puppet/modules
git clone git://github.com/puppetlabs/puppetlabs-openstack openstack
cd openstack
rake modules:clone

2:修改openstack部署模块

大家最好读一下下面的内容,并不太难懂, 可以根据自己的情况进行修改

cat > /tmp/puppetlabs-openstack.patch << EOF
diff --git examples/site.pp examples/site.pp
index 879d8fa..fd38d4e 100644
--- examples/site.pp
+++ examples/site.pp
@@ -4,7 +4,9 @@
 #
 
 # deploy a script that can be used to test nova
-class { 'openstack::test_file': }
+class { 'openstack::test_file':
+  image_type => 'ubuntu',
+}
 
 ####### shared variables ##################
 
@@ -21,17 +23,17 @@ \$public_interface        = 'eth0'
 \$private_interface       = 'eth1'
 # credentials
 \$admin_email             = 'root@localhost'
-\$admin_password          = 'keystone_admin'
-\$keystone_db_password    = 'keystone_db_pass'
-\$keystone_admin_token    = 'keystone_admin_token'
-\$nova_db_password        = 'nova_pass'
-\$nova_user_password      = 'nova_pass'
-\$glance_db_password      = 'glance_pass'
-\$glance_user_password    = 'glance_pass'
-\$rabbit_password         = 'openstack_rabbit_password'
-\$rabbit_user             = 'openstack_rabbit_user'
-\$fixed_network_range     = '10.0.0.0/24'
-\$floating_network_range  = '192.168.101.64/28'
+\$admin_password          = 'openstack'
+\$keystone_db_password    = 'openstack'
+\$keystone_admin_token    = 'bdbb8df712625fa7d1e0ff1e049e8aab'
+\$nova_db_password        = 'openstack'
+\$nova_user_password      = 'openstack'
+\$glance_db_password      = 'openstack'
+\$glance_user_password    = 'openstack'
+\$rabbit_password         = 'openstack'
+\$rabbit_user             = 'openstack'
+\$fixed_network_range     = '10.1.0.0/16'
+\$floating_network_range  = '10.1.199.32/27'
 # switch this to true to have all service log at verbose
 \$verbose                 = false
 # by default it does not enable atomatically adding floating IPs
@@ -75,7 +77,7 @@ node /openstack_all/ {
 
 # multi-node specific parameters
 
-\$controller_node_address  = '192.168.101.11'
+\$controller_node_address  = '10.1.199.15'
 
 \$controller_node_public   = \$controller_node_address
 \$controller_node_internal = \$controller_node_address
@@ -83,9 +85,9 @@ \$sql_connection         = "mysql://nova:\${nova_db_password}@\${controller_node_in
 
 node /openstack_controller/ {
 
-#  class { 'nova::volume': enabled => true }
+  class { 'nova::volume': enabled => true }
 
-#  class { 'nova::volume::iscsi': }
+  class { 'nova::volume::iscsi': }
 
   class { 'openstack::controller':
     public_address          => \$controller_node_public,
@@ -142,7 +144,7 @@ node /openstack_compute/ {
     vncproxy_host      => \$controller_node_public,
     vnc_enabled        => true,
     verbose            => \$verbose,
-    manage_volumes     => true,
+    manage_volumes     => false,
     nova_volume        => 'nova-volumes'
   }

EOF
cd /etc/puppet/modules/openstack
patch -p0 < /tmp/puppetlabs-openstack.patch

运行下面命令

rm -rf /etc/puppet/manifests/site.pp
ln -s /etc/puppet/modules/openstack/examples/site.pp /etc/puppet/manifests/site.pp

3:安装Openstack nova 控制节点

puppet agent -vt --waitforcert 60 --certname openstack_controller

这个时候,你需要另开一个ssh,去签发证书

puppetca sign -a

大概等待5分钟,你就可以通过 http://10.1.199.15  user:admin pass:openstack

4:安装多节点

需要在3台机器安装nova的计算节点。分别运行

puppet agent -vt --waitforcert 60 --certname openstack_compute_node15
puppet agent -vt --waitforcert 60 --certname openstack_compute_node16
puppet agent -vt --waitforcert 60 --certname openstack_compute_node17

在控制节点上,再开一个ssh,签发证书

puppetca sign -a

等10分钟吧,就可以把3个计算节点都装完。

5; 上传image

编辑/root/openrc ,默认的auth_url 是使用IP地址,这有问题,你运行glance index会报错。

root@node15:~# cat /root/openrc 

  export OS_TENANT_NAME=openstack
  export OS_USERNAME=admin
  export OS_PASSWORD=openstack
  export OS_AUTH_URL="http://localhost:5000/v2.0/"
  export OS_AUTH_STRATEGY=keystone
  export SERVICE_TOKEN=bdbb8df712625fa7d1e0ff1e049e8aab
  export SERVICE_ENDPOINT=http://10.1.199.15:35357/v2.0/

设置环境变量

source /root/openrc

这个时候,你运行

glance index

就不会有问题。

Ubuntu官方image

下载image

wget http://cloud-images.ubuntu.com/precise/current/precise-server-cloudimg-amd64-disk1.img

上传image

glance add name="Ubuntu 12.04 cloudimg amd64" is_public=true container_format=ovf \
disk_format=qcow2 < /root/precise-server-cloudimg-amd64-disk1.img

 

6:设置安全组

nova secgroup-add-rule default tcp 1 65535 0.0.0.0/0
nova secgroup-add-rule default udp 1 65535 0.0.0.0/0
nova secgroup-add-rule default icmp -1 255 0.0.0.0/0

7:检查所有节点的服务

root@node15:~# nova-manage service list
Binary           Host                                 Zone             Status     State Updated_At
nova-volume      node15                               nova             enabled    🙂   2012-07-18 12:52:55
nova-consoleauth node15                               nova             enabled    🙂   2012-07-18 12:52:53
nova-scheduler   node15                               nova             enabled    🙂   2012-07-18 12:52:55
nova-cert        node15                               nova             enabled    🙂   2012-07-18 12:52:55
nova-network     node15                               nova             enabled    🙂   2012-07-18 12:52:55
nova-compute     node15                               nova             enabled    🙂   2012-07-18 12:52:52
nova-network     node16                               nova             enabled    🙂   2012-07-18 12:52:57
nova-compute     node16                               nova             enabled    🙂   2012-07-18 12:52:51
nova-network     node17                               nova             enabled    🙂   2012-07-18 12:52:56
nova-compute     node17                               nova             enabled    🙂   2012-07-18 12:52:50

 

计算节点都跑 nova-compute 和nova-network

8:登陆创建虚拟机

我已经全部测试了一遍,在计算节点的创建的虚拟机,都是可以登陆,访问外网。好好看看设置。我以前的文档,估计也要修改修改。

 

  19 Responses to “ubuntu 12.04 puppet部署Openstack”

  1. 支持!

  2. 想请教一下陈老师,创建好的卷附加不到实例,这会是什么原因呢?折腾了一个星期!!

  3. 沙克,请问这种安装是用的apt-get安装软件包方式吗? 怎样用git clone 这种方式自动安装部署 ?
    谢谢。

  4. 沙克,我安装就没那么顺利。。。
    主控节点上执行 puppet agent -vt –waitforcert 60,报如下错误:
    err: /File[/var/lib/puppet/lib]: Could not evaluate: Could not retrieve information from environment production source(s) puppet://node55.coolias.com/plugins

    第一次弄puppet,是在不知怎么解决。。。

  5. puppet agent -vt –waitforcert 60 –certname openstack_compute_node15

    注册是成功的

    但在在检查node的时候只发现master节点上的node,其他的node节点显示不出来,不知道是什么情况

    • puppet水平不行,还没有排错能力。我也是对着老外那个文档,step by step,不过是做成功。

  6. I just update the installation example for OpenStack Folsom + Ubuntu 12.04 + Puppet: http://edin.no-ip.com/blog/hswong3i/openstack-folsom-deploy-puppet-ubuntu-12-04-howto

    Would you mind to give a hand for testing?

    • 已经看到,肯定会尽快测试,给你反馈。看看什么时候加上quantum。以前我的Essex版本,全靠你提供的文档,才搞定。当时我的计算节点没安装nova api,结果mutilhost不行。

    • I would test it later and give your feedback.

  7. set /files/etc/puppet/puppet.conf/agent/pluginsync true
    不好意思 想问一下这条命令是来让agent保持同步的吗? 不要也可以同步吧

    • 这个是设置agent同步,你可以看看agent的puppet.conf ,可以看到这个选项。

  8. 按照你的步骤写,出现在下面错误,语法应该没问题~~~~求解
    err: Could not retrieve catalog from remote server: Error 400 on SERVER: Invalid parameter export_resources at /etc/puppet/manifests/site.pp:117 on node openstack_controller

  9. 你好,请教一个问题,我在做rake modules:clone这步的时候,出现如下错误,搞不清楚是什么问题,是我少了什么步骤吗?
    rake aborted!
    no such file to load — puppet-lint/tasks/puppet-lint
    /etc/puppet/modules/openstack/Rakefile:2
    (See full trace by running task with –trace)

  10. 刚才的问题,解决了,是因为少装了东西,但又有新的问题
    rake modules:clone
    rake aborted!
    Don’t know how to build task ‘modules:clone’

 Leave a Reply

(required)

(required)