Commit Graph

245 Commits

Author SHA1 Message Date
Paul Angus a2aabb8f12 first stab a adding a smaller 'start up helper' to VR patching 2017-07-28 16:30:22 +01:00
Jayapal 6a59eb7327 CLOUDSTACK-9669: updated the strongswan debian conf setting for template 2017-06-06 15:51:00 +05:30
Jayapal 065fa1c849 CLOUDSTACK-9669:Advaced zone isolated network egress destination cidr support
CLOUDSTACK-9669:egress destination cidr VR python script changes
    CLOUDSTACK-9669:egress destination API and orchestration changes
    CLOUDSTACK-9669: Added the ipset package in systemvm template
    CLOUDSTACK-9669:Added licence header for new files
    CLOUDSTACK-9669: replacing 0.0.0.0/0 with the network cidr

     ipset member add with 0.0.0.0/0 fails. So 0.0.0.0/0 replaced with the network cidr.
     In source cidr 0.0.0.0/0 is nothing but network cidr.
     updated the default egress all cidr with network cidr
2017-06-06 15:51:00 +05:30
Daan Hoogland 70ef0788c9 CLOUDSTACK-9408: Fix download urls in sql and scripts
This fixes the agreed upon url on download.cloudstack.org in various
sql files and misc scripts.

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2017-04-20 12:33:33 +05:30
Daan Hoogland f07d729086 CLOUDSTACK-9408 for the move away from download.cloud.com
- commented some occurences of cloud.com as being harmless
  * examples
  * identifiers (internal)
 - changed the URL for vhd-util download
 - changed comments from 'cloud.com' to 'Apache CloudStack'
2017-04-20 11:35:36 +05:30
Rajani Karuturi 7b78a22c5e Merge release branch 4.9 to master
* 4.9:
  CLOUDSTACK-9591: Fix guest VM ovf xml to remove network nodes
  CLOUDSTACK-9591: Fix systemvmtemplate to not include network details
2017-04-12 10:30:23 +05:30
Rohit Yadav 92fd5bee3d CLOUDSTACK-9591: Fix systemvmtemplate to not include network details
This removes nic/network specific details while exporting the systemvmtemplate
for vmware (ova file). Having this causes the ssvms to not deploy in
dvswitch-based vmware environments that have no vswitch portgroups (dummy etc).
Tested this on a local Trillian env.

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2017-03-30 13:47:53 +05:30
Will Stevens f045d65b90 complete implementation of the StrongSwan VPN feature 2017-02-02 16:18:06 -05:00
Rohit Yadav e6cc78f531 CLOUDSTACK-9710: Switch to JRE1.8
- Switches Travis to use jdk1.8
- Changes java-version to 1.8
- Change jdk/maven version to 1.8
- Switch to F5/java8 compatible library release
- Switch packaging to use jdk 1.8, and jre 1.8 in init/systemd scripts
- Switch systemvm to openjdk-8-jre

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2017-01-11 14:04:03 +05:30
Wido den Hollander 2a5f37c1b1
CLOUDSTACK-8715: Add channel to Instances for Qemu Guest Agent
This commit adds a additional VirtIO channel with the name
'org.qemu.guest_agent.0' to all Instances.

With the Qemu Guest Agent the Hypervisor gains more control over the Instance if
these tools are present inside the Instance, for example:

* Power control
* Flushing filesystems
* Fetching Network information

In the future this should allow safer snapshots on KVM since we can instruct the
Instance to flush the filesystems prior to snapshotting the disk.

More information: http://wiki.qemu.org/Features/QAPI/GuestAgent

Keep in mind that on Ubuntu AppArmor still needs to be disabled since the default
AppArmor profile doesn't allow libvirt to write into /var/lib/libvirt/qemu

This commit does not add any communication methods through API-calls, it merely
adds the channel to the Instances and installs the Guest Agent in the SSVMs.

With the addition of the Qemu Guest Agent channel a second channel appears in /dev
on a SSVM as a VirtIO port.

The order in which the ports are defined in the XML matters for the naming inside
the SSVM VM and by not relying on /dev/vportXX but looking for a static name the
SSVM still boots properly if the order in the XML definition is changed.

A SSVM with both ports attached will have something like this:

  root@v-215-VM:~# ls -l /dev/virtio-ports
  total 0
  lrwxrwxrwx 1 root root 11 May 13 21:41 org.qemu.guest_agent.0 -> ../vport0p2
  lrwxrwxrwx 1 root root 11 May 13 21:41 v-215-VM.vport -> ../vport0p1
  root@v-215-VM:~# ls -l /dev/vport*
  crw------- 1 root root 251, 1 May 13 21:41 /dev/vport0p1
  crw------- 1 root root 251, 2 May 13 21:41 /dev/vport0p2
  root@v-215-VM:~#

In this case the SSVM port points to /dev/vport0p1, but if the order in the XML
is different it might point to /dev/vport0p2

By looking for a portname with a pre-defined pattern in /dev/virtio-ports we
do not rely on the order in the XML definition.

Signed-off-by: Wido den Hollander <wido@widodh.nl>
2016-11-23 16:01:08 +01:00
Rohit Yadav 2cddaf3d36 CLOUDSTACK-9447: fix build and upgrade to debian 7.11 iso
- Update base debian iso to version 7.11
- Upgrade ruby version to 2.3.0 (latest/stable)
- Fix Gemfile
- Update README
- Fix openswan pkg name with the same version
- Remove cloud-cleanup it's not available

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2016-08-05 12:40:07 +05:30
Rajani Karuturi 61526190d0 changed the base iso file from debian-7.8.0 to debian-7.9.0
7.8.0 url is not available(404 Error)
2015-09-15 21:37:44 +05:30
Pierre-Luc Dion 9e4a1a08ff fix dependency for keepalived from wheezy-backports
Signed-off-by: wilderrodrigues <wrodrigues@schubergphilis.com>
2015-07-28 14:18:40 +02:00
wilderrodrigues 08348593a2 CLOUDSTACK-8616 - the systemvm packages are installed from install_systemvm_packages.sh
- Adding keepalived installation in the right script. I added the change on the buildsystemvm.sh, which is no longer used.

Signed-off-by: wilderrodrigues <wrodrigues@schubergphilis.com>
2015-07-16 13:14:49 +02:00
Rohit Yadav 9d8a62d0ee systemvmtemplate: install libc6:i386 for 64bit template
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-05-18 19:58:57 +02:00
Remi Bergsma 95e7673a55 Systemvm: Disable services that slow down boot
The console-setup service brings a nice font to the console, but why would we want to use it. In most cases it takes a <10 seconds to set it up. When using nested hypervising, I found this takes much longer time that causes tests to time-out. I'd suggest turning off these services. They are not required for the services the systemvm provides.
2015-05-18 13:44:09 +02:00
Rohit Yadav 0f82650dcf systemvmtemplate: use ovftool for building vmware template if available
This commit fixes a chmod issue where extracted vmdk file is not readable by all
users/groups. The other improvement is to use ovftool to build systemvm template
for vmware if it's available. This is based on a dev ML discussion and a suggested
approach by Ilya: http://markmail.org/message/kntsetgxdbppfh22

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-05-12 16:46:23 +02:00
Rohit Yadav 0fa1453809 systemvmtemplate: use archived debian 7.8.0 iso since Debian8 is released now
This fixes the urls and jenkins build

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-04-29 17:19:15 +02:00
Rohit Yadav d8eb2e5e48 systemvmtemplate: install open-vm-tools from wheezy-backports, install XStools
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-04-10 15:48:36 +05:30
Rohit Yadav 97ad1e24b8 systemvmtemplate: increase /opt parititon by 100MB
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-04-03 10:49:36 +05:30
Rohit Yadav 2de12b50f8 systemvmtemplate: zero out /var/log partition
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-30 15:52:51 +05:30
Rohit Yadav 6f907fb2cd systemvmtemplate: increase disk size to 3000
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-30 13:58:33 +05:30
Rohit Yadav d0e65d7c34 systemvmtemplate: use separate partition for /var/log
/var/log fills up /var and fails operation of normal services. This fix
restricts /var/log to 100-200M. The fix for CLOUDSTACK-6885 tries to make sure
we don't keep a lot of logs.

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-30 13:54:20 +05:30
Rohit Yadav 8fe3c0b8ba appliance: remove raw.img before exporting and building template for KVM
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-25 17:27:03 +05:30
Rene Moser dc2aa8a808 systemvm: use Debian http redirector for backports
This closes #123

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-24 16:51:05 +05:30
Rohit Yadav 6a881b9337 systemvmtemplate: install irqbalance from wheezy-backports
Ported systemvm enhancement by Rene Moser <rene.moser@swisstxt.ch> from
https://github.com/apache/cloudstack/pull/119

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-23 14:31:12 +05:30
Rohit Yadav 7a2e27c3b3 appliance: save md5 checksums after building systemvm templates
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-20 15:16:57 +05:30
Leo Simons 3bd59a4bf3 veewee 0.5 alpha is breaking build 2015-03-16 11:38:14 +01:00
Leo Simons d0281a3b41 Seems like some of these can be nil 2015-03-16 11:35:35 +01:00
Ian Southam cc5d72133e Removed chef as we will definitely not go this way 2015-03-16 11:35:14 +01:00
Ian Southam c7c1f3202e Plan B
Replace chef with a python script
configure.py will read the bags and (hopefully) create the desired state
At this stage this is ipassociation
This code should work for both VR and VPCrs

TODO:
iptables
ip route throw (present in VR but not in VPCr
Determine default route
Unit tests
2015-03-16 11:35:08 +01:00
Leo Simons 66b5260c90 Documentation and license headers for new systemvm testing tools. 2015-03-16 11:35:08 +01:00
Leo Simons 04ad01a064 Commit missing .kitchen.yml 2015-03-16 11:35:07 +01:00
Ian Southam ab64c7df6f Added curl to the base install 2015-03-16 11:35:00 +01:00
Ian Southam 5b82e2059d Cherry-pick of 11c00977f77f45aa7b0c387dc88360eba0819e8a:
----
Author:    Ian Southam <isoutham@schubergphilis.com>

First commit towards moving systemvm to chef based configuration
In this commit

1.  cmdline json databag is created
2.  ip association data bag is created
3.  Basic chef cookbook to manage ips and routes

Conflicts:
	systemvm/patches/debian/config/etc/init.d/cloud-early-config
	systemvm/patches/debian/config/var/chef/cookbooks/README
	tools/appliance/definitions/systemvm64template/postinstall.sh
----
Because we've refactored the systemvm template the change to
postinstall.sh now gets its own chef.sh file.
2015-03-16 11:34:59 +01:00
Hugo Trippaers 4fd616fc0f Make sure the location for the persistant configs exists 2015-03-16 11:34:58 +01:00
Leo Simons f7dd35e1ee CLOUDSTACK-7143: a better fix for kernel upgrade disk space problems
Increase / and /boot a little bit, to the point that there is enough
space on them to do a kernel upgrade. With this I think we can
decrease total disk space usage back down to 2.5GB.

Docs for the preseed config found at
  http://anonscm.debian.org/gitweb/?p=d-i/debian-installer.git;a=blob_plain;f=doc/devel/partman-auto-recipe.txt;hb=HEAD
2015-03-16 11:34:58 +01:00
Funs c27c69438b hypervisors: add OVM3 plugin that supports OVM 3.2.1/3.3.x
This is a plugin that puts in ovm3 support ranging from 3.3.1 to 3.3.2. Basic
functionality is in here, advanced networking etc..

Snapshots only work when a VM is stopped now due to the semantics of OVM's raw
image implementation (so snapshots should work on a storage level underneath the
hypervisor shrug)

This closes #113

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-12 11:33:42 +05:30
Rohit Yadav 5fb5937cdb appliance: do a apt-get clean before upgrade to free up space
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-02-06 17:02:44 +05:30
Rohit Yadav b9ae18c5fb appliance: except for openswan upgrade rest of the packages
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-01-28 23:26:47 +05:30
Rohit Yadav 6b6ce5d074 appliance: don't fail is bak is not found
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-01-28 18:27:19 +05:30
Rohit Yadav 3fddfe0e10 appliance: fix Debian ISO urls, fixes jenkins build
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-01-15 15:35:13 +05:30
Wei Zhou ca5c800f8d Fix CloudStack version (4.6.0) in systemvm template 2014-12-08 15:26:56 +01:00
Will Stevens 03daae571b CLOUDSTACK-7959: fixed 'qemu-img convert' compat issue 2014-12-02 12:15:16 -05:00
Will Stevens 8e689b1148 Updated the system vm build to remove incompatible qemu-img 'compat' option 2014-11-21 05:59:06 -05:00
Edison Su 05bec59c14 CS-27148 system vm image build process, needs to build an old version of qemu image, otherwise, it won't work on RHEL 6 Reviewed-by:Frank 2014-11-06 15:25:57 -08:00
Rohit Yadav ce51fe32f9 CVE­2014­3566: Avoid using SSLv3 on apache2 webserver used by SSVM
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2014-11-04 14:46:22 +05:30
Harikrishna Patnala 34b7288ca4 CLOUDSTACK-7748: Cloudstack version number is missing in system vm template. /etc/cloudstack-release in system vm does not have version number which leads in vm deployment failure while checking router version. 2014-11-03 12:13:04 +05:30
Harikrishna Patnala 6c04d867b0 CLOUDSTACK-7660: Enhance system vm template to support baremetal
Installed flask package and removed the disk expert recipe in
system vm template to keep only one partition

Signed-off-by:  Frank Zhang <frank.zhang@citrix.com>
2014-10-31 19:35:09 +05:30
SrikanteswaraRao Talluri 93529e47fd CLOUDSTACK-7824: using debian 7.7.0 and
added 'sharutils' package installation in system template

Signed-off-by: SrikanteswaraRao Talluri <talluri@apache.org>
2014-10-31 18:52:17 +05:30