Commit Graph

340 Commits

Author SHA1 Message Date
Leo Simons 362946c52e CLOUDSTACK-7143: don't call rvm from build
It is simpler to expect that rvm setup is done outside of this build.
The buildacloud.org jenkins has rvm installed/enabled by default so
does not invoke rvm.
2014-09-22 21:38:17 +02:00
Leo Simons a8500ed73e CLOUDSTACK-7143: survive / in branch names 2014-09-22 21:38:17 +02:00
Leo Simons 115b2cf8e7 CLOUDSTACK-7143: only archive the zipped hyperv image
Cherry-pick of d09acc44f2b36cd593ebe97ab1673b7757ea2c25.
2014-09-22 21:38:17 +02:00
Leo Simons d56e950e85 CLOUDSTACK-7143: work on vagrant box export
Running --export creates the .ovf and the .vmdk files referenced
from that .ovf in one go. Guessing/predicting the names of the .vmdk
files is not fool-proof.
2014-09-22 21:38:17 +02:00
Ian Southam cab4dd8258 CLOUDSTACK-7143: Fixed box file for virtualbox 2014-09-22 21:38:16 +02:00
Leo Simons 598c472b73 CLOUDSTACK-7143: remove erroneous backticks
The backticks in the Vagrantfile template were getting evaluated by bash.
This caused some harmless but confusing error messages to appear on running
the build. Easy fix is to remove them.
2014-09-22 21:38:16 +02:00
Leo Simons 35347f8350 CLOUDSTACK-7143: try to fix jenkins problems with last 2 commits
* bundle install needs to run before running the vbox cleaning scripts,
  so move prepare step before clean step
* feature branches have / in their name which is a bad character to
  put into filenames
2014-09-22 21:38:16 +02:00
Leo Simons 00b39de0f8 CLOUDSTACK-7143: more reliable support for vagrant box export
Veewee supports exporting vagrant boxes out of virtualbox, out of the box.
However, it assumes that it can export a disk if the shutdown of the vm that
is using that disk has succeeded. This assumption is not strictly always true
(see previous commit). So, we replicate the bit of logic in veewee for making
vagrant boxes.

This has the added side benefit of creating an .ovf export only once, rather
than once for vmware and then again for vagrant.
2014-09-22 21:38:16 +02:00
Leo Simons be8b2d7c21 CLOUDSTACK-7143: more robust box cleanup
Having experimented with many edge cases of running multiple build.sh
commands in parallel / against busy virtualbox setups, the only really
reliable way to produce consistent images is to not do these commands
in parallel and to not do them while the machine is doing many other
things.

If virtualbox or the machine that hosts it is very busy, and/or it has
a lot of disks it knows/knew about, and/or its tuesday, behavior may
be a bit different.

Realizing this reality, this commit adds some scripts that try really
hard to set virtualbox back to known/healthy state before building.
2014-09-22 21:38:16 +02:00
Leo Simons d658fc4637 CLOUDSTACK-7143: attempt to export a vagrant box 2014-09-22 21:38:16 +02:00
Leo Simons 1821f4ec06 CLOUDSTACK-7143: fix a missing apt-get update
In 8e2d06153b3d5ec1540fac1c8fbc97b5d2b58a8e I mistakenly/accidentally
a apt-get update.

As
    https://wiki.debian.org/Multiarch/HOWTO
explains, apt-get update is needed after adding a new architecture.
2014-09-22 21:38:15 +02:00
Leo Simons 91ffedb39c CLOUDSTACK-7143: a better fix for kernel upgrade disk space problems
Increase / and /boot a little bit, to the point that there is enough
space on them to do a kernel upgrade. With this I think we can
decrease total disk space usage back down to 2.5GB.

Docs for the preseed config found at
  http://anonscm.debian.org/gitweb/?p=d-i/debian-installer.git;a=blob_plain;f=doc/devel/partman-auto-recipe.txt;hb=HEAD
2014-09-22 21:38:15 +02:00
Leo Simons d5a4a2521b CLOUDSTACK-7143: fix do_signature to account for change to install_cloud_scripts
The do_signature script required a lingering cloud-scripts.tar that was no longer
there after the git export tarball fiddling magic was gone.
2014-09-22 21:38:15 +02:00
Leo Simons 25bb682cd1 CLOUDSTACK-7143: fix the fix for rvm/ruby/bundler setup on jenkins
The recommended use of --deployment goes along with the requirement to
check Gemfile.lock into source control, which I don't want to do.
2014-09-22 21:38:15 +02:00
Leo Simons 0570d37106 CLOUDSTACK-7143: initial apt-upgrade still running out of space (upgrading the kernel)
I wonder if this is due to the 7.4.0->7.6.0 needing more space. Should see if
there's more stuff that can be cleaned earlier?
2014-09-22 21:38:15 +02:00
Leo Simons b4fceef407 CLOUDSTACK-7143: sometimes the consolidated 'apt' command runs out of space 2014-09-22 21:38:15 +02:00
Leo Simons 41ddb6b768 CLOUDSTACK-7143: make script compatible with linux mktemp 2014-09-22 21:38:15 +02:00
Leo Simons 631a3c8722 CLOUDSTACK-7143: install openssl early enough to allow generating passwords 2014-09-22 21:38:14 +02:00
Leo Simons a56392b5e4 CLOUDSTACK-7143: attempt at a reliable way to set up rvm/bundler on jenkins 2014-09-22 21:38:14 +02:00
Leo Simons a7d07bf3df CLOUDSTACK-7143: fix a bug where a script file rename wasn't propagated to build.sh 2014-09-22 21:38:14 +02:00
Leo Simons 634560e381 CLOUDSTACK-7143: fix a bug in the debianbase template that was referencing deleted scripts 2014-09-22 21:38:14 +02:00
Leo Simons dd34d10159 CLOUDSTACK-7143: add tests for the appliance build
Create a new minimal 'debianbase' definition which is a veewee template
that's a lot like the systemvmtemplate, but does not have any
systemvm-ness in it. Use it to create a new test.sh which tests a few
common invocations of build.sh work as desired.

This is mainly useful for debugging whether the appliance build process
is working / consistent; in order to test a systemvm itself it should
really first be merged with systemvm.iso.
2014-09-22 21:38:14 +02:00
Leo Simons 33fd6894a0 CLOUDSTACK-7143: use shar to inject cloud-scripts from working copy
The current build downloads its script from master by fetching a cloudstack
tarball. Besides being an unneeded load on the apache git server, this is a
problem when working on a branch and wanting to inject a different set of
scripts. It also makes it pretty likely that the injected copy of the script
will not match what a production release wants, so there is very little
chance of not needing to overwrite the scripts.

Ideally we would just rsync over some files. However, veewee does not provide
an option to do that. In order to keep a 'cleanly veewee-only' build possible,
and work with any recent veewee version, in this change we restor to using
shar (http://en.wikipedia.org/wiki/Shar) to produce an archive which can
execute as a script, which we feed to veewee to execute.
2014-09-22 21:38:14 +02:00
Leo Simons 35ba68444b CLOUDSTACK-7143: add the ability to inject a custom SSH key
When working on the systemvm in isolation, or using vagrant or similar tools,
it can be useful to inject a custom SSH key before merging a management server
systemvm.iso into it. This option allows that. It should _not_ have effect
on management-server-managed vms which always get their SSH keys injected.
2014-09-22 21:38:13 +02:00
Leo Simons 18364216d8 CLOUDSTACK-7143: improve build.sh failure handling and recovery
In particular, this refactoring allows the use of 'set -e' to exit early on
error. Previously the script would continue for a while when encountering a
problem, stuttering sometimes to (almost) completion, producing partial or
no results.

Added a bash on EXIT trap which runs add_on_exit cleanup code in the reverse
order it was specified. Resource cleanup is now co-located with resource
definition.

Added color-coded logging.

Made most of the hypervisor-specific exports optional. This script now
works on Mac OS X.
2014-09-22 21:38:13 +02:00
Leo Simons 2832bc47e1 CLOUDSTACK-7143: improve build.sh ergonomics
Added a bunch of possible arguments / environment variables, see the new usage
function for details (or run ./build.sh help).

Creates a new template with a unique name on every invocation, resulting in a
new virtualbox instance with a unique name. This makes it possible to build
multiple boxes at the same time, in parallel (including for example on a
multiuser box), and reduces the chance of failed build results conflicting
with each other.

Inject the version given on the command line (if any) into the created image.
2014-09-22 21:38:13 +02:00
Leo Simons de68741f60 CLOUDSTACK-7143: license headers on all the systemvm scripts 2014-09-22 21:38:13 +02:00
Leo Simons d3ecb0099c CLOUDSTACK-7143: cleanup configure_conntrack.sh code 2014-09-22 21:38:13 +02:00
Leo Simons 44ceeabb28 CLOUDSTACK-7143: cleanup zerodisk.sh code 2014-09-22 21:38:13 +02:00
Leo Simons f67a379a46 CLOUDSTACK-7143: tune timeouts to expect about <=~60 min build 2014-09-22 21:38:12 +02:00
Leo Simons 654c871e75 CLOUDSTACK-7143: cleanup configure_systemvm_services.sh code 2014-09-22 21:38:12 +02:00
Leo Simons 7d9e46425f CLOUDSTACK-7143: rename postinstall.sh to represent what remains 2014-09-22 21:37:19 +02:00
Leo Simons c7e6387752 CLOUDSTACK-7143: collapse apt-get install onto one line
In theory this _could_ have changed behavior (apt coming up with a different
solution, or one of the packages configuring a new apt repository), but in my
testing, the end result is the same.
2014-09-22 21:37:19 +02:00
Leo Simons 22617e9496 CLOUDSTACK-7143: reorg of install_systemvm_packages.sh (no logic changes, yet) 2014-09-22 21:37:18 +02:00
Leo Simons 3d4e4a6e09 CLOUDSTACK-7143: consider vhdutil a software package 2014-09-22 21:37:18 +02:00
Leo Simons 06c1c16dc3 CLOUDSTACK-7143: move install_packages from postinstall.sh to its own file 2014-09-22 21:37:18 +02:00
Leo Simons 71c913c658 CLOUDSTACK-7143: cleanup configure_networking.sh code 2014-09-22 21:34:47 +02:00
Leo Simons a533de7593 CLOUDSTACK-7143: move networking logic from postinstall.sh to configure_networking.sh 2014-09-22 21:34:47 +02:00
Leo Simons 3574dcf543 CLOUDSTACK-7143: split connection tracking config into its own file 2014-09-22 21:31:36 +02:00
Leo Simons ed53167547 CLOUDSTACK-7143: cleanup cleanup.sh code 2014-09-22 21:31:36 +02:00
Leo Simons 3c9f2c7227 CLOUDSTACK-7143: cleanup configure_acpid.sh code 2014-09-22 21:31:36 +02:00
Leo Simons 5627b67ff3 CLOUDSTACK-7143: move fix_acpid to its own file 2014-09-22 21:31:35 +02:00
Leo Simons 6a688a0337 CLOUDSTACK-7143: cleanup configure_locale.sh code 2014-09-22 21:31:35 +02:00
Leo Simons aa14a619a6 CLOUDSTACK-7143: split locale config into its own file 2014-09-22 21:31:35 +02:00
Leo Simons 3f8c31b0da CLOUDSTACK-7143: cleanup configure_login.sh code
Had to change various things to make this code re-entrant. In particular,
the sed-based manipulation of /etc/sudoers is gone and replaced with a
simpler, minimal (but compatible) sudoers file.

Remove the sshd_config tuning since sshd_config is overwritten when we
apply the cloud_scripts overlay (from build.sh).
2014-09-22 21:31:35 +02:00
Leo Simons e86121db7b CLOUDSTACK-7143: split login config out from postinstall.sh 2014-09-22 21:31:35 +02:00
Leo Simons e5a2e67551 CLOUDSTACK-7143: cleanup configure_gruh.sh code
Adding a check whether GRUB_TIMEOUT has already been set, and if it has,
skip re-running update-grub.
2014-09-22 21:31:35 +02:00
Leo Simons 29c1f91aea CLOUDSTACK-7143: add vagrant_box_build_time file that's standard with current veewee templates 2014-09-22 21:31:34 +02:00
Leo Simons 58ca92ce52 CLOUDSTACK-7143: cleanup apt_upgrade.sh code 2014-09-22 21:31:34 +02:00
Leo Simons 6641fd3a76 CLOUDSTACK-7143: move add_backports to apt_upgrade.sh 2014-09-22 21:31:34 +02:00
Leo Simons 5f3caf6d01 CLOUDSTACK-7143: reformat definition.rb code. No other changes. 2014-09-22 21:31:34 +02:00
Leo Simons 2210f1b1da CLOUDSTACK-7143: remove 'manual' from preseed config. No other changes. 2014-09-22 21:31:34 +02:00
Leo Simons 3c0cdb595f CLOUDSTACK-7143: merge systemvm templates, step 2: only one template remains 2014-09-22 21:31:33 +02:00
Leo Simons 039a47bd5b CLOUDSTACK-7143: merge systemvm templates, step 1: remove differences 2014-09-22 21:30:39 +02:00
Leo Simons 262cde5fb7 CLOUDSTACK-7143: move network tuning from cleanup.sh to its own script. 2014-09-22 21:30:39 +02:00
Leo Simons e2f1740de5 CLOUDSTACK-7143: split base.sh into its two functions. 2014-09-22 21:30:39 +02:00
Leo Simons 0f2012e842 CLOUDSTACK-7143: upgrade systemvm to latest debian stable, 7.6.0. 2014-09-22 21:30:39 +02:00
Rohit Yadav ad8ad404fe systemvmtemplate: set next CLOUDSTACK_VERSION to 4.5.0
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2014-09-12 17:19:46 +02:00
Rohit Yadav 765659091a appliance: fix newer debian iso links and checksums for debian
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
(cherry picked from commit ac5309b8b4)
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2014-09-09 18:41:53 +02:00
Rohit Yadav 4217d157c5 appliance: box commands for dumb bash in cleaning branch name, in build.sh
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
(cherry picked from commit edb5650c73)
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2014-08-08 21:24:18 +02:00
Rohit Yadav e71009a571 appliance: fix branch finding method from e16414e even Junio can be wrong
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
(cherry picked from commit bbaefb8e5d)
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2014-08-08 20:30:42 +02:00
Rohit Yadav ffe0f2f60f appliance: use the right way to get git branch name
Taken from Junio C Hamano's blog [1], git's maintainer, he must not be wrong :)

[1] http://git-blame.blogspot.ch/2013/06/checking-current-branch-programatically.html

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
(cherry picked from commit e16414e56d)
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2014-08-08 19:22:20 +02:00
Rohit Yadav a0006a6990 appliance: change the way we find git branch in build.sh
(cherry picked from commit 493c0a68d2)
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

Conflicts:
	tools/appliance/build.sh
2014-08-08 15:44:33 +02:00
Joris van Lieshout b8deb6ba3f volume /usr was sized to small and ends up being 100% full on SSVMs and CVMs. By juggling some partman-auto numbers the space gets devided more evenly. After this patch /usr should be around 80% full. I've also reduced the swap space because this makes no sense on virtual instances.
Signed-off-by: Daan Hoogland <daan@onecht.net>
2014-08-08 12:58:12 +02:00
Harikrishna Patnala 2dfd278625 CLOUDSTACK-7087: Latest OS X VPN client not working Downgrading openswan version to 1:2.6.37-3
Reviewed-by: Abhinandan

Signed-off-by: Sheng Yang
2014-08-05 16:06:00 +05:30
Hugo Trippaers 733a7ba8c1 Put in a note that will hopefully prevent a bunch of systemvm build failures 2014-07-18 10:18:19 +02:00
Daan Hoogland fec52be20e Revert "raw immage for ovm"
This reverts commit 23b1f228a1.
2014-06-24 10:21:05 +02:00
Daan Hoogland 23b1f228a1 raw immage for ovm 2014-06-23 14:54:07 +02:00
Joris van Lieshout bfccf439cf By preloading some modules we fix two things. 1. Some sysctl settings like ip_conntrack_max are not set during boot because the module is not loaded at that time. 2. Passive ftp does not work through iptables without these modules.
Signed-off-by: Daan Hoogland <daan@onecht.net>
2014-06-10 15:42:40 +02:00
Tim Mackey a8212d9ef4 Cleanup of Xen and XenServer terms. Cloned xen plugin creating a xenserver plugin, then removed xen plugin
Signed-off-by: Tim Mackey <tmackey@gmail.com>
Signed-off-by: Sebastien Goasguen <runseb@gmail.com>
2014-06-07 04:50:23 -04:00
rayeesn 5f11c2e0be CLOUDSTACK-6392: system template always create with name master instead of specific branch
Signed-off-by: Abhinandan Prateek <aprateek@apache.org>
2014-05-28 11:35:57 +05:30
Marcus Sorensen 2c810d73e2 CLOUDSTACK-6751 - Disable stats logging for conntrackd upon systemvm creation
Submitted-by: Joris van Lieshout <jvanlieshout@schubergphilis.com>
2014-05-22 09:20:33 -06:00
ynojima 570c3a2130 bugfix: systemvm template build failed
since newer vboxmanage generates $appliance-$branch-vmware-disk3.vmdk
2014-05-21 18:27:24 -06:00
Ian Duffy 1213180219 Resolve issue with build script for systemvm hanging due to libssl waiting on a input prompt caused by apt-get update 2014-05-15 07:08:01 +01:00
ynojima f21e527923 CLOUDSTACK-6614 bugfix: systemvm template build failed because of src iso link is broken 2014-05-08 16:48:18 -06:00
Daan Hoogland 9b26ca20fc build recent systemvm[64]templates 2014-02-27 17:48:18 +01:00
Daan Hoogland c1aa3a3f1a strip leading spaces from path 2014-02-27 16:11:52 +01:00
Hugo Trippaers 5e717cbb89 Fixed on master for jenkins buildslave 2014-02-19 16:21:43 +01:00
Hugo Trippaers fefddc0624 Dynamically detect the current branch and remove the build date from the systemvm name. This makes it easier to push them to the download location automagically. 2014-02-19 09:36:03 +01:00
Hugo Trippaers 28ac2f758e Every tar has it's own way of doing things 2014-02-05 11:48:53 +01:00
Hugo Trippaers 3df97bd663 Sync systemvm and systemvm64 build instructions 2014-02-05 11:21:23 +01:00
Hugo Trippaers 0ce488849d CLOUDSTACK-5932: update the definitions with the new debian version 2014-02-05 10:52:36 +01:00
Abhinandan Prateek 18191ce79a CLOUDSTACK-5932: updated script with the valid iso download urls 2014-02-05 10:38:26 +01:00
Abhinandan Prateek d578d7ef85 update packages list before getting jre 7
(cherry picked from commit 5121f8cd4e)
Signed-off-by: Hugo Trippaers <htrippaers@schubergphilis.com>
2014-01-31 09:42:31 +01:00
Abhinandan Prateek 0685371179 updating the jre to version 7 on system vms
(cherry picked from commit fc2e7ec70a)
Signed-off-by: Hugo Trippaers <htrippaers@schubergphilis.com>
2014-01-31 09:41:41 +01:00
Hugo Trippaers c2da280347 Add a zipped version of the hyperv image that we can store in the archives on the jenkins server 2014-01-23 09:06:33 +01:00
Hugo Trippaers ecf57c368a Adjust values for this version of vbox 2014-01-17 17:23:46 +01:00
Hugo Trippaers 50054fe060 Namespaces are important 2014-01-17 16:00:10 +01:00
Alena Prokharchyk dcf9607a46 Fixed code style errors breaking the build 2014-01-16 14:05:20 -08:00
Hugo Trippaers da8ee45a24 Why is the easy solution always to hard 2014-01-16 17:27:13 +01:00
Hugo Trippaers 95a92ad2e3 Fix typo in convert call 2014-01-16 16:41:46 +01:00
Hugo Trippaers 5d24843ef5 Proper cleanup before the next build of the systemvm 2014-01-16 16:03:56 +01:00
Hugo Trippaers bf26efc551 Little hack until we can install xsltproc on the buildslave 2014-01-16 15:33:05 +01:00
Hugo Trippaers 794d47c5f2 CLOUDSTACK-5883 Convert ovf file to proper format for ESXi 2014-01-16 14:43:44 +01:00
Hugo Trippaers 1b5f8e21a9 Fix typo 2014-01-09 14:42:34 +01:00
Hugo Trippaers d56a962445 Radvd is needed in the template so we can start testing with IPv6 2014-01-09 12:33:55 +01:00
Rajesh Battala fc306d13bf CLOUDSTACK-5602 cloudstack-release file in systemvm for hyperv is showing the release as 4.2. It should be 4.3
CLOUDSTACK-5538 additional libraries requires in systemvm for console proxy to work in HyperV
2013-12-27 14:58:23 +05:30
Abhinandan Prateek bbeb164abf CLOUDSTACK-5259: added 32 bit support for vhd-util 2013-12-12 14:48:08 +05:30
Rajesh Battala 9d50b0bb68 Adding cifs support to systemvm 64bit to support Hyperv 2013-12-04 15:53:27 +05:30
Rajesh Battala 4a61e928c4 Added hv kvp daemon support for 64 bit systemvm template to support system vms to run on HyperV. hv_kvp daemon is used to pass the boot args from host to the guest. 2013-12-03 12:17:09 +05:30
Jayapal 553a9ab853 CLOUDSTACK-4958 Removing installing monit from the postinstall.sh template script
Monit is AGPL package so removing it from the script which installs in template
2013-11-13 15:15:31 +05:30
Abhinandan Prateek 499a8c0915 syncing 64 bit svm scripts 2013-10-24 18:52:13 +05:30
John Kinsella 45e4d4fc3b Summary: Updated sudoers approved commands for cloud user
Detail: Previously the cloud user has full password-less sudo access.
This commit changes that to only allow access to a specific list of
commands. Been tested in production on ACS 4.0 and 4.2 mangement servers.

BUG-ID: CLOUDSTACK-967
Bugfix-for:
Reviewed-by:
Reported-by:
Signed-off-by: John Kinsella <jlk@stratosec.co> 1382560936 -0700
2013-10-23 13:42:16 -07:00
Hugo Trippaers c94c0b53fd Rename the definition to we avoid grep problems as grepping for systemvmtemplate would include systemvmtemplate64 2013-10-17 16:05:11 +02:00
Hugo Trippaers 789438651a Fix systemvm build scripts with the new location of the systemvm patches.
And wondering why they are included here and not in the systemvm.iso.

Also giving the systemvm a little more space to fix the out-of-diskspace error during the build
2013-10-17 14:57:33 +02:00
Darren Shepherd decc04b294 Run veewee using 'bundler exec'
Signed-off-by: Hugo Trippaers <htrippaers@schubergphilis.com>
2013-09-22 10:56:22 +08:00
Prasanna Santhanam 63f303933a testbuiltin: reduce the root disk size
faster bootup and use less space

Signed-off-by: Prasanna Santhanam <tsp@apache.org>
2013-08-07 15:47:53 +05:30
Prasanna Santhanam 03150fd6ee CLOUDSTACK-3797: Including httpd permission and test page
- add a test page for the http service
- startup on boot
- configure iptables port :80
- cleanup iso files

Signed-off-by: Prasanna Santhanam <tsp@apache.org>
2013-07-28 12:21:02 +05:30
Prasanna Santhanam 0f7870332a CLOUDSTACK-3797: Fix wget installation of xs-tools in to the builtin
Signed-off-by: Prasanna Santhanam <tsp@apache.org>
2013-07-27 00:02:28 +05:30
Prasanna Santhanam 4bf7abcbe9 CLOUDSTACK-3797: remove duplicate packages from base.sh already in postinstall.sh
Signed-off-by: Prasanna Santhanam <tsp@apache.org>
2013-07-27 00:02:28 +05:30
Prasanna Santhanam 26a0fd5af9 CLOUDSTACK-3797: Builtin appliance definition using veewee
This appliance will be used for testing purposes only. The appliance
will replace the built-in in a test environment before deployment.

Some of the integration tests require specific services running within
guests to test for cloudstack features. Eg: VPC LB needs an httpd server
running. When we need to customize the template this appliance can be
used instead of having custom templates for each test.

Signed-off-by: Prasanna Santhanam <tsp@apache.org>
2013-07-26 17:34:00 +05:30
Prasanna Santhanam b020bcfb49 CLOUDSTACK-2481: SystemVM template 64-bit patched with vhd-util
This allows a template of a snapshot operation

Signed-off-by: Prasanna Santhanam <tsp@apache.org>
(cherry picked from commit 337811dd810e413238a012381ae1c84d1e1fac7c)
2013-07-13 10:43:58 +05:30
Edison Su d51fa1c063 set vhd-util executable 2013-07-12 10:59:38 -07:00
Edison Su cf4dba34a4 Don't generate bzipped hyperv image 2013-06-27 12:09:39 -07:00
Hiroaki KAWAI 29c39e8f4e Add check for some cli programs
Add check for faketime and vhd-util for xen export.
2013-06-27 13:04:12 +09:00
Hiroaki KAWAI c484d8aaba Add notes about systemvm build script 2013-06-26 15:16:29 +09:00
Prasanna Santhanam 4591f94a0b Debian 7.0.0 in archives
Debian released 7.1 and moved the old image to archives. Updated with
the archives link to the -netinst image.

Signed-off-by: Prasanna Santhanam <tsp@apache.org>
2013-06-22 16:25:22 +05:30
Edison Su 5456d0d85e CLOUDSTACK-2481: add vhd-util in system vm template 2013-06-20 17:51:38 -07:00
Prasanna Santhanam 1c6e1012dc Fix the build system VM job
When both systemvmtemplate64 and systemvmtemplate are present the grep
match fails and returns (non-deterministically) the 64bit appliance
instead of the 32bit one. Fix this by matching the path separater as
well.

Signed-off-by: Prasanna Santhanam <tsp@apache.org>
2013-06-12 20:25:20 +05:30
Chiradeep Vittal cb80ae2440 Debian repository (backports) now has latest haproxy, re-introduce into systemvm 2013-06-07 17:29:14 -07:00
Shane Witbeck 5fa1ad518f fix for incorrect secondary dns 2013-06-05 17:21:44 -04:00
Abhinandan Prateek 3000cb31af CLOUDSTACK-2434: Enable irq balance on system VM 2013-05-30 17:35:30 +05:30
Chiradeep Vittal 521e156520 CLOUDSTACK-2521: auto download ISO if not present 2013-05-15 15:33:57 -07:00
Nitin Mehta c11dbad9c9 merge master 2013-05-11 15:28:43 +05:30
Rohit Yadav 81e1ba3bb4 appliance: Don't mkdir 70-persistent-net.rules for systemvms
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-04-19 09:05:42 +05:30
Rohit Yadav d39a06c0e9 Revert "appliance: Revertible patch to create half baked template for vmware"
This reverts commit 91faf2d14a.
2013-04-11 15:35:28 +05:30
Rohit Yadav 91faf2d14a appliance: Revertible patch to create half baked template for vmware
This is to allow buildjob to produce semi-automate template for vmware.

Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-04-11 15:23:04 +05:30
Rohit Yadav 09542ce70a appliance: Fix preseed, sum of partitions should be 2000M
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-04-11 00:09:12 +05:30
Rohit Yadav ed79b8bf14 CLOUDSTACK-1867: Comment vmware-tools installation, use open-vm-tools
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-04-10 23:14:50 +05:30
Rohit Yadav 9fca393f01 appliance: Install open-vm-tools, vmwaretools alternative
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-04-10 18:10:03 +05:30
Rohit Yadav 11042121b2 appliance: only build-essential needed to build vmtools
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-04-10 18:04:54 +05:30
Rohit Yadav 26695151f6 appliance: Permute again, give some more megas to /usr for systemvm
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-04-10 18:01:49 +05:30
Rohit Yadav bdc82627fe appliance: Permute partition space such as it succeeds during partitioning
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-04-10 17:04:51 +05:30
Rohit Yadav dc3c834a22 appliance: Feed more disk space to /usr
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-04-10 16:47:33 +05:30
Rohit Yadav b50201e69c appliance: Make more room in /usr, installing vmwaretools takes 'em all
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-04-10 16:27:56 +05:30
Rohit Yadav 26d772f740 CLOUDSTACK-1867: Install vmwaretools while buildling systemvms
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-04-10 16:06:54 +05:30
Rohit Yadav 9eaef0e7c7 appliance: Fix systemvm's preseed to give more space for /usr
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-04-10 16:06:54 +05:30
Rohit Yadav 643ee1d15e CLOUDSTACK-1867: Export both ova and vmdk systemvm appliances for VMWare
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-04-10 13:05:54 +05:30
Rohit Yadav b3a3ad74c6 appliance: While building systemvms fetch src tarball from new git repo
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-03-26 11:26:50 +05:30
Rohit Yadav 87500f9796 appliance: veewee definition to build devcloud, work in progress
forked from systemvmtemplate

Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-03-25 14:52:36 +05:30
Rohit Yadav 99ed891804 appliance: Fix readme and zerodisk /home
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-03-18 11:00:39 +05:30
Rohit Yadav 9af338c651 appliance: While building don't just check empty arg, check if it was passed
The fix makes systemvmtemplate as the default veewee vbox appliance if not
other appliance is provided to be built

Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-03-12 17:58:15 +05:30
Rohit Yadav 7e7ceba83b appliance: Fix hardcoded appliance name while checking and removing shared folders
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-03-11 14:56:20 +05:30
Rohit Yadav 72c1a888eb appliance: Fix build.sh to build 64bit systemvm appliance as well
TODO: Make it general like boxer.sh in tools/devcloud/src

Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-03-11 14:19:30 +05:30
Rohit Yadav 9f4444c9e4 appliance: Add veewee definition for 64bit systemvm template
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-03-11 14:10:44 +05:30
Rohit Yadav 602ca7fe6d appliance: during cleanup remove veewee and vbox txt files
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-03-07 16:50:37 +05:30
Rohit Yadav c2fbac4166 appliance: Use Debian Wheezy rc1 for building systemvm
We switch from Debian beta-4 i386 to rc1 i386.

Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-03-07 15:01:01 +05:30
Rohit Yadav bb2c7dc728 CLOUDSTACK-1340: Fix grub2 cfg to boot without waiting, fix locale
Thanks to Marcus for testing and helping on KVM template, adding locale fix as
per Marcus's suggestion. Tested with latest build on my local vbox.

Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-03-06 14:21:06 +05:30
Rohit Yadav 34b37ef8ed CLOUDSTACK-1340: Compress QCOW2 for KVM
As suggested by Marcus, by compression qcow2, we end up having smaller disk image.
I'm still archiving the qcow2 as bz2 because our installation manual still ask
users to cloud-install-sys-tmplt which expects a *.qcow2.bz2

Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-03-05 18:35:09 +05:30
Rohit Yadav b55f5898d5 CLOUDSTACK-1340: Exit script if exporting fails for any disk format
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-03-01 21:02:04 +05:30
Rohit Yadav 26edb3c0aa CLOUDSTACK-1340: Just take the first of results, query and remove shared folders
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-03-01 20:39:52 +05:30
Rohit Yadav 0f30c1e6b0 CLOUDSTACK-1340: Fix typo in variable in build.sh
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-03-01 20:04:03 +05:30
Rohit Yadav 512c16f483 CLOUDSTACK-1340: Do two rounds of vhd export, from raw to fixed to dynamic
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-03-01 16:59:02 +05:30
Rohit Yadav 0b07bc974a CLOUDSTACK-1340: Remove any shared folders, don't install legacy grub
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-03-01 15:08:19 +05:30
Rohit Yadav e80ccea517 CLOUDSTACK-1340: Jenkins fails for changing directories, rvm sourcing fails
http://jenkins.cloudstack.org/job/build-systemvm-master/64/console

Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-28 17:37:02 +05:30
Rohit Yadav 44f345e4c6 CLOUDSTACK-1340: Fix destination path issue, vbox's internalcommands issue
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-28 16:55:41 +05:30
Rohit Yadav 80a6aaf7e1 CLOUDSTACK-1340: Fix locale, cmd, disk size and remove multiple apt-get installs
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-28 16:15:09 +05:30
Rohit Yadav 6380e2004c CLOUDSTACK-1340: apt-get autoclean and then clean to remove cached debs
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-28 16:02:44 +05:30
Rohit Yadav 673700a1a2 CLOUDSTACK-1340: Fix raw disk export using vbox internalcommand
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-28 15:58:50 +05:30
Rohit Yadav 644a73bb2f CLOUDSTACK-1340: Don't remove all scripts in /root, rm only those copied by veewee
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-28 13:19:59 +05:30
Rohit Yadav a5ab63602d CLOUDSTACK-1340: Fix typos, paths, create user cloud and make 'em invincible
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-27 18:40:51 +05:30
Rohit Yadav 9c6ced96c1 CLOUDSTACK-1340: Fix path issues in postinstall.sh, zerodisk on all partitions
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-27 17:56:55 +05:30
Rohit Yadav 51f66e2b52 CLOUDSTACK-1340: Correct paths used to create cloud-script.tar, fix debug msgs
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-27 17:16:18 +05:30
Rohit Yadav ff32ae5305 CLOUDSTACK-1340: During cleanup deluser vagrant, sync after zero-ing the disk
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-27 17:00:17 +05:30
Rohit Yadav 23be2e7ba0 CLOUDSTACK-1340: Shrink the final virtual disk, vmdk was not supported, use vdi
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-27 16:59:34 +05:30
Rohit Yadav aabaf25ce4 CLOUDSTACK-1340: Install scripts and packages which were in previous systemvm
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-27 16:37:57 +05:30
Chiradeep Vittal 091682cf67 CLOUDSTACK-1066: remove useless config.dat 2013-02-19 23:36:08 -08:00
Rohit Yadav e85b1cbe8f CLOUDSTACK-1066: Fix README for building systemvm appliance
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-19 14:01:50 +05:30
Rohit Yadav e24e6d747c CLOUDSTACK-1066: Make appliance export verbose, put archived images in dist/
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-19 13:25:23 +05:30
Rohit Yadav a5f77d348d CLOUDSTACK-1066: RVM needs a login shell, fix build.sh to start with a login shell
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-19 12:31:32 +05:30
Rohit Yadav a6f5052958 CLOUDSTACK-1066: Wait for appliance to shutdown before exporting to various fmts
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-19 11:42:34 +05:30
Rohit Yadav c97653b42e systemvmtemplate: Clean any old vm before building appliance
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-18 21:33:15 +05:30
Rohit Yadav a4ed061dbf systemvmtemplate: Fix build.sh to export ova, vhd, qcow2 and vhd-hyperv
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-18 18:52:03 +05:30
Rohit Yadav ab63a433ec systemvmtemplate: Fix definitions and partition map
- Fix definitions, create vhd (virtual disk) format (reusable for hyperv)
- Fix partition maps in preseed, create /boot, /home, /var, /usr, /opt etc.

Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-18 18:52:02 +05:30
Rohit Yadav 825c1c17a1 CLOUDSTACK-1066: Add building script to build appliance
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-15 19:51:26 +05:30
Rohit Yadav 98c0a4fb9d CLOUDSTACK-1066: Fix FIXMEs, rename script to postinstall.sh
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-12 18:28:55 +05:30
Rohit Yadav 4b268c4ae6 CLOUDSTACK-1066: Add random password for cloud, fix trailing whitespaces, cleanup isos
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-12 17:58:17 +05:30
Chip Childers ebe738ee20 CLOUDSTACK-1233: Fixed veewee config file legal documentation
The veewee configuration files used for the devcloud base-box build, as
well as the newly introduced files used to create a system vm, were
inappropriately identified as ASLv2 licensed and copyrighted by the ASF.

The fixes:
- The ASF headers stripped to match the source.
- The files are now excluded from RAT checks in the root pom.
- The tools/whisker/descriptor.xml file updated
- The root LICENSE and NOTICE were re-generated

Changes in the Apache Whisker templates for LICENSE and NOTICE files
caused a good bit of whitespace oddness in this commit for those 2
files.

Signed-off-by: Chip Childers <chip.childers@gmail.com>
2013-02-11 21:40:06 -05:00
Chiradeep Vittal 9e13533e21 CLOUDSTACK-1066: fetch cloudstack init files for systemvm from git.
Currently fetching from HEAD, for a particular branch it should be fetched from the respective branch
2013-02-11 10:25:10 -08:00
Chiradeep Vittal 78b00f51a9 CLOUDSTACK-1066: fixes
cloudstack-packages: fixes install_packages (diff -> diffutils),
                     use debconf-set-selections for iptables-persistent
preseed.cfg : change root password, use separate partitions for /usr /var /home
definition.rb: reset timeout to sane value
cleanup.sh, zerodisk.sh: move wipe of root directory to zerodisk
2013-02-08 17:44:56 -08:00
Chiradeep Vittal 606fa9df70 Add ASL to scripts as a temporary workaround for RAT breakage. This will get changed to MIT license later 2013-02-08 13:05:24 -08:00
Chiradeep Vittal 82dc16e58a CLOUDSTACK-1066: no need for build helpers. Also reduces attack surface of system vm
CLOUDSTACK-1066: no need for busybox and dictionaries

CLOUDSTACK-1066: fix bug in generating signature

CLOUDSTACK-1066: don't confuse veewee about root password
Clean up stuff copied in to vm by veewee
2013-02-08 12:52:41 -08:00
Chiradeep Vittal 31791e241d CLOUDSTACK-1066: fix openswan install to not require interactive input 2013-02-08 12:52:19 -08:00
Chiradeep Vittal eaaf880dcf CLOUDSTACK-1066: add license and attribution 2013-02-07 19:06:47 -08:00
Chiradeep Vittal 97833c9f93 CLOUDSTACK-1066: bug fixes to cloudstack package script 2013-02-07 19:02:22 -08:00
Chiradeep Vittal ee9baefe3f CLOUDSTACK-1066: restore modularity in config files by splitting postinstall tasks
Add config.dat to ensure that openswan install does not hang asking for user input
2013-02-07 19:02:22 -08:00
Chiradeep Vittal 990d20b67b CLOUDSTACK-1066 slim down the package by not choosing 'standard'.
Allow root user to login (FIXME) otherwise veewee is unable to login
2013-02-07 19:02:21 -08:00
Chiradeep Vittal 3dea9a7be5 Summary: Remove superfluous chroot and change to use standard jre
Detail: Since the script executes inside the running vm, the chroot is not necessary. Also the standard jre is used instead of sun jre.

BUG-ID: CLOUDSTACK-1066
Signed-off-by: Chiradeep Vittal <chiradeep@apache.org> 1360277071 -0800
2013-02-07 14:48:18 -08:00
Rohit Yadav 04d51c9e4d CLOUDSTACK-1066: Fix only one postinstall script, install packages etc.
- Remove different scripts, just use postinstall.sh that runs after basic appliance
  is built using veewee
- Port package installation method from old script
- Time the installation/build process

Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-07 17:42:35 +05:30
Rohit Yadav f97e2a6297 CLOUDSTACK-1066: Add definitions for building systemvm template appliance
Signed-off-by: Rohit Yadav <bhaisaab@apache.org>
2013-02-05 18:02:52 +05:30