cloudstack/tools/appliance
Nicolas Vazquez e86bb41e0e CLOUDSTACK-10146: Bypass Secondary Storage for KVM templates (#2379)
This feature allows using templates and ISOs avoiding secondary storage as intermediate cache on KVM. The virtual machine deployment process is enhanced to supported bypassed registered templates and ISOs, delegating the work of downloading them to primary storage to the KVM agent instead of the SSVM agent.

Template and ISO registration:
- When hypervisor is KVM, a checkbox is displayed with 'Direct Download' label.
- API methods registerTemplate and registerISO are both extended with this new parameter directdownload.
- On template or ISO registration, no download job is sent to SSVM agent, CloudStack would only persist an entry on template_store_ref indicating that template or ISO has been marked as 'Direct Download' (bypassing Secondary Storage). These entries are persisted as:
template_id = Template or ISO id on vm_template table
store_id NULL
download_state = BYPASSED
state = Ready
(Note: these entries allow users to deploy virtual machine from registered templates or ISOs)
- An URL validation command is sent to a random KVM host to check if template/ISO location can be reached. Metalink are also supported by this feature. In case of a metalink, it is fetched and URL check is performed on each of its URLs.
- Checksum should be provided as indicated on #2246: {ALGORITHM}CHKSUMHASH
- After template or ISO is registered, it would be displayed in the UI

Virtual machine deployment:
When a 'Direct Download' template is selected for deployment, CloudStack would delegate template downloading to destination storage pool via destination host by a new pluggable download manager.
Download manager would handle template downloading depending on URL protocol. In case of HTTP, request headers can be set by the user via vm_template_details. Those details should be persisted as:
Key: HTTP_HEADER
Value: HEADERNAME:HEADERVALUE

In case of HTTPS, a new API method is added uploadTemplateDirectDownloadCertificate to allow user importing a client certificate into all KVM hosts' keystore before deployment.
After template or ISO is downloaded to primary storage, usual entry would be persisted on template_spool_ref indicating the mapping between template/ISO and storage pool.
2018-01-09 12:22:18 +05:30
..
builtin CLOUDSTACK-10194: Use packer for building systemvmtemplates 2017-12-23 09:22:44 +05:30
systemvmtemplate CLOUDSTACK-10146: Bypass Secondary Storage for KVM templates (#2379) 2018-01-09 12:22:18 +05:30
README.md CLOUDSTACK-10194: Use packer for building systemvmtemplates 2017-12-23 09:22:44 +05:30
build.sh CLOUDSTACK-10194: Use packer for building systemvmtemplates 2017-12-23 09:22:44 +05:30
shar_cloud_scripts.sh CLOUDSTACK-10194: Use packer for building systemvmtemplates 2017-12-23 09:22:44 +05:30

README.md

Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

===========================================================

Introduction

This is used to build appliances for use with CloudStack. Currently two build profiles are available for building systemvmtemplate (Debian based) and CentOS based built-in user VM template.

Setting up Tools and Environment

  • Install packer and latest KVM, qemu on a Linux machine

  • Install tools for exporting appliances: qemu-img, ovftool, faketime

  • Build and install vhd-util as described in build.sh or use pre-built binaries at:

    http://packages.shapeblue.com/systemvmtemplate/vhd-util
    http://packages.shapeblue.com/systemvmtemplate/libvhd.so.1.0
    

How to build appliances

Just run build.sh, it will export archived appliances for KVM, XenServer, VMWare and HyperV in dist directory:

bash build.sh systemvmtemplate
bash build.sh builtin