mirror of https://github.com/apache/cloudstack.git
eba186aa40
Added support for PowerFlex/ScaleIO (v3.5 onwards) storage pool as a primary storage in CloudStack (for KVM hypervisor) and enabled VM/Volume operations on that pool (using pool tag). Please find more details in the FS here: https://cwiki.apache.org/confluence/x/cDl4CQ Documentation PR: apache/cloudstack-documentation#169 This enables support for PowerFlex/ScaleIO (v3.5 onwards) storage pool as a primary storage in CloudStack Other improvements addressed in addition to PowerFlex/ScaleIO support: - Added support for config drives in host cache for KVM => Changed configuration "vm.configdrive.primarypool.enabled" scope from Global to Zone level => Introduced new zone level configuration "vm.configdrive.force.host.cache.use" (default: false) to force host cache for config drives => Introduced new zone level configuration "vm.configdrive.use.host.cache.on.unsupported.pool" (default: true) to use host cache for config drives when storage pool doesn't support config drive => Added new parameter "host.cache.location" (default: /var/cache/cloud) in KVM agent.properties for specifying the host cache path and create config drives on the "/config" directory on the host cache path => Maintain the config drive location and use it when required on any config drive operation (migrate, delete) - Detect virtual size from the template URL while registering direct download qcow2 (of KVM hypervisor) templates - Updated full deployment destination for preparing the network(s) on VM start - Propagate the direct download certificates uploaded to the newly added KVM hosts - Discover the template size for direct download templates using any available host from the zones specified on template registration => When zones are not specified while registering template, template size discovery is performed using any available host, which is picked up randomly from one of the available zones - Release the VM resources when VM is sync-ed to Stopped state on PowerReportMissing (after graceful period) - Retry VM deployment/start when the host cannot grant access to volume/template - Mark never-used or downloaded templates as Destroyed on deletion, without sending any DeleteCommand => Do not trigger any DeleteCommand for never-used or downloaded templates as these doesn't exist and cannot be deleted from the datastore - Check the router filesystem is writable or not, before performing health checks => Introduce a new test "filesystem.writable.test" to check the filesystem is writable or not => The router health checks keeps the config info at "/var/cache/cloud" and updates the monitor results at "/root" for health checks, both are different partitions. So, test at both the locations. => Added new script: "filesystem_writable_check.py" at /opt/cloud/bin/ to check the filesystem is writable or not - Fixed NPE issue, template is null for DATA disks. Copy template to target storage for ROOT disk (with template id), skip DATA disk(s) * Addressed some issues for few operations on PowerFlex storage pool. - Updated migration volume operation to sync the status and wait for migration to complete. - Updated VM Snapshot naming, for uniqueness in ScaleIO volume name when more than one volume exists in the VM. - Added sync lock while spooling managed storage template before volume creation from the template (non-direct download). - Updated resize volume error message string. - Blocked the below operations on PowerFlex storage pool: -> Extract Volume -> Create Snapshot for VMSnapshot * Added the PowerFlex/ScaleIO client connection pool to manage the ScaleIO gateway clients, which uses a single gateway client per Powerflex/ScaleIO storage pool and renews it when the session token expires. - The token is valid for 8 hours from the time it was created, unless there has been no activity for 10 minutes. Reference: https://cpsdocs.dellemc.com/bundle/PF_REST_API_RG/page/GUID-92430F19-9F44-42B6-B898-87D5307AE59B.html Other fixes included: - Fail the VM deployment when the host specified in the deployVirtualMachine cmd is not in the right state (i.e. either Resource State is not Enabled or Status is not Up) - Use the physical file size of the template to check the free space availability on the host, while downloading the direct download templates. - Perform basic tests (for connectivity and file system) on router before updating the health check config data => Validate the basic tests (connectivity and file system check) on router => Cleanup the health check results when router is destroyed * Updated PowerFlex/ScaleIO storage plugin version to 4.16.0.0 * UI Changes to support storage plugin for PowerFlex/ScaleIO storage pool. - PowerFlex pool URL generated from the UI inputs(Gateway, Username, Password, Storage Pool) when adding "PowerFlex" Primary Storage - Updated protocol to "custom" for PowerFlex provider - Allow VM Snapshot for stopped VM on KVM hypervisor and PowerFlex/ScaleIO storage pool and Minor improvements in PowerFlex/ScaleIO storage plugin code * Added support for PowerFlex/ScaleIO volume migration across different PowerFlex storage instances. - findStoragePoolsForMigration API returns PowerFlex pool(s) of different instance as suitable pool(s), for volume(s) on PowerFlex storage pool. - Volume(s) with snapshots are not allowed to migrate to different PowerFlex instance. - Volume(s) of running VM are not allowed to migrate to other PowerFlex storage pools. - Volume migration from PowerFlex pool to Non-PowerFlex pool, and vice versa are not supported. * Fixed change service offering smoke tests in test_service_offerings.py, test_vm_snapshots.py * Added the PowerFlex/ScaleIO volume/snapshot name to the paths of respective CloudStack resources (Templates, Volumes, Snapshots and VM Snapshots) * Added new response parameter “supportsStorageSnapshot” (true/false) to volume response, and Updated UI to hide the async backup option while taking snapshot for volume(s) with storage snapshot support. * Fix to remove the duplicate zone wide pools listed while finding storage pools for migration * Updated PowerFlex/ScaleIO volume migration checks and rollback migration on failure * Fixed the PowerFlex/ScaleIO volume name inconsistency issue in the volume path after migration, due to rename failure |
||
|---|---|---|
| .. | ||
| misc | ||
| __init__.py | ||
| test_accounts.py | ||
| test_affinity_groups.py | ||
| test_affinity_groups_projects.py | ||
| test_async_job.py | ||
| test_backup_recovery_dummy.py | ||
| test_certauthority_root.py | ||
| test_create_list_domain_account_project.py | ||
| test_create_network.py | ||
| test_deploy_vgpu_enabled_vm.py | ||
| test_deploy_virtio_scsi_vm.py | ||
| test_deploy_vm_extra_config_data.py | ||
| test_deploy_vm_iso.py | ||
| test_deploy_vm_root_resize.py | ||
| test_deploy_vm_with_userdata.py | ||
| test_deploy_vms_with_varied_deploymentplanners.py | ||
| test_diagnostics.py | ||
| test_direct_download.py | ||
| test_disk_offerings.py | ||
| test_domain_disk_offerings.py | ||
| test_domain_network_offerings.py | ||
| test_domain_service_offerings.py | ||
| test_domain_vpc_offerings.py | ||
| test_dynamicroles.py | ||
| test_enable_role_based_users_in_projects.py | ||
| test_global_settings.py | ||
| test_guest_vlan_range.py | ||
| test_host_annotations.py | ||
| test_host_maintenance.py | ||
| test_hostha_kvm.py | ||
| test_hostha_simulator.py | ||
| test_human_readable_logs.py | ||
| test_internal_lb.py | ||
| test_iso.py | ||
| test_kubernetes_clusters.py | ||
| test_kubernetes_supported_versions.py | ||
| test_list_ids_parameter.py | ||
| test_loadbalance.py | ||
| test_login.py | ||
| test_metrics_api.py | ||
| test_migration.py | ||
| test_multipleips_per_nic.py | ||
| test_nested_virtualization.py | ||
| test_network.py | ||
| test_network_acl.py | ||
| test_nic.py | ||
| test_nic_adapter_type.py | ||
| test_non_contigiousvlan.py | ||
| test_outofbandmanagement.py | ||
| test_outofbandmanagement_nestedplugin.py | ||
| test_over_provisioning.py | ||
| test_password_server.py | ||
| test_portable_publicip.py | ||
| test_portforwardingrules.py | ||
| test_primary_storage.py | ||
| test_privategw_acl.py | ||
| test_projects.py | ||
| test_public_ip_range.py | ||
| test_pvlan.py | ||
| test_regions.py | ||
| test_reset_vm_on_reboot.py | ||
| test_resource_accounting.py | ||
| test_resource_detail.py | ||
| test_router_dhcphosts.py | ||
| test_router_dns.py | ||
| test_router_dnsservice.py | ||
| test_routers.py | ||
| test_routers_iptables_default_policy.py | ||
| test_routers_network_ops.py | ||
| test_scale_vm.py | ||
| test_secondary_storage.py | ||
| test_service_offerings.py | ||
| test_snapshots.py | ||
| test_ssvm.py | ||
| test_staticroles.py | ||
| test_storage_policy.py | ||
| test_templates.py | ||
| test_update_security_group.py | ||
| test_usage.py | ||
| test_usage_events.py | ||
| test_vm_deployment_planner.py | ||
| test_vm_life_cycle.py | ||
| test_vm_snapshots.py | ||
| test_volumes.py | ||
| test_vpc_redundant.py | ||
| test_vpc_router_nics.py | ||
| test_vpc_vpn.py | ||