mirror of https://github.com/apache/cloudstack.git
ea90848429
This pull request (PR) implements a Distributed Resource Scheduler (DRS) for a CloudStack cluster. The primary objective of this feature is to enable automatic resource optimization and workload balancing within the cluster by live migrating the VMs as per configuration.
Administrators can also execute DRS manually for a cluster, using the UI or the API.
Adds support for two algorithms - condensed & balanced. Algorithms are pluggable allowing ACS Administrators to have customized control over scheduling.
Implementation
There are three top level components:
Scheduler
A timer task which:
Generate DRS plan for clusters
Process DRS plan
Remove old DRS plan records
DRS Execution
We go through each VM in the cluster and use the specified algorithm to check if DRS is required and to calculate cost, benefit & improvement of migrating that VM to another host in the cluster. On the basis of cost, benefit & improvement, the best migration is selected for the current iteration and the VM is migrated. The maximum number of iterations (live migrations) possible on the cluster is defined by drs.iterations which is defined as a percentage (as a value between 0 and 1) of total number of workloads.
Algorithm
Every algorithms implements two methods:
needsDrs - to check if drs is required for cluster
getMetrics - to calculate cost, benefit & improvement of a migrating a VM to another host.
Algorithms
Condensed - Packs all the VMs on minimum number of hosts in the cluster.
Balanced - Distributes the VMs evenly across hosts in the cluster.
Algorithms use drs.level to decide the amount of imbalance to allow in the cluster.
APIs Added
listClusterDrsPlan
id - ID of the DRS plan to list
clusterid - to list plans for a cluster id
generateClusterDrsPlan
id - cluster id
iterations - The maximum number of iterations in a DRS job defined as a percentage (as a value between 0 and 1) of total number of workloads. Defaults to value of cluster's drs.iterations setting.
executeClusterDrsPlan
id - ID of the cluster for which DRS plan is to be executed.
migrateto - This parameter specifies the mapping between a vm and a host to migrate that VM. Format of this parameter: migrateto[vm-index].vm=<uuid>&migrateto[vm-index].host=<uuid>.
Config Keys Added
ClusterDrsPlanExpireInterval
Key drs.plan.expire.interval
Scope Global
Default Value 30 days
Description The interval in days after which old DRS records will be cleaned up.
ClusterDrsEnabled
Key drs.automatic.enable
Scope Cluster
Default Value false
Description Enable/disable automatic DRS on a cluster.
ClusterDrsInterval
Key drs.automatic.interval
Scope Cluster
Default Value 60 minutes
Description The interval in minutes after which a periodic background thread will schedule DRS for a cluster.
ClusterDrsIterations
Key drs.max.migrations
Scope Cluster
Default Value 50
Description Maximum number of live migrations in a DRS execution.
ClusterDrsAlgorithm
Key drs.algorithm
Scope Cluster
Default Value condensed
Description DRS algorithm to execute on the cluster. This PR implements two algorithms - balanced & condensed.
ClusterDrsLevel
Key drs.imbalance
Scope Cluster
Default Value 0.5
Description Percentage (as a value between 0.0 and 1.0) of imbalance allowed in the cluster. 1.0 means no imbalance
is allowed and 0.0 means imbalance is allowed.
ClusterDrsMetric
Key drs.imbalance.metric
Scope Cluster
Default Value memory
Description The cluster imbalance metric to use when checking the drs.imbalance.threshold. Possible values are memory and cpu.
|
||
|---|---|---|
| .. | ||
| __init__.py | ||
| test_2fa.py | ||
| test_accounts.py | ||
| test_affinity_groups.py | ||
| test_affinity_groups_projects.py | ||
| test_annotations.py | ||
| test_async_job.py | ||
| test_attach_multiple_volumes.py | ||
| test_backup_recovery_dummy.py | ||
| test_certauthority_root.py | ||
| test_cluster_drs.py | ||
| test_console_endpoint.py | ||
| test_create_list_domain_account_project.py | ||
| test_create_network.py | ||
| test_deploy_vgpu_enabled_vm.py | ||
| test_deploy_virtio_scsi_vm.py | ||
| test_deploy_vm_extra_config_data.py | ||
| test_deploy_vm_iso.py | ||
| test_deploy_vm_iso_uefi.py | ||
| test_deploy_vm_root_resize.py | ||
| test_deploy_vm_with_userdata.py | ||
| test_deploy_vms_in_parallel.py | ||
| test_deploy_vms_with_varied_deploymentplanners.py | ||
| test_diagnostics.py | ||
| test_direct_download.py | ||
| test_disk_offerings.py | ||
| test_disk_provisioning_types.py | ||
| test_domain_disk_offerings.py | ||
| test_domain_network_offerings.py | ||
| test_domain_service_offerings.py | ||
| test_domain_vpc_offerings.py | ||
| test_dynamicroles.py | ||
| test_enable_account_settings_for_domain.py | ||
| test_enable_role_based_users_in_projects.py | ||
| test_events_resource.py | ||
| test_gateway_on_shared_networks.py | ||
| test_global_settings.py | ||
| test_guest_os.py | ||
| test_guest_vlan_range.py | ||
| test_host_control_state.py | ||
| test_host_maintenance.py | ||
| test_hostha_kvm.py | ||
| test_hostha_simulator.py | ||
| test_human_readable_logs.py | ||
| test_internal_lb.py | ||
| test_ipv6_infra.py | ||
| test_iso.py | ||
| test_kubernetes_clusters.py | ||
| test_kubernetes_supported_versions.py | ||
| test_list_ids_parameter.py | ||
| test_loadbalance.py | ||
| test_login.py | ||
| test_metrics_api.py | ||
| test_migration.py | ||
| test_multipleips_per_nic.py | ||
| test_nested_virtualization.py | ||
| test_network.py | ||
| test_network_acl.py | ||
| test_network_ipv6.py | ||
| test_network_permissions.py | ||
| test_nic.py | ||
| test_nic_adapter_type.py | ||
| test_non_contigiousvlan.py | ||
| test_nonstrict_affinity_group.py | ||
| test_outofbandmanagement.py | ||
| test_outofbandmanagement_nestedplugin.py | ||
| test_over_provisioning.py | ||
| test_password_server.py | ||
| test_persistent_network.py | ||
| test_portable_publicip.py | ||
| test_portforwardingrules.py | ||
| test_primary_storage.py | ||
| test_private_roles.py | ||
| test_privategw_acl.py | ||
| test_privategw_acl_ovs_gre.py | ||
| test_projects.py | ||
| test_public_ip_range.py | ||
| test_pvlan.py | ||
| test_regions.py | ||
| test_register_userdata.py | ||
| test_reset_configuration_settings.py | ||
| test_reset_vm_on_reboot.py | ||
| test_resource_accounting.py | ||
| test_resource_detail.py | ||
| test_router_dhcphosts.py | ||
| test_router_dns.py | ||
| test_router_dnsservice.py | ||
| test_routers.py | ||
| test_routers_iptables_default_policy.py | ||
| test_routers_network_ops.py | ||
| test_safe_shutdown.py | ||
| test_scale_vm.py | ||
| test_secondary_storage.py | ||
| test_service_offerings.py | ||
| test_set_sourcenat.py | ||
| test_snapshots.py | ||
| test_ssvm.py | ||
| test_staticroles.py | ||
| test_storage_policy.py | ||
| test_templates.py | ||
| test_update_security_group.py | ||
| test_usage.py | ||
| test_usage_events.py | ||
| test_vm_autoscaling.py | ||
| test_vm_deployment_planner.py | ||
| test_vm_life_cycle.py | ||
| test_vm_lifecycle_unmanage_import.py | ||
| test_vm_schedule.py | ||
| test_vm_snapshot_kvm.py | ||
| test_vm_snapshots.py | ||
| test_volumes.py | ||
| test_vpc_ipv6.py | ||
| test_vpc_redundant.py | ||
| test_vpc_router_nics.py | ||
| test_vpc_vpn.py | ||