Commit Graph

979 Commits

Author SHA1 Message Date
Kelven Yang 50f311ed94 CLOUDSTACK-5928: disable host delta sync when new VM sync is enabled 2014-01-22 11:17:25 -08:00
Mike Tutkowski 0679af3434 CLOUDSTACK-5873: [Automation] Failed to attach volume to VM, if the vm is created with option startvm=false 2014-01-22 11:08:57 -07:00
Likitha Shetty 94ea2736f4 CLOUDSTACK-5927. Storage garbage collector is trying to destroy the SSVM/CPVM root disk that is in use.
In case of VMware VM during root volume preparation if we are switching to a new volume, force expunge root disk that was created from the old template.
Because otherwise storage garbage collector will later try to expunge the old disk marked for expunge and fail with 'Cannot delete file' exception
since in VMware the new root vmdk has the same name and is now in use.
2014-01-22 17:32:13 +05:30
Animesh Chaturvedi 70ba92fc14 Updating pom.xml version numbers for release 4.3.0
Signed-off-by: Animesh Chaturvedi <animesh@apache.org>
2014-01-21 17:29:51 -08:00
Min Chen afb8a79321 CLOUDSTACK-5921: S3 security key is stored in DB unencrypted 2014-01-21 14:17:30 -08:00
edison 1b064515ac CLOUDSTACK-5432: potential bugs in case of stop mgt server while template is downloading, template_store_ref has leftover not in ready state, when create vm from that template, the code doesn't check either zone id, nor template_store_ref state. 2014-01-20 17:15:23 -08:00
Kelven Yang 8db0d83d1a CLOUDSTACK-5358: Bring back concurrency control in sync-queue management 2014-01-20 16:53:33 -08:00
edison 27fd490885 CLOUDSTACK-5329: stupid java box/unbox 2014-01-20 10:43:32 -08:00
Mike Tutkowski 0e053668b8 CLOUDSTACK-5873: [Automation] Failed to attach volume to VM, if the vm is created with option startvm=false 2014-01-18 12:36:53 -07:00
edison 7c2449dabd CLOUDSTACK-5432:sync vm and storage commands on mgt server for kvm 2014-01-17 15:23:43 -08:00
Prachi Damle c2902db0b1 CLOUDSTACK-5895: CreateVolumeFromSnapshot can fail in a multiple pod environment with tagged storagepool
Changes:

    After finding the storagepool suitable to create the volume, we should not look for more pods
2014-01-17 14:05:22 -08:00
Anthony Xu b52e8028e9 only send stop command when agent reports VM running and CS thinks it is stopped. 2014-01-17 11:48:27 -08:00
Kelven Yang be0d688511 CLOUDSTACK-5731: Use general instance type to categorize VM work jobs to correctly serialize VM operations 2014-01-17 10:42:04 -08:00
Kishan Kavala 1bf610d0c3 CLOUDSTACK-5892: Disabled removal of old system Vm templates during upgrades. Updated hyperV template URL and checksum 2014-01-17 17:12:43 +05:30
Kishan Kavala 04492bad43 CLOUDSTACK-5690: Added upgarde template support for 4.3 64 bit templates. Changed min required version for VR to 4.3 2014-01-17 12:29:37 +05:30
Mike Tutkowski e2364cfca6 CLOUDSTACK-5873: [Automation] Failed to attach volume to VM, if the vm is created with option startvm=false 2014-01-16 12:08:05 -07:00
Edison Su 9ed4ab731f CLOUDSTACK-5395: mark snapshot_store_ref as destroyed in case of backup snapshot failed 2014-01-15 18:46:57 -08:00
Hugo Trippaers 4ccc74e768 Fix typo 2014-01-15 15:54:26 +01:00
Mike Tutkowski fef4c79cb2 CLOUDSTACK-5873: [Automation] Failed to attach volume to VM, if the vm is created with option startvm=false 2014-01-15 00:18:34 -07:00
Sateesh Chodapuneedi 032888c46c CLOUDSTACK-5408 [Automation] Failed to deploy vm in vmware environment with error "due to java.io.IOException: Cannot run program "mount": java.io.IOException: error=12, Cannot allocate memory"
Bump up RAM size of system offering for SSVM to 512MB

Signed-off-by: Sateesh Chodapuneedi <sateesh@apache.org>
2014-01-15 01:38:34 +05:30
Kelven Yang 7a8c0e3ae0 CLOUDSTACK-5696: Fix sync issue with out-of-band changes 2014-01-14 17:33:15 -08:00
Murali Reddy b6698f354c CLOUDSTACK-5861: networks that failed to implement can not be destroyed
introduces a force option in delete network to forcifully delete a
network. This comes handy in rare cases where network fails to implenet
and network is in shutdown state, but network shutdown to rollback
implement process fails as well.
2014-01-13 23:24:12 +05:30
Marcus Sorensen a80debbddf CLOUDSTACK-5853
Create two storage pools, one with storage tag X, one with storage tag Y.
Create a service offering with storage tag X.
Create a disk offering with storage tag Y.
Attempt to deploy a virtual machine with a datadisk, using given offerings, it fails.

Deployment planner keeps a global object 'avoid'. It loops through each volume to
be created, asking storage allocators for matching pools, passing this avoid object.

First disk matches a pool or pools, adds ALL other pools to avoid object, then
deployment planner attaches matching pools to a list for that disk.

Second disk matches a pool, adds all other pools to avoid object, then deployment
planner says "wait, matching pool is in avoid, can't use it". Oops. In fact, at this
point ALL pools are in avoid (unless there are other pools that have both tags).

Need to remove matching pool from the avoid set during each select phase.
2014-01-10 11:34:17 -07:00
Kishan Kavala 202a935fcd CLOUDSTACK-5852: router search in DomainDouterDao using AllFieldsSearch filters few routers due to router_network_ref join. Created a seperate search to list running routers with filters. 2014-01-10 19:57:02 +05:30
Olivier Lemasle d5277a81e6 CLOUDSTACK-5404: Fix timezone bug in network usage 2014-01-09 14:06:28 +01:00
Rajani Karuturi 12f3568e97 CLOUDSTACK-5790: decrypted ldap hostname and port during upgrade as they are not encrypted now.
Signed-off-by: Abhinandan Prateek <aprateek@apache.org>
2014-01-09 15:43:21 +05:30
Min Chen 693f0c280a CLOUDSTACK-5841:Snapshots taken before migration NFS to S3 can not be
used cross-zone.
2014-01-08 16:33:37 -08:00
Min Chen 5b07590786 CLOUDSTACK-5813: With S3 as secondary storage, snapshot taken in one
zone cannot be used to create volume in another zone. zoneId parameter
in createVolumeCmd is not observed.
2014-01-08 16:33:37 -08:00
Wei Zhou 4bb85cd7f9 CLOUDSTACK-5303: fix incorrect resource count (snapshot, secondary_storage)
(cherry picked from commit fa43987e43)
2014-01-08 15:34:51 +01:00
Harikrishna Patnala c3e6444adf CLOUDSTACK-5827: [Automation] Destroy VM failed, while deleting account
Signed-off-by: Koushik Das <koushik@apache.org>
2014-01-08 18:29:58 +05:30
Kelven Yang c75b0044ef CLOUDSTACK-5765: cleanup internal serialization and exception propagation issues 2014-01-07 17:12:06 -08:00
Sanjay Tripathi 0706757e00 CLOUDSTACK-5314: Negative (-ve) values for primary storage and volumes are shown in the resource count table. 2014-01-07 14:27:35 +05:30
Bharat Kumar 3a2cf48d92 CLOUDSTACK-5750 Make default value of execute.in.sequence.hypervisor.commands false. 2014-01-06 18:40:39 +05:30
Koushik Das 2b2d5998d7 CLOUDSTACK-5002: unable to destroy vm ;VM destroy failed in Stop i-2-59-VM Command due to You gave an invalid object reference. The object may have recently been deleted.
This is happening as concurrent operations are happening on the same VM. Earlier this was not seen as all vm operations were synchronized at agent layer. By making execute.in.sequence
global config to false this restriction is no longer there. In the latest code operations to a single vm are synchronized by maintaining a job queue. In some scenarios the destroy vm operation
was not going through this job queue mechanism and so was resulting in failures due to simultaneous operations.
2014-01-06 18:19:06 +05:30
Kelven Yang 22a1b8c3fc CLOUDSTACK-5672: Fix VM work job serialization issues in Add/Remove nic 2014-01-03 17:20:24 -08:00
edison db25228b23 CLOUDSTACK-5329: fix NPE in storage migration for zone-wide primary storage, and also the serization error. 2014-01-03 16:44:21 -08:00
Kelven Yang ce7bc8fd90 CLOUDSTACK-5725: put origin flow context id into log4j context prefix to link jobs with the orchestration work flow in logging 2014-01-03 15:47:03 -08:00
Kelven Yang 9cad092054 CLOUDSTACK-5767: Remove the logic of using underlying job related fields for volume specific logic. 2014-01-03 13:10:32 -08:00
Sanjay Tripathi 3964a566f7 CLOUDSTACK-5701: physical size is not getting updated in snapshot_store_ref table. 2014-01-03 18:20:31 +05:30
Harikrishna Patnala 6ce46e94f5 CLOUDSTACK-5730: [Automation]DirectAgentAttache's send command fails due to ArrayIndexOutOfBoundsException; Unable to cleanup hypervisor's datastructures as part of Delete Account Job
Signed-off-by: Koushik Das <koushik@apache.org>
2014-01-03 15:42:31 +05:30
Kelven Yang a03c8fe668 Fix a typo caused problem in attach-volume process 2013-12-31 15:13:10 -08:00
Kelven Yang 3094160718 CLOUDSTACK-669: Finalize VM work dispatching mechanism to avoid big switch statement 2013-12-31 13:32:28 -08:00
Sateesh Chodapuneedi 57cb023eb8 CLOUDSTACK-5447 [Automation] Volume migration failing with NullPointerException in vmware and KVM
Instead of injecting object of VolumeOrchestrationService into VmwareResource, we now populate the command object (MigrateVolumeCommand here) with required information. Thus we dont need volume orchestration service to query that information from resource.
Signed-off-by: Sateesh Chodapuneedi <sateesh@apache.org>
2013-12-31 06:21:32 +05:30
Harikrishna Patnala 662383e24b CLOUDSTACK-5515: #cpu ,cpuspeed and ram is set to NULL in usage db(usage_vm_instance table) after vm stop and start Fixed populating usage event details in usage db on vm start/upgrade/dynamic_scale 2013-12-30 12:08:30 +05:30
Mike Tutkowski e65fae412c CLOUDSTACK-5662: XenServer can't discover iSCSI targets with different credentials 2013-12-28 21:43:28 -07:00
Mike Tutkowski 8eb430f602 CLOUDSTACK-5662: XenServer can't discover iSCSI targets with different credentials 2013-12-28 00:12:11 -07:00
Kelven Yang dc303fda6e CLOUDSTACK-669: Convert volume snapshot orchestration flow to make it be serialized with other VM operations 2013-12-27 16:40:50 -08:00
Mike Tutkowski 574fc3a4f8 CLOUDSTACK-5662: XenServer can't discover iSCSI targets with different credentials 2013-12-27 13:12:12 -07:00
Min Chen 69524fb11f CLOUDSTACK-5653:S3 object store as Secondary Storage, the template
created from different zone is not available for the other zones.
2013-12-26 14:26:55 -08:00
Min Chen 35ba14d88d CLOUDSTACK-5648:CopyTemplate and CopyISO across zones fails after NFS
migration to S3.
2013-12-26 11:12:00 -08:00
Devdeep Singh 7e54ca8831 CLOUDSTACK-5456: Download root volume when vm is in stopped state fails on hyper-v. Made
changes to make sure the volume entry is created in the db with the right image format.
2013-12-26 19:11:11 +05:30
Devdeep Singh 079323f591 CLOUDSTACK-5420: The agent manager wasn't transitioning the host to maintenance
mode if their are no vms running on the host. Made the change to do so.
2013-12-26 11:14:01 +05:30
Likitha Shetty 289c8a09ea CLOUDSTACK-5508. Vmware - When there are multiple secondary stores, the newly added secondary store is not being selected for backing up snapshots.
If the snapshot being backed up is a a delta snapshot, pick the image store where the parent snapshot is stored. Otheriwse pick a random image store.
2013-12-24 17:31:29 +05:30
Kelven Yang 497feab841 CLOUDSTACK-669: covert VMsnapshot orchestration flows to make them be serialized with other VM operations 2013-12-20 16:45:27 -08:00
Edison Su ddc3d87b4d CLOUDSTACK-5572: quicevm won't save memory, as it needs pv driver installed 2013-12-20 12:20:46 -08:00
Edison Su 88a5202eea CLOUDSTACK-4939 - Failed to create snapshot (KVM, Multiple hosts, Sharedstorage)
Conflicts:

	engine/storage/datamotion/src/org/apache/cloudstack/storage/motion/AncientDataMotionStrategy.java
	engine/storage/src/org/apache/cloudstack/storage/endpoint/DefaultEndPointSelector.java
	plugins/storage/volume/default/src/org/apache/cloudstack/storage/datastore/driver/CloudStackPrimaryDataStoreDriverImpl.java
2013-12-19 13:15:40 -08:00
Harikrishna Patnala 4034aad250 CLOUDSTACK-5208: upgrade from 3.0.6 to 4.3 is not throwing any exception if new System VM template is not registered with proper name Commit ae231444bc Commented the exception. . 2013-12-19 15:46:16 +05:30
Harikrishna Patnala 1c6b146d04 CLOUDSTACK-5554: Custom disk offering allows to create a datadisk with size greater than custom.diskoffering.size.max value 2013-12-19 15:45:43 +05:30
edison 15403a1f29 add xenserver 6.2.0 hotfix support, to optimize vdi copy
add xenserver hot fix
2013-12-18 18:22:52 -08:00
Min Chen 3ce63bef82 CLOUDSTACK-5541: Template Creation from snapshot failed with S3 store. 2013-12-18 15:42:13 -08:00
Koushik Das efe2549e7a CLOUDSTACK-5458: cpu speed is not getting updated in vm_instance table after service offeirngs change
Removed cpu, ram and cpu speed fields from the vm_instance table as these are not used
2013-12-18 15:34:44 +05:30
Nitin Mehta dc0f8ebdf1 CLOUDSTACK-4941:
During HA call different planners which skip some heurestics
2013-12-17 18:32:46 -08:00
Kelven Yang ed2125ec34 CLOUDSTACK-669: convert volume attach/detach flows to make them be serialized with other VM operations 2013-12-17 17:11:05 -08:00
Prachi Damle 35afd012f5 CLOUDSTACK-4852: Since upgrade to 4.2 only users at the zone-attached domain level can manipulate VMs
Changes:
- The vmprofile owner passed in to the planner should be the VM's account and not the caller
- Do not do the access check for Root Admin
2013-12-17 11:23:21 -08:00
Bharat Kumar 9118bbf934 CLOUDSTACK-5495 Unable to stop VM. adding the changes to make the global config execute.in.sequence.hypervisor.commands configurable for stopvm command.
Signed-off-by: Koushik Das <koushik@apache.org>
2013-12-17 17:43:19 +05:30
Bharat Kumar 2724db67f6 Cloudstack-5077: reserve cpu and memory only when
vmware.reserve.cpu/mem are set to true. Insted of setting
 the ovecommit values to one on upgrade, we popultate them
 from the global values.
Signed off by : nitin mehta<nitin.mehta@citrix.com>
2013-12-16 11:13:51 -08:00
Murali Reddy df16623533 CLOUDSTACK-4616: When system Vms fail to start when host is down , link
local Ip addresses do not get released resulting in all the link local
Ip addresses being consumed eventually.

fix ensure Nics with reservation strategy 'Start' should go through
release phase in the Nic life cycle so that release is performed before
Nic is removed to avoid resource leaks.
2013-12-16 19:03:16 +05:30
Min Chen 7cd125ca39 CLOUDSTACK-5446:KVM-Secondary Store down-Even after secondary store is
brought back up after being down for few hours,snapshot jobs do not get
triggered with reason "there is other active snapshot tasks on the
instance to which the volume is attached".
2013-12-13 18:09:16 -08:00
Kelven Yang 96678bbbfb CLOUDSTACK-669: refactor VM work job dispatcher to allow volume/snapshot manager to participate serialized job handling 2013-12-13 17:26:13 -08:00
Rajani Karuturi ef9fc95e87 CLOUDSTACK-5483 : Failed to start management server when db encryption is enabled When db encryption is enabled, the server expects all secure,hidden fields in encrypted form. moved the insert statements which has dafault values to java and populated encrypted values if encryption is enabled. 2013-12-13 17:44:36 +05:30
Jayapal 11c7fad535 CLOUDSTACK-5417 Updating egress firewall rules CiDR on external network restart 2013-12-13 13:59:42 +05:30
Alena Prokharchyk 326313e02e Resource metadata support for S2SVpnConnection 2013-12-12 14:57:44 -08:00
Alena Prokharchyk 888a599a41 Resource metadata support for customer gateway 2013-12-12 13:56:38 -08:00
Syed Ahmed fb89a2d8f6 CLOUDSTACK-5296: Add certificate chain support for netscaler.
adds support for trust chains in the netscaler
2013-12-12 12:13:43 +05:30
Kelven Yang 619f5381d5 CLOUDSTACK-669: put user vm work under new vmsync model 2013-12-11 16:19:57 -08:00
Min Chen feb9fe18b8 CLOUDSTACK-5451:Restart MS after migrating NFS image store to S3,
previous Ready template is not ready anymore.
2013-12-11 14:02:24 -08:00
Min Chen eb64159632 CLOUDSTACK-5414: With NFS Image Store migrated to S3 an error is thrown
in creation of Virtual Router.
2013-12-11 14:02:24 -08:00
Murali Reddy 4fb54ca32d CLOUDSTACK-5428: support NetScaler to be configured exclusively for GSLB
service and not used for LB

Fix adds a boolean flag to addNetscalerLoadBalancer api, which
will mark added NetScaler for exclusive GSLB service. A netscaler marked
as exclusive gslb service provider is not picked for any guest network's
lb provider.

Conflicts:
	engine/schema/src/com/cloud/network/dao/ExternalLoadBalancerDeviceVO.java
	plugins/network-elements/f5/src/com/cloud/network/element/F5ExternalLoadBalancerElement.java
	plugins/network-elements/netscaler/src/com/cloud/api/commands/AddNetscalerLoadBalancerCmd.java
	plugins/network-elements/netscaler/src/com/cloud/api/response/NetscalerLoadBalancerResponse.java
	plugins/network-elements/netscaler/src/com/cloud/network/element/NetscalerElement.java
	server/src/com/cloud/network/ExternalLoadBalancerDeviceManager.java
	server/src/com/cloud/network/ExternalLoadBalancerDeviceManagerImpl.java
	setup/db/db/schema-421to430.sql
2013-12-11 15:36:22 +05:30
Jayapal 3caef2b1d5 CLOUDSTACK-5278 Fixed cleaning up egress default rules on VR and SRX
1. Egress default policy rules is send to the firewall provider. It is up to the
    provider to configure the rules.
   2. The default policy rules are send for both allow and deny default policy.
   3. On network shutdown rules for delete are send.
   4. For VR and SRX, by default deny the traffic. So no default rule to deny traffic is required.
2013-12-10 14:43:13 +05:30
Alena Prokharchyk 93fd323357 Resource metadata support for Site2SiteVpnGateway 2013-12-09 17:37:37 -08:00
Nitin Mehta 5d9335fcc3 CLOUDSTACK-3664:
scaling up vms was not considering parameter cluster.(memory/cpu).allocated.capacity.disablethreshold. Fixed it
Also added overprovisioning factor retrieval at the cluster level for host capacity check
2013-12-09 14:51:59 -08:00
Kelven Yang d931718ab2 CLOUDSTACK-669: put system vm work under new vmsync model 2013-12-06 15:48:10 -08:00
Prachi Damle 13d2caa6b5 CLOUDSTACK-5401: VM migration during host maintenance fails if pool.storage.capacity.disablethreshold is lowered
Changes:
- During Vm migration while finding a new host within the cluster, we need to set the storagepool Id to the deployment plan too.
- This will indicate the planner that the volumes are ready and no need to find new pool
- This in turn will prevent the threshold check done during the pool allocation. This step is not needed since there is no need to allocate pools newly.
- Thus the migration wont fail because th threshold check fails.
2013-12-06 13:18:40 -08:00
Prachi Damle 3a6adb3c58 CLOUDSTACK-5399: Add option to createVolume API to specify a VM, to place the volume appropriately and attach immediately
Changes:

    - Added 'virtualmachineid' parameter to the createVolume API to specify a VM for the volume. The Vm should be in 'Running' or 'Stopped' state.
    - This parameter is used only when createVolume API is called using snapshotid parameter
    - When this parameter is set, the volume is created from the snapshot in the pod/cluster of the VM. Also the volume is then attached to the VM in the same request
    - If attach Volume fails but create has succeeded, the API errors out but the Volume created remains available. User may attach the same volume later
    - When Vm is provided, but if no storage pool is available in the VM's pod/cluster then the volume is not created and API fails.
2013-12-06 13:18:37 -08:00
Nitin Mehta 1cdc064c43 CLOUDSTACK-4880:
check for host cpu capability while dynamic scaling a vm on the same host
2013-12-05 14:14:31 -08:00
Anthony Xu 0847ccfe97 XS VMmetadata platform contains virtual platform related info, CS should save platform info in DB to migrate the VM to other Cluster
Conflicts:
	engine/orchestration/src/com/cloud/vm/VirtualMachineManagerImpl.java
	plugins/hypervisors/xen/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java
	server/src/com/cloud/template/TemplateManagerImpl.java
2013-12-05 01:17:56 -08:00
Nitin Mehta ee82870aa2 CLOUDSTACK-5349:
Volume create usage event and resource count werent getting registered. Check its type rather than it is UserVm since the code is coming from VirtualMachineManager.
2013-12-04 10:53:42 -08:00
Alena Prokharchyk b315ca1895 CLOUDSTACK-5261: support for alert publishing via Root admin web api
listAlerts: introduced new parameter "name" to the alertResponse

Added new Admin API - generateAlert. Available to ROOT admin only

listAlerts: implemented search by alert name
2013-12-03 17:08:23 -08:00
edison su 77227960cf Fix snapshot details dao 2013-12-03 13:05:03 -08:00
Bharat Kumar 089c7bc9f8 CLOUDSTACK-5161 use a map to specify the custom parameters instead of having one parameter each 2013-12-03 16:53:58 +05:30
Bharat Kumar 72e0354661 CLOUDSTACK-5161 enable scaling and upgrading of a vm using custom offering
Signed-off-by: Koushik Das <koushik@apache.org>
2013-11-29 18:32:16 +05:30
Wei Zhou 5598ba0fc7 allow delete snapshot with ERROR state
(cherry picked from commit 81c07f1791)

Conflicts:

	engine/storage/snapshot/src/org/apache/cloudstack/storage/snapshot/XenserverSnapshotStrategy.java
2013-11-29 10:55:33 +01:00
Alena Prokharchyk 4edc3989bb Resource metadata support for NetworkACLItem 2013-11-27 14:37:28 -08:00
Alena Prokharchyk c9b0a8b1f4 Resource metadata support for NetworkACLList 2013-11-26 17:22:32 -08:00
Alena Prokharchyk 1fe8efc85f Resource metadata support for VPC Private Gateway 2013-11-26 12:48:41 -08:00
Harikrishna Patnala 8970c95154 CLOUDSTACK-4737: handling usage events for dynamic compute offering
Signed-off-by: Koushik Das <koushik@apache.org>
2013-11-26 18:00:27 +05:30
Bharat Kumar 6af8021ef7 CLOUDSTACK-5162 Usage details are not getting populated when using dynamic offerings.
Signed-off-by: Koushik Das <koushik@apache.org>
2013-11-26 17:45:13 +05:30
Alena Prokharchyk abb95c1016 Resource metadata - fixed the bug in removeResourceDetail API - when "key" parameter was passed in, used to remove the details matching the key, for all the resources, not just the one defined by resource_id 2013-11-25 15:30:55 -08:00
Hugo Trippaers 4de858c7a9 Expose getPrimaryDataStore(String uuid) through the DatastoreManager interface so it can be used clients. 2013-11-22 16:22:38 -08:00
Edison Su 70fed9f387 Add a new method on datastoredriver: getCapabilities, which will be called by liststoragepoolcmd. UI can make decision based on the capabilities of the storage.
And also add a new table: snapshotdetails

Conflicts:
	plugins/storage/volume/default/src/org/apache/cloudstack/storage/datastore/driver/CloudStackPrimaryDataStoreDriverImpl.java
2013-11-22 16:20:41 -08:00