Commit Graph

3908 Commits

Author SHA1 Message Date
frank 89e04458b6 Bug 11522 - New agent manager
move all listxxx interface from HostDao to managers(ResourceManager, SecondaryStorageVmManager etc) with decent name using SearchCriteria2
or direct call SearchCriteria2 on demand
2011-10-04 14:35:26 -07:00
Edison Su ae83246acb bug 11600: aquirelock before deleting a volume, which can be aquired by snapshot manager
status 11600: resolved fixed
2011-10-03 16:43:47 -07:00
prachi 083b458f03 Bug 11617 - Ensure the Deployment planner is choosing clusters based on aggregate capacity
Merge removed this import statement. Adding it back.
2011-10-03 15:46:41 -07:00
prachi e0a179752d Bug 11617: Ensure the Deployment planner is choosing clusters based on aggregate capacity
Changes:
- We were ordering clusters based on capacity of the first-fit host found in each cluster. Due to this, there were cases where we deployed VMs to one cluster instead of balancing off within clusters.
- Now we order the list of clusters by aggregate capacity and choose the ones that have enough capacity for the required VM in this order.
- This should balance the load between clusters instead of bombarding one.

Conflicts:

	server/src/com/cloud/capacity/dao/CapacityDao.java
	server/src/com/cloud/capacity/dao/CapacityDaoImpl.java
2011-10-03 15:37:38 -07:00
frank 683113cc38 Bug 11522 - New agent manager
get rid of all secondary storage interface from HostDao, instead, put them in
SecondaryStorageVmManager using SearchCriteria2 with decent name
2011-10-03 11:21:34 -07:00
frank 3947c9a126 Bug 11522 - New agent manager
Initailize SearchCriteria2 in order to replace search interface of DAO
2011-10-03 10:32:27 -07:00
prachi 9bd5e5871b Bug 11481 - get manual live migration working with all VMs
Changes:
- Added a new API  'migrateSystemVm'  backed by MigrateSystemVMCmd.java to migrate system VMs (SSVM, consoleproxy, domain routers(router, LB, DHCP))
- This is Admin only action
- The existing API 'migratevirtualmachine' is only for user VMs
2011-09-29 17:47:46 -07:00
Sheng Yang b8f8989821 bug 11130: Update template and script version in the database when domR started 2011-09-29 14:51:20 -07:00
anthony 33b1055c01 timeout is not set for some commands 2011-09-29 13:09:05 -07:00
frank a1193149a0 Bug 11522 - New agent manager
renamce updateResourceState to resourceStateTransitTo
2011-09-29 11:58:41 -07:00
alena 53b1b9f63b bug 11603: for OSS build - update guru_name from GuestNetworkGuru to ExternalGuestNetworkGuru.
status 11603: resolved fixed
2011-09-29 10:43:01 -07:00
alena d7267fb0c5 bug 11589: don't fail deleteVpn command when domR is in Stopped state.
status 11589: resolved fixed

Conflicts:

	server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java
2011-09-29 10:22:14 -07:00
alena 12e25fb988 Implemented vm* api commands to be executed against the project 2011-09-29 10:20:51 -07:00
alena eda1b53c76 Events for adding/removing project users 2011-09-29 10:20:51 -07:00
Murali Reddy a623b2824b bug 6876: netscaler integration
added external lb network usage and inline support
2011-09-29 18:59:46 +05:30
anthony aef74ff521 bug 10579: disable pool vm sync and disable hostTrack for XenServer,
status 10579: resolved fixed

reviewed-by: alex

Conflicts:

	core/src/com/cloud/hypervisor/xen/resource/CitrixResourceBase.java
2011-09-28 12:41:24 -07:00
Nitin b9df06619a bug 11051: ListPods/ListZones - Apply cpu overprovisioning explicitly as it is not applied when its stored in the db. Also avoid calculating the non shared storage for storage allocated capacity calculation. 2011-09-28 17:48:31 +05:30
kishan 806bfe33c4 bug 11581: During router start, create iptables NETWORK_STATS chain before adding rules for additional public interfaces into that chain
status 11581: resolved fixed
reviewed-by: Chiradeep
2011-09-28 16:46:45 +05:30
Nitin da2696b2f6 bug 11051: ListCluster - Apply cpu overprovisioning explicitly as it is not applied when its stored in the db. Also avoid calculating the non shared storage for storage allocated capacity calculation. 2011-09-28 16:16:28 +05:30
Sheng Yang 1fb5030cca Clean up global redundant_router config item
We would use network_offering option in 3.0 instead.
2011-09-27 16:50:24 -07:00
frank b188a513ba Bug 11522 - New agent manager
Secondary storage worked
2011-09-27 16:43:26 -07:00
frank 5efaed1d82 Bug 11522 - New agent manager
able to add host
2011-09-27 15:18:21 -07:00
frank e5fca855c1 Bug 11522 - New agent manager
register/unregister resource state adapter in configure/stop of implementations
2011-09-27 11:51:03 -07:00
Abhinandan Prateek 83c6cf3db0 bug 10588: code to sync VM state at cluster level and dettached from ping command 2011-09-27 13:18:21 +05:30
alena ccd47c1b21 Implemented Project Invitations 2011-09-26 17:47:20 -07:00
frank e8c13e10c7 Bug 11522 - New agent manager
able to compile besides mycloud stuff
2011-09-26 16:55:20 -07:00
frank caa8aaf6fe Bug 11522 - New agent manager
clean up events, status of agent
2011-09-26 15:01:16 -07:00
Kelven Yang d32241ec9c bug 10971: support vSphere 5 2011-09-26 12:16:28 -07:00
frank 66c347bec5 Bug 11522 - New agent manager
clean up stale functions
2011-09-26 11:29:22 -07:00
frank e8c3ff653d Bug 11522 - New agent manager
move maintanenceFailed to ResourceManager
2011-09-23 16:54:28 -07:00
frank bb4237336f Bug 11522 - New agent manager
refine reconnectHost logic
2011-09-23 16:22:14 -07:00
frank 95dbf2ac73 Bug 11522 - New agent manager
move updatePassword to ResourceManager
2011-09-23 15:48:06 -07:00
frank 98900717dd Bug 11522 - New agent manager
move umanageHost to ResourceManager
2011-09-23 15:40:52 -07:00
frank 7c5d3597a9 Bug 11522 - New agent manager
move cancelMaintenanceMode to ResourceManager
2011-09-23 15:32:58 -07:00
frank f63e412ac9 Bug 11522 - New agent manager
moves migration to ResourceManager
2011-09-23 15:22:39 -07:00
frank 81665757de Bug 11522 - New agent manager
move delete host to ResourceManager
2011-09-23 15:04:44 -07:00
frank e0e5491c42 Bug 11522 - New agent manager
implements ResourceStateAdapter in a couple of components
2011-09-23 11:28:02 -07:00
alena 10308d1ea6 bug 11555: Fixed NPE happening during LB rule cleanup in case when createLB fails
status 11555: resolved fixed

Reviewed-by: frank@cloud.com

Conflicts:

	server/src/com/cloud/network/lb/LoadBalancingRulesManagerImpl.java
2011-09-23 11:02:19 -07:00
alena a8d3c7436a bug 11550: rolled back the changes done to ConfigurationServerImpl during the resourceLimit refactor as it was leading to System/Admin account not being inserted to the DB
status 11550: resolved fixed
2011-09-23 09:42:07 -07:00
Sheng Yang b96701a6c4 bug 11541: Change CheckRouterCommand timeout from default 10 minutes to 1 minute
Reviewed-by: Anthony Xu

status 11541: resolved fixed
2011-09-22 19:22:33 -07:00
alena 5c35b7f164 1) Resource limits for Projects
2) Security checker for Projects
2011-09-22 18:10:35 -07:00
Kelven Yang 2a6de104e2 bug 11531: while taking snapshot on volume, if volume is attached to a VM instance and under VMware, check if there are other ongoing snapshot tasks for the VM instance. 2011-09-22 16:22:12 -07:00
frank b5e3639263 Bug 11522 - New agent manager
replace handleConnect with handleConnectedAgent
2011-09-22 15:07:21 -07:00
Edison Su ee59c26e93 bug 11513: another customer hits the same issue by associate ip in the basic zone
Reviewed-by: alena@citrix.com
2011-09-22 15:04:47 -07:00
Edison Su 211c7099a6 bug 11513: add more log in the cleanup network
Reviewed-by:alena@citrix.com
2011-09-22 15:04:43 -07:00
frank 0343cb79c3 Bug 11522 - New agent manager
replace simulateStart with createHostAndAgent
2011-09-22 14:42:05 -07:00
alena a1cab92ae1 bug 11537: revoke related FirewallRules when do vmExpunge and ipAddress release.
status 11537: resolved fixed

Reviewed-by: edison@cloud.com

Conflicts:

	server/src/com/cloud/network/firewall/FirewallManagerImpl.java
	server/src/com/cloud/vm/UserVmManagerImpl.java
2011-09-22 14:01:02 -07:00
frank 0677232e06 Bug 11522 - New agent manager
complete ResourceAdapter relevant interface
2011-09-22 11:55:23 -07:00
alena 1561c7d2f9 bug 11468: create ROOT domain and admin user as a part of cloud-setup-databases, not during the management server startup to avoid multiple records insertion for the same domain
status 11468: resolved fixed

Reviewed-by: will@cloud.com

Conflicts:

	server/src/com/cloud/server/ConfigurationServerImpl.java
2011-09-22 11:01:13 -07:00
kishan 2b9c0a695f bug 11520: Include TrafficMonitor hosts also while scanning for direct agents to load
status 11520: resolved fixed
2011-09-22 13:34:37 +05:30
Sheng Yang abcf246293 bug 11513: Fix public IP release in advance network
We should only persist DomR's public ip, not console proxy and ssvm.

Reviewed-by: Edison
2011-09-21 19:16:41 -07:00
alena ae56bd11e0 bug 11513: always wrap marking IP address with Releasing state and actual IP deallocation in Transaction
Reviewed-by:edison@citrix.com

Conflicts:

	server/src/com/cloud/network/guru/DirectPodBasedNetworkGuru.java
2011-09-21 18:42:47 -07:00
alena 9f9b60a287 1) Added resource limits for the Projects - the same as for the account
2) Added "Project" limit type for the Domain object
2011-09-21 17:09:49 -07:00
frank ce3d810f51 Bug 11522 - New agent manager
introduce ResourceState and ResourceStateAdapter
2011-09-21 16:52:39 -07:00
frank 443385471f Bug 11522 - New agent manager
change angent state machine to state machine 2
2011-09-21 16:48:33 -07:00
Edison Su b1b11a6928 bug 11047: change the put storage pool into maintenance mode: 1. only look at the available storoge pool in its own dc to decide to start vms created on it. 2. if start vm failed, don't throw exception, as these vms are marked stopped already, admin can start these vm by himself.
status 11047: resolved fixed
Reviewed-by: frank
2011-09-21 16:20:33 -07:00
alena 4d89066b2c bug 11515: reapply all firewall rules for the IP address when VPN related rules are being revoked
status 11515: resolved fixed

Reviewed-by: will@cloud.com
2011-09-21 09:50:32 -07:00
Nitin f49578c23a bug 11051: ListZones - Introduce a flag 'showCapacitites'. When its true it will start displaying all the capacitites (as objects in the response) for the respective zone. Also correcting the summation logic for List cluster, pod and zone commands 2011-09-21 16:59:16 +05:30
alena a1331d1cfc Intermidiate checkin to Project feature:
1) Introduce new managers - ProjectManager and DomainManager. Moved all domain related code from AccountManager to DomainManager.
2) Moved some code from ManagementServerImpl to the correct managers.
3) New resource limit for Domain - Project
2011-09-20 18:35:28 -07:00
alena bddc2b9e45 bug 11487: catch all exceptions in cleanupAccount, and mark the account for cleanup when the exception is caught.
status 11487: resolved fixed

Reviewed-by: will@cloud.com
2011-09-20 10:33:06 -07:00
alena b6f58b77b8 bug 11462: 1) when delete PF rule, revoke corresponding firewall first (if exists) 2) never remove PF rule from the table when corresponding firewall rule wasn't removed yet
status 11462: resolved fixed

Reviewed-by: edison@cloud.com

Conflicts:

	server/src/com/cloud/network/lb/LoadBalancingRulesManagerImpl.java
2011-09-20 10:32:57 -07:00
alena 459b32cc6a bug 11493: no need to do cross domain checks for the templates as domain level templates are not supported. We support only public (everybody can see and use) and private (only owner can see and use unless changed with updateTemplatePermissions call)
status 11493: resolved fixed

Reviewed-by: will@cloud.com
2011-09-20 10:31:57 -07:00
Nitin 7bcbdeb834 bug 11051: ListPods - Introduce a flag 'showCapacitites'. When its true it will start displaying all the capacitites (as objects in the response) for the respective cluster. 2011-09-20 15:59:45 +05:30
Nitin 4a5f6faca2 bug 11051: ListClusters - Introduce a flag 'showCapacitites'. When its true it will start displaying all the capacitites (as objects in the response) for the respective cluster. 2011-09-20 14:33:46 +05:30
Edison Su a02ae53417 bug 11495: set bootable as user selected for iso/templates
status 11495: resolved fixed
Reviewed-by:alena@citrix.com
2011-09-19 17:48:55 -07:00
alena 03bd7d0c96 bug 11480: verify account/user state when do single signon verification
status 11480: resolved fixed

Reviewed-by: kelven@cloud.com
2011-09-19 10:57:18 -07:00
alena ba64010cb5 bug 11470: 1) fixed listResourceLimits 2) Fixed -1 to be treated as unlimited for all the resources
status 11470: resolved fixed
2011-09-19 09:47:07 -07:00
prachi 0eea1cb733 Bug 11404 - VM was in Running state, had null for a pod_id, basically didnt allow creation of subsequent vm's
Reviewed-by: Alex

Changes:
- When management server starts, it goes through all the pending work items from op_it_work table and schedules HA work for each. It used to mark each item as done. Instead we should keep the item as pending and let it get marked as Done after the HA work is done.
- Changes in VirtualMachineMgr::advanceStop() :
a) if we find a VM with null hostId, we stop the VM only if it is forced stopped.
b) if VM state transition to Stopping fails,for state Starting and Migrating we try to find the pending work item and then do cleanup the VM. In case state is Stopping we can cleanup directly.
c) We proceed releasing all resources only if state transitioned to 'Stopping'.
- Changes in HA:
a) Depend on VirtualMachineMgr::advanceStop() in case host is not found to do VM cleanup
- When Vm state between mgmt server and agent syncs from starting -> running, mark any pending work item as done.

Conflicts:

	server/src/com/cloud/vm/VirtualMachineManagerImpl.java
2011-09-15 19:06:19 -07:00
alena 117de2a61a Do agent disconnect when agent rebalance fails
Reviewed-by: Alex Huang
2011-09-15 18:37:06 -07:00
prachi 6b82ba3ff9 Bug 11457 - NullPointerException while synching VM state from Starting -> Running between management server and agent
Reviewed-by: Kelven and Alex

Changes:
- Added log statements about the podId during deploying a VM.
2011-09-15 16:16:24 -07:00
prachi df17ce5648 Bug 11457 - NullPointerException while synching VM state from Starting -> Running between management server and agent
reviewed-by: Alex/Kelven

Changes:
1.	UserVmManagerImpl :: finalizeStart()
Added null check for the cmds.getAnswers() object. Return ‘true’ if null.

2.	VirtualMachineManagerImpl :: advanceStart()
Move the line to set PodId to the vm being started above the state transition where hostId gets set, so that podId is not null in case management server goes down when vm starts on the agent. On restart, podId is not updated during fullsync. So this will prevent podId remaining null.

vm.setPodId(dest.getPod().getId());
2011-09-15 16:16:15 -07:00
keshav 60d69aabb2 In inline SRX/F5 mode, collect outbound usage for LB rules from the SRX. 2011-09-15 14:45:06 -07:00
Sheng Yang c67594ef50 bug 11300: Make restartNetwork destroy and recreate DHCP server
status 11300: resolved fixed
2011-09-15 11:56:31 -07:00
alena 2138f86bb3 bug 11447: don't do security group check if both groups belong to the same domain
status 11447: resolved fixed
2011-09-15 10:08:00 -07:00
Nitin d53c3f0798 bug 11051: Listing Secondary Storage - also show the total and used storage. Listing Storage pools show the realtime storage stats and correctly populate the allocated storage. 2011-09-15 15:53:31 +05:30
Naredula Janardhana Reddy 10fb507609 bug 11372:
Added two New values "all" and "default" to global config "network.loadbalancer.haproxy.stats.visibility" . With this change, it can take six possible value:
            global - stats visible from public network.
            guest-network - stats visible only to guestnetwork.
            link-local - stats visible only to link local network(for xen and kvm).
            disabled - stats disabled.
            all - stats available on public,guest and link-local. (Newly added)
            default - stats availble on the serving http port, this does need any specific http port.(Newly added)
   Except "default" and "disabled", all the rest of 4 need to configure the stats port.
2011-09-15 11:46:34 +05:30
Murali Reddy bb7b6d5eee fixing build break due to commit edbd3a862ce16cce1b22f54c843d33f8f6cf809c 2011-09-15 11:40:46 +05:30
anthony 6ecc981e25 bug 9777: introduce Error status for snapshot, if snapshot creation fails, it will be in Error status
status 9777: resolved fixed
2011-09-14 18:14:02 -07:00
Kelven Yang 1b9552ea74 Let VmwareInvestigator return fake but meaningful investigation result 2011-09-14 17:04:28 -07:00
Sheng Yang c85902b04c bug 11307: Using latest query result rather than set bumpup to false
After the host is disconnected, we can't get latest result, but it's not safe to
think it's priority bump up flag changed.
2011-09-14 16:26:48 -07:00
Sheng Yang f19fca6ec6 Fix restartNetwork wrongly report stop failure 2011-09-14 16:24:43 -07:00
Sheng Yang 474d1a6034 bug 11307: Add destroyRouter command 2011-09-14 16:23:42 -07:00
Sheng Yang 684a603a6e bug 11307: Add cleanup parameter to restartNetwork command
Default set it to true. When cleanup=false, restartNetwork would only
re-implement the network, but don't destroy current existed routers.
2011-09-14 16:23:34 -07:00
Sheng Yang e330e97f4b bug 11307: Mark router as to-be-stopped, rather than force stop it.
Force stop the router would release all the resources it used, but router may
still running. Add a column "stop_pending" in the database, and stop it when the
router come back.

Admin would able to choose to force destroy such router, then recover the
network using restartNetwork command with cleanup=false.
2011-09-14 16:23:17 -07:00
Sheng Yang ebd67feae7 bug 11307: Rewrite the redundant router's priority
Now the very first router's priority would be 100, and the second one would be
100 - 2 + 1 = 99.
2011-09-14 16:22:33 -07:00
Sheng Yang dfd36e4ae2 bug 11307: Add Bumped field for domain_router
Only used for redundant virtual router.
2011-09-14 16:22:11 -07:00
Sheng Yang b987123daa bug 11307: Let CheckRouterAnswer() parse the return result 2011-09-14 16:21:33 -07:00
alena bb9fda3435 Fixed the problem in addDhcpEntry code when _dnsBasicZoneUpdates was never reset once set to false.
Conflicts:

	server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java
2011-09-14 16:11:01 -07:00
Kelven Yang 7a64d8fda4 add VmwareInvestigator and VmwareFencer, use short worker VM name to avoid vCenter truncation 2011-09-14 15:15:26 -07:00
anthony 313b624373 bug 9777: only allow to delete snapshot in BackedUp status
status 9777: resolved fixed
2011-09-14 14:16:19 -07:00
alena 5f9246114b bug 10435: use "hostName" instead of "name" as a search filed in listSystemVms
status 10435: resolved fixed
2011-09-14 11:01:37 -07:00
alena b7f45cfbd6 bug 11434: don't execute destroy call when vm is already in Destroyed/Expunging state
status 11434: resolved fixed
2011-09-14 10:33:45 -07:00
prachi ea97ce2a93 Bug 11430 - add host > Host Tags field missing from DB + UI even when host tags specified in add host 2.2.y -> 2.2.12 KVM
Changes:

A KVM agent always connects to the management server itself, we dont have to do direct connect. This part of code was missing updating the DB host entry with hosttags.
Corrected the code to save the hosttags while adding a KVM host.
2011-09-14 10:27:07 -07:00
Murali Reddy 78a5b651ac bug 11425: dont count direct IP in resource count while updating resource count through API
status 11425: resolved fixed
2011-09-14 22:52:30 +05:30
Nitin 20f0707755 bug 11190: My changes got reverted. Putting them back - Treating the max account limits with -1 values as infinite 2011-09-14 19:35:48 +05:30
anthony d6cbd2b6bc bug 11275:
remove heartbeat entry for this Primary Storage, when put this Primary Storage into maintenance mode
create heartbeat entry for this Primary Storage, when cancal maintenance for this Primary Storage

status 11275: resolved fixed
2011-09-13 22:15:21 -07:00
frank 71385f7cc0 check hypervisorType and StoragePoolType in OCFS2 manager when delete host
don't take lock in processResourceEvent()
2011-09-13 17:35:58 -07:00
alena 45c595d558 Don't update resource count for system account 2011-09-13 16:58:54 -07:00
alena 569427ba1f bug 11036: if resource_count record is missing for account or domain, insert it during the management server startup (with count=0)
status 11036: resolved fixed
2011-09-13 15:23:27 -07:00
anthony f071ce571c bug 10949: if a cluster doesn't have any hosts, set cluster guid to new one when add host to this cluster.
status 10949: resolved fixed
2011-09-13 13:53:23 -07:00
alena b05c69f3b3 bug 11246: return lb rule Id in the async response for createLoadBalancer api
status 11246: resolved fixed
2011-09-13 12:08:12 -07:00
anthony c5bc16ef42 XcpServerDiscoverer is only for XenServer 2011-09-13 11:11:55 -07:00
kishan d2293137c7 bug 11199: Moved DB upgrade changes to schema-2211to2212-premium
status 11199: resolved fixed
2011-09-13 23:28:54 +05:30
alena f6a79c603f bug 11036: resource count update is refactored
status 11036: resolved fixed

1) Use row locks instead of global lock when update resource_count table. When update resource_count for account, make sure that we lock account+all related domains
2) Insert resource_count records for account/domain at the moment when account/domain is created.
3) As a part of DB upgrade, insert missing resource_count records for all non-removed accounts/domains

Conflicts:

	core/src/com/cloud/alert/AlertManager.java
	server/test/com/cloud/agent/MockAgentManagerImpl.java
2011-09-13 10:47:36 -07:00
anthony ae64c56c12 bug 11413: when mark host ad disconnected, set lastping to now - pingtimeout
status 11413: resolved fixed
2011-09-12 18:50:07 -07:00
Chiradeep Vittal 3cb4ad4934 Add more detail when unable to schedule cleanup
clean up tests for security group manager v2

move interval to listener -- allows it to be configurable if needed

fix mocks

Enhanced logging for security group manager (from zucchini)

fix merge issues

merge issues
2011-09-12 18:22:55 -07:00
Chiradeep Vittal 1f3c6efb81 Retry only a few times 2011-09-12 18:20:24 -07:00
Chiradeep Vittal fae5e84699 if the xenserver host cannot do bridge firewalling do not attempt to retry the security rule updat
change some logs to debug level
2011-09-12 18:20:24 -07:00
Chiradeep Vittal 65fb83035f Enable monitoring over JMX
Add the ability to disable some vms from being scheduled

Add ability to trigger ruleset updates from JMX

added a few more dangerous JMX operations
2011-09-12 18:20:24 -07:00
Chiradeep Vittal d81bc5a375 Dequeue the vm with the largest id first -- this ensures that newly started vms get updated early 2011-09-12 18:20:23 -07:00
Chiradeep Vittal 925f5f2f09 Retry 3 times on deadlock: if not updated, then throw a runtime exception to roll back the vm start 2011-09-12 18:20:23 -07:00
Chiradeep Vittal 82fcfe8edc make signature calculation consistent across management servers 2011-09-12 18:20:23 -07:00
Chiradeep Vittal 37b4384990 retry a transaction if it deadlocks 2011-09-12 18:20:23 -07:00
Chiradeep Vittal cfbbe4c031 fix perf. issue in deploy vm. also remove dead code in dao 2011-09-12 18:20:23 -07:00
Chiradeep Vittal c21a214372 if true, this could lead to the dog chasing its own tail 2011-09-12 18:20:23 -07:00
Chiradeep Vittal 5dba8cf430 only update sequence number when asked to. full sync SHOULD NOT request sequence number updates since this will lead to the dog chasing its own tail 2011-09-12 18:20:23 -07:00
Chiradeep Vittal 6252d605c1 Avoid going back to the nics table for information we already have 2011-09-12 18:20:23 -07:00
Chiradeep Vittal d03c5af720 make instance_id unique to allow usage of ON DUPLICATE KEY
useful logging

Reduce batch size to 16 to avoid sql errors

try using multi inserts to overcome deadlock during batch update
2011-09-12 18:20:23 -07:00
Chiradeep Vittal b52d1157e9 use the new implementation of SG manager 2011-09-12 18:20:22 -07:00
Chiradeep Vittal 4cd6a9217c Use hashset since it is 50% faster. we can use treeset when we support priority 2011-09-12 18:20:22 -07:00
Chiradeep Vittal 2fc782b8ba Add basic Mocks for some managers 2011-09-12 18:20:22 -07:00
Chiradeep Vittal abf4754503 New security group mgr WIP : memory based queueing 2011-09-12 18:20:22 -07:00
Chiradeep Vittal f41b352d36 revert egress rules implementation pending review
Reverts a19212703b9734ebd44ebf55cfdd81ebdc9d7fe4
Reverts 24e4e44b8f0712a37147a3777833de3f9e24829e
2011-09-12 14:45:58 -07:00
Chiradeep Vittal d817f3c364 Revert "bug 10617: Added Egress rules to Security groups."
revert pending review

This reverts commit a19212703b9734ebd44ebf55cfdd81ebdc9d7fe4.
2011-09-12 14:45:58 -07:00
Chiradeep Vittal e216686029 Revert "bug 10617: Intermediate checking"
revert pending review

This reverts commit 561b27565512d438db3d8896df6f97b644b0b498.
2011-09-12 14:45:58 -07:00
Nitin cbe996e1ce bug 11403: Making hypervisor_type of xs-tools.iso (id=200) as XenServer. Made the corresponding DB changes as well. 2011-09-13 03:07:32 +05:30
Kelven Yang 41926cb038 bug 11377: remove the restriction on VMware in API layer to let it support VM manual migration 2011-09-12 14:28:32 -07:00
frank d828f4e434 Bug 11350 - Baremetal destroy instance doesnt power off machine
status 11350: resolved fixed
2011-09-12 14:17:43 -07:00
anthony 299ae3ed91 fixed typo 2011-09-12 12:38:56 -07:00
kishan b30827a0ec bug 9778: Log snapshot create event only if the snapshot is in not removed state after backingUp to secondary. Log snapshot delete event for backed up snapshots only
status 9778: resolved fixed
2011-09-12 20:22:30 +05:30
kishan 5928a9b370 bug 9778: Log snapshot create event only if the snapshot is in not removed state after backingUp to secondary. Log snapshot delete event for backed up snapshots only
status 9778: resolved fixed
2011-09-12 20:01:19 +05:30
Nitin 3e096afba6 bug 10974: Fixed a bug in the search for listRouters API. The bug was introduced due to change in the VmInstancVO where the name field was changed to hostName. This went unnoticed in the DAO layer as we dont throw an exception but an assert error. 2011-09-12 16:51:17 +05:30
Nitin 002d0fda5a bug 11190: Treating the max account limits with -1 values as infinite. When acquiring a lock to check for resourceLimitExceeded if the lock times out then return as limit exceeded. 2011-09-12 14:26:15 +05:30
Kelven Yang 3c41775184 1) Increase working buffer size to 1M when downloading/uploading VMDK, hopefully can improve OVF exporting/importing performance. 2) use atomic SQL operation to get rid of global lock usage 2011-09-09 17:07:09 -07:00
Naredula Janardhana Reddy f9b0962ad9 bug 10617: Intermediate checking
Changes :
         - Fixing API doc +response name + errorMessage
         - Adding seperate events to Egress rules
         - Egress rules Using the same database table as that of ingress with new column type.

   Pending Tasks:
         - db upgrade
         - database table rename from security_ingress_rule to generic name, renaming some of the jave class from ingress to generic name.
         - Retesting on kvm
2011-09-09 18:14:19 +05:30
Nitin 50efe56335 bug 11051: listHostsCmd - Fixed the capacity and stats response. Also removed the unwarranted code. 2011-09-09 14:23:13 +05:30
kishan 4e663bbef9 bug 8338: Added usage.aggregation.range parameter. Also included in 2211 to 2212 upgrade 2011-09-09 13:43:13 +05:30
prachi d854923ac5 Bug 11200 - maximum number of guests per host
Manual Migration should fail if the destination host chosen by Admin already has max guest VMs running.
2011-09-08 18:33:55 -07:00
prachi 4ad9ac5e71 Bug 11200 - maximum number of guests per host
Changes:

To make sure migration does not attempt to pick a host that has running VMs more than the max guest VM's limit:

- Changed manual migration to call host allocators to return a list of hosts suitable for migration. Host allocators check for the max guest VM limit.
- Earlier we returned hosts with enough capacity but now Host Allocators make other checks along with capacity. So the list of hosts returned are hosts that have enough capacity AND satisfy all other conditions like host tags, max guests limit etc. Or in other words Allocators dont return the hosts that dont satisfy all conditions even if they have capacity.
-Therefore, now we mark the list of hosts returned for manual migration as 'suitable' hosts instead of 'hasenoughCapacity' in the HostResponse.
- HA migration already calls allocators, so no change is needed there.
2011-09-08 18:08:31 -07:00
keshav e3252e5e66 Excluded external firewall/LB from host stats collection, and included them in ping checks 2011-09-08 16:43:37 -07:00
Kelven Yang aa7f06d7eb bug 11384: deprecate vmware.guest.nic.device.type global configuration variable 2011-09-08 16:11:17 -07:00
alena 6e6b6ab2ab Fixed the bug in AgentLB: consider only hosts of type=Routing when calculate average load 2011-09-08 14:57:04 -07:00
Kelven Yang a118880836 bug 10874: don't invalid run session of other management server even if it detects it is unreachable as the event may just be temporary network condition 2011-09-08 14:22:52 -07:00
anthony 4423da06a2 1. added timeout in Command Class, then each command can configure itself timeout, if timeout is not configed, use the default timeout , which is 30 minute
2. added following configurable timeout
       PrimaryStorageDownloadWait("Storage", TemplateManager.class, Integer.class, "primary.storage.download.wait", "10800", "In second, timeout for download template to primary storage", null),
       CreateVolumeFromSnapshotWait("Storage", StorageManager.class, Integer.class, "create.volume.from.snapshot.wait", "10800", "In second, timeout for create template from snapshot", null),
       CopyVolumeWait("Storage", StorageManager.class, Integer.class, "copy.volume.wait", "10800", "In second, timeout for copy volume command", null),
       CreatePrivateTemplateFromVolumeWait("Storage", UserVmManager.class, Integer.class, "create.private.template.from.volume.wait", "10800", "In second, timeout for CreatePrivateTemplateFromVolumeCommand", null),
       CreatePrivateTemplateFromSnapshotWait("Storage", UserVmManager.class, Integer.class, "create.private.template.from.snapshot.wait", "10800", "In second, timeout for CreatePrivateTemplateFromSnapshotCommand", null),
       BackupSnapshotWait("Storage", StorageManager.class, Integer.class, "backup.snapshot.wait", "10800", "In second, timeout for BackupSnapshotCommand", null),
2011-09-07 19:17:54 -07:00
Kelven Yang 905df61aac bug 11362: Make VM network adapter device type be selectable based on VM-specific details 2011-09-07 17:58:42 -07:00
Kelven Yang f70958809b bug 11360: make user_vm_details generic to all VMs instead of user-only VMs, VM details info will be carried down to hypervisor resource 2011-09-07 15:42:40 -07:00
prachi 84868b7f9c Bug 11200 - maximum number of guests per host
Changes:
- Adding a new table 'hypervisor_capabilities' that will record capabilities for each hypervisor version. Added db schema changes for this.
- Currently a few capabilities have been added, namely, 'max_guests_limit' and 'security_group_enabled'
- Added a new column 'hypervisor_version' to host table. StartupRouting command now takes in this parameter. It should be set when a host connects.
- If a host's hypervisor version is not present, we find all the capabilities rows for that hypervisor type and use the first record.
- 'max_guests_limit' is the maximum number of running guest Vms that a host can have for the given hypervisor.
- Host Allocators use this limit and skip a host if the number of running VMs on that host exceeds this limit.
2011-09-07 14:53:05 -07:00
alena b883b25a12 bug 11348: make content type for "json" files configurable
status 11348: resolved fixed
2011-09-07 14:22:01 -07:00
alena ba2c6695cc bug 11326: don't try to transfer the agent if it's a forward agent
status 11326: resolved fixed

Also added more logging to the agent rebalance code.

Conflicts:

	server/src/com/cloud/agent/manager/ClusteredAgentManagerImpl.java
2011-09-07 12:47:25 -07:00
anthony 13ee22d421 bug 10078:
1. introduce migratewait in global configuration, the default value is 1 hour
 2. use async xapi VM migration API

status 10078: resolved fixed
2011-09-07 12:36:17 -07:00
kishan 066537a565 bug 4282: Removed caching of signatures. Added detailed error message expires parameter parsing 2011-09-07 17:51:09 +05:30
alena 47d9cbd2ee bug 11331: allow extending vnet range as a part of updateZone call
status 11331: resolved fixed
2011-09-06 17:40:28 -07:00
kishan f9d5a46871 Compare current and previous network stats before updating. Ignore stats if the current stats are not same as the prev stats. Set NetworkUsageAnswer log level to debug 2011-09-05 18:41:42 +05:30
Naredula Janardhana Reddy 3c1f6fd24b bug 10467: Incorrect display of domain router linklocalmac address and linklocal netmask fixed 2011-09-05 13:42:12 +05:30
alena 3c0396bb20 bug 10751: don't remove already removed templates during the account cleanup
status 10751: resolved fixed
2011-09-02 16:06:55 -07:00
alena b93318cb73 bug 11002: userVmDao - create searchBuilder as a part of dao init process (otherwise it's not threadsafe)
status 11002: resolved fixed
2011-09-02 15:51:52 -07:00
Kelven Yang 4d3d47f01c bug 11304: restore host status after initialization failure 2011-09-02 15:19:36 -07:00
anthony c683fda236 set timeout for CheckOnHostCommand to 50 s 2011-09-02 15:01:32 -07:00
anthony c7fb330914 put getConnection into try 2011-09-02 15:01:28 -07:00
alena eb9b5c1f65 bug 11259: ROOT admin can extract template/iso even when it's not mark as extractable
status 11259: resolved fixed
2011-09-02 12:37:15 -07:00
alena ecd99ad379 bug 11332: don't try to log vm's information when the vm is already Expunged
status 11332: resolved fixed

Conflicts:

	server/src/com/cloud/vm/dao/VMInstanceDaoImpl.java
2011-09-02 12:08:39 -07:00
Sheng Yang 4e5ce5690a bug 11305: Stop disconnected redundant virtual router if we can process with the connected one
When we apply rules or start new VM, we may encounter some running routers that
we can't program. That can due to network issue or host is down or vCenter is
disconnected, etc. To keep the synchronization, we would stop them, but only
when there is the other router we've successfully updated. If both routers are
unable to communicate with, we simply give up and report it user.

Conflicts:

	server/src/com/cloud/network/router/VirtualNetworkApplianceManagerImpl.java
2011-08-31 19:29:32 -07:00
Sheng Yang 01eb08a384 bug 11305: Remove router stop logic from disconnect host.
Now the logic is: if we can only connect to one of the two redundant routers, we
would stop the one that can't be connected. If we fail to program both routers,
just let it go.
2011-08-31 19:27:57 -07:00
alena 8b5f2c758e Do account permission checks for snapshots the way it's done for all other ControlledEntities 2011-08-31 18:15:08 -07:00
frank 0c0fe8c1b3 Bug 8966 - Oracle VM (OVM) support
configure hostname of host for OCFS2
small fixes
2011-08-31 17:25:04 -07:00
Kelven Yang 0421eafba0 bug 10765: add japanese keyboard support for linux OSes 2011-08-31 15:53:01 -07:00
kishan 8d5e7ff659 bug 11316: In 2.2.y, removed new template upgrade changes. Added upgrade path from 2210 to 2211. Moved existing changes to 2211to2212
status 11316: resolved fixed
2011-08-31 15:16:12 +05:30
kishan 2ff1e4f92a bug 11316: Removed new template upgrade changes. Added upgrade path from 2210 to 2211. Existing changes moved to 2211to2212 upgrade
status 1316: resolved fixed
2011-08-31 14:19:20 +05:30
alena 39b78ee17c bug 11298: give detailed error message when failed to authenticate a user
status 11298: resolved fixed
2011-08-30 16:51:45 -07:00
alena d65bef383c Mark account as cleanup_required=0 when cleanup was finished successfully 2011-08-30 14:09:14 -07:00
alena 8f9b929e3f Don't remove the domain when it has accounts that are removed, but require cleanup 2011-08-30 14:09:01 -07:00
alena 09f8d8ee4c Fixed the bug when networkRate for the domR's guest network wasn't taken from the service offering 2011-08-30 10:41:17 -07:00
Naredula Janardhana Reddy 854f81962f bug 10617: Added Egress rules to Security groups.
Description :
   API's:
     -  Two new api's authorizeSecurityGroupEgress,revokeSecurityGroupEgressCmd are added. These two API's are similer to ingress rule API's.
           - authorizeSecurityGroupEgress :Authorizes a particular egress rule for this security group . Usageof API is very similer to that of authorizeSecurityGroupIngress except that instead of source cidr  there will be destination cidr. By default like ingress, all the outgoing flows are blocked.
           - revokeSecurityGroupEgress : It is similer to revokeSecurityGroupIngress api, It removes the egress rule.
     -  listSecurityGroup API's response changed. It include's egress list apart from the existing ingress rules in the output of the API.

   Hypervisors :
      - It is implemented in Xen and KVM.

   Pending Tasks :  Blocking using destination security groups.

   Previous commits: c9fda641673df7701f44963ef27e1d488f121219 , 24e4e44b8f0712a37147a3777833de3f9e24829e
2011-08-30 16:28:35 +05:30
Murali Reddy 279d21ee92 bug 11179: template url and format are not validated
added check to verify url ends with extension same as the template format specified
2011-08-30 16:15:58 +05:30
Edison Su 03e33f16bf bug 11217: only work on the snapshot whose state is "backedup" and is not removed
status 11217: resolved fixed
2011-08-29 15:28:01 -07:00
Edison Su 60cbef1fb8 bug 11217: add db upgrade script, if sechost_id is missing of a snapshot, add one got from presnapshot_id
status 11217: resovled fixed

Conflicts:

	server/src/com/cloud/upgrade/dao/Upgrade229to2210.java
2011-08-29 15:27:53 -07:00
alena 41be3716e3 bug 11196: fixed the code when gson serialization was done twice
status 11196: resolved fixed
2011-08-29 14:50:18 -07:00
Murali Reddy 9abb544865 bug 6876: netscaler MPX & VPX support
- adding supprt for Netscaler VPX & MPX load blancers
    - implemented for virtual networking
    - works only with new fetched public IP, inline support is not added yet
2011-08-30 00:14:05 +05:30
alena 0b95ad2f0f bug 11290: insert VPN config values as a part of 229-2210 upgrade
status 11290: resolved fixed
2011-08-29 11:22:42 -07:00
Murali Reddy 9a10f2b402 bug 6876: netscaler MPX & VPX support
- adding supprt for Netscaler VPX & MPX load blancers
- implemented for virtual networking
- works only with new fetched public IP, inline support is not added yet

more details will be added in the bug
2011-08-29 19:26:08 +05:30
alena 9ecd2058e7 Reverted wrong commit for logging in HostDaoImpl 2011-08-26 17:49:12 -07:00
Kelven Yang ebfe43d15c bug 11263: only update host Id when VM is in running state when detected external VM migration 2011-08-26 16:28:58 -07:00
alena 482528ce8c Fixed the bug in extractTemplate - do ignoreCase comparison when verify the download mode. 2011-08-26 10:11:30 -07:00
Nitin 294f3953a4 bug 11244: Thread updating "op_host_capacity" table shouldn't do updates for removed pods/zones.
status 11244: resolved fixed
2011-08-26 18:58:52 +05:30
Naredula Janardhana Reddy cbed4c7a44 bug 11253:
Added New value "link-local"  to  global config network.loadbalancer.haproxy.stats.visibility . With this change it can take new parameter "link-local" value apart from the existing 3 values global,guest-network,disabled.
       global -  stats visible from public network
       guest-network - stats visible only to guestnetwork.
       link-local - stats visible only to link local network
       disabled - stats disabled.
2011-08-26 15:21:29 +05:30
alena a11b7de9fe Set firewall.rule.ui.enabled to false by default
Conflicts:

	server/src/com/cloud/configuration/Config.java
2011-08-25 16:12:55 -07:00
Kelven Yang 9ace681547 bug 11162: merge fix from 2.2.10 premium 2011-08-25 15:38:43 -07:00
Kelven Yang 97a7dddf7d bug 11162: support memory overprovisioning in VMware 2011-08-25 15:38:28 -07:00
alena 35b551a199 bug 11260: Take networkRate for domR's guest and public interface from the corresponding system service offering 2011-08-25 14:15:12 -07:00
prachi 1fefdd628d Bug 11261 - Allow to update host tags
Changes:
- Changes to updateHostCmd to accepts hosttags parameter
- Changes to wipe out existing tags and save new ones in host_tags DB.
- UpdateHost is Admin only operation - so only root admin can update host tags
2011-08-25 13:01:57 -07:00
alena 8c53dbcdd7 bug 11185: support multiple CIDR on overlapping port ranges for firewall rules
status 11185: resolved fixed

Conflicts:

	server/src/com/cloud/network/firewall/FirewallManagerImpl.java

Conflicts:

	api/src/com/cloud/network/firewall/FirewallService.java
	server/src/com/cloud/network/firewall/FirewallManagerImpl.java
	server/src/com/cloud/network/lb/LoadBalancingRulesManagerImpl.java
	server/src/com/cloud/network/rules/RulesManagerImpl.java
2011-08-25 12:21:11 -07:00
prachi 16986c01c8 Bug 9921 - template tags
-Added missing import statement.
2011-08-25 12:16:09 -07:00
prachi b6851e631e Bug 9921 - template tags
-Upgrade path from 2.2.10 to 2.2.11
2011-08-25 12:09:21 -07:00
prachi 05440f0905 Bug 9921 - template tags
Changes:
- CreateTemplate and RegisterTemplate now support adding a template tag. It is a string value. This is root-admin only action - only admin can add template tags.
- ListTemplates will return the template tag in response.
- HostAllocator changed to use template tag along with the existing tag on service offering. If both tags are present, allocator now finds hosts satisfying both tags. If no hosts have both tags, allocation will fail.
- DB changes to add new column to vm_template table.
- DB upgrade changes for upgrade from 2.2.10 to 2.2.11
2011-08-25 12:03:59 -07:00
Abhinandan Prateek cd01f7dab2 bug 11181: taking care of a boundary condition with 0 user VM 2011-08-25 15:38:48 +05:30
Naredula Janardhana Reddy 9feb05ac13 bug 10617: This is Intermediate commit for Egress rules implementation in security groups.
previous commit: c9fda641673df7701f44963ef27e1d488f121219 ( this under bug 1067, typing error)
        changes: 1) partially implemented  listing of egress rules along with ingress rules.
                 2) partially implemneted egress rules for KVM
2011-08-25 12:18:33 +05:30
Edison Su 9391938908 fix conflict 2011-08-24 18:47:09 -07:00
alena 0355c26f03 bug 11242: check if db object is already removed before generating the Debug log. It can happen in case when deleteHost command is called many times in parallel for the same host
status 11242: resolved fixed
2011-08-24 15:48:18 -07:00
Kelven Yang a51383e296 bug 11219: use local storage flag from service offering when it is ROOT disk 2011-08-24 15:17:53 -07:00
alena ee9fbf10b6 Method signature change 2011-08-24 14:56:37 -07:00