Commit Graph

36240 Commits

Author SHA1 Message Date
Abhishek Kumar c33aa96025 refactor, improve startuptask
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-17 19:30:26 +05:30
Abhishek Kumar 290f7a944f agent: allow not to exit on failure if serverresource has flag
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-17 19:29:25 +05:30
Abhishek Kumar b178946dbf allow serverresource flag to not exit on failures
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-17 19:12:18 +05:30
Abhishek Kumar 4b2c5734db fix npe
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-17 14:01:41 +05:30
Abhishek Kumar ad4c56a11f minor refactor for executor min-max
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-16 11:37:31 +05:30
Abhishek Kumar 053a19f551 refactor
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-15 18:53:46 +05:30
Abhishek Kumar 79c257c454 minor change for ssl handshake pool factory
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-15 11:28:54 +05:30
Abhishek Kumar a932a9c2bb refactor agent hostname retrieval
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-15 11:28:35 +05:30
Abhishek Kumar 99e630370c revert min threads for AgentTaskPool
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-12 19:28:15 +05:30
Abhishek Kumar 4e41394088 refactor
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-11 18:21:43 +05:30
Abhishek Kumar 8038b28b1c server: indirectagentlb hypervisor type fix
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-11 17:56:18 +05:30
Abhishek Kumar 38765f327c fix Transaction error
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-11 16:51:33 +05:30
Abhishek Kumar d7bfa276b9 remove unused
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-11 16:06:37 +05:30
Abhishek Kumar 3ff2d81976 fix Transaction.finalize error for updatePowerState
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-11 16:02:56 +05:30
Abhishek Kumar d85dd6d782 make default for powersync for transitioning vms as true
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-11 16:02:05 +05:30
Abhishek Kumar 47333a7077 Merge remote-tracking branch 'apple/apple-base418' into scalability-improvements 2024-10-11 13:37:12 +05:30
Abhishek Kumar af32bcf4ca
Merge pull request #478 from shapeblue/scalability-improvements-fixes
Following changes and improvements:
- Improvements in handling of PingRoutingCommand
   
    1. Added global config - vm.sync.power.state.transitioning, default value: false, to control syncing of power states for transitioning VMs
    2. Improved VirtualMachinePowerStateSync to allow power state sync for host VMs in a batch
    3. Optimized scanning stalled VMs
- Added caching for account/use role API access with expiration after write set to 60 seconds.
- Added caching for some recurring DB retrievals
   
    1. CapacityManager updateCapacityForHost - beneficial for calculation for host capacities by CapacityChecker, host joins
    2. CapacityManager - listing service offerings - beneficial in host capacity calculation
    3. LibvirtServerDiscoverer existing host for the cluster - beneficial for host joins
    4. DownloadListener - hypervisors for zone - beneficial for host joins
    5. VirtualMachineManagerImpl - VMs in progress- beneficial for processing stalled VMs during PingRoutingCommands
- Optimized MS list retrieval for agent connect 
- Optimize finding ready systemvm template for zone
- Database retrieval optimisations - fix and refactor for cases where only IDs or counts are used mainly for hosts and other infra entities. Also similar cases for VMs and other entities related to host concerning background tasks
- Changes in agent-manager connection with NIO classes
   
    1. Optimize use of executor service
    2. Do SSL handshakes within worker threads
    3. Added global configs to finely control the behaviour depending on the infra
    4. On agent side backoff and sslhandshake timeout can be controlled by agent properties
- Improvements in StatsCollection - minimize DB retrievals.
- Improvements in DeploymentPlanner to retrieve only desired host fields and lesser retrievals.
- Improvements in resource calculation
2024-10-11 13:33:38 +05:30
Abhishek Kumar 42111d8e83 fix EOF
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-11 12:30:57 +05:30
Fabricio Duarte bc42264b34 Restore listNetworks behavior & clean up the code (#9461)
Co-authored-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-11 12:29:43 +05:30
Abhishek Kumar 52c483d91d revert to constant backoff
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-11 12:19:50 +05:30
Abhishek Kumar 7ecc173187 changes
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-11 12:12:57 +05:30
Abhishek Kumar d0fc91ab2a build fix
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-09 17:29:18 +05:30
Abhishek Kumar 3ebc6c3d1e agent ssl handshake timeout
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-09 17:19:18 +05:30
Abhishek Kumar 0b8ebb08d6 increase expiry
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-09 17:18:44 +05:30
Wei Zhou 85076cb0f8
Resize volume: add pool capacity disablethreshold for resize and allow volume auto migration (#492)
* server: add global settings for volume resize

* resizeVolume: support automigrate

* server: fix build errors as it is backported from 4.20/main

* Address Suresh's comments

* Update api/src/main/java/org/apache/cloudstack/api/command/user/volume/ResizeVolumeCmd.java

Co-authored-by: Suresh Kumar Anaparti <suresh.anaparti@shapeblue.com>

* Apple issue-299: address Suresh's comments

* Update api/src/main/java/org/apache/cloudstack/api/command/user/volume/ResizeVolumeCmd.java

* UI: add autoMigrate to resizeVolume

---------

Co-authored-by: Suresh Kumar Anaparti <suresh.anaparti@shapeblue.com>
2024-10-09 16:36:33 +05:30
Abhishek Kumar 5f86dad4cb improve cluster overcommit value cache
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-09 16:28:24 +05:30
Abhishek Kumar 1589cde4e4 check for empty ids
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-09 16:27:39 +05:30
Abhishek Kumar 3e830252ab fix invalid range
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-08 17:36:55 +05:30
Abhishek Kumar 864afda935 backoff changes
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-08 16:03:31 +05:30
Abhishek Kumar f85ac6adf9 add a todo
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-08 14:30:45 +05:30
Abhishek Kumar a3ea8603a9 during resource calculation directly return ids for service offering,
templates

Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-08 14:28:26 +05:30
Abhishek Kumar 3f6b7b930a during resourcecalculation select specific fields for uservmjoinvo
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-08 14:27:26 +05:30
Abhishek Kumar a069e14cf9 directly return count for systemvms used in listInfra
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-08 14:25:25 +05:30
Abhishek Kumar c6cc136ce6 changes in pools for agent executors
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-08 14:24:09 +05:30
Abhishek Kumar 3fa9334954 limits changes for listing accounts and domains
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-07 17:30:56 +05:30
Abhishek Kumar 56d8ae371c minor test revert
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-07 16:36:03 +05:30
Abhishek Kumar c859f8ba80 changes in vm powerstate sync
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-07 16:25:14 +05:30
Abhishek Kumar a9661f4587 changes in statscollection
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-07 16:23:15 +05:30
Abhishek Kumar a5d02665b4 changes for host reqrieval from db
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-07 16:21:06 +05:30
Abhishek Kumar d2075415ac remove logs from DynamicRoleBasedAPIAccessChecker
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-07 15:32:06 +05:30
Abhishek Kumar b4fb97c886 change in account role caching
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-04 16:50:09 +05:30
Abhishek Kumar a74403bd97 revert logging changes
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-04 16:49:39 +05:30
Abhishek Kumar 9afb25a969 fix
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-10-03 15:54:21 +05:30
Abhishek Kumar f7f9249be5 fix
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-09-30 18:09:34 +05:30
Abhishek Kumar d9269842d0 changes
- add timeout for CheckNetworkCommand
- use SychnonousQueue for ssl/tls handshake worker
- revert to TLSv1.2

Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-09-30 17:40:42 +05:30
Abhishek Kumar adae7c88b8 changes
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-09-27 13:00:38 +05:30
Abhishek Kumar fa50740514 wip
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-09-26 12:10:38 +05:30
Abhishek Kumar 1652086ff9 wip changes for agent reconnection
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-09-25 18:33:55 +05:30
Suresh Kumar Anaparti 7068a6ebeb
Fix root disk resize validation - don't lookup with disk offering id of the root disk in service offering view (#9428) (#489)
Issue: During root disk resize, the root disk size details are checked in a different service offering (looks up with disk offering id of the root disk in service offering view which is getting wrong service offering).
2024-09-24 21:45:03 +05:30
Abhishek Kumar 0151f125aa improvement
Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2024-09-23 20:04:34 +05:30