Commit Graph

34822 Commits

Author SHA1 Message Date
Leo (Hsueh Yu-Min) 72a1c0e7f1
[KVM] Add MV Settings for virtual GPU hardware type and memory (#5513)
* KVM: Add MV Settings for virtual GPU hardware type and memory

* fix method createVideoDef argument in test package

* add available options for KVM virtual GPU hardware VM setting

* fix videoRam default value

* fix _videoRam is 0, it will use default provided by libvirt
2021-10-04 09:55:32 +05:30
Wei Zhou 669ab73efe
server: check service offering (storage) tags when reallocate a ROOT disk (#5501)
* server: check service offering (storage) tags when reallocate a ROOT disk

* server: resize volumes in Allocated state
2021-10-03 19:45:59 -03:00
Daniel Augusto Veronezi Salvador e92ce916f3
network: Remove logic that creates gap for multiple 'source NAT' in VR (#5532)
In ACS, when a VPC has more than one public IP and a user tries to use the non `source NAT` IP with some feature/option (like `static NAT`, `port forwarding`, `VPN` and others), ACS adds the public IP (used for the feature/option) as `source NAT` in the `iptables` of the VR.

Example:
- VPC has one public IP `192.168.0.50` and it is defined as the `source NAT`.
- If we assign another public IP `192.168.0.51` to the VPC and use it to execute `port forwarding`, ACS will automatically add `192.168.0.51` as `source NAT` too.

Co-authored-by: GutoVeronezi <daniel@scclouds.com.br>
2021-10-03 14:55:28 +05:30
Wei Zhou 09fce75047
OVS/GRE: bug fixes (#5446)
* OVS/GRE: fix failed to fetch cloudbr* info on host

* OVS/GRE: move ovstunnel.py to python3

* OVS: add test_privategw_acl_ovs_gre.py for automatic testing

(1) VR <-> VM should work
(2) Private GW should work

* OVS: fix an issue on xenserver

ovs bridges are deleted by xenserver/ovs automatically
```
[root@ref-trl-1797-x-M7-wei-zhou-xs2 ~]# grep -r xapi7 /var/log/ |grep del-br
/var/log/xensource.log:Sep 15 07:13:44 ref-trl-1797-x-M7-wei-zhou-xs2 xcp-networkd: [ info|localhost|611 |org.xen.xapi.xenops.classic events D:4a3d931cd89f|network_utils] /usr/bin/ovs-vsctl --timeout=20 -- --if-exists del-br xapi7
/var/log/daemon.log:Sep 15 07:13:45 ref-trl-1797-x-M7-wei-zhou-xs2 ovs-vsctl: ovs|00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl --timeout=20 -- --if-exists del-br xapi7
```

which results that xe network exists but bridge does not exist, and operation stuck for 20 minutes at
```
2021-09-15 16:06:56    DEBUG [root] #### VMOPS enter  create_tunnel ####
2021-09-15 16:06:56    DEBUG [root] Creating tunnel from host 2 to host 1 with GRE key 2116
2021-09-15 16:06:56    DEBUG [root] Executing:['/usr/bin/ovs-vsctl', '--timeout=0', 'wait-until', 'bridge', 'xapi7', '--', 'get', 'bridge', 'xapi7', 'name']
2021-09-15 16:26:56    DEBUG [root] bridge xapi7 for creating tunnel - VERIFIED
2021-09-15 16:26:56    DEBUG [root] Executing:['/usr/bin/ovs-vsctl', 'add-port', 'xapi7', 't2116-2-1', '--', 'set', 'interface', 't2116-2-1', 'type=gre', 'options:key=2116', 'options:remote_ip=10.0.34.230']
```

* OVS/GRE: component test test_vpc_distributed_routing_offering.py passes on xenserver

* OVS: support Shared network with GRE protocol

* update #5446: use lang3.StringUtils

* OVS/GRE: VPC with distributed routing on kvm (still not working)
2021-10-03 14:47:52 +05:30
Abhishek Kumar 4a42e7ef9e
vmware, ui: update portgroup on network update (#5470)
Enhanced update network form in the UI.
On network offering change for an isolated network,

- VMware portgroup should be updated accordingly.
- VMs on the network should be placed on the correct VMware portgroup based on the network rate, https://docs.cloudstack.apache.org/en/latest/adminguide/service_offerings.html#network-throttling.

Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2021-10-03 14:41:42 +05:30
SadiJr 965a47fdfd
Create UpdateBackupOffering API (#5511)
* Create UpdateBackupOffering API

* Address reviews

* Address reviews

* Address reviews

Co-authored-by: SadiJr <sadi@scclouds.com.br>
2021-10-01 08:30:25 -03:00
Harikrishna df0c0045b5
Fix export snapshot and template to secondary storage to export only required disk (#5510)
* Fix export snapshot and export template to secondary storage in VMware to export only one required disk

* Move clone operation into virtual machine mo

* Code refactored for readability

* Added disk key check even for successful clone operation

* Delete dettached disks from cloned VM and added few logs
2021-09-30 12:44:02 -03:00
Pearl Dsilva 32051fb5fa
Fix permission issue during Diagnostic service garbage collection (#5504) 2021-09-30 08:18:23 -03:00
Hoang Nguyen 75922bb727
remove duplicate endipv6 item in shared network (#5537) 2021-09-30 10:19:37 +05:30
Hoang Nguyen d08e2bcf3a
UI - Fixes modal width by device screen (#5526)
* fix modal width by screen width

* fix test unit fail

* fix overlaps dialogs
2021-09-30 10:19:10 +05:30
Wei Zhou ea643a64e5
server: cannot deploy/start vm if service offering has multiple tags (#5521) 2021-09-29 14:59:48 +05:30
Rakesh dcc02e0fbb
Enable account settings to be visible under domain settings (#4215)
* Enable account settings to be visible under domain settings

All the account settings can't be configured under domain
level settings right now.
By default, if account setting is not configured then
its value will be taken from global setting.
Add a global setting "enable.account.settings.for.domain"
so that if its enabled then all the account level settings
will be visible under domain levelsettings also.
If account level setting is configured then that value will
be considered else it will take domain scope value. If
domain scope value is not configured then it will pick
it up from global setting.

If domain level setting is not configured then by default
the value will be taken from global setting
Add another global setting "enable.domain.settings.for.child.domain"
so that when its true, if a value for domain setting is not
configured then its parent domain value is considered until
it reaches ROOT domain. If no value is configured till ROOT
domain then global setting value will be taken.

Also display all the settings configured under the domain level
in list domains api response

* rename variables

Co-authored-by: Rakesh Venkatesh <rakeshv@apache.org>
2021-09-29 10:29:20 +02:00
DK101010 9ef7355399
ui: show datastore cluster option in vmware zone deployment (#5522)
Co-authored-by: DK101010 <dirk.klahre@itelligence.de>
2021-09-29 09:52:38 +05:30
Pearl Dsilva 37d22646b2
simulator: Add support to scale a VM (#5515)
* simulator: Add support to scale VM

* make list a constant
2021-09-29 09:47:58 +05:30
slavkap 75c15fd0d6
Allow storage plugins to get storage/volume stats without sending commands to hosts (#4826)
* Allow storage plugins to use storage/volume stats

Allow the rest of the storage plugins, not only ScaleIO to implement and
use the storage/volume statistics directly instead of sending cmd to
hosts

* Get the store driver from pool instead of passing it as argument

required change from code review to pick the store driver from pool not
to pass it as argument
2021-09-28 16:17:34 -03:00
Pearl Dsilva e573d0ddcb
Allow users (User accout Role) to delete / archive events (#5520) 2021-09-28 09:45:04 -03:00
Rohit Yadav b955b38ccb Merge remote-tracking branch 'origin/4.15' into main 2021-09-27 16:17:49 +05:30
Abhishek Kumar 25d522fb3d
server: add vm boot details for start vm api (#5469)
Add vm boot details for start vm api

Fixes #5466

Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2021-09-27 16:16:27 +05:30
Rakesh a9c42fd0cd
Provide option to force delete the project (#4617)
* Provide a cleanup flag so that the project will
be deleted only when there are no resources left
in the project. If users click on delete project
by mistake then everything is deleted.

* fix travis failures

Co-authored-by: Rakesh Venkatesh <rakeshv@apache.org>
2021-09-26 01:02:29 -03:00
nicolas 9de5ef9f2b
Merge branch '4.15' into main 2021-09-24 11:32:38 -03:00
Wei Zhou 6aa75cf671
test_vpc_redundant.py: reduce sleep time from 1 hour to 21 mins (#5503) 2021-09-24 11:31:47 -03:00
SadiJr c3a1c7862f
backup: Improve Veeam Plugin logs (#5455)
* Improve Veeam Plugin logs

* Address reviews

* Address reviews

Co-authored-by: SadiJr <sadi@scclouds.com.br>
2021-09-24 17:25:27 +05:30
Wei Zhou 06f602c7df
tools/docker: Upgrade to ubuntu 20.04 , MySQL 8 and python3 (#5507)
* tools/docker: Upgrade to ubuntu 20.04 , MySQL 8 and python3

* Update tools/docker/README.md

* docker simulator: run 'npm rebuild node-sass' before 'npm install'
2021-09-24 17:17:27 +05:30
Pearl Dsilva d1f375f35a
marvin: Refactor - cleanup of resource after test run (#5505) 2021-09-24 13:42:15 +05:30
Pearl Dsilva 74bb80687d
resource limit: Fix resource limit check on VM start (#5428)
* resource limit: Fix resource limit check on VM start

* add check to validate if cpu/memory are within limits for custom offering + exception handling

* unit tests

Co-authored-by: utchoang <hoangnm@unitech.vn>
2021-09-24 09:51:16 +05:30
Pearl Dsilva 6ba656b664
marvin: Fix intermittent failure observed in test_02_list_snapshots_with_removed_data_store (#5483)
* marvin: Fix intermittent failure observed in test_02_list_snapshots_with_removed_data_store

* refactor test
2021-09-23 00:37:25 +05:30
Wei Zhou 50a0e80de6
CPVM: use X509ExtendedTrustManager (#5419) 2021-09-22 15:46:57 -03:00
wx930910 7d5393d577
Refactor GroupByExtension to improve test logic (#5480) 2021-09-22 12:02:10 -03:00
Nicolas Vazquez 2601ee32d2
Fix VM state column (#5490) 2021-09-22 11:34:00 -03:00
Rakesh 56ef349b0e
Display capability info in listNetwork response (#3804)
* Display capability info in listNetwork response

Co-authored-by: Rakesh Venkatesh <r.venkatesh@global.leaseweb.com>
Co-authored-by: Rakesh Venkatesh <rakeshv@apache.org>
2021-09-22 14:54:34 +05:30
Rohit Yadav 910d02466e
ui: recommend adv zone to new users and show basic zone as bottom option (#5496)
* ui: recommend adv zone to new users and show basic zone as bottom option

This shows the adv zone option in the create zone wizard before the basic
zone option and recommends it for new users. This is because adv zone
can offer more flexible and network topology options including what
basic zone offers in form of shared network (with/without security
groups).

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

* let's see if this ticks advanced by default

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2021-09-22 14:52:20 +05:30
Rohit Yadav 9f7a350cbb Merge remote-tracking branch 'origin/4.15' into main
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2021-09-22 14:50:20 +05:30
dahn 3208929a97
move out broken tests (#5495)
Co-authored-by: Daan Hoogland <dahn@onecht.net>
2021-09-22 14:47:18 +05:30
Rohit Yadav 847078b3c8 Merge remote-tracking branch 'origin/4.15' into main 2021-09-22 14:38:56 +05:30
daweilics fb7086a335
Update README.md (#5492)
Correct minor grammatical issues.
2021-09-22 13:35:25 +05:30
Wei Zhou 7444bc6cd5
travis: fix test/integration/component/test_public_ip.py (#5486) 2021-09-22 09:55:13 +02:00
Pearl Dsilva 5d63379ea4
ui: Add support to filter Roles permissions (#5488) 2021-09-21 11:38:50 -03:00
Abhishek Kumar 67be3da36e
ui: fix create account/user with saml (#5481)
Fixes #5477
Fixes #5478

Signed-off-by: Abhishek Kumar <abhishek.mrt22@gmail.com>
2021-09-21 17:32:58 +05:30
davidjumani d9154e8a69
ui: Fix editVM in projectview (#5485) 2021-09-21 17:04:57 +05:30
SadiJr 3eafbf7329
ui: edit tariff quota and allow user driven backups parameter in Import Backup Offering (#5454)
* [UI] Fixes: edit tariff quota and allow user driven backups parameter in Import Backup Offering

* Address reviews

Co-authored-by: SadiJr <sadi@scclouds.com.br>
2021-09-21 12:45:58 +05:30
aleskxyz daa183d9fd
Universal sshkey and password manager script (#4890)
* Add sshkey and password manager script that works with userdata server and configdrive

* fix duplicated sshkey insertion

* Add Alpine support

* Force curl to fail on server errors

* Keep user defined ssh-keys only
2021-09-21 09:00:58 +02:00
sureshanaparti 34bd92259a
New API endpoint to update pod management network IP range (#5458)
* Add UpdatePodManagementNetwork api endpoint

* Checkstyle changes and added a few methods

* Minor Checkstyle change

* Refactor UpdatePodManagementNetworkIpRangeCmd.java

* Added missing parameters

* Cleanup

* Addressed the review comments

Co-authored-by: kioie <kioieddy@google.com>
Co-authored-by: kioie <kioi@outlook.com>
2021-09-20 18:19:05 -03:00
Hoang Nguyen 121a72c4fa
UI - Fixes search error in selectbox (#5472)
* fix search select options

* fix error when selected zone

* fix filterOptions of selecbox
2021-09-20 14:42:18 -03:00
Pearl Dsilva 93150f465b
api: Fix list templates when no secondary stores present (#5468) 2021-09-20 14:07:47 -03:00
dahn 22a0c0a46c
change logging during upgrade (#5474)
* reduce ERROR logging on ignored exception

* string concat formatting

Co-authored-by: sureshanaparti <12028987+sureshanaparti@users.noreply.github.com>

Co-authored-by: Daan Hoogland <dahn@onecht.net>
Co-authored-by: sureshanaparti <12028987+sureshanaparti@users.noreply.github.com>
2021-09-20 13:00:06 -03:00
Pearl Dsilva 20d5bf55b7
server: Add support to encrypt https.keystore.password in server.properties (#5459)
* Add support to encrypt https.keystore.password in server.properties

* address comments

* address comments
2021-09-20 12:58:27 -03:00
Pearl Dsilva ca870dfc73
UI: Fixes issue during logout as user / domain admin (#5476) 2021-09-20 12:20:19 -03:00
Rohit Yadav 0facba9372 Merge remote-tracking branch 'origin/4.15' into main 2021-09-20 13:42:43 +05:30
Wei Zhou 747608f75f
Add New API endpoint: UpdateVlanIpRange (#5411)
* Added Logic to update the user_ip_address table

* Edited ConfigurationManagerImpl

* Refactor UpdateVlanIpRangeCmd location

* Checkstyle corrections

* Mock updateVlanAndPublicIpRange

* Changes:
- UpdateVlanIpRangeCmd - changed since to 4.15.0
- ConfigurationService - Updated Javadoc
- ConfigurationManager - Updated Javadoc
- Added Unit tests
- Added license
- Update server/src/main/java/com/cloud/configuration/ConfigurationManagerImpl.java
- fix some bugs in #5411 and add support for ipv6 and forsystemvms
- fix #5411: disallow forsystemvms if ip range is dedicated
- update #5411: ui changes
- update #5411: support gateway/netmask change
- update #5411: change to sync call and fix bugs

Co-authored-by: kioie <kioieddy@google.com>
Co-authored-by: kioie <kioi@outlook.com>
Co-authored-by: dahn <daan.hoogland@gmail.com>
2021-09-20 10:56:29 +05:30
Wei Zhou f50cc27a5c
server: fix list public ip returns duplicated records (#5464)
* server: fix list public ip returns duplicated records

* update #5464: fix shared network
2021-09-20 10:49:53 +05:30