Commit Graph

1221 Commits

Author SHA1 Message Date
Rohit Yadav 2c5adb8085 CLOUDSTACK-9446: Marvin and integration-tests packages
This introduces two new cloudstack packages: marvin and integration-tests.
The two packages will make it easier for CI systems to install Marvin for a
specific cloudstack release/build and run integration tests that are specific
for that version/build.

- maven: add explicit juniper-contrail-api maven repository
- marvin: build source distribution for both install and package mvn phases

(cherry picked from commit 0d0ad8f5b4)
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2016-08-10 17:57:57 +05:30
Rohit Yadav 11abfb8766 tools/appliance: update Debian 7 iso URLs based on 615261
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-09-16 12:56:25 +05:30
Rohit Yadav a4f552d46d cloudstack: set next version to 4.5.3-SNAPSHOT
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-09-14 09:59:40 +05:30
Rohit Yadav 7385441807 Updating pom.xml version numbers for release 4.5.2
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-08-19 14:42:54 +05:30
Rohit Yadav cc63611cc2 tools: fix build_asf.sh release script to remove -SNAPSHOT from bunch of files
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-08-14 13:54:06 +05:30
Rohit Yadav 2ed9539c29 travis: don't force M2_HOME, let Travis use the bundled maven3
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

This closes #652
2015-08-04 01:13:37 +05:30
Rohit Yadav 2777caddbb appliance: bump systemvm template version to 4.5.2
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-07-01 12:45:52 +02:00
Rohit Yadav 20ce346f3a CLOUDSTACK-8457: SAML auth plugin improvements for production usage
* Move config options to SAML plugin
  This moves all configuration options from Config.java to SAML auth manager. This
  allows us to use the config framework.
* Make SAML2UserAuthenticator validate SAML token in httprequest
* Make logout API use ConfigKeys defined in saml auth manager
* Before doing SAML auth, cleanup local states and cookies
* Fix configurations in 4.5.1 to 4.5.2 upgrade path
* Fail if idp has no sso URL defined
* Add a default set of SAML SP cert for testing purposes
  Now to enable and use saml, one needs to do a deploydb-saml after doing a deploydb
* UI remembers login selections, IDP server

- CLOUDSTACK-8458:
    * On UI show dropdown list of discovered IdPs
    * Support SAML Federation, where there may be more than one IdP
        - New datastructure to hold metadata of SP or IdP
        - Recursive processing of IdP metadata
        - Fix login/logout APIs to get new interface and metadata data structure
        - Add org/contact information to metadata
        - Add new API: listIdps that returns list of all discovered IdPs
        - Refactor and cleanup code and tests

- CLOUDSTACK-8459:
    * Add HTTP-POST binding to SP metadata
    * Authn requests must use either HTTP POST/Artifact binding

- CLOUDSTACK-8461:
    * Use unspecified x509 cert as a fallback encryption/signing key
      In case a IDP's metadata does not clearly say if their certificates need to be
      used as signing or encryption and we don't find that, fallback to use the
      unspecified key itself.

- CLOUDSTACK-8462:
    * SAML Auth plugin should not do authorization
      This removes logic to create user if they don't exist. This strictly now
      assumes that users have been already created/imported/authorized by admins.
      As per SAML v2.0 spec section 4.1.2, the SP provider should create authn requests using
      either HTTP POST or HTTP Artifact binding to transfer the message through a
      user agent (browser in our case). The use of HTTP Redirect was one of the reasons
      why this plugin failed to work for some IdP servers that enforce this.
    * Add new User Source
      By reusing the source field, we can find if a user has been SAML enabled or not.
      The limitation is that, once say a user is imported by LDAP and then SAML
      enabled - they won't be able to use LDAP for authentication
    * UI should allow users to pass in domain they want to log into, though it is
      optional and needed only when a user has accounts across domains with same
      username and authorized IDP server
    * SAML users need to be authorized before they can authenticate
        - New column entity to track saml entity id for a user
        - Reusing source column to check if user is saml enabled or not
        - Add new source types, saml2 and saml2disabled
        - New table saml_token to solve the issue of multiple users across domains and
          to enforce security by tracking authn token and checking the samlresponse for
          the tokens
        - Implement API: authorizeSamlSso to enable/disable saml authentication for a
          user
        - Stubs to implement saml token flushing/expiry

- CLOUDSTACK-8463:
    * Use username attribute specified in global setting
      Use username attribute defined by admin from a global setting
      In case of encrypted assertion/attributes:
      - Decrypt them
      - Check signature if provided to check authenticity of message using IdP's
        public key and SP's private key
      - Loop through attributes to find the username

- CLOUDSTACK-8538:
    * Add new global config for SAML request sig algorithm

- CLOUDSTACK-8539:
    * Add metadata refresh timer task and token expiring
        - Fix domain path and save it to saml_tokens
        - Expire hour old saml tokens
        - Refresh metadata based on timer task
        - Fix unit tests

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

This closes #489
2015-06-29 12:25:02 +02:00
Rohit Yadav 5921c493c8 systemvmtemplate: Disable services that slow down boot
The console-setup service brings a nice font to the console, but why would we
want to use it. In most cases it takes a <10 seconds to set it up. When using
nested hypervising, I found this takes much longer time that causes tests to
time-out. I'd suggest turning off these services. They are not required for the
services the systemvm provides.

Manually picked from commit 95e7673
PR #254

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-05-18 23:17:09 +01:00
Rohit Yadav 8daa665fca systemvm64template: install libc6:i386
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-05-18 19:57:01 +02:00
Rohit Yadav 9e3c7d309a systemvmtemplate: update version and fix chmod issue
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-05-12 16:47:59 +02:00
Rohit Yadav 034b986595 systemvmtemplate: use ovftool for building vmware template if available
This commit fixes a chmod issue where extracted vmdk file is not readable by all
users/groups. The other improvement is to use ovftool to build systemvm template
for vmware if it's available. This is based on a dev ML discussion and a suggested
approach by Ilya: http://markmail.org/message/kntsetgxdbppfh22

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-05-12 16:34:01 +02:00
Milamber 815f4d087a Update L10N resource files on 4.5 branch (with 4.5 translation strings from Transifex) Add new HU resource file for Hungarian translation 2015-05-09 07:58:11 +02:00
Laszlo Hornyak ed7704620e Added hu to the language list
Signed-off-by: Laszlo Hornyak <laszlo.hornyak@gmail.com>
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

This closes #237
2015-05-08 17:26:36 +02:00
Rohit Yadav 8b18ab3ff2 Fix version to 4.5.2-SNAPSHOT throughout the source
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-05-08 11:35:59 +02:00
Rohit Yadav 0963432268 apidoc: get version information from $project.version
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-05-08 11:35:34 +02:00
Rohit Yadav d0d08e68e9 tools: fix build
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-05-08 11:11:10 +02:00
Rohit Yadav 4ba72a877c Updating pom.xml version numbers for release 4.5.2-SNAPSHOT
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-05-07 15:33:01 +02:00
Rohit Yadav 11b7b0a3c3 Merge branch 'GA-4.5.1' into 4.5 2015-05-07 15:27:45 +02:00
Abhinandan Prateek e1a212842a CLOUDSTACK-8429: optimizing travis to run configurable set of tests only after configurable runs 2015-05-06 08:49:16 +05:30
Rohit Yadav 0eb4eb2370 Updating pom.xml version numbers for release 4.5.1
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-05-04 12:17:03 +02:00
Abhinandan Prateek fb0bfd5d4f CLOUDSTACK-8429: disabling unit test for faster build 2015-05-01 12:35:03 +05:30
Rohit Yadav a4120b24e4 systemvmtemplate: 7.8.0 iso is archived now, use link from archives
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-04-29 17:14:11 +02:00
Rohit Yadav bf3a0d6085 appliance: remove 32bit systemvmtemplate definition
Starting 4.5, we won't be using 32bit systemvmtemplate. Removing dead code as
it's already far behind in terms of maintenance compared to the 64bit definitions.

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-04-10 15:35:18 +05:30
Rohit Yadav 5d458e8fb7 systemvmtemplate: fix guest driver/tool installation
- VMWare tools not needed since we're install open-vm-tools also recommended by VMWare:
    http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=2073803

- Installing XStools 6.5

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-04-10 15:34:57 +05:30
Rohit Yadav be26b9189c systemvmtemplate: set systemvm version to 4.5.1
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-04-10 13:24:34 +05:30
Rohit Yadav 0fff19a76f systemvmtemplate: increase /opt partition by 100MB
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-04-03 10:48:19 +05:30
Rohit Yadav fe6c009399 zerodisk: zeroout /var/log and cleanup
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-30 15:42:11 +05:30
Rohit Yadav 9080ed6efc systemvmtemplate: only extract systemvm directory from src snapshot
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-30 14:29:38 +05:30
Rohit Yadav 03ff244ff1 systemvmtemplate: increase disk size to 3000
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-30 13:56:41 +05:30
Rohit Yadav 77ed0c4b96 systemvm64template: use separate partition for /var/log
/var/log fills up /var and fails operation of normal services. This fix
restricts /var/log to 100-200M. The fix for CLOUDSTACK-6885 tries to make sure
we don't keep a lot of logs.

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-30 13:49:15 +05:30
Rohit Yadav 666f752875 appliance: remove raw.img before export a new one
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-25 17:25:50 +05:30
Rohit Yadav a80522acf2 systemvm: fix/improve irqbalance on multicore VR
Porting changes from PR: https://github.com/apache/cloudstack/pull/119
to new codebase used for systemvmtemplate generation.

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-23 14:23:46 +05:30
Rohit Yadav d22dd01cb8 appliance: after building systemvm template save the md5 checksums
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-20 15:18:30 +05:30
Rohit Yadav c198dfdb7a Update pom and version usage to 4.5.1-SNAPSHOT
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-12 12:13:18 +05:30
Rohit Yadav 7d2ffe063d systemvms: use Debian http redirector for apt repos
Picked in parts from https://github.com/apache/cloudstack/pull/103/files

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-03-11 13:22:09 +05:30
Abhinandan Prateek 519488fcdc fixing misleading comment 2015-03-09 00:20:28 -04:00
Pierre-Luc Dion c234751069 apidoc: back button and devdoc link update 2015-02-07 16:18:26 -05:00
Pierre-Luc Dion a8ed45b64b apidoc: license date change to 2015 2015-02-07 16:13:27 -05:00
Rohit Yadav 8be969124c appliance: fix typo in git repo script tarball url
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-02-06 23:54:22 +05:30
Rohit Yadav bb14a6553d appliance: make room for /var fix systemvm build
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-02-06 23:39:31 +05:30
Rohit Yadav 9198859dcf appliance: before apt-get upgrade, do a clean to free-up space
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-02-06 16:59:44 +05:30
Rohit Yadav 5159cbec9f appliance: get scripts only from 4.5 and not master
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-02-03 16:50:37 +05:30
Rohit Yadav 805704721f appliance: hold on to openswan version, don't upgrade
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
(cherry picked from commit a10a9d522c)
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-01-28 23:22:48 +05:30
Rohit Yadav a3fa59eaf1 appliance: fix missing statement
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-01-28 23:14:12 +05:30
Rohit Yadav eca528dec7 appliance: upgrade systemvm to latest packages
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-01-28 23:10:31 +05:30
SrikanteswaraRao Talluri 2c515395d7 CLOUDSTACK-8161: mark the data volume related operations on LXC as skipped if RBD storage pool is not available
Signed-off-by: SrikanteswaraRao Talluri <talluri@apache.org>
2015-01-16 18:45:19 +05:30
Rohit Yadav b99d950dd3 appliance: fix Debian iso url, fixes failing Jenkins builds
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2015-01-15 15:31:27 +05:30
David Nalley d161642f69 make the date command actually work 2015-01-12 17:46:12 -05:00
Gaurav Aradhye 94237a4c5b CLOUDSTACK-8116: Moved ldap data to configurableData section in test_data.py and made related changes in the test case
Signed-off-by: SrikanteswaraRao Talluri <talluri@apache.org>
2014-12-24 10:38:05 +05:30