cloudstack/setup/db
Rohit Yadav 366d82e292 FR12 (CLOUDSTACK-9993): Secure Agent Communications (#38)
This introduces a new certificate authority framework that allows
pluggable CA provider implementations to handle certificate operations
around issuance, revocation and propagation. The framework injects
itself to `NioServer` to handle agent connections securely. The
framework adds assumptions in `NioClient` that a keystore if available
with known name `cloud.jks` will be used for SSL negotiations and
handshake.

This includes a default 'root' CA provider plugin which creates its own
self-signed root certificate authority on first run and uses it for
issuance and provisioning of certificate to CloudStack agents such as
the KVM, CPVM and SSVM agents and also for the management server for
peer clustering.

Additional changes and notes:
- Comma separate list of management server IPs can be set to the 'host'
  global setting. Newly provisioned agents (KVM/CPVM/SSVM etc) will get
  radomized comma separated list to which they will attempt connection
  or reconnection in provided order. This removes need of a TCP LB on
  port 8250 (default) of the management server(s).
- All fresh deployment will enforce two-way SSL authentication where
  connecting agents will be required to present certificates issued
  by the 'root' CA plugin.
- Existing environment on upgrade will continue to use one-way SSL
  authentication and connecting agents will not be required to present
  certificates.
- A script `keystore-setup` is responsible for initial keystore setup
  and CSR generation on the agent/hosts.
- A script `keystore-cert-import` is responsible for import provided
  certificate payload to the java keystore file.
- Agent security (keystore, certificates etc) are setup initially using
  SSH, and later provisioning is handled via an existing agent connection
  using command-answers. The supported clients and agents are limited to
  CPVM, SSVM, and KVM agents, and clustered management server (peering).
- Certificate revocation does not revoke an existing agent-mgmt server
  connection, however rejects a revoked certificate used during SSL
  handshake.
- Older `cloudstackmanagement.keystore` is deprecated and will no longer
  be used by mgmt server(s) for SSL negotiations and handshake. New
  keystores will be named `cloud.jks`, any additional SSL certificates
  should not be imported in it for use with tomcat etc. The `cloud.jks`
  keystore is stricly used for agent-server communications.
- Management server keystore are validated and renewed on start up only,
  the validity of them are same as the CA certificates.

New APIs:
- listCaProviders: lists all available CA provider plugins
- listCaCertificate: lists the CA certificate(s)
- issueCertificate: issues X509 client certificate with/without a CSR
- provisionCertificate: provisions certificate to a host
- revokeCertificate: revokes a client certificate using its serial

Global settings for the CA framework:
- ca.framework.provider.plugin: The configured CA provider plugin
- ca.framework.cert.keysize: The key size for certificate generation
- ca.framework.cert.signature.algorithm: The certificate signature algorithm
- ca.framework.cert.validity.period: Certificate validity in days
- ca.framework.cert.automatic.renewal: Certificate auto-renewal setting
- ca.framework.background.task.delay: CA background task delay/interval
- ca.framework.cert.expiry.alert.period: Days to check and alert expiring certificates

Global settings for the default 'root' CA provider:
- ca.plugin.root.private.key: (hidden/encrypted) CA private key
- ca.plugin.root.public.key: (hidden/encrypted) CA public key
- ca.plugin.root.ca.certificate: (hidden/encrypted) CA certificate
- ca.plugin.root.issuer.dn: The CA issue distinguished name
- ca.plugin.root.auth.strictness: Are clients required to present certificates
- ca.plugin.root.allow.expired.cert: Are clients with expired certificates allowed

UI changes:
- Button to download/save the CA certificates.

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
2017-09-26 09:19:31 +05:30
..
db FR12 (CLOUDSTACK-9993): Secure Agent Communications (#38) 2017-09-26 09:19:31 +05:30
22beta4to22GA.sql applying the commits from Chip Childers licensing cleanup 2012-06-26 10:44:04 -04:00
221to222upgrade.sh applying the commits from Chip Childers licensing cleanup 2012-06-26 10:44:04 -04:00
create-database-premium.sql applying the commits from Chip Childers licensing cleanup 2012-06-26 10:44:04 -04:00
create-database-simulator.sql property files and build file fixes for simulator db changes 2012-09-17 17:33:26 +05:30
create-database.sql applying the commits from Chip Childers licensing cleanup 2012-06-26 10:44:04 -04:00
create-schema-premium.sql db: use explicit USE statements to avoid SQL failures 2015-02-23 02:02:02 +05:30
create-schema-simulator.sql new vmsync for simulator 2014-07-30 15:10:51 -07:00
create-schema.sql CLOUDSTACK-7873 Fixed the user vm details length issue for higher key lengths 2014-11-10 21:24:28 +05:30
data-20to21.sql applying the commits from Chip Childers licensing cleanup 2012-06-26 10:44:04 -04:00
data-22beta1to22beta2.sql applying the commits from Chip Childers licensing cleanup 2012-06-26 10:44:04 -04:00
deploy-db-clouddev.sh It's due to replace.properties is missing, by default the password is cloud for user cloud 2012-07-09 11:48:43 -07:00
deploy-db-dev.sh db: Remove create-schema-view.sql, views are created using schema-40to410.sql 2013-02-17 23:49:27 +05:30
deploy-db-simulator.sh db: Remove create-schema-view.sql, views are created using schema-40to410.sql 2013-02-17 23:49:27 +05:30
hypervisor_capabilities.simulator.sql CLOUDSTACK-5080: Hypervisor Capabilities table missing entry for Simulator 2013-11-11 12:11:28 +05:30
index-20to21.sql applying the commits from Chip Childers licensing cleanup 2012-06-26 10:44:04 -04:00
index-212to213.sql applying the commits from Chip Childers licensing cleanup 2012-06-26 10:44:04 -04:00
postprocess-20to21.sql applying the commits from Chip Childers licensing cleanup 2012-06-26 10:44:04 -04:00
server-setup.sql FR12 (CLOUDSTACK-9993): Secure Agent Communications (#38) 2017-09-26 09:19:31 +05:30
server-setup.xml FR12 (CLOUDSTACK-9993): Secure Agent Communications (#38) 2017-09-26 09:19:31 +05:30
templates.simulator.sql APPLE-165: Host HA management and HA provider for KVM 2017-01-18 18:18:53 +05:30
templates.sql CLOUDSTACK-8165: updating guest os id for xen template to corresponding 64 bit as default template is 64 bit 2015-01-19 15:44:14 +05:30