Multinode Installation#

Before You Begin#

Before continuing, you should have followed the OVA installation on each node according to the steps and preliminary requirements specified in: Create a New VM Using the Platform-Install OVA and according to the node roles as indicated in Notes on Multi-Node Installation.

Optionally download or extract language pack template files to support languages other than English.

Note

  • For geo-redundant Multinode Cluster deployment with six Unified Nodes, there are four Unified nodes in the Primary Site and two Unified nodes in the Disaster Recovery (DR) Site in active-standby setup.

    The worker count (voss workers command) needs to be set on the DR nodes. Refer to:

  • For 2 node cluster deployment there are 2 unified nodes.

  • Template installation and upgrade takes approximately two hours. You can follow the progress on the Admin Portal transaction list.

  • It is strongly recommended not to allow customer end-users the same level of administrator access as the restricted groups of provider- and customer administrators. This is why Self-service web proxies as well as Administrator web proxies should be used.

    Systems with Self-service only web proxies are only recommended where the system is customer facing, but where the customer does not administer the system themselves.

  • For cluster installations, also refer to the Health Checks for Cluster Installations Guide.

  • If it is necessary to change an IP address of a node in a cluster, first remove it from the cluster by running the command below on the node to be changed:

    cluster del <IP address of node to be changed>

  • Refer to Installation Logs for troubleshooting logs during an installation.

  • Before installing release 24.1, ensure that an additional 70 GB disk has been made available for the Insights database.

    See: Adding Hard Disk Space and VOSS Automate Hardware Specifications.

    This disk is needed to assign to the insights-voss-sync:database mount point. See the final installation step below.

The standard screen command should be used where indicated. See: Using the screen command.

Installation#

  1. Install VMware tools on each node.

    1. Log in to each node and run app install vmware.

    2. Verify that vmware is running: app list.

  2. Prepare each node to be added to the cluster:

    1. Select a primary Unified node that will become the primary database node. The designation of primary unified node is arbitrary. The deploying administrator can pick any unified node that they see fit.

    2. On each WebProxy and Unified node, excluding the primary node, run cluster prepnode.

  3. Add nodes to the cluster.

    1. Log in to the selected primary Unified node.

    2. Add the Unified and WebProxy nodes to the cluster: cluster add <ip_addr>.

      Note that you do not have to add the selected primary node to the cluster. It will automatically be added to the cluster.

    3. Verify the list of nodes in the cluster: cluster list.

  4. Add the network domain (optional if a domain name is needed). From the selected primary Unified node:

    1. Configure the domain: cluster run all network domain <domain_name>.

    2. Verify the configured network domain: cluster run all network domain. Each node shows the domain that you configured.

  5. Check the network:

    1. From the selected primary Unified node, run cluster check to verify the status of the cluster, network connectivity, disk status and NTP.

      Note

      • Since database weights have not been added yet, database: not configured errors can be ignored. Verification of database weights should be done when this command is run during the step following the provisioning step.

      • If a cluster has not been provisioned, port 443 errors from web proxies are raised upon this check. These errors can be ignored.

      • If errors on other ports (for example 27020) are raised by the check, verify that the firewall service has started. The following command can be run:

        cluster run database app start services:firewall --force

    2. Verify the DNS configuration: cluster run all network dns. Each node responds with the DNS server address.

  6. Create a restore point. As part of the rollback procedure, ensure that a suitable restore point is obtained prior to the start of the activity, as per the guidelines for the infrastructure on which the VOSS Automate platform is deployed.

  7. Configure the cluster.

    1. Provide a weight for each database server with the database weight add <database_ip> <priority> command.

      • Weights of 40, 30 are recommended for two Unified nodes

      • Weights of 40, 30, 20, and 10 are recommended for four Unified nodes

      • Weights of 60, 50, 40, 30, 20, and 10 are recommended for six Unified nodes

      The higher the value, the more priority.

      For Multinode Cluster deployment with four Unified Nodes in a geo-redundant system containing two data center infrastructures in two physical locations the following weights are used:

      • Specify a weight of 40 for the Primary node at the Primary site

      • Specify a weight of 30 for the Secondary node at the Primary site

      • Specify weights of 20 and 10 for the Secondary nodes at the DR site

      For Multinode Cluster deployment with six Unified Nodes in a geo-redundant system containing two data center infrastructures in two physical locations the following weights are used:

      • Specify a weight of 60 for the Primary node at the Primary site

      • Specify a weight of 50 for the Secondary node at the Primary site

      • Specify a weight of 40 for the Secondary node at the Primary site

      • Specify a weight of 30 for the Secondary node at the Primary site

      • Specify weights of 20 and 10 for the Secondary nodes at the DR site

    2. From the selected primary Unified node, now set it up as the primary Unified node. It is recommended that this step is run in a terminal opened with the screen command.

      1. Run screen.

      2. Run cluster provision

        Allow approximately 2 hours for the operation to complete for two WebProxy and four Unified nodes.

    3. When provisioning is complete, check that each node is contactable and that the time server is running on each with cluster check.

      If a service is down, run cluster run <node_ip> app start to restart the service.

      If provisioning is successful, the screen session can be closed by typing exit in the screen terminal. If errors occurred, keep the screen terminal open for troubleshooting purposes and contact VOSS support.

    4. (Optional) If required, set the web weights configurations (Active-Active, Active-Standby, Single node cluster). From the primary Unified node, run the required web weight commands for the Web Proxy nodes. For details, refer to Multi Data Center Deployments and the VOSS Automate Best Practices Guide.

    5. (Optional) If required, enable or disable Self-service or admin web services on the web proxy nodes. This may for example be needed for security purposes.

      The commands must be run on the relevant web proxy node. It is not recommended that the commands be run on a single node cluster system, but only on a cluster. The commands will automatically reconfigure and restart the nginx process, so some downtime will result. Request URLs to a disabled service will redirect the user to the active service.

      • To disable or enable admin or Self-service web services on the web proxy node:

        web service disable <selfservice|admin>

        web service enable <selfservice|admin>

      • To list web services on the web proxy node:

        web service list

  8. Create a restore point. As part of the rollback procedure, ensure that a suitable restore point is obtained prior to the start of the activity, as per the guidelines for the infrastructure on which the VOSS Automate platform is deployed.

  9. Initialize the database and clear all data. On the primary Unified node, run voss cleardown.

    Note that this step may take some time. You can follow the process by running log follow upgrade_db.log or log follow voss-deviceapi/app.log in a separate console on the primary Unified node.

  10. Import the templates.

    1. Copy the VOSS Automate template file to the primary Unified node with the command:

      scp <VOSS Automate_template_file> platform@<unified_node_ip_address>:~/media

    2. Log in to the primary Unified node and and install the template. It is recommended that this step is run in a terminal opened with the screen command.

      1. Run screen.

      2. Run app template media/<VOSS Automate_template_file>

      • The console will display a message:

        Deploying the template-product for VOSS Automate <<RELEASE_VERSION>> ...
        
    3. When prompted to select the product deployment type, provide and confirm the deployment type:

      • Enterprise

      • Provider

      In accordance with the selected deployment type, you are prompted to enter and verify:

      • a top-level administrator password:

        Please enter a password for "sysadmin"

      • and one administrator password - depending on the deployment:

        • Enterprise : Please enter a password for "entadmin"

        • Provider : Please enter a password for "hcsadmin"

      Upon installation, the password length should be at least 8 characters.

      Deployment-specific artifacts are installed according to the selected type of product deployment. A message displays according to the selected deployment type - one of:

      "Importing EnterpriseOverlay.json"
      
      "Importing ProviderOverlay.json ..."
      

      Deployment specific system artifacts are imported and a message is displayed:

      Deployment-specific Overlay artifacts successfully imported.
      
      1. Python functions are deployed

      2. System artifacts are imported.

      3. You are prompted to provide administrator passwords.

      The template install automatically restarts necessary applications. If a cluster the installation propagates changes throughout the cluster.

  11. Review the output from the app template commands and confirm that the install message appears:

    Deployment summary of UPDATED template solution (i.e. current values after installation):
    -----------------------------------------------------------------------------------------
    
    Product: [PRODUCT]
    Version: [UPDATED PRODUCT RELEASE]
    Iteration-version: [UPDATED ITERATION]
    Platform-version: [UPDATED PLATFORM VERSION]
    

    You can also monitor the template installation from the Admin Portal transaction list.

    • If there are no errors, as part of the rollback procedure, ensure that a suitable restore point is obtained prior to the start of the activity, as per the guidelines for the infrastructure on which the VOSS Automate platform is deployed.

    • If there was an error, the install script stops with a failure message listing the problem. Contact VOSS Support.

  12. Check for needed security updates by running the cluster run all security check command on the primary node. If at least one update is required for any node, run the cluster run all security update command on the primary Unified node.

    After the security update is successful, reboot the cluster:

    1. From the selected primary Unified node, run cluster run notme system reboot. Since all services will be stopped, this takes some time.

    2. From the selected primary Unified node, run system reboot. Since all services will be stopped, this takes some time.

    If a node does not properly reboot but the console shows that all processes have terminated, you can manually reboot the node without any system corruption.

  13. (Optional) Install language templates for languages other than English.

    1. Copy the language template file to the primary Unified node with the command:

      scp <language_template_file> platform@<unified_node_ip_address>:~/media

    2. Log in to the primary Unified node and install the template with the command:

      app template media/<language_template_file>

      For example, to install French:

      app template media/VOSS AutomateLanguagePack_fr-fr.template

      There is no need to run this command on all nodes.

  14. (Optional) If the VOSS Automate Phone Based Registration Add-on is required, follow the installation instructions in the Appendix of your Core Feature Guide:

    “Install the Phone Based Registration Web Service”

  15. Run the following command:

    voss migrate_summary_attributes device/cucm/HuntPilot

  16. License the installation:

    From release 21.4 onwards, the deployment needs to be licensed. After installation, a 7-day grace period is available to license the product.

    1. Obtain the required license token from VOSS.

    2. License:

      1. To license through the GUI, follow steps indicated in Product License Management in the Core Feature Guide.

      2. To license through the CLI, follow steps indicated in Product Licensing in the Platform Guide.

  17. Mount the Insights database drive

    On each unified node, assign the insights-voss-sync:database mount point to the drive added for the Insights database prior to installation.

    For example, if drives list shows the added disk as:

    Unused disks:
    sde
    

    then run the command

    drives add sde insights-voss-sync:database

    on each unified node where the drive has been added.

    Sample output (the message below can be ignored on release 24.1:

    WARNING: Failed to connect to lvmetad. Falling back to device scanning.)

    $ drives add sde insights-voss-sync:database
    Configuration setting "devices/scan_lvs" unknown.
    Configuration setting "devices/allow_mixed_block_sizes" unknown.
    WARNING: Failed to connect to lvmetad. Falling back to device scanning.
    71ad98e0-7622-49ad-9fg9-db04055e82bc
    Application insights-voss-sync processes stopped.
    Migrating data to new drive - this can take several minutes
    Data migration complete - reassigning drive
    Checking that /dev/sde1 is mounted
    Checking that /dev/dm-0 is mounted
    /opt/platform/apps/mongodb/dbroot
    Checking that /dev/sdc1 is mounted
    /backups
    
    Application services:firewall processes stopped.
    Reconfiguring applications...
    Application insights-voss-sync processes started.