Configure HUAWEI Cloud for Cloud Bursting

Create the necessary components in HUAWEI Cloud that are required for cloud bursting and then create a cloud bursting scenario.

Before you can begin creating the components necessary for cloud bursting, you must create and activate an HUAWEI Cloud account.

Obtain the HUAWEI Cloud Administrator Credentials

Get the credentials for the HUAWEI Cloud administrative user account so that you can later use this information to create a cloud account in Control.

You must already have signed up for an HUAWEI Cloud account.
When subscribing to HUAWEI Cloud, an administrative user account that has permissions for all system operations is automatically created. Use this user account to add an HUAWEI Cloud account to Control. Reset the password for this account when the password is unknown.
Note: Alternately, you can create a new user and give the user administrative privileges by setting its User Group to "admin".
  1. Login to the HUAWEI Cloud Console.
  2. Click Service List.

    HUAWEI Cloud Console
    Figure 1. HUAWEI Cloud Console
  3. Under Management & Deployment, click Identity and Access Management.
  4. Click Users from the menu located on the left-hand side of the web page.
    A list of users is displayed.
  5. Under Management & Deployment, click Identity and Access Management.
  6. Click Users from the menu located on the left-hand side of the web page.
    A list of users is displayed.
  7. Click located next to a username to display the user's details.
    The user account listed as an "admin" is the account to use to create the cloud account in Control.
    User Details Figure 2. User Details
  8. If you do not know the password for the administrative user account, click Set Credentials.

    Set Password
    Figure 3. Set Password
    1. Enable Set manually.
    2. For Password, enter a password for the user account.
    3. For Confirm Password, enter the password a second time.
    4. Click OK.
      You may have to confirm the password change either by email or by a SMS text.

Add an HUAWEI Cloud Account

Add an existing HUAWEI Cloud account to Control so that you can create a cloud bursting scenario.

  1. Login to Control.
  2. Click the Cloud tab.
  3. Click Cloud from the Infrastructure menu located on the left-hand side of the web page.
  4. Click .
  5. Enter the following to add a cloud account:
    1. For Account name, enter any name for the cloud account.
      The name can be anything meaningful to your organization, e.g., huawei_cloudaccount.
    2. For Auth (IAM) URL, enter https://iam.ap-southeast-1.myhwclouds.com.
    3. For Domain name, enter the Domain Name provided when your subscription to HUAWEI Cloud was created.
      If you do not know your Domain name, contact HUAWEI Cloud support.
    4. For Username, enter a username that is an HUAWEI Cloud administrator.
    5. For Password, enter the password for the HUAWEI Cloud administrator.
  6. Click Create Account.

Check HUAWEI Cloud Account Service Quotas

View your account resource usage and limits.

Quotas are used to limit the number of resources available to users. It is important to ensure you are not exceeding your quota while setting up the resources for cloud bursting. If the existing resource quota cannot meet your service requirements, you can submit a work order to increase your quota. Once your application is approved, your resource quota is updated accordingly and you will be sent a notification.

  1. Login to the HUAWEI Cloud Console.
  2. Click Resources > My Quota.

    View Quotas
    Figure 4. View Quotas
    Information about resources usage and availability is displayed.

    Resource Quotas
    Figure 5. Resources Quotas

Create a Virtual Private Cloud

Create a Virtual Private Cloud (VPC) so that you can perform cloud bursting.

HUAWEI Cloud documentation for creating a VPC can be found at: Creating a VPC and Regions and AZs.
  1. Login to the HUAWEI Cloud Console.
  2. Click Service List.

    HUAWEI Cloud Console
    Figure 6. HUAWEI Cloud Console
  3. Under Network, click Virtual Private Cloud.
  4. Click + Create VPC.
  5. In the Basic Information section:
    1. For Region, select a region.

      Regions are geographic areas isolated from each other. Resources are region-specific and cannot be used across regions through internal network connections. For low network latency and quick resource access, select the nearest region.

    2. For Name, enter a name for the VPC.
    3. For CIDR Block, enter an address range for the network using CIDR notation.
  6. In the Subnet Settings section:
    1. For the Subnet Settings choose the AZ (Availability Zone).
      An Availability Zone is a physical location where resources use independent power supplies and networks. AZs are physically isolated and AZs in the same VPC are interconnected through an internal network.
    2. For Subnet Name, enter a name for the subnet.
    3. For CIDR, enter an address range for the subnet using CIDR notation.
    4. For Advanced Settings, click Default.
  7. Click Create Now.
  8. Once the VPC is created, click Back to VPC List.
  9. Click Security Group located on the left-hand side of the web page.
  10. Click + Create Security Group.
  11. For Name, enter a name for the Security Group.
  12. For Description, enter a suitable description.
  13. Click OK
    Note: By default, the Outbound and Inbound traffic over IPv4 is open. You can add firewall rules to this security group if required.

Creating a Virtual Machine

Create a Elastic Cloud Server (ECS) using a public image provided by HUAWEI Cloud for cloud bursting.

You must have already created a Virtual Private Network with a subnet and assigned a Security Group. If you do not have this information, see Create a Virtual Private Cloud.

HUAWEI Cloud documentation for creating an ECS (virtual machine) can be found at Purchase an ECS.

  1. Login to the HUAWEI Cloud Console.
  2. Click Service List.

    HUAWEI Cloud Console
    Figure 7. HUAWEI Cloud Console
  3. Under Computing, click Elastic Cloud Server.
  4. Click Key Pair from the menu located on the left-hand side of the web page.
  5. Click + Create Key Pair.
  6. For Name, enter a name for the key pair.
  7. Click OK.
  8. Save the key pair (.pem) file to your local disk in a secure location.
    The information in this .pem file is used later to SSH into the VM.
  9. Click OK to confirm that you have downloaded the key pair file.
  10. Click Elastic Cloud Server from the menu located on the left-hand side of the web page.
  11. Click Buy ECS.
  12. For Billing Mode, click Pay-per-use.
  13. For Region, select the same region that was chosen for the previously created VPC.
  14. For AZ (Availability Zone), select the same AZ that was chosen for the previously created VPC.
  15. In the Type section:
    1. Choose a ECS type category:
      • General computing
      • General computing-plus
      • Memory-optimized
      • Large-memory
      • High-performance computing
      • Disk-intensive
    2. For ECS type, click one of the flavor based on the needs of your site.
  16. In the Image section:
    1. Click Public image.
    2. For Select an OS, select CentOS.
    3. For Select an OS version, select CentOS 7.2 64bit(40GB).
  17. In the Disk section, select your system disk requirements.
  18. In the VPC section:
    1. For VPC, select the VPC you created for cloud bursting.
      The NIC information is automatically populated.
    2. For Security Group, select the security group you created for cloud bursting.
    3. For EIP, click Automatically assign
    4. For Bandwidth, specify it as 5 Mbit/s.
  19. For Login Mode, select Key Pair.
  20. For Key Pair, select the key pair file you generated earlier.
  21. For Advanced Settings, click Not required.
  22. For ECS Name, enter a name for the virtual machine.
  23. For Quantity, specify 1.
  24. Click Next.
  25. Review the specifications.
  26. Enable the I have read and agree to the Huawei Image Disclaimer checkbox.
  27. Click Submit Application.
  28. Click Back to ECS List.
    It may take some time to create the virtual machine. Once the ECS is created it is displayed in the ECS list.

Installing and Configuring the PBS MoM on the VM

Install the PBS MoM on the virtual machine and configure the VM per your site's environment.

Log into the VM using the default user "root" and the .pem generated during the creation of the VM.

A startup script is provided during the creation of the bursting scenario. This script is ran after a cloud node is burst and is used to set up the system environment so that nodes burst in the cloud can communicate with the PBS Server. A service specifically designed for cloud instance initialization is cloud-init and is utilized by Control when booting cloud nodes, therefore it must be installed on the VM. For more information about installing cloud-init, refer to the Cloudinit Documentation.

  1. Login to the HUAWEI Cloud console.
  2. Click Service List.

    HUAWEI Cloud Console
    Figure 8. HUAWEI Cloud Console
  3. Under Computing, click Elastic Cloud Server.
  4. Copy the Public IP address (External IP) of the ECS.

    VM IP Address
    Figure 9. VM IP Address
  5. Login to your site's PBS Server.
  6. SSH into the VM using the default user "root", the .pem file you generated when creating the VM and the External IP assigned to the VM.
    ssh -i /path/my-key-pair.pem root@IPV4PublicIP
    where /path/my-key-pair.pem is the path to the .pem file downloaded while creating the virtual machine and IPV4PublicIP is the public IP address of the virtual machine.
  7. Copy the PBS Professional installation package to the VM.
  8. Using the PBS Professional Installation and Upgrade Guide, install and configure the PBS Professional MOM.
  9. Configure the VM for your site's environment such as mounting file systems, connecting it to the authentication service, installing any applications, etc.
  10. Install cloud-init.
  11. Connect the VM to your PBS Professional server and submit a job to ensure it is working as expected.

Create an OS Image

Create an image of the virtual machine configured per your site's requirements.

You must have already created a ECS (virtual machine), installed the PBS MoM on the ECS and configured it per your site's environment.

HUAWEI Cloud documentation can be found at Creating a Linux Private Image.

  1. Login to the HUAWEI Cloud Console.
  2. Click Service List.

    HUAWEI Cloud Console
    Figure 10. HUAWEI Cloud Console
  3. Under Computing, click Image Management Service.
  4. Click + Create Image.
  5. For Region, select the same region that was chosen for the previously created VPC and ECS.
  6. In the Image Type and Source section, .
    1. For Type, click System disk image.
    2. For Source, click ECS.
    3. Select the virtual machine created for cloud bursting.
    4. For Name, enter a name for the virtual machine.
  7. Click Next.
  8. Review the specifications.
  9. Enable the I have read and agree to the Statement of Commitment to Image Creation and Huawei Image Disclaimer checkbox.
  10. Click Submit.
  11. Click Back to Image List.
    The time required for creating an image varies depending on the image file size. Generally, it takes about 20 minutes to create an image. The image is successfully created when its image status changes to Normal.
    Note: Do not perform any operation on the selected ECS or its associated resources during image creation.
You can now delete the virtual machine so that you are no longer charged for it.

Create an HUAWEI Cloud Bursting Scenario

Create an HUAWEI Cloud bursting scenario so that PBS execution nodes can be burst in the cloud.

Open a browser window and login to the HUAWEI Cloud console. Open a second browser window and login to Control.

A startup script is provided during the creation of the bursting scenario. This script is ran after a cloud node is burst and is used to set up the system environment so that nodes burst in the cloud can communicate with the PBS Server. Use a cloud-init script for the startup script. For more information about writing cloud-init scripts, refer to the Cloudinit Documentation and Cloud Bursting Startup Script.

  1. Navigate to the Control browser window.
  2. Click the Cloud tab.
  3. Click Bursting from the Infrastructure menu located on the left-hand side of the web page.
  4. Click Add Bursting Scenario.
  5. Enter information about the bursting scenario such as name, cloud provider, cloud account, and geographic location.
    1. For Name, enter a name for the cloud bursting scenario.
    2. For Description, enter a description.
    3. For Cloud Account, choose a previously created HUAWEI Cloud account from the list.
    4. For Region, select the same region that was chosen for the previously created VM and VPC.
  6. Click Next.

Enter information about the HUAWEI Cloud resources necessary to burst in the cloud.

  1. For Domain name, provide the domain name of your organization for the cloud bursting network.
    altair.com, burst.altair.com
  2. For Hostname prefix, enter a prefix for the names of the burst nodes.
    If "node" is entered , the cloud bursting nodes will be available to PBS Professional as node1, node2, node3, etc.
  3. Navigate to the cloud provider browser window.
  4. Click Service List.

    HUAWEI Cloud Console
    Figure 11. HUAWEI Cloud Console
  5. Under Network, click Virtual Private Cloud.
  6. Click Virtual Private Cloud from the menu located on the left-hand side of the web page.
  7. Click the name of the VPC you created for cloud bursting.
  8. Click the name of the VPC's subnet.
  9. Copy the Subnet ID.
  10. Navigate to the Control browser window.
  11. For Subnet ID, paste the subnet's ID copied from HUAWEI Cloud console.
  12. Navigate to the cloud provider browser window.
  13. Click Security Group from the menu located on the left-hand side of the web page.
  14. Click the name of the security group you created for the VPC.
  15. Copy the ID of the security group.
  16. Navigate to the Control browser window.
  17. For Security Group, paste the security group's ID you copied from the HUAWEI Cloud console.
  18. Navigate to the cloud provider browser window.
  19. Click Service List.

    HUAWEI Cloud Console
    Figure 12. HUAWEI Cloud Console
  20. Under Computing, click Image Management Service.
  21. Click the Private Images tab.
  22. Click the name of the VM image you created for cloud bursting.
  23. Copy the Image ID of the image.
  24. Navigate to the Control browser window.
  25. For OS Image URI, paste the image ID you copied from the HUAWEI Cloud console.
  26. Enable Add public IP to VMs if you need to connect to the cloud bursting nodes from the internet.
    It is recommended to leave this disabled.
  27. For Cloud-init script, click Browse, browse for the startup script file and select it.
    This script will run after a cloud node is burst.
  28. Add public SSH keys for any users that you want to have access to the burst nodes:
    1. Login to the PBS Professional Server.
    2. Copy the public SSH key for the user.
      Public key files are usually stored in /.ssh in the user's home directory.
    3. Navigate to the Control browser window.
    4. Click Add to add the public key.
    5. For Public SSH keys, paste the public SSH key.
    6. Repeat steps a through e to add additional public SSH keys.
    The public keys are copied to each burst node for secure connectivity.
  29. For Idle time before unbursting, enter the minimum time that a cloud node can be idle before it is unburst.

    It is expressed as an integer whose units are in seconds.

  30. For Tags, enter a key-value pair to add a label to the cloud node and press ENTER.
    A tag is a label that is assigned to a cloud node. Tags enable cloud nodes to be categorized in different ways, for example, by purpose, owner, or environment.
    The key-value pair must be entered as key:value. The key must be less than 36 characters and the value must be less than 43 characters. The length of both the key + value should be less than 80 characters. Valid values are alphanumeric, dash (-) and an underscore ( _ ).
    Once the tag is added, it will appear within its own bubble.

    Key-Value Tag
    Figure 13. Key-Value Tag
  31. Repeat the previous step to add more tags.

    Additional Tags
    Figure 14. Additional Tags
    Tip: To remove a tag click on the 'x' located within the tag bubble.
  32. Click Next.
  33. Click the Select instance types for bursting link.
  34. Select the instance types to enable for the bursting scenario by clicking the Enabled checkbox located to the far right of the instance type name.
  35. Click Save.
  36. Click the Create an API Key/ Token link.
  37. For Name, enter a name for the token.
  38. For Expiration date, use the calendar widget to specify the expiration date.
  39. Click Add Token.
    An API key is generated and displayed.
  40. Copy and save this API key.
    The API key is only displayed once. It is pasted in the configuration file used to configure the cloud bursting hook.
  41. Click Close.
  42. Enable the bursting scenario by clicking the slider at the top next to the scenario title.
    If an attempt is made to burst nodes with a disabled instance type, the node is not burst and the below message is displayed in the PBS Server logs (if bursting through PBS), the Cloud logs and through the Cloud component user interface.
    TYPE is not enabled

    Where TYPE is the instance type used when attempting to burst the node.

Once the scenario created, it is recommended to Add Quotas and Alerts. Quotas define bursting limits such as the maximum number of cloud nodes to burst.