Uploaded image for project: 'Solution Center'
  1. Solution Center
  2. SOL-434

AWS Multiple EXAStorage Disks per Node

    Details

    • Type: How To
    • Status: Published
    • Affects Version/s: EXASolution 5.0.15
    • Fix Version/s: None
    • Labels:
      None
    • Solution:
      Hide

      This article guides you through the process of setting up cluster nodes with multiple EXAStorage disks. Multiple EXAStorage disks increase disk throughput. For best performance, we recommend using at least one 1TB GP2 SSD (3000IOPS and ~150MB/s).

      • It requires your cluster nodes to be completely reinstalled. All data will be lost
      • Create a database remote backup before proceeding

      Situation:

      Disk throughput saturated

      Goal:

      Increase disk throughput to a maximum

      Calculating the optimal amount of disks

      Example: Instance type m4.10xlarge

      • Provides a maximum disk throughput of 4000mbps (~500MB/s)
      • Optimal disk setup 3x1TB GP2 SSDs (3x150MB/s -> 450MB/s)
      • The remaining 50MB/s are used for the operating system

      Step-by-step instructions:

      a. Stop database instances
      b. Stop EXAStorage service
      c. Set Install flag for all data nodes Nodes - Select all Nodes - Actions - Set Install Flag
      d. Edit Disks of each node Nodes - n0011- Disks and add additional disks

      1. Select d04_storage and click Edit
      2. Click Add, each device requires one separate field
      3. Fill in additional device names, e.g. “/dev/xvdd, /dev/xvde, …” and click Apply
      4. Repeat steps for all data nodes

      e. Create additional EC2 volumes (same size 1TB) using EC2 console, pay attention to the Availability Zones
      f. Attach volumes to the data nodes using EC2 console, use the very same device names as before in EXAoperation, e.g. “/dev/xvdd, /dev/xvde, …”
      g. Reboot nodes though EC2 console
      h. During reboot, data nodes will be reinstalled with the new disks
      i. Once the nodes are up and running set the Active flag Nodes - Select all Nodes - Actions - Set Active Flag
      j. Remove EXAStorage Metadata and start EXAStorage
      k. In EXAStorage, add unused disks on all nodes Select all nodes and click Add Unused Disks
      l. Recreate data volume(s)
      m. Recreate database (optional)
      n. Restore database backup (optional)

      Show
      This article guides you through the process of setting up cluster nodes with multiple EXAStorage disks. Multiple EXAStorage disks increase disk throughput. For best performance, we recommend using at least one 1TB GP2 SSD (3000IOPS and ~150MB/s). It requires your cluster nodes to be completely reinstalled. All data will be lost Create a database remote backup before proceeding Situation: Disk throughput saturated Goal: Increase disk throughput to a maximum Calculating the optimal amount of disks Example: Instance type m4.10xlarge Provides a maximum disk throughput of 4000mbps (~500MB/s) Optimal disk setup 3x1TB GP2 SSDs (3x150MB/s -> 450MB/s) The remaining 50MB/s are used for the operating system Step-by-step instructions: a. Stop database instances b. Stop EXAStorage service c. Set Install flag for all data nodes Nodes - Select all Nodes - Actions - Set Install Flag d. Edit Disks of each node Nodes - n0011- Disks and add additional disks Select d04_storage and click Edit Click Add , each device requires one separate field Fill in additional device names, e.g. “/dev/xvdd, /dev/xvde, …” and click Apply Repeat steps for all data nodes e. Create additional EC2 volumes (same size 1TB) using EC2 console, pay attention to the Availability Zones f. Attach volumes to the data nodes using EC2 console, use the very same device names as before in EXAoperation, e.g. “/dev/xvdd, /dev/xvde, …” g. Reboot nodes though EC2 console h. During reboot, data nodes will be reinstalled with the new disks i. Once the nodes are up and running set the Active flag Nodes - Select all Nodes - Actions - Set Active Flag j. Remove EXAStorage Metadata and start EXAStorage k. In EXAStorage, add unused disks on all nodes Select all nodes and click Add Unused Disks l. Recreate data volume(s) m. Recreate database (optional) n. Restore database backup (optional)
    • Category 1:
      Plattform Support - EXASOL on AWS
    • Category 2:
      Database Administration - Performance

      Attachments

        Activity

          People

          • Assignee:
            CaptainEXA Captain EXASOL
            Reporter:
            CaptainEXA Captain EXASOL
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated: