During the past days we started to use our new data center in a new building. One of the first things that needed to be moved was our HPE 3PAR storage system. This storage is used only with VMware vCenter using a vSphere Metro Storage Cluster (vMSC) with Peer Persistence.
With the help of HPE 3PAR engineers we were able to carry out a hot moving without any interruption of production for users and servers. This was made possible by the excellent Peer Persistence system made by HPE and the VMware vSphere Metro Storage Cluster certified configuration.
Before trying to move this storage system, I made some search on the Internet without finding information regarding this kind of operation. So I hope that my personal notes can help someone else in the same situation.
⚠️ Please note that’s informational only, you need to be sure about the operations and the method to recover during the process for ALL operations. Getting help from HPE engineers will be the only way to be safe and to ensure that operations will be successful.
Before starting
- Identify all cables that need to be moved, you can use stickers and photos to facilitate the migration
- Take care of the SAS cables and FC ports used for Peer Persistence
- Prepare the new location by cabling and configuring everything that can be performing before the move
- Check that you’re respecting all the known best practices, especially the ones about multi-pathing
- Check that you’re not affected by a known HPE Advisor
- Give a look especially here about ATS: Array Host Disconnects While Running VMware vSphere 5.5 Update 2 and Later
- Check your setup with compatibility matrix:
- HPE 3PAR Operating System Upgrade Planning Guide (Not exactly what’s expected, but contains useful information)
- VMware Compatibility Guide
- Check the multi-path status of your ESXi servers in vSphere
- Execute a Health Check on both HPE 3PAR and validate the result
- Check that your Peer Persistence volumes are synced
- SSMC -> Remote Copy Groups -> Select the copy group -> Volume Pair
Perform the move
- On the device that need to be moved execute a switchover command
- SSMC -> Remote Copy Groups -> Select the copy group -> Switchover
- Wait until the operation is done
- Check the stability of your installation with vSphere
- Performance monitoring is a good way to check the latency
- Rescanning the hosts for HBA a storage path is a good way to know if you’ve lost something
- Check that the volumes on the HPE 3PAR which must be moved have no IOPS
- SSMC -> Virtual Volumes -> Filter by the unit that must be moved -> Select the volumes one by one -> Performance – > 1 hour
- Check that the activity is now handled by the remaining HPE 3PAR
- SSMS -> Virtual Volumes -> Filter by the unit that will stay -> Select the replicated volumes one by one -> Performance – > 1 hour
- Momentary disable the Quorum Witness
- SSMC -> Remote Copy Configurations -> Select the configuration -> Configure Quorum Witness -> Set to off the Start option
- Stop the Remote Copy Groups
- SSMS -> Remote Copy Groups -> Select affected groups one by one -> Stop
- Shutdown the HPE 3PAR that need to be moved
- CLI -> shutdownsys halt -> Confirm
- Richard T Arnold has a more complete blog post about how to shutdown a 3PAR
- Physically shutdown the HPE 3PAR by pressing the power button on the power supply
- Expect a complete shutdown, battery cache can keep the unit powered one still a few minutes
- Check again that your production is not affected and everything is working fine on vSphere
- Physically move all equipments and cables
- Check that the SAN fabric is ready and the zoning is corresponding as what you need
- If you’ve moved the SAN fabric switches at the same time, check that the ISL link is up and trunk is allowing the correct SAN
- Power On the HPE 3PAR
- Execute a check health to be sure that the health status has not changed
- Remote Copy Groups error will be reported because it was disabled
- Check that the Remote Copy Group configuration is up and ready
- SSMC -> Remote Copy Configurations -> Links
- Start again the Remote Copy Groups
- SSMC -> Remote Copy Groups -> Select affected groups one by one -> Start
- Enable the Quorum Witness
- SSMC -> Remote Copy Configurations -> Select the configuration -> Configure Quorum Witness -> Set to On the Start option
- Wait until all the data is in sync again
- SSMC -> Remote Copy Groups -> Select affected groups one by one -> Volume Pairs
- Check that all Virtual Volumes are synced
- On the device that was moved execute a switchover command again
- SSMC -> Remote Copy Groups -> Select the copy group -> Switchover
- Wait until the operation is done
- Check that the volumes that were moved have again some IOPS
- SSMC -> Virtual Volumes -> Filter by the unit that have been moved -> Select the volumes one by one -> Performance – > 1 hour
- Check on the vSphere side if everything is running fine
I have 5 boxes of disks, is it extremely necessary to identify or label the SAS cables ?.
What happens if I don’t?
The goal is to replicate exactly the same architecture. If you follow the HPE cabling recommendations, this should not be a problem. But during a move, the advantage is that you don’t have to think and you’re sure that was working like that before.
Please note that’s an old post, and I don’t know if it’s still 100% accurate.