This last fortnight has been business as usual, except for the last two days.
The last two days
Its been hot so I set the cluster to NNT (no new tasks) and let it finish off what it had, which can take up to 20 hours for the slower Pis. I also set the cache levels to their minimum so it doesn't take so long to finish off the work on hand. Normally I keep 8 tasks per Pi, 4 in progress and 4 cached. The cluster has been idle since then apart from me taking the opportunity to apply updates. Its going to be hot again today.
Replacement USB charger
I got another 5 port USB charger rated at 39 watts/8 amps. Its a Comsol brand so lets see how long they last. That has freed up one of the Astrotek brand chargers which is now a spare. Given I had two of these Astrotek chargers fail I think it best to keep a spare.
I put the two powered-off Pi3B+ nodes on the new charger. They had been off since the last charger died. That puts Marks Rpi Cluster back to 12 x Pi3B+ and 10 x Pi3B compute nodes.
Friday, October 25, 2019
Sunday, October 13, 2019
13th of October
Pi4 support nodes
The official power supply for the Pi4's finally arrived so I installed them this weekend.
The first problem I encountered was the cables for the PiDrive. The PiDrive has a Y split Micro USB cable for power and the Pi4 uses USB C. I had an 3TB external hard disk that has its own power adapter so that was one. For the other one I bought a portable SSD drive which came with a USB A to USB C cable and didn't require external power.
First the proxy server
I then had to find my instructions for moving the root partition from the Micro SD card onto the external device. Most external drives come formatted as exFAT. My instructions uses the command line to do everything. For wiping the external drives I found its easier to plug them into one of my larger Linux machines and use gparted. Once I had them repartitioned and formatted I plugged them into the Pi.
I clean installed Raspbian. I probably could have just swapped the Micro SD cards from the old ones but instead I went with a clean install. I kept the old proxy server running so I could cut and paste the config file across. A couple more commands to set it up and its ready. I then had to go through each of the compute nodes and point all 20 of them to the new proxy server.
There were a bunch of Raspbian updates this weekend so the proxy server got a bit of a work out. File transfer speeds are higher than before for the cached content. I'm not sure if that is the result of the faster network port or using the SSD. I don't think its the extra memory as the proxy doesn't seem to be using it at the moment.
Next the NFS server
The second support node is a NFS server. Again I had to dig out instructions on how to set it up. I did the same process to move the root partition but this time I used the 3TB external hard disk. I kept the old NFS server running so I could copy the files across before powering the old one down for the final time. In hind sight I probably should have done the NFS server first and then I could have just copied the configuration files rather than editing them on each of the compute nodes.
For cooling I left the top off the case. I need to look at a better solution. Unlike the compute nodes the CPU isn't working hard so they aren't running hot.
Current cluster
Marks Rpi Cluster now consists of:
12 x Pi3B+ as compute nodes (two not working due to a failed USB charger)
10 x Pi3B as compute nodes
2 x Pi4B as support nodes
The official power supply for the Pi4's finally arrived so I installed them this weekend.
The first problem I encountered was the cables for the PiDrive. The PiDrive has a Y split Micro USB cable for power and the Pi4 uses USB C. I had an 3TB external hard disk that has its own power adapter so that was one. For the other one I bought a portable SSD drive which came with a USB A to USB C cable and didn't require external power.
First the proxy server
I then had to find my instructions for moving the root partition from the Micro SD card onto the external device. Most external drives come formatted as exFAT. My instructions uses the command line to do everything. For wiping the external drives I found its easier to plug them into one of my larger Linux machines and use gparted. Once I had them repartitioned and formatted I plugged them into the Pi.
I clean installed Raspbian. I probably could have just swapped the Micro SD cards from the old ones but instead I went with a clean install. I kept the old proxy server running so I could cut and paste the config file across. A couple more commands to set it up and its ready. I then had to go through each of the compute nodes and point all 20 of them to the new proxy server.
There were a bunch of Raspbian updates this weekend so the proxy server got a bit of a work out. File transfer speeds are higher than before for the cached content. I'm not sure if that is the result of the faster network port or using the SSD. I don't think its the extra memory as the proxy doesn't seem to be using it at the moment.
Next the NFS server
The second support node is a NFS server. Again I had to dig out instructions on how to set it up. I did the same process to move the root partition but this time I used the 3TB external hard disk. I kept the old NFS server running so I could copy the files across before powering the old one down for the final time. In hind sight I probably should have done the NFS server first and then I could have just copied the configuration files rather than editing them on each of the compute nodes.
For cooling I left the top off the case. I need to look at a better solution. Unlike the compute nodes the CPU isn't working hard so they aren't running hot.
Current cluster
Marks Rpi Cluster now consists of:
12 x Pi3B+ as compute nodes (two not working due to a failed USB charger)
10 x Pi3B as compute nodes
2 x Pi4B as support nodes
Sunday, October 6, 2019
Progress as of 7th of October
Current status
Marks Rpi Cluster continues to run 24/7. The cluster currently has 10 Pi3B+ and 10 Pi3B's all doing Einstein BRP4 work.
The cluster is up to 6.8M credits for Einstein with a recent average of 9,673 credits per day.
Other news
There are two more Pi3B+ nodes off-line which I haven't included in the above numbers because their power supply (a USB charger) failed.
I am still waiting for the back ordered USB-C power supplies for the Pi4's which will become support nodes.
Subscribe to:
Posts (Atom)