High-Performance Computing Cluster Using Raspberry Pi Nodes

Project Summary: Conventional data-center clusters are huge in size, they require more power and more cooling solutions and they are not affordable by everyone. In this project we will introduce a High-Performance Computing cluster, which will be assembled using 8 Raspberry Pi nodes interconn

Project Title

High-Performance Computing Cluster Using Raspberry Pi Nodes

Project Area of Specialization

Software Engineering

Project Summary

Project Summary:

Conventional data-center clusters are huge in size, they require more power and more cooling solutions and they are not affordable by everyone. In this project we will introduce a High-Performance Computing cluster, which will be assembled using 8 Raspberry Pi nodes interconnected with 100 Mbits Ethernet links. This cluster will have a low total cost, comparable to that of a single workstation, and will consume relatively little energy. These qualities along with its light weight, small volume and passive, ambient cooling render it eminently suitable for a number of applications that to which a conventional cluster with its high attendant cost and special infrastructure requirements is ill-suited.

The cluster that we will present in this work combines the unconventional elements of utilizing low-cost and low-power ARM processors, single-board computers like raspberry Pi, commodity Ethernet interconnects, and low-power flash based local storage, whilst supporting traditional technologies such as MPI upon which many super computing applications are built. With a very compact overall size, light weight, and passive, ambient cooling, our cluster will be ideal for demonstration and educational purpose.

Project Objectives

project Objectives:

1) To develop and construct compact, low-power Linux cluster, based on Raspberry Pi single-board computer.

2) To understand the significance of a high-performance computing and clustering.

3)To understand the importance of Raspberry Pi single-board computer as a cluster node

compared to other alternative hardware.

4)To execute chosen parallel programs/Benchmarks to analyze the performance and understand the acceptability of the cluster.

5) To make such cluster will be ideal for demonstration and educational purpose.

Project Implementation Method

Project Implementation Method:

1)Netwrok Topolgy -Making cluster by connecting raspberry Pie's with each other with 100MB ethernet capables and switch.

2)After that installing Raspberry Pi operating system on all Respberry Pi's.

3)Password-less SHH on all nodes.

4)Defining Hostsnames.

5)Deploying and configuration of Hadoop.

6)Installing and configuration of NFS and MPICH

7)Will Execute and analyze different Benchmarks for Perfomance, Network and memory access.

8) Optimization of code to achieve high performance computing.

Benefits of the Project

Benefits of Project:

 1)Through this mini super computer we will achieve High Performance computing with low cost ARM processors, single-board computers using Rasbpberry Pi.

 2) Fault-tolerance is plus point that any time in case if any node corrupt or dead you can change only that node not all the embeded CPU like in other modern laptops or computers.

 3)Cluster will be used for solving Big data analysis and Data science projects.

 4) Portability: we can take this mini super computer any where due to its light weight and compact size as compare to modern workstations which are heavy in weight and big in size.

Technical Details of Final Deliverable

High-performance computing (HPC) is the ability to process data and perform complex calculations at high speeds. To put it into perspective, a laptop or desktop with a 3 GHz processor can perform around 3 billion calculations per second. While that is much faster than any human can achieve, it pales in comparison to HPC solutions that can perform quadrillions of calculations per second. 

One of the best-known types of HPC solutions is the supercomputer. A supercomputer contains thousands of compute nodes that work together to complete one or more tasks. This is called parallel processing. It’s similar to having thousands of PCs networked together, combining compute power to complete tasks faster.

Final Deliverable of the Project

Hardware System

Core Industry

IT

Other Industries

Core Technology

Internet of Things (IoT)

Other Technologies

Artificial Intelligence(AI)

Sustainable Development Goals

Responsible Consumption and Production

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com