Parallel computing for less

High speed networks and improved microprocessor performances are making workstations an appealing prospect for parallel computing. With just commodity hardware and software, networked workstations can offer parallel processing at a relatively low cost. Parallel computing can be implemented in two ways. The networked workstations can be set up as a processor bank with dedicated processors providing computing cycles. Or, it can consist of a dynamically varying set of machines that perform long running computations during idle periods. In the latter case, the hardware cost is essentially zero since many organizations already have extensive workstation networks. For some applications, networked workstations can approach or exceed supercomputer performance. However, these loosely coupled multiprocessors will by no means replace the more tightly coupled designs. Supercomputer lower latencies (time elapsed between issuing a memory request and receiving the corresponding data from memory) and higher bandwidths are more efficient for applications with stringent synchronization and communication requirements. But, advances in networking technology and processor performance are expanding the applications that can be executed efficiently on networked workstations