insideHPC

Using Advanced MPI: Modern Features of the Message-Passing Interface

I just received my copy of the newly published Using Advanced MPI: Modern Features of the Message-Passing Interface. Written by William Gropp, Torsten Hoefler, Ewing Lusk, and Rajeev Thakur, the book ...
The Next Platform

MPI and Scalable Distributed Machine Learning

MPI (Message Passing Interface) is the de facto standard distributed communications framework for scientific and commercial parallel distributed computing. The Intel MPI implementation is a core ...
The Next Platform

Pushing MPI into the Deep Learning Training Stack

We have written much about large-scale deep learning implementations over the last couple of years, but one question that is being posed with increasing frequency is how these workloads (training in ...
insideHPC

Interview: The Importance of the Message Passing Interface to Supercomputing

In this video, Mike Bernhardt from the Exascale Computing Project catches up with ORNL’s David Bernholdt at SC18. They discuss supercomputing the conference, his career, the evolution and significance ...