You are here

nf.nci.org.au

NCI’s National Facility peak system Raijin is a Fujitsu Primergy high-performance, distributed-memory, cluster based on Intel Sandy Bridge 8-core processors (2.6 GHz) comprising:

  • 57,472 cores in the compute nodes;
  • approximately 160 TBytes of main memory;
  • Infiniband FDR interconnect; and
  • approximately 10 PBytes of usable fast file system (for short-term scratch space).

This provides a:

  • peak performance of approximately 1.2 PFlops -- 8.6 times that of the current peak system;
  • sustained performance of approximately 6.7 times the current peak system (i.e., an aggregate SPECfp_rate2006 of 1.6M); and
  • file system performance which is 6.0 times that of the current system; and consistent with NCI's requirements that the system be well-balanced.

As with the previous system, Vayu, the unit of shared memory parallelism is the node, which comprises dual 8-core processors, i.e., 16 cores.  The memory specification across the nodes is heterogeneous in order to provide a configuration capable of accommodating the requirements of most applications, and providing also for large-memory jobs.  Accordingly:

  • two-thirds of the nodes have 32 GBytes, i.e., 2 GBytes/core;
  • almost one-third of the nodes have 64 GBytes, i.e., 4 GBytes/core; while
  • two (2) per cent of the nodes have 128 GBytes, i.e., 8 GBytes.core.

Raijin is configured with an operating system environment very similar to that of the existing system, therefore providing an easy route for the migration of user codes, and the maintenance of the application software base. It is also hoped that these similarities will facilitate a quick transition.