Patch-ID# 112863-04
Keywords: mpi rsm hpc_rsmd libcre libcre_nomt
Synopsis: HPC 5.0: MPI CRE RSM fixes
Date: Oct/11/2004


Install Requirements: None                      
                      
Solaris Release: 8 9

SunOS Release: 5.8 5.9

Unbundled Product: HPC

Unbundled Release: 5.0

Xref: 

Topic: 

Relevant Architectures: sparc

BugId's fixed with this patch: 4784876 4785143 4785966 4804481 4812693 4815821 4816919 4817414 4818271 4818335 4819831 4822435 4822854 4825666 4827850 4828144 4828184 4829405 4833850 4837346 4838396 4841030 4842681 4971579 5057547

Changes incorporated in this version: 5057547

Patches accumulated and obsoleted by this patch: 

Patches which conflict with this patch: 

Patches required with this patch: 
NOTE: For Solaris 8, patch 108528-28 is required

Obsoleted by: 

Files included with this patch: 

/kernel/drv/sparcv9/hpctm
/opt/SUNWhpc/HPC5.0/bin/mprun
/opt/SUNWhpc/HPC5.0/etc/sunhpc.hpc_rsmd
/opt/SUNWhpc/HPC5.0/lib/libcre.so.2
/opt/SUNWhpc/HPC5.0/lib/libcre_nomt.so.2
/opt/SUNWhpc/HPC5.0/lib/libfmpi.so.1
/opt/SUNWhpc/HPC5.0/lib/libmpi.so.1
/opt/SUNWhpc/HPC5.0/lib/libmpi_mt.so.1
/opt/SUNWhpc/HPC5.0/lib/libpmpi.so.1
/opt/SUNWhpc/HPC5.0/lib/rsmid.so.1
/opt/SUNWhpc/HPC5.0/lib/rsmpm.so.2
/opt/SUNWhpc/HPC5.0/lib/rsmpm_mt.so.2
/opt/SUNWhpc/HPC5.0/lib/sparcv9/hpc_rsmd
/opt/SUNWhpc/HPC5.0/lib/sparcv9/hpc_rsmd_jobrelease
/opt/SUNWhpc/HPC5.0/lib/sparcv9/libcre.so.2
/opt/SUNWhpc/HPC5.0/lib/sparcv9/libcre_nomt.so.2
/opt/SUNWhpc/HPC5.0/lib/sparcv9/libmpi.so.1
/opt/SUNWhpc/HPC5.0/lib/sparcv9/libmpi_mt.so.1
/opt/SUNWhpc/HPC5.0/lib/sparcv9/rsmid.so.1
/opt/SUNWhpc/HPC5.0/lib/sparcv9/rsmpm.so.2
/opt/SUNWhpc/HPC5.0/lib/sparcv9/rsmpm_mt.so.2
/opt/SUNWhpc/HPC5.0/lib/sparcv9/tcppm.so.2
/opt/SUNWhpc/HPC5.0/lib/sparcv9/tcppm_mt.so.2
/opt/SUNWhpc/HPC5.0/lib/tcppm.so.2
/opt/SUNWhpc/HPC5.0/lib/tcppm_mt.so.2

Problem Description:

5057547 Memory leak in MPI libraries
 
(from 112863-03)
 
4971579 ClusterTools 5: I/O bug within mprun/tm.iod(spmd)
 
(from 112863-02)
 
4785966 Performance: RSM bw with MPO
4841030 Very minor typos in error message
4784876 runtime option needed to get debug information for hpc_rsmd
4812693 hpc_rsmd lock files left over in ufs /tmp prevent hpc_rsmd start on boot
4828144 hpc_rsmd crash can leave hpctm paths up and interfer withwrsmconf use
4828184 hpc_rsmd will hang when trying to create/export rsm segment totaling >4GB
4829405 very large memory rsm mpi jobs lead to long hpc_rsmd jobrelease times
4833850 hpc_rsmd can take too long to exit when a large job is running at exit time
4837346 hpc_rsmd rsm pathup requests are passed over
4838396 hpc_rsmd needs to relate local host to wrsmconf topology Node Name field
4842681 open file references can accumulate up to limit in hpc_rsmd
4785143 runtime option needed to get debug hpctm messages
 
(from 112863-01)
 
4816919 large rsm mpi jobs interrupted immediately fail to deliverhpc_rsmd jobrelease
4804481 mpi MT MPI_Put over RSM requires reboot
4815821 mpi uses too much rsm buffer space at high np
4818271 Missing PMPI_ symbols for one sided communication
4819831 MPI_Comm_spawn fails after 2 spwans
4825666 MPI_Alltoall hangs after transient RSM barrier failures
4817414 Performance: start-up of large RSM jobs
4827850 MPI RSM PM hangs when MPI_POLLALL=0 and data phase timeouts occur
4818335 hpc_rsmd resources left behind if job aborts before atexit handler is active
4822854 MPI 1-sided communication test fails over Sun Fire Link RSM
4822435 hpc_rsmd linked with libtnfprobe can segv in thr_exit
 
 
 
Usage notes:

Patch Installation Instructions:
--------------------------------
For Solaris 7-8 releases, refer to the man pages for instructions
on using 'patchadd' and 'patchrm' scripts provided with Solaris.
Any other special or non-generic installation instructions should be
described below as special instructions.  The following example
installs a patch to a standalone machine:
 
        example# patchadd /var/spool/patch/104945-02
 
The following example removes a patch from a standalone system:
 
        example# patchrm 104945-02
 
For additional examples please see the appropriate man pages.

Special Install Instructions:
----------------------------- 
- restart all HPC CT daemons via:
	/opt/SUNWhpc/HPC5.0/sbin/ctstopd ...
	<install this patch>
	/opt/SUNWhpc/HPC5.0/sbin/ctstartd ...
 
- See FIN #: I0997-1 for information about running MPI jobs with a large
  number of processes (>1000).
 
- To have HPC ClusterTool 5.0 be completely fixed when working with
  the Sun Fire Link interconnect the following patches must be applied:
 
    Solaris 8
 
    111796-04  (or newer)
    108528-11 (or newer)
    112077-07 (or newer)
    113656-04 (or newer)
    113655-03 (or newer)
    110934-10 (or newer)
 
    Solaris 9
 
    113024-07 (or newer)
    112233-06 (or newer)
    113713-03 (or newer)
    114233-03 (or newer)
    115498-01 (or newer)
 
- On large Sun Fire Link cluster configurations consisting of 4 nodes
  or greater the timeout for the Sun Fire Link needs to be increased.
  Please add or change the value listed below in the /etc/system file
  of the nodes utilizing the Sun Fire Link:
 
    set wrsm:wrsm_tl_rpc_timeout=0x989680
 
  A reboot of the domain is required for this change to take effect.
 
 
- Before applying this patch shutdown the CT daemons.
      On all nodes (including master) as root:
      # /opt/SUNWhpc/bin/Install_Utilities/bin/ctstopd -l
 
      Alternatively you can use the -n or -N options to shutdown
      the daemons from one node.
 
   Apply patch on all nodes.
 
   Restart the daemons after applying the patch.
      On all nodes (including master) as root:
      # /opt/SUNWhpc/bin/Install_Utilities/bin/ctstartd -l

README -- Last modified date:  Monday, October 11, 2004

