Patch-ID# 118083-01
Keywords: qmaster scheduler qmon qstat qconf qconf memory usage
Synopsis: N1 Grid Engine 6.0 maintenance patch
Date: Aug/19/2004


Install Requirements: Additional instructions may be listed below                      
                      
Solaris Release: 7 8 9

SunOS Release: 5.7 5.8 5.9

Unbundled Product: N1 Grid Engine

Unbundled Release: 6.0

Xref: See patch matrix below

Topic: 

Relevant Architectures: sparc

BugId's fixed with this patch: 5063311 5063316 5063987 5071498 5071502 5071522 5071525 5071539 5071914 5071918 5071987 5072005 5072481 5072772 5073218 5074788 5075346 5075398 5075451 5075849 5075936 5076358 5076372 5076491 5077165 5077549 5077589 5078783 5079514 5079572 5080779 5080784 5080833 5080836 5080839 5080840 5080851 5080852 5080853 5080856 5081821 5081822 5081839 5082490 5083102 5083115 5084317 5085392

Changes incorporated in this version: 5063311 5063316 5063987 5071498 5071502 
5071522 5071525 5071539 5071914 
5071918 5071987 5072005 5072481 
5072772 5073218 5074788 5075346 
5075398 5075451 5075849 5075936 
5076358 5076372 5076491 5077165 
5077549 5077589 5078783 5079514 
5079572 5080779 5080784 5080833 
5080836 5080839 5080840 5080851 
5080852 5080853 5080856 5081821 
5081822 5081839 5082490 5083102 
5083115 5084317 5085392

Patches accumulated and obsoleted by this patch: 

Patches which conflict with this patch: 

Patches required with this patch: 

Obsoleted by: 

Files included with this patch: 

<install_dir>/bin/sol-sparc64/qacct
<install_dir>/bin/sol-sparc64/qalter
<install_dir>/bin/sol-sparc64/qconf
<install_dir>/bin/sol-sparc64/qdel
<install_dir>/bin/sol-sparc64/qhost
<install_dir>/bin/sol-sparc64/qmake
<install_dir>/bin/sol-sparc64/qmod
<install_dir>/bin/sol-sparc64/qmon
<install_dir>/bin/sol-sparc64/qping
<install_dir>/bin/sol-sparc64/qsh
<install_dir>/bin/sol-sparc64/qstat
<install_dir>/bin/sol-sparc64/qsub
<install_dir>/bin/sol-sparc64/qtcsh
<install_dir>/bin/sol-sparc64/sge_coshepherd
<install_dir>/bin/sol-sparc64/sge_execd
<install_dir>/bin/sol-sparc64/sge_qmaster
<install_dir>/bin/sol-sparc64/sge_schedd
<install_dir>/bin/sol-sparc64/sge_shadowd
<install_dir>/bin/sol-sparc64/sge_shepherd
<install_dir>/lib/sol-sparc64/libXltree.so
<install_dir>/lib/sol-sparc64/libdrmaa.so
<install_dir>/lib/sol-sparc64/libspoolb.so
<install_dir>/lib/sol-sparc64/libspoolc.so
<install_dir>/utilbin/sol-sparc64/adminrun
<install_dir>/utilbin/sol-sparc64/berkeley_db_svc
<install_dir>/utilbin/sol-sparc64/checkprog
<install_dir>/utilbin/sol-sparc64/checkuser
<install_dir>/utilbin/sol-sparc64/db_archive
<install_dir>/utilbin/sol-sparc64/db_checkpoint
<install_dir>/utilbin/sol-sparc64/db_dump
<install_dir>/utilbin/sol-sparc64/db_load
<install_dir>/utilbin/sol-sparc64/filestat
<install_dir>/utilbin/sol-sparc64/fstype
<install_dir>/utilbin/sol-sparc64/gethostbyaddr
<install_dir>/utilbin/sol-sparc64/gethostbyname
<install_dir>/utilbin/sol-sparc64/gethostname
<install_dir>/utilbin/sol-sparc64/getservbyname
<install_dir>/utilbin/sol-sparc64/infotext
<install_dir>/utilbin/sol-sparc64/loadcheck
<install_dir>/utilbin/sol-sparc64/now
<install_dir>/utilbin/sol-sparc64/openssl
<install_dir>/utilbin/sol-sparc64/qrsh_starter
<install_dir>/utilbin/sol-sparc64/rlogin
<install_dir>/utilbin/sol-sparc64/rsh
<install_dir>/utilbin/sol-sparc64/rshd
<install_dir>/utilbin/sol-sparc64/sge_share_mon
<install_dir>/utilbin/sol-sparc64/spooldefaults
<install_dir>/utilbin/sol-sparc64/spooledit
<install_dir>/utilbin/sol-sparc64/spoolinit
<install_dir>/utilbin/sol-sparc64/testsuidroot
<install_dir>/utilbin/sol-sparc64/uidgid

Problem Description:

5063311 high memory usage of schedd and qmaster (schedd_job_info)
5063316 PE job submit error, when qmaster is busy
5063987 qmaster cannot bind port below 1024 on Linux
5071498 projects not available after sge_qmaster restart
5071502 calendars broken
5071522 Startup of qmaster changes act_qmaster to `hostname`
5071525 qalter abort
5071539 qping doesn't support host_aliases file
5071914 scheduler ignores queue seqno for queue sorting
5071918 qmod -e '@<host>' causes segmentation fault in qmaster
5071987 Qmaster requires a local conf in order to start.
5072005 drmaa_run_job() may change the current directory
5072481 Deleted pending job appears in qstat
5072772 sge_qmaster constantly rewrites spool files of tightly integrated parallel jobs
5073218 qconf -aq <queue>@<host> crashes qmaster
5074788 jobs on hold due to -a time cause qmaster/schedd get out of sync
5075346 Sharetree doesn't work correct
5075398 variable syntax :  equal sign support
5075451 sched_conf(5) reprioritize_interval should default to 0
5075849 a registering event client can get events before it got its total update
5075936 qmon's queue filtering doesn't work
5076358 It shuld be used "." and "$" with qsub -N
5076372 "|" should be able to be used with qsub -N
5076491 qmaster clients may not reconnect after qmaster outage
5077165 reprioritize_interval descr in sched_conf(5) needs improvemen
5077549 qsub -N "@" causes qmaster down
5077589 schedd and qmaster get out of sync - no scheduling for long time
5078783 Wallclock time limit in qmon
5079514 execd shutdown with sgeexecd fails when host aliases are used
5079572 Resending queue signals broken
5080779 qconf -de host does not update the host groups
5080784 qselect crash
5080833 qconf -mattr dumps core if used incorrectly
5080836 qhosts outputs NCPU as float
5080839 qconf -mq displayes "slots" in the complex_values line
5080840 problems when qconf -mattr is used in conjunction with host_aliases file
5080851 qalter/qdel/qmod abort
5080852 qconf -aq <queue>@<host> crashes qmaster
5080853 DRMAA doesn't reject jobs that never will be dispatchable
5080856 QCONF: qconf -mc segfaults
5081821 qstat XML output typo
5081822 Deleting a queue instance slots value actually adds it
5081839 qconf -ahgrp fails if no hgrp name is specified
5082490 qstat -ext -urg omits time info
5083102 hostgroup changes do not always take effect.
5083115 Need more verbose diagnosis msg if execd port is already bound
5084317 Invalid job_id's in reporting file (only l24_amd64)
5085392 qstat -j -xml generates no parseble xml output

Patch Installation Instructions:
--------------------------------
 
tar.gz Patch Installation:
--------------------------
 
   See the patch installation instructions below before installing this
   patch!
 
   Patches in 'tar.gz' format cannot be installed with 'patchadd' on Solaris
   systems. The patch is installed by unpacking the 'tar.gz' file(s) in this
   directory in <install_dir>. <install_dir> is usually your <sge_root>
   directory. The installation of this patch later is not visible with the
   "showrev -p" command on Solaris.
 
   This patch cannot be backed out. You may want to make a backup copy of the
   files  before installing this patch since the files will be overwritten.
 
   Please read "Install Instructions" later in this file and carry out all
   steps before you unpack the 'tar.gz' file(s) included in this patch.
 
   This patch in 'tar.gz' format should not be installed if the original
   package has been installed with 'pkgadd' on Solaris. If the orginal
   installation used packages ('pkgadd') utility, install the available
   patches for N1 Grid Engine 6; refer to the patch matrix below.
 
   The patch is installed by user root by unpacking the file(s) in the
   directory where the original package has been installed:
 
      # cd <install_dir>
      # gzip -dc <patchid>/<targzfile> | tar xvpf -
 
   After installing the patch, you should correct the file permissions if
   your Sun Grid Engine installation is installed as an "admin user" system:
 
      # cd <sge_root>
      # util/setfileperm.sh <sge_root>
 
 
Patch requirements and patch matrix for N1 Grid Engine 6 packages
-----------------------------------------------------------------
 
   The patches below update a N1 Grid Engine 6 distribution to N1 Grid
   Engine 6 Update 1. The "-help" output of most commands will print a
   version string "N1GE 6.0u1" after applying the patch.
 
   All packages of a N1 Grid Engine 6 distribution must have the same patch
   level. Refer to the patch matrix below which updates the distribution to
   most recent patch level. It is not supported to mix different patch levels
   in a single Grid Engine cluster. Also, make sure to update the "common" and
   "arco" packages.
 
   1. Patches for Packages in Sun pkgadd format
   --------------------------------------------
 
      Package name*   OS*                    Architecture*    Patch-Id
      -----------------------------------------------------------------
      SUNWsgee        Solaris, Sparc, 32bit  sol-sparc        118094-01
      SUNWsgeex       Solaris, Sparc, 64bit  sol-sparc64      118130-01
      SUNWsgeex       Solaris x86            sol-x86          118131-01
      SUNWsgeec       all                    common           118132-01
      SUNWsgeea       all                    arco             118133-01
 
      *Package Name = see pkginfo(1)
      *OS           = Operating system
      *Architecture = N1 Grid Engine binary architecture string or
                      "common" = architecture independent packages
                      "arco"   = Accounting and Reproting console
 
   2. Patches for packages in tar.gz format
   ----------------------------------------
 
      OS*                        Architecture     Patch-Id
      -----------------------------------------------------
      Solaris, Sparc, 32bit      sol-sparc        118082-01
      Solaris, Sparc, 64bit      sol-sparc64      118083-01
      Solaris, x86               sol-x86          118084-01
      Linux kernel2.4/2.6, x86   lx24-x86         118085-01
      Linux kernel2.4/2.6, AMD64 lx24-amd64       118086-01
      IBM AIX 4.3                aix43            118087-01
      IBM AIX 5.1                aix51            118088-01
      Apple MAC OS/X             darwin           118089-01
      HP HP-UX 11                hp11             118090-01
      SGI Irix 6.5               irix65           118091-01
      all                        common           118092-01
      all                        arco             118093-01

Special Install Instructions:
-----------------------------
 
   These installation instructions assume that you are running a homogenous
   N1 Grid Engine cluster (called "the software") where all hosts share the
   same directory for the binaries. If you are running the software in a
   heterogenous environment (mix of different binary architectures), you need
   to apply the patch installation for all binary architectures as well as the
   "common" and "arco" packages. See the patch matrix above for details about
   the available patches.
 
   If you installed the software on local filesystems, you need to install
   all relevant patches on all hosts where you installed the software
   locally.
 
   By default, there may by no running jobs when the patch is installed.
   There may pending batch jobs, but no pending interactive jobs (qrsh,
   qmake, qsh, qtcsh).
 
   It is possible to install the patch with running batch jobs. To avoid a
   failure of the active 'sge_shepherd' binary, it is necessary to move the
   old shepherd binary (and copy it back prior the installation of the
   patch).
 
   You can not install the patch with running interactive jobs, 'qmake' jobs
   or with running parallel jobs which use the tight integration support
   (control_slaves=true in PE configuration is set).
 
   Stopping the N1 Grid Engine cluster to start jobs
   -------------------------------------------------
 
   Disable all queues that no new jobs are started:
 
      # qmod -d '*'
 
   Optional (only needed if there are running jobs which should continue to
   run when the patch is installed):
 
      # cd $SGE_ROOT/bin
      # mv <arch>/sge_shepherd <arch>/sge_shepherd.sge60
 
   It is important that the binary is moved with the "mv" command. It may
   not be copied because this could cause a crash of an active shepherd
   process of a running job when the patch is installed.
 
   Shutting down the N1 Grid Engine qmaster, scheduler and execution daemons
   -------------------------------------------------------------------------
 
   You need to shutdown (and restart) the qmaster and scheduler daemon and
   all running execution daemons.
 
   Shutdown all your execution hosts. Login to all your execution hosts and
   stop the execution daemons:
 
      # /etc/init.d/sgeexecd softstop
 
   Then login to your qmaster machine and stop qmaster and scheduler:
 
      # /etc/init.d/sgemaster stop
 
   Now verify with the 'ps' command that all N1 Grid Engine daemons on all
   hosts are stopped. If you decided to rename the 'sge_shepherd' binary
   so that running jobs can continue to run during the patch installation, you
   must not kill the 'sge_shepherd' binary (process).
 
   Installing the patch and restarting the software
   ------------------------------------------------
 
   Now please install the patch by unpacking the 'tar.gz' files included in
   this patch as outline above.
 
   After installing the patch, you need to restart your cluster. Please login
   to your qmaster machine and execution hosts and enter:
 
      # /etc/init.d/sgemaster
      # /etc/init.d/sgeexecd
 
   After restarting the software, you may again enable your queues:
 
      # qmod -e '*'
 
   If you renamed the shepherd binary, you may safely delete the old binary
   when all jobs finished which where running prior the patch installation.

README -- Last modified date:  Thursday, August 19, 2004

