OMEGAMON XE For Storage On ZOSProblem
OMEGAMON XE For Storage On ZOSProblem
Version 4.1.0
SC32-1836-01
Tivoli OMEGAMON XE for Storage on z/OS
®
Version 4.1.0
SC32-1836-01
Note
Before using this information and the product it supports, read the information in Appendix D, “Notices,” on page 169.
Part 1. Messages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 171
Contents v
vi IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
About this guide
IBM Tivoli OMEGAMON XE for Storage on z/OS: User’s Guide introduces the features, workspaces,
predefined situations, and attributes, for the IBM® Tivoli® OMEGAMON® XE for Storage on z/OS® product
and supplements the user assistance provided with this product. This document is written for system
programmers.
The document assumes no previous experience with Tivoli OMEGAMON products or with IBM Tivoli
Monitoring. To learn about this family of products, access the following Web page: http://www-
306.ibm.com/software/tivoli/solutions/availability/products.html.
Publications
This section lists publications in the Tivoli OMEGAMON XE for Storage on z/OS product, the OMEGAMON
II® for SMS component, and the OMEGAMON XE platform libraries. It also describes how to access Tivoli
publications online and how to order publications.
viii IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
OMEGAMON II for SMS library
Most OMEGAMON II documentation has not been updated. These documents refer to the Candle Support
structure rather than to IBM Software Support. References to Candle Support processes and procedures
are from previous versions of OMEGAMON products. Direct your questions to IBM Software Support. For
details about the IBM support structure, see Appendix C, “Support information,” on page 161.
The following information sources are available in the OMEGAMON II for SMS library. The books listed
here can be ordered on CD using this order number: SCD7-0968-00.
v OMEGAMON II for SMS User’s Guide, GC32-9284
Provides the information necessary for you to quickly start monitoring your storage environment.
v OMEGAMON II for SMS Administrator’s Guide, GC32-9281
Provides the information necessary to customize OMEGAMON II for SMS for your site.
v OMEGAMON II for SMS Tuning Guide, GC32-9283
Provides information on enhancing the performance of OMEGAMON II for SMS. This information allows
you to achieve maximum benefit from OMEGAMON II for SMS while using the minimum amount of
resources.
http://publib.boulder.ibm.com/tividd/glossary/tivoliglossarymst.htm
The IBM Terminology Web site consolidates the terminology from IBM product libraries in one convenient
location. You can access the Terminology Web site at the following Web address:
http://www.ibm.com/software/globalization/terminology
IBM posts publications for this and all other Tivoli products, as they become available and whenever they
are updated, to the Tivoli software information center Web site. Access the Tivoli software information
center by first going to the Tivoli software library at the following Web address:
http://publib.boulder.ibm.com/tividd/td/link/tdprodlist.html
In the Tivoli Information Center window, click the Tivoli product manuals link. In the Tivoli Technical
Product Documents Alphabetical Listing window, click the OMEGAMON XE for Storage link to access the
product library at the Tivoli software information center.
Note: If you print PDF documents on other than letter-sized paper, set the option in the File → Print
window that allows Adobe Reader to print letter-sized pages on your local paper.
Ordering publications
You can order many Tivoli publications online at the following Web site: http://www.elink.ibmlink.ibm.com/
public/applications/publications/cgibin/pbi.cgi
In other countries, contact your software account representative to order Tivoli publications. To locate the
telephone number of your local representative, perform the following steps:
1. Go to http://www.elink.ibmlink.ibm.com/public/applications/publications/cgibin/pbi.cgi.
2. Select your country from the list and click Go.
3. Click About this site in the main panel to see an information page that includes the telephone number
of your local representative.
Accessibility
Accessibility features help users with a physical disability, such as restricted mobility or limited vision, to
use software products successfully. With this product, you can use assistive technologies to hear and
navigate the interface. You can also use the keyboard instead of the mouse to operate most features of
the graphical user interface.
For additional information, see the Accessibility Appendix. This appendix is provided only in the user’s
guide.
http://www.ibm.com/software/tivoli/education
Support information
Appendix C, “Support information,” on page 161 describes the following options for obtaining support for
IBM products:
v “Using IBM Support Assistant” on page 161
v “Obtaining fixes” on page 162
v “Contacting IBM Software Support” on page 163
Typeface conventions
This guide uses the following typeface conventions:
Bold
v Lowercase commands and mixed case commands that are otherwise difficult to distinguish from
surrounding text
v Interface controls (check boxes, push buttons, radio buttons, spin buttons, fields, folders, icons,
list boxes, items inside list boxes, multicolumn lists, containers, menu choices, menu names,
tabs, property sheets), labels (such as Tip:, and Operating system considerations:)
v Keywords and parameters in text
Italic
v Words defined in text (example: a nonswitched line is called a point-to-point line)
v Emphasis of words and letters (words as words example: ″Use the word that to introduce a
restrictive clause.″; letters as letters example: ″The LUN address must start with the letter L.″)
When using the Windows command line, replace $variable with %variable% for environment variables and
replace each forward slash (/) with a backslash (\) in directory paths. The names of environment variables
are not always the same in Windows and UNIX. For example, %TEMP% in Windows is equivalent to $tmp
in UNIX.
Note: If you are using the bash shell on a Windows system, you can use the UNIX conventions.
For a more complete mapping of previous Candle names and new IBM names, refer to
http://www.ibm.com/software/tivoli/products/product-matrix.html.
xii IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Part 1. Messages
This section provides the content of the messages that can be generated by Tivoli OMEGAMON XE for
Storage on z/OS, the Tivoli Enterprise Monitoring Agent, and the OMEGAMON II for SMS component. The
messages are alphabetized and subdivided as follows:
v Chapter 2, “KS3 Messages,” on page 5
v Chapter 3, “KDF and KDFA Messages,” on page 55
v Chapter 4, “KDFC Messages,” on page 71
v Chapter 5, “KDFD Messages,” on page 73
v Chapter 6, “KDFH and KDFL Messages,” on page 91
v Chapter 7, “KDFS Messages,” on page 93
v Chapter 8, “KRC Messages,” on page 103
When you encounter a problem, check the messages in the log files to determine if the source is a
problem in your environment or with an IBM Tivoli Monitoring product. If you determine that the problem is
caused by a product defect, follow the instructions for contacting IBM Software Support in the Appendix C,
“Support information,” on page 161.
See “Collecting logs for reproducible problems that are reported as Tivoli Enterprise Portal client problems”
on page 134 for the locations of log files. The location of the log depends on the client type and operating
system the client is running on. The following sections provide locations of the fundamental types of logs:
v Logs for components on distributed systems:
– “Collecting logs for the Tivoli Enterprise Portal desktop client” on page 134
– “Collecting logs for the Tivoli Enterprise Portal browser client” on page 135
– “Additional logs to collect: Tivoli Enterprise Portal Server logs, Tivoli Enterprise Monitoring Server
logs, and data warehousing logs” on page 135
v Logs for components on z/OS systems: “Collecting logs on the z/OS system” on page 137
IBM Software Support might request some or all of these files while investigating a problem you have
reported. Also, you might be asked to set a trace in the client and then collect the log. Trace logging is a
fundamental tool for troubleshooting in cases where a problem is reproducible.
Note: Some of the tracing options produce large amounts of trace information. Therefore, monitor the disk
or spool space when activating tracing to prevent your disk or spool from reaching capacity. Return
the trace settings to the default settings after the desired trace information has been collected.
When you investigate problems with the Tivoli OMEGAMON XE for Storage on z/OS Tivoli Enterprise
Monitoring Agent, view the sysout data sets or spool files in the job output and view the z/OS system log
file for any messages that might pertain to the problem.
Message format
The messages for this product are in the following format:
xxxyyyyyz
where:
xxx Alpha-numeric product or component identifier. This product supports three component identifiers:
This book provides the following additional information about these messages, including:
v Message text that is displayed on the same line as the message number
v A description of the system conditions that generated the message
v Suggested responses to the message
attribute and value to use for detail data selection. System action: Processing for the function in process
Otherwise contact IBM Software Support. is halted.
Operator response: Contact IBM Software Support.
KS3A087E UNABLE TO ACQUIRE STACK
STORAGE
KS3A104E [module_name] DA MASTER CB
Explanation: A request was made for a data set detail FAILED VALIDITY CHECK
data, however the database detail retrieval interface
Explanation: Internal error. The indicated control block
was unable to obtain sufficient storage.
was found to be invalid by module [module_name].
System action: The Dataset Detail Table data
System action: Processing for the function in process
requested is not returned for display at the Tivoli
is halted.
Enterprise Portal.
Operator response: Contact IBM Software Support.
Operator response: If this error persists it might be
necessary to increase the storage available to the Tivoli
Enterprise Monitoring Server. Contact IBM Software KS3A105E [module_name] ESTAEX MACRO
Support. FAILED; RC=RETCODE/REASON
Explanation: Internal error. Module [module_name]
KS3A088E INVALID PARMA ADDR FORMAT: was unable to establish its recovery routine.
[input_parm]
System action: Processing for the function in process
Explanation: A request was made for detail data from is halted.
a specific data set, however the Address/ALET provided
is in an invalid format. Operator response: Contact IBM Software Support.
Operator response: If this error was issued in Explanation: Internal error. The indicated control block
response to a user-written Query, correct the cannot be found by module [module_name].
Address/ALET parm so that it is in the format System action: Processing for the function in process
″:ALET:Address:″. Otherwise contact IBM Software is halted.
Support.
Operator response: Contact IBM Software Support.
KS3A281W DATASET ATTRIBUTE DATABASE KS3A292E SUBTASK ENDED WITH ERROR CODE
IMMEDIATE HALT DETECTED; [code]
COLLECTION TERMINATION IN
Explanation: Internal error. A volume collection
PROGRESS
subtask failed with the indicated return code.
Explanation: The collection cycle is halted. The
System action: Collection terminates.
reason for the halt is indicated in a previously-issued
message. Operator response: Contact IBM Software Support.
System action: The collection cycle is halted. All
attributes collected up to this point are available in the KS3A293E DEVICE TABLE UNAVAILABLE;
database. COLLECTION CYCLE CANCELLED
Operator response: None. If the time collection was Explanation: A collection subtask cannot be initiated,
halted is either too early or too late, adjust the End Time as the internal product device table has not yet been
specified in the Dataset Attribute Database User created.
Interface dialog.
System action: The collection cycle is not started.
KS3A282E VOLUME TASK FOR [volser] ABENDED Operator response: This error might occur when a
WITH CODE [abend_code] user or an operator-initiated Start request is issued for
Dataset Attribute Database collection, or a scheduled
Explanation: Internal error. The collection subtask for Start time occurs, before full Tivoli OMEGAMON XE for
the indicated volume abnormally terminated with the Storage product initialization is complete. If this
indicated abend code. condition occurs, configure the manual or scheduled
start to happen after the product is fully initialized. If this
System action: Collection continues for other volume
configuration change does not solve the problem,
tasks. If more than a set number of tasks abend during
contact IBM Software Support.
a collection cycle, the cycle itself is terminated.
Operator response: Examine other messages in the
KS3A294E UNABLE TO OBTAIN VOLUME-LEVEL
ITMS:Engine log, RKLVLOG, to determine the cause of
STV
the error. Contact IBM Software Support.
Explanation: The collection task was unable to obtain
storage for a required control block.
KS3A290E UNABLE TO OBTAIN [size] BYTES FOR
CB STORAGE System action: Collection terminates.
Explanation: The collection task was unable to obtain Operator response: This error might occur because
the indicated amount of storage. of the aggregate storage requirements in the address
space at the time collection started. The problem might
System action: Collection terminates.
not recur on the next collection cycle. Examine other
Operator response: This error might occur because messages in the ITMS:Engine log, RKLVLOG, to
of the aggregate storage requirements in the address determine the cause of the error and contact IBM
space at the time collection started. The problem might Software Support.
not recur on the next collection cycle. Examine other
messages in the ITMS:Engine log, RKLVLOG, to
KS3A299E DATASET ATTRIBUTE DATABASE
determine the cause of the error and contact IBM
COLLECTION CYCLE TERMINATED
Software Support.
Explanation: A previously indicated error has caused
the Dataset Attribute Database collection controller to
KS3A291E SUBTASK ATTACH FAILED WITH RC
terminate processing.
[attach_retcode]
System action: The collection cycle is terminated.
Explanation: An ATTACH for a volume collection
subtask failed with the indicated return code. Operator response: Examine the ITMS:Engine log,
RKLVLOG, for other messages indicating the original
System action: Collection terminates.
error. Contact IBM Software Support.
Operator response: Contact IBM Software Support.
KS3A501E INPUT VWE ADDRESS MISSING OR
INVALID
Explanation: Internal error. A volume collection
subtask cannot locate a required control block.
System action: Collection for the volume terminates.
Other collection tasks continue. the VTOC of the specified volume, for the specified
reason.
Operator response: Examine other messages in the
ITMS:Engine log, RKLVLOG, to determine the cause of System action: Collection for the indicated volume
the error and contact IBM Software Support. terminates. Other collection tasks continue.
Operator response: This message might be issued in
KS3A503E UNABLE TO OBTAIN STORAGE FOR response to a problem with the VTOC of the specified
DSCB BUFFERS ON VOLUME [volser] volume and not a program error. If the volume can be
successfully accessed through other means (for
Explanation: The collection task was unable to obtain
example, ISPF option 3.4), then contact IBM Software
storage for a required control block.
Support.
System action: Collection for the indicated volume
terminates. Other collection tasks continue.
KS3A509E UNABLE TO CREATE NEW
Operator response: This error might occur because DATASPACE; DSAP=[dsap]
of the aggregate storage requirements in the address
Explanation: The current dataspace is full but the
space at the time collection started. The problem might
collection task was unable to create a new one.
not recur on the next collection cycle. Examine other
messages in the ITMS:Engine log, RKLVLOG, to System action: The collection cycle is halted. All
determine the cause of the error and contact IBM attributes collected up to this point are available in the
Software Support. database.
Operator response: This error might occur because
KS3A504E ERROR [return_code/reason_code] of the aggregate storage requirements in the address
ATTEMPTING TO READ VTOC OF space at the time collection started. The problem might
[volser] not recur on the next collection cycle. Examine other
messages in the ITMS:Engine log, RKLVLOG, to
Explanation: The collection task was unable to read
determine the cause of the error and contact IBM
the VTOC of the specified volume, for the specified
Software Support.
reason.
System action: Collection for the indicated volume
KS3A510I NEW DATASPACE [dataspace_name]
terminates. Other collection tasks continue.
ORIGIN=[dataspace_origin],
Operator response: This message might be issued in LENGTH=[dataspace_length],
response to a problem with the VTOC of the specified STOKEN=[dataspace_stoken],
volume and not a program error. If the volume can be ALET=[dataspace_alet]
successfully accessed through other means (for
Explanation: A new dataspace was created with the
example, ISPF option 3.4), contact IBM Software
indicated attributes for a Dataset Attribute Database
Support.
collection cycle.
System action: Collection continues using the newly
KS3A505E UNABLE TO OBTAIN STORAGE FOR
created dataspace.
CSI BUFFER
Operator response: None.
Explanation: Internal error. The collection task was
unable to obtain storage for a required control block.
KS3A515W VOLUME [volser] IS IN USE BY
System action: Collection for this volume terminates.
ANOTHER JOB OR USER AND WILL
Other collection tasks continue.
NOT BE PROCESSED
Operator response: This error might occur because
Explanation: An attempt was made to issue a shared
of the aggregate storage requirements in the address
Enqueue on the specified volume for QNAME
space at the time collection started. The problem might
SYSVTOC, however another job or user has that
not recur on the next collection cycle. Examine other
resource enqueued exclusively.
messages in the ITMS:Engine log, RKLVLOG, to
determine the cause of the error and contact IBM System action: Collection for the specified volume is
Software Support. bypassed. Other volume tasks continue.
Operator response: None.
KS3A506E CVAFSEQ FAILED FOR VOLUME
[volser]; RC=[CVAF_return_code]
CVSTAT=[CVAF_cvstat_code]
Explanation: The collection task was unable to read
System action: Historical data for Logical Control Explanation: A load failed for the named module.
Units (LCU) are not written to the Persistent Data System action: Most of the modules named by this
Stores until this situation is corrected. message are used to gather data to be written to the
User response: Check for message KS3D002E in the Persistent Data Store for historical reporting. Data
RKLVLOG. If found, take the recommended actions. associated with the module named in this message is
Otherwise, contact IBM Software Support. not written to the PDS until the problem is corrected.
User response: Contact IBM Software Support.
KS3C002E KS3CPLCU Unable to allocate memory
for PDSRec KS3D004E UNABLE TO FIND SE VECTOR
Explanation: The LCU historical retriever was unable Explanation: This is an internal error.
to allocate sufficient Tivoli Enterprise Monitoring Server
Engine storage for a work area. System action: Most storage monitoring functions are
disabled for the Tivoli Enterprise Portal.
System action: Historical data for Logical Control
Units (LCU) are not written to the persistent Data Stores User response: Contact IBM Software Support.
until this situation is corrected.
User response: Increase the value specified in the
MINIMUM parameter of the KDSSYSIN RKANPAR
member. This might also require an increase in region
Explanation: Module modname has detected a Explanation: Module modname has not been able to
problem while attempting to write historical data. synchronize historical recording with the RMF interval.
Historical recording for the table pds table has been
System action: Tivoli OMEGAMON XE for Storage on
disabled due to the given reason.
z/OS continues; however, the recording interval for
System action: Tivoli OMEGAMON XE for Storage on historical recording is set to 15 minutes.
z/OS continues without recording historical data for the
User response: If this message persists and RMF
given table.
monitor 1 is active contact IBM Software Support.
User response: Contact IBM Software Support.
KS3D013E modname: ALLOCATION FAILED FOR
KS3D009E modname: - SETUP FAILED FOR pds item, SIZE = size, RC = return code
table INSERTS; RC = rc
Explanation: Module modname was unsuccessful in
Explanation: Module modname has detected a obtaining size number of bytes of storage to allocate
problem while attempting to setup the persistent data the control block item. The request failed with return
store table. The setup call returned with a return code of code return code.
rc. KS3D009E messages normally result when the
System action: Tivoli OMEGAMON XE for Storage on
RMF™ interval ends prior to the complete initialization of
z/OS continues; PDS recording for this interval is
the persistent data store.
skipped.
System action: Tivoli OMEGAMON XE for Storage on
User response: Contact IBM Software Support.
z/OS continues without recording historical data for the
given table.
modules were successfully installed into the data sets successfully installed into the dataset specified on the
specified on the STEPLIB and RKANMODL DD RKANMODL DD statements in the TEMS started task
statements in the TEMS started task JCL. If the JCL.
specified module is present in that library, contact IBM
Software Support.
KS3G042E ERROR DURING [module_name]
SDUMPX PROCESSING,
KS3G038E [module_name] Returned error, RC = RC=[sdump_return_code
[return_code]
Explanation: An abend occurred in a Dataset Group
Explanation: Internal error. The indicated Dataset module, however the attempt to take a dump failed with
Group collection subtask module returned the specified the indicated return code.
invalid code.
System action: Abend processing continues.
System action: Dataset Group collection is stopped
Operator response: Examine other console
until the TEMS is restarted.
messages to determine if dump processing encountered
Operator response: Contact IBM Software Support. an out of space or other identifiable condition. If a dump
was produced examine it to determine the cause of the
original abend. Contact IBM Software Support.
KS3G039E [module_name] Invalid interval value -
[interval]
KS3G060E [module_name] DSN Group data
Explanation: Possible internal error. The indicated
collected is incomplete -
Dataset Group collection interval is invalid. Valid
RC=[return_code]
intervals are between 5 and 999 minutes.
Explanation: There is insufficient storage in the
System action: Dataset Group collection is stopped
allocated data space to contain all of the datasets in all
until the TEMS is restarted.
of the specified groups.
Operator response: Check the collection interval
System action: Dataset group processing continues
value specified in the Dataset Group Collection Control
with the datasets that could be contained in the data
dialog and correct it if invalid. If it appears to be correct,
space.
contact IBM Software Support.
Operator response: Examine the installation-specified
maximum data space size and increase it if possible.
KS3G040W [module_name] LOAD FAILED FOR
Delete some dataset groups or make them inactive.
KDFRMFI
Remove some of the dataset masks within the specified
Explanation: Possible internal error. Dataset group groups; Change the dataset masks to limit the number
collection was specified or defaulted as RMF, however of datasets selected from the catalog.
the OMEGAMON XE for Storage RMF interface module
KDFRMFI could not be loaded.
KS3G061E [module_name] Storage Obtain error,
System action: A 15 minute collection interval is used; Data Collection terminating,
processing continues. RC=[return_code]
Operator response: Ensure that module KDFRMFI Explanation: There is insufficient storage in the TEMS
was successfully installed into the dataset specified on address space for the catalog interface to initialize.
the RKANMODL DD statements in the TEMS started
System action: Dataset group processing for this
task JCL. If so, contact IBM Software Support.
collection cycle terminates.
Operator response: Examine the space values
KS3G041W [module_name] COLLECTION
specified for the TEMS address space and the
INTERVAL DEFAULTING TO 15
OMEGAMON for Storage application in RKANPAR, and
MINUTES
increase them if appropriate. If the messages in
Explanation: Possible internal error. Dataset group RKLVLOG indicate that storage is being allocated and
collection was specified or defaulted as RMF, however not released over time, contact IBM Software Support.
the OMEGAMON XE for Storage RMF interface module
KDFRMFI could not be found, or RMF is inactive.
KS3G062E [module_name] Input parameter error,
System action: A 15 minute collection interval is used; Data Collection terminating,
processing continues. RC=[return_code]
Operator response: Ensure that RMF is active on the Explanation: Internal error. The catalog interface
system if RMF interval synchronization is specified for module was invoked with an invalid parameter list.
data collection. Ensure that module KDFRMFI was
System action: Dataset group processing for this System action: Dataset group processing for this
collection cycle terminates. collection cycle terminates.
Operator response: Contact IBM Software Support. Operator response: Contact IBM Software Support.
KS3G063E [module_name] Group definitions table KS3G093E IGGCSI00 Returned Error, terminating
error, Data Collection terminating, with RC=[return_code]
RC=[return_code]
Explanation: Possible internal error. The DFSMS
Explanation: Internal error. The catalog interface catalog interface module IGGCSI00 returned an error.
module detected an invalid control block. This could be due to insufficient storage in the address
space or an error by the calling module.
System action: Dataset group processing for this
collection cycle terminates. System action: Dataset group processing for this
collection cycle terminates.
Operator response: Contact IBM Software Support.
Operator response: Examine TEMS storage trace
messages in RKLVLOG and, if there was insufficient
KS3G064E [module_name] KS3SGCSI LOAD Error,
storage in the address space at the time of the error,
Data Collection terminating,
attempt to increase the storage available to the TEMS.
RC=[return_code]
If this does not appear to be a storage-related error,
Explanation: Possible internal error. The Dataset contact IBM Software Support.
Group catalog interface could not be initialized because
module KS3SGCSI could not be found.
KS3G094E IGGCSI00 Load Error, terminating with
System action: Dataset group processing for this RC=12
collection cycle terminates.
Explanation: Possible internal error. The DFSMS
Operator response: Ensure that module KS3SGCSI catalog interface module IGGCSI00 could not be
was successfully installed into the dataset specified on loaded.
the RKANMODL DD statements in the TEMS started
System action: Dataset group processing for this
task JCL. If so, contact IBM Software Support.
collection cycle terminates.
Operator response: Ensure that module IGGCSI00 is
KS3G066E [module_name] UNABLE TO OBTAIN
in the LPA or Linklist and is loadable. If the module
GSA ADDRESS
appears to be correct, contact IBM Software Support.
Explanation: Internal error. The catalog interface
module detected an invalid control block.
KS3G095E Storage Obtain Error, Terminating
System action: Dataset group processing for this RC=12
collection cycle terminates.
Explanation: Possible internal error. The Dataset
Operator response: Contact IBM Software Support. Group catalog interface module could not obtain
sufficient storage to continue processing.
KS3G090E [module_name] LOAD FAILED FOR System action: Dataset group processing for this
MODULE IGGCSI00, RC=[return_code], collection cycle terminates.
REASON CODE=[reason_code]
Operator response: Examine TEMS storage trace
Explanation: Possible internal error. The DFSMS message in RKLVLOG and, if there was insufficient
catalog interface module IGGCSI00 could not be loaded storage in the address space at the time of the error,
for the specified reason. attempt to increase the storage available to the TEMS.
If this does not appear to be an insufficient storage
System action: Dataset group processing for this error, contact IBM Software Support.
collection cycle terminates.
Operator response: Ensure that module IGGCSI00 is KS3G096E Input Parameter Error, Terminating
in the LPA or Linklist and is loadable. If the module RC=12
appears to be correct, contact IBM Software Support.
Explanation: Internal error. The Dataset Group
catalog interface module was invoked with an invalid
KS3G092E Data Retrieval Error, terminating with parameter list.
RC=[return_code]
System action: Dataset group processing for this
Explanation: Internal error. The catalog interface collection cycle terminates.
module detected an error in the returned catalog data.
Operator response: Contact IBM Software Support.
KSGG184E [module_name] UNABLE TO LOCATE Operator response: Contact IBM Software Support.
UCB FOR [datasetname] ON [volser]
Explanation: The UCB for the specified volume could KS3G204E [module_name] UNABLE TO LOCATE
not be located. [control_block_name]
System action: Space collection for the current Explanation: Internal error. The Dataset Group
dataset is skipped, and processing continues with the summary module could not be initialized.
next dataset. System action: Dataset Group collection is stopped
Operator response: Ensure that the specified volume until the TEMS is restarted.
actually exists and is online, and that the dataset Operator response: Contact IBM Software Support.
actually exists on that volume, as indicated by its
catalog entry. If so, check the validity of its VTOC entry
using another utility (e.g. ISPF 3.4; IEHLIST). If it KS3G205E [module_name] UNABLE TO
appears to be correct, contact IBM Software Support. ALLOCATE SUMMARY TABLE
STORAGE
KS3G200E [module_name] UNABLE TO OBTAIN Explanation: Internal error. The Dataset Group
WORKAREA STORAGE summary module could not be initialized due to
insufficient storage.
Explanation: Internal error. The Dataset Group
summary module could not be initialized due to System action: Dataset Group collection is stopped
insufficient storage. until the TEMS is restarted.
System action: Dataset Group collection is stopped Operator response: Ensure that sufficient storage has
until the TEMS is restarted. been specified during product configuration, as per the
documented guidelines. If changing or increasing
Operator response: Ensure that sufficient storage has available storage does not correct the problem contact
been specified during product configuration, as per the IBM Software Support.
documented guidelines. If changing or increasing
available storage does not correct the problem contact
IBM Software Support.
KS3G265E [module_name] PARAMETER ERROR, Explanation: Internal error. The specified group could
REASON: [reason_code] not be added because of an error creating the
persistent table.
Explanation: Internal error. The Dataset Group
summary module was invoked with an invalid parameter System action: The new group is not added.
list. Operator response: Contact IBM Software Support.
System action: Dataset Group summary reporting is
ended for the current request.
Operator response: Contact IBM Software Support.
KS3L008E Unable to allocate storage for new KS3L011E KS3LAPPL Unable to allocate storage
application entry for the Application Name Table
Explanation: An attempt to add an application for Explanation: An attempt to allocate storage from the
monitoring has failed because there is insufficient Tivoli Tivoli Enterprise Monitoring Server Engine pool was
Enterprise Monitoring Server Engine storage available. unsuccessful.
System action: The requested application is not System action: Application monitoring is not available
added to the list of monitored applications. in the Tivoli Enterprise Portal.
User response: Increase the value specified in the User response: Increase the value specified in the
MINIMUM parameter of the KDSSYSIN RKANPAR MINIMUM parameter of the KDSSYSIB RKANPAR
member. This can also require an increase in region member. This can also require an increase in region
size if the Tivoli Enterprise Monitoring Server startup size if the Tivoli Enterprise Monitoring Server startup
proc does not specify REGION=0M. proc does not specify REGION=0M.
KS3L008I Issue updates using explore loc= KS3L011I Processing count of total
location
Explanation: This shows the progress of the Launch
Explanation: The launch points are updated using the Application processing the launch points.
location that was entered by the user.
Programmer response: KS3L012E modname Unable to allocate nnnn
bytes storage for xxx volume|dataset
work table
KS3L009E Unable to acquire ASID work area of
nnnnnnn bytes Explanation: An attempt to allocate storage from the
Tivoli Enterprise Monitoring Server Engine pool was
Explanation: An application monitoring request has
unsuccessful. Possible values for modname include
failed because there is insufficient Tivoli Enterprise
KS3LAPDD and KS3LAPVP.
Monitoring Server Engine storage available. nnnnnnn
indicates the number of bytes requested. System action: Application monitoring data set and
volume details information are unavailable until the
System action: All application monitoring fails.
problem is corrected.
User response: Increase the value specified in the
User response: Increase the value specified in the
MINIMUM parameter of the KDSSYSIN RKANPAR
MINIMUM parameter of the KDSSYSIN RKANPAR
member. This can also require an increase in region
member. This can also require an increase in region
size if the Tivoli Enterprise Monitoring Server startup
size if the Tivoli Enterprise Monitoring Server startup
proc does not specify REGION=0M.
proc does not specify REGION=0M.
KS3L015E modname Unable to allocate storage KS3L019E modname: INVALID pds table RECORD
for node table DETECTED, HEADER = header
Explanation: An attempt to allocate storage from the Explanation: Module modname retrieved a record from
Tivoli Enterprise Monitoring Server Engine pool was historical table pds table and found the heading
unsuccessful. Possible values for modname include information to be invalid. The invalid data, header, is
KS3LXSUM and KS3LXSYS. printed as part of the message.
System action: Cross-system DASD monitoring is System action: Tivoli OMEGAMON XE for Storage on
unavailable in Tivoli Enterprise Portal until the problem z/OS continues without returning historical data.
is corrected.
User response: Contact IBM Software Support.
User response: Increase the value specified in the
MINIMUM parameter of the KDSSYSIN RKANPAR
KS3LHREQ KDFHMWE MAX MWES REACHED
member. This can also require an increase in region
size if the Tivoli Enterprise Monitoring Server startup Explanation: Displays in the RKLVLOG file when the
proc does not specify REGION=0M. management work elements (MWEs) that DFSMShsm™
builds exceeds the maximum amount that Tivoli
OMEGAMON XE for Storage on z/OS is capable of
KS3L016E modname Unable to allocate storage
capturing.
for volume table
System action: The returned HSM request data is
Explanation: An attempt to allocate storage from the
truncated.
Tivoli Enterprise Monitoring Server Engine pool was
unsuccessful. Possible values for modname include User response: None. This message is informational.
KS3LXSUM and KS3LXSYS. The destination is the Tivoli Enterprise Monitoring
Server Engine log file, RKLVLOG.
System action: Cross-system DASD monitoring is
unavailable in Tivoli Enterprise Portal until the problem
is corrected. KS3S001I Scheduler MCB allocated, $DSCWRK
@: address
User response: Increase the value specified in the
MINIMUM parameter of the KDSSYSIN RKANPAR Explanation: The Scheduler master control block
member. This can also require an increase in region $DSCWRK was allocated at address
size if the Tivoli Enterprise Monitoring Server startup
proc does not specify REGION=0M. Operator response: None. This is an informational
message. This information is stored in the ITMS:Engine
log, RKLVLOG.
KS3L017E modname: - REQUEST FOR
HISTORICAL DATA FAILED - reason
KS3S002I V#S3VCTR@: address
Explanation: Module modname has detected a problem
while attempting to retrieve historical data. The retrieval Explanation: The address of the V#S3VCTR control
of historical data is unsuccessful due to the given block is address
reason. Operator response: None. This is an informational
System action: Tivoli OMEGAMON XE for Storage on message. This information is stored in the ITMS:Engine
z/OS continues without returning historical data. log, RKLVLOG.
Explanation: Module modname received return code Operator response: None. This is an informational
return code when attempting to retrieve data from the message. This information is stored in the ITMS:Engine
historical table pds table. log, RKLVLOG.
KS3S015I No schedule events loaded, Wait for KS3S033E module_name Input Parameter error,
schedule events reason= reason_code ; Forced
termination
Explanation: This message indicates that was were
no previously saved events. Explanation: This is an internal error.
Operator response: None. This is an informational Tivoli OMEGAMON XE for Storage continues, but the
message. This information is stored in the ITMS:Engine scheduling function is disabled.
log, RKLVLOG.
Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine
KS3S016I Scheduler task started log, RKLVLOG.
Explanation: The scheduler task has started, and is
able to process scheduling request. KS3S034E module_name Storage obtain error rc=
return_code ; Forced termination
Operator response: None. This is an informational
message. This information is stored in the ITMS:Engine Explanation: This is an internal error.
log, RKLVLOG.
Tivoli OMEGAMON XE for Storage continues, but the
scheduling function is terminated.
KS3S017I Waiting for termination request
Operator response: Contact IBM Software Support.
Explanation: This is an information messages. A This problem information is stored in the ITMS:Engine
scheduling task is waiting for termination request. log, RKLVLOG.
Operator response: None. This is an informational
message. This information is stored in the ITMS:Engine KS3S035E module_name Unable to obtain GSA
log, RKLVLOG. address; Terminating
Explanation: This is an internal error.
KS3S020E module_name Abnormal Termination
Tivoli OMEGAMON XE for Storage continues, but the
Recovered
scheduling function is terminated.
Explanation: module_name has experienced an
Operator response: Contact IBM Software Support.
abnormal termination that was recovered.
This problem information is stored in the ITMS:Engine
Operator response: Contact IBM Software Support. log, RKLVLOG.
This problem information is stored in the ITMS:Engine
log, RKLVLOG.
KS3S036E module_name Process Controls error,
reason= reason_code ; Forced
KS3S031E module_name ESTAEX macro request termination
rc = return_code
Explanation: This is an internal error.
Explanation: The ESTEAX macro returned with a
Tivoli OMEGAMON XE for Storage continues, but the
return code of return_code
scheduling function is terminated.
Operator response: Contact IBM Software Support.
Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine
This problem information is stored in the ITMS:Engine
log, RKLVLOG.
log, RKLVLOG.
KS3S038E module_name Build error; missing KS3S102W Requested schedule event time has
missing_module_name module past
Explanation: This is an internal error. Explanation: The time of the event to be scheduled
has pasted.
Tivoli OMEGAMON XE for Storage continues, but the
scheduling function is terminated. Operator response: None. This is an warning
message. This information is stored in the ITMS:Engine
Operator response: Contact IBM Software Support.
log, RKLVLOG.
This problem information is stored in the ITMS:Engine
log, RKLVLOG.
KS3S105I There are event_count saved Scheduled
Events
KS3S039E module_name Storage obtain error for
callback parameter list. Invocation Explanation: The initialization of the Scheduler found
ignored. event_count events that were stored
Explanation: This is an internal error. Operator response: None. This is an informational
message. This information is stored in the ITMS:Engine
Tivoli OMEGAMON XE for Storage continues, but the
log, RKLVLOG.
requested command is ignored.
Operator response: Contact IBM Software Support.
KS3S110I Loaded schedule: Time( schedule_time )
This problem information is stored in the ITMS:Engine
Days( schedule_days ) Callback(
log, RKLVLOG.
callback_name ) Name( event_name )
Info( event_user_info )
KS3S042E ERROR DURING module_name
Explanation: The event has been loaded into the
SDUMPX PROCESSING, RC=
Scheduler
return_code , REASON= reason_code
Operator response: None. This is an informational
Explanation: This is an internal error.
message. This information is stored in the ITMS:Engine
Tivoli OMEGAMON XE for Storage continues, but the log, RKLVLOG.
scheduling function is terminated.
Operator response: Contact IBM Software Support. KS3S111I Requesting schedule: Time(
This problem information is stored in the ITMS:Engine schedule_time ) Days( schedule_days )
log, RKLVLOG. Callback( callback_name ) Name(
event_name ) Info( event_user_info )
KS3S100I Waiting for Schedule Event request Explanation: There has been a request for this event
to the Scheduler
Explanation: The scheduler is waiting for new
scheduling requests. Operator response: None. This is an informational
message. This information is stored in the ITMS:Engine
Operator response: None. This is an informational log, RKLVLOG.
message. This information is stored in the ITMS:Engine
log, RKLVLOG.
KS3S112I Deleting schedule: Time( schedule_time
) Days( schedule_days ) Callback(
KS3S101E On-line Scheduler unable to define callback_name ) Name( event_name )
Scheduler Event variable; rc= Info( event_user_info )
return_code variable= variable_name
Explanation: There has been a request to delete this
Explanation: This is an internal error. event from the Scheduler
Tivoli OMEGAMON XE for Storage continues, but the Operator response: None. This is an informational
scheduling function is terminated. message. This information is stored in the ITMS:Engine
Operator response: Contact IBM Software Support. log, RKLVLOG.
This problem information is stored in the ITMS:Engine
log, RKLVLOG. KS3S115I Active schedule: Time( schedule_time )
Days( schedule_days ) Callback(
callback_name ) Name( event_name )
Info( event_user_info )
Explanation: This event is ready for processing
KS3T312E ERROR INITIATING DFDSS STC, RC= KS3T317E ERROR DURING VSAM OPERATION
rcrc, REASON= reason ON ACTION RESPONSE CHECKPOINT
DATA, ERROR= eeee
Explanation: An error occurred starting the DFDSS
slave address space. The ASCRE macro provides the Explanation: The DFDSS slave address space
rcrc and reason values. attempted to open, read, update, or close the Response
Checkpoint Dataset. VSAM returned a non-zero
System action: The DFDSS master task terminates.
condition code. Additional action messages indicate the
User response: Call IBM Software Support. The exact operation. One of the following messages follows
destination is the MVS system console. this message: KDFAP3035E, KDFAP3036E,
KDFAP3037E, or KDFAP3038E.
KS3T313E ERROR DURING SLAVE A.S. System action: The DFDSS slave and master tasks
INITIALIZATION, RETURN CODE= rcrc terminate.
Explanation: During initialization, the DFDSS slave User response: Check the DFDSS slave address
address space returned a non-zero condition code to space for additional messages. The destination is the
the master address space. MVS system console.
System action: The DFDSS master task terminates.
KS3T330E ERROR OBTAINING SLAVE A.S. ENQ,
User response: Check the DFDSS slave address RETURN CODE= rcrc, TERMINATING
space for messages or a dump. The destination is the
MVS system console. Explanation: A non-zero code was returned while
attempting to obtain an ENQUE.
KS3T314E ERROR ENCOUNTERED IN IKJTSOEV, System action: The DFDSS slave and master tasks
RETURN CODE= rcrc, REASON CODE= terminate.
reason
User response: Call IBM Software Support. The
Explanation: A non-zero code was returned from the destination is the MVS system console.
TSO/E environmental initialization.
System action: The DFDSS slave and master tasks KS3T331E ERROR ALLOCATING ACTION
terminate. RESPONSE DATASET, TERMINATING
User response: Call IBM Software Support. The Explanation: An error was encountered dynamically
destination is the MVS system console. allocating the action response data set. Message
KDFAP3016E should precede this message and provide
the exact error and resolution.
KS3T315E LOAD FAILED FOR MODULE
IKJTSOEV, RETURN CODE= rcrc, System action: The DFDSS slave and master tasks
REASON CODE= reason terminate.
Explanation: A non-zero code was returned from User response: Call IBM Software Support. The
LOAD while attempting to load the module. destination is the MVS system console.
System action: The DFDSS slave and master tasks
terminate. KS3T332E ERROR OBTAINING TIVOLI
ENTERPRISE MONITORING SERVER
User response: Call IBM Software Support. The ENQ, RETURN CODE= rcrc,
destination is the MVS system console. TERMINATING
Explanation: A non-zero code was returned
KS3T316E ERROR DURING DYNAMIC attempting to obtain an ENQUE.
ALLOCATION, ERROR= eeee, INFO= iiii
System action: The DFDSS slave and master tasks
Explanation: A non-zero code was returned while terminate.
attempting to dynamically allocate a resource.
User response: Call IBM Software Support. The
System action: The DFDSS slave and master tasks destination is the MVS system console.
terminate.
User response: Call IBM Software Support. The
destination is the MVS system console.
KS3T336E ERROR READING ACTION RESPONSE User response: Correct the started task JCL and
CHECKPOINT DATASET, TERMINATING resubmit the request. The destination is the MVS
system console.
Explanation: An error was encountered reading the
action response checkpoint data set. Message
KDFAP3017E should precede this message and provide KS3T410W FREE FAILED FOR DDNAME= ddname.
the exact error and information codes for resolution. RC=rc ERROR=error INFO=info
System action: The DFDSS slave and master tasks Explanation: A service response data set containing
terminate. response text could not be freed. The data set is most
likely open by another thread of execution and cannot
User response: Call IBM Software Support. The be freed until the other thread of execution has closed
destination is the MVS system console. the data set. The destination is the Tivoli Enterprise
Monitoring Server Engine log, RKLVLOG.
KS3T337E ERROR UPDATING ACTION Message Variables:
RESPONSE CHECKPOINT DATASET,
TERMINATING ddname
The DDNAME of the response data set
Explanation: An error was encountered updating the allocation.
action response checkpoint data set. Message
KDFAP3017E should precede this message and provide rc The SVC 99 return code for the deallocation
the exact error and information codes for resolution. request.
error The SVC 99 error code for the deallocation. OMEGAMON II for SMS
The Tivoli Enterprise Monitoring Server
request info
address space log, RKLVLOG.
The SVC 99 information code for the
deallocation request. All other products
The data collection (Tivoli Enterprise
System action: This message is issued to the
Monitoring Server) address space SYSTSPRT
RKLVLOG. No further actions are taken to delete the
output file.
data set. If the error occurred in response to an SQL
DELETE request to remove a completed service
request, a return code of RCABVU (26) is returned to KS3T427E REXX ERROR EXECUTING EXEC ’p0’.
the application issuing the DELETE. REXX RETURN CODE p1.
User response: None. Explanation: An error occurred when invoking the
specified REXX exec.
KS3T422E NULL RESULT FROM REXX EXEC ’ p0’. Message Variables:
Explanation: A null result was returned by the p1 Specifies the REXX return code.
specified REXX exec. The exec should provide a
System action: The attempt to perform the associated
numeric result.
service request is aborted. See TSO/E REXX
System action: None. Programming Services IRXEXEC return codes for a
description of the actions taken by REXX.
User response: This error could have been caused by
an error in the stated REXX exec. Unless you have User response: See the REXX messages issued prior
changed the exec, contact IBM Software Support to this message for more information regarding the
providing this message with the REXX exec name. If error. Review the appropriate destination:
this problem has not been reported previously, you must
OMEGAMON II for SMS
determine why the REXX exec did not return a result.
The Tivoli Enterprise Monitoring Server
You might have to place additional problem
address space log, RKLVLOG.
determination aids in the REXX exec. Review the
appropriate destination: All other products
The data collection (Tivoli Enterprise
OMEGAMON II for SMS
Monitoring Server) address space SYSTSPRT
The Tivoli Enterprise Monitoring Server
output file.
address space log, RKLVLOG.
All other products
KS3T431E INCOMPATIBLE LEVEL OF TSO/E.
The data collection (Tivoli Enterprise
VERSION 2.3.0 OR ABOVE REQUIRED.
Monitoring Server) address space SYSTSPRT
VERSION=p0 RELEASE=p1.
output file.
Explanation: The action services could not be
initialized because an unsupported version of TSO/E
KS3T426E NON-NUMERIC RESULT FROM REXX
was found. Action services requires TSO/E VERSION
EXEC ’ p0’.
2.3.0 or above to satisfy action requests.
Explanation: A non-numeric result was returned by
Message Variables:
the specified REXX exec. The exec should provide a
numeric result. p0 Reports the version of TSO/E found for the
system.
System action: None.
p1 Reports the release of TSO/E found for the
User response: The routine calling REXX failed to
system.
indicate that a only a numeric result was valid. Contact
IBM Software Support providing this message with the System action: The action request processing is
REXX exec name. If this problem has not been reported disabled for the remainder of the data collection (Tivoli
previously, you must determine why the REXX did not Enterprise Monitoring Server) address space execution.
return a numeric result. The routine calling REXX,
KS3IRACT, could have failed to indicate that the REXX User response: Install the required version of TSO/E
exec was being called as a command, or a REXX error before attempting to issue any action requests. The
could have occurred. REXX should detect an error (and destination is the Tivoli Enterprise Monitoring Server
issue message IRX0026) if a non-numeric result is Engine log, RKLVLOG.
being returned by an exec called as a command.
Review the appropriate destination:
This problem information is stored in the ITMS:Engine This problem information is stored in the ITMS:Engine
log, RKLVLOG. log, RKLVLOG.
KS3T609E Internal error analyzing REQUEST KS3T614E Internal error: RESULT number must
option be present
Explanation: This is an internal error. Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does continues, but the operation triggering the error does
not complete. not complete.
Operator response: Contact IBM Software Support. Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine This problem information is stored in the ITMS:Engine
log, RKLVLOG. log, RKLVLOG.
KS3T610E missing BIGSTRING column in KS3T615E Internal error: period missing between
TK_MODIFY query REQUEST and RESULT
Explanation: This is an internal error. Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does continues, but the operation triggering the error does
not complete. not complete.
Operator response: Contact IBM Software Support. Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine This problem information is stored in the ITMS:Engine
log, RKLVLOG. log, RKLVLOG.
KS3T611E Internal error: unknown REQUEST KS3T616E Internal error: REQUEST number must
option be present
Explanation: This is an internal error. Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does continues, but the operation triggering the error does
not complete. not complete.
Operator response: Contact IBM Software Support. Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine This problem information is stored in the ITMS:Engine
log, RKLVLOG. log, RKLVLOG.
KS3T612E Internal error: REQUEST option must KS3T617E Internal error: REQUEST or RESULT
follow REQUEST id number not valid
Explanation: This is an internal error. Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does continues, but the operation triggering the error does
not complete. not complete.
Operator response: Contact IBM Software Support. Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine This problem information is stored in the ITMS:Engine
log, RKLVLOG. log, RKLVLOG.
KS3T613E Internal error: number must follow KS3T618E Internal error: REQUEST or RESULT
REQUEST command number not valid
Explanation: This is an internal error. Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does continues, but the operation triggering the error does
not complete. not complete.
Operator response: Contact IBM Software Support. Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine Operator response: Contact IBM Software Support.
log, RKLVLOG. This problem information is stored in the ITMS:Engine
log, RKLVLOG.
KS3T619E STORAGE TOOLKIT ANCHOR BLOCK
CREATE ERROR STATUS CODE KS3T623E STORAGE TOOLKIT RUNTIME
[status_code] REASON CODE PARAMETER MEMBER KS3ACTIN
[reason_code] READ ERROR RETURN CODE
[return_code]
Explanation: This is an internal error.
Explanation: This is an internal error. The
System action: Tivoli OMEGAMON XE for Storage
[return_code] has these possible values and meanings:
continues, but the operation triggering the error does
4=Invalid handle, 5=Unsuccessful, >256=An abend
not complete.
occurred. The value is (abendcode * 256). Divide the
Operator response: Contact IBM Software Support. value by 256. If the result is less than 4096, this is a
This problem information is stored in the ITMS:Engine system abend. If the result is greater than 4096,
log, RKLVLOG. subtract 4096 to determine the user abend code.
System action: Tivoli OMEGAMON XE for Storage
KS3T620E Internal error analyzing RESULT option continues, but the operation triggering the error does
not complete.
Explanation: This is an internal error.
Operator response: Contact IBM Software Support.
System action: Tivoli OMEGAMON XE for Storage This problem information is stored in the ITMS:Engine
continues, but the operation triggering the error does log, RKLVLOG.
not complete.
Operator response: Contact IBM Software Support. KS3T624W KS3ACTIN RUNTIME PARAMETER
This problem information is stored in the ITMS:Engine ’[parm_name]’ NOT RECOGNIZED
log, RKLVLOG.
Explanation: An unsupported keyword was supplied
within the KS3ACTIN parameter member in the
KS3T621E STORAGE TOOLKIT RUNTIME RKANPAR data set. The valid keywords are:
PARAMETER MEMBER KS3ACTIN NOT CHECKDSNAME RESDSMGMTCLAS RESDSNPREFIX
FOUND RESDSSTORCLAS RESDSUNIT RESDSVOLUME
Explanation: The RKANPAR data set must contain a SLAVESTCNAME SLAVEMAXSTC SLAVETIMEOUT
member named KS3ACTIN, which contains options that System action: Tivoli OMEGAMON XE for Storage
control the Storage Toolkit. continues, but the operation triggering the error does
System action: The Storage Toolkit is not started. not complete.
Operator response: Rerun the process provided by Operator response: Ensure that you have not
the Configuration Tool to create the KS3ACTIN member. incorrectly typed any of these keywords and that you
This information is stored in the ITMS:Engine log, have not added any text other than keywords or
RKLVLOG. comments (line that begin with *). Also ensure that the
keyword and value supplied are in this format:
″KEYWORD = VALUE″ (but without the quotes). This
KS3T622E STORAGE TOOLKIT RUNTIME information is stored in the ITMS:Engine log, RKLVLOG.
PARAMETER MEMBER KS3ACTIN
OPEN ERROR RETURN CODE
[return_code] KS3T625E STORAGE TOOLKIT RUNTIME
PARAMETER MEMBER KS3ACTIN
Explanation: This is an internal error. The CLOSE ERROR RETURN CODE
[return_code] has these possible values and meanings: [return_code]
4=Invalid handle, 5=Unsuccessful - open failed,
8=Dynamic allocation failed, 9=DSNAME greater than Explanation: This is an internal error. The
44 characters, 10=DDNAME greater than 8 characters, [return_code] has these possible values and meanings:
>256=An abend occurred. The value is (abendcode * 4=Invalid handle, >256=An abend occurred. The value
256). Divide the value by 256. If the result is less than is (abendcode * 256). Divide the value by 256. If the
4096, this is a system abend. If the result is greater result is less than 4096, this is a system abend. If the
than 4096, subtract 4096 to determine the user abend result is greater than 4096, subtract 4096 to determine
code. the user abend code.
System action: Tivoli OMEGAMON XE for Storage System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does continues, but the operation triggering the error does
not complete. not complete.
Operator response: Contact IBM Software Support. Operator response: None. This is an informational
This problem information is stored in the ITMS:Engine message. This information is stored in the ITMS:Engine
log, RKLVLOG. log, RKLVLOG.
KS3T626E Internal error: unknown RESULT option KS3T631W PARAMETER ’[keyword]’ WAS
SPECIFIED PREVIOUSLY
Explanation: This is an internal error.
Explanation: A keyword was repeated within the
System action: Tivoli OMEGAMON XE for Storage
KS3ACTIN parameter member.
continues, but the operation triggering the error does
not complete. System action: The additional keyword and value are
ignored.
Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine Operator response: Remove one of the instances of
log, RKLVLOG. the keyword parameter and its value. This information is
stored in the ITMS:Engine log, RKLVLOG.
KS3T627E Internal error: RESULT option must
follow RESULT id KS3T632E Internal error: unrecognized TOOLKIT
command
Explanation: This is an internal error.
Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does System action: Tivoli OMEGAMON XE for Storage
not complete. continues, but the operation triggering the error does
not complete.
Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine Operator response: Contact IBM Software Support.
log, RKLVLOG. This problem information is stored in the ITMS:Engine
log, RKLVLOG.
KS3T628I STORAGE TOOLKIT RUNTIME
PARAMETER MEMBER KS3ACTIN WAS KS3T633W PARAMETER ’[keyword]’ VALUE
READ SUCCESSFULLY ’[value]’ IS TOO LONG MAXIMUM
LENGTH IS [max_length]
Explanation: The KS3ACTIN member was read and
processed successfully. Explanation: This is an internal error.
System action: The Storage Toolkit continues its System action: Tivoli OMEGAMON XE for Storage
initialization processing. continues, but the operation triggering the error does
not complete.
Operator response: None. This is an informational
message. This information is stored in the ITMS:Engine Operator response: Contact IBM Software Support.
log, RKLVLOG. This problem information is stored in the ITMS:Engine
log, RKLVLOG.
KS3T629E STORAGE TOOLKIT RUNTIME
PARAMETER MEMBER KS3ACTIN WAS KS3T636W PARAMETER ’[keyword]’ VALUE
NOT READ SUCCESSFULLY ’[value]’ IS NOT NUMERIC
Explanation: This is an internal error. Explanation: A non-numeric parameter value was
supplied where not allowed.
System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does System action: The keyword and value are ignored.
not complete.
Operator response: Ensure that the SLAVEMAXSTC
Operator response: Contact IBM Software Support. and SLAVETIMEOUT values are numeric. This
This problem information is stored in the ITMS:Engine information is stored in the ITMS:Engine log, RKLVLOG.
log, RKLVLOG.
KS3T637E Internal error: missing TOOLKIT
KS3T630I PARAMETER ’[keyword]’ HAS BEEN command
ASSIGNED THE VALUE ’[value]’
Explanation: This is an internal error.
Explanation: The parameter listed was understood
System action: Tivoli OMEGAMON XE for Storage
and processed.
continues, but the operation triggering the error does
System action: None. not complete.
KS3T654E Internal error: Storage Toolkit KS3T666E Quoted string found without XML
Tk_global is 0, source = [program_id] attribute name or equal sign
Explanation: This is an internal error. Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does continues, but the operation triggering the error does
not complete. not complete.
Operator response: Contact IBM Software Support. Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine This problem information is stored in the ITMS:Engine
log, RKLVLOG. log, RKLVLOG.
KS3T655E Timed-Out waiting for Checkpoint KS3T667E Character < found within XML start or
dataset lock end tag
Explanation: This is an internal error. Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does continues, but the operation triggering the error does
not complete. not complete.
Operator response: Contact IBM Software Support. Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine This problem information is stored in the ITMS:Engine
log, RKLVLOG. log, RKLVLOG.
KS3T657E Internal error: Storage Toolkit KS3T668E Invalid XML end tag
Tk_modify_session not found
Explanation: This is an internal error.
Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage
System action: Tivoli OMEGAMON XE for Storage continues, but the operation triggering the error does
continues, but the operation triggering the error does not complete.
not complete.
Operator response: Contact IBM Software Support.
Operator response: Contact IBM Software Support. This problem information is stored in the ITMS:Engine
This problem information is stored in the ITMS:Engine log, RKLVLOG.
log, RKLVLOG.
KS3T669E Invalid XML start tag
KS3T660E Character < found in string, which is
Explanation: This is an internal error.
not valid
System action: Tivoli OMEGAMON XE for Storage
Explanation: This is an internal error.
continues, but the operation triggering the error does
System action: Tivoli OMEGAMON XE for Storage not complete.
continues, but the operation triggering the error does
Operator response: Contact IBM Software Support.
not complete.
This problem information is stored in the ITMS:Engine
Operator response: Contact IBM Software Support. log, RKLVLOG.
This problem information is stored in the ITMS:Engine
log, RKLVLOG.
KS3T670E Character = found without earlier XML
attribute name
KS3T665E End of quoted string not found
Explanation: This is an internal error.
Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage
System action: Tivoli OMEGAMON XE for Storage continues, but the operation triggering the error does
continues, but the operation triggering the error does not complete.
not complete.
Operator response: Contact IBM Software Support.
Operator response: Contact IBM Software Support. This problem information is stored in the ITMS:Engine
This problem information is stored in the ITMS:Engine log, RKLVLOG.
log, RKLVLOG.
KS3T671E End of XML start tag found while XML KS3T676E ---End of parse 2---
attribute incomplete
Explanation: This is an internal error.
Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage
System action: Tivoli OMEGAMON XE for Storage continues, but the operation triggering the error does
continues, but the operation triggering the error does not complete.
not complete.
Operator response: Contact IBM Software Support.
Operator response: Contact IBM Software Support. This problem information is stored in the ITMS:Engine
This problem information is stored in the ITMS:Engine log, RKLVLOG.
log, RKLVLOG.
KS3T677E Invalid character (0x[character]) after
KS3T672E Invalid characters within XML start tag number
Explanation: This is an internal error. Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does continues, but the operation triggering the error does
not complete. not complete.
Operator response: Contact IBM Software Support. Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine This problem information is stored in the ITMS:Engine
log, RKLVLOG. log, RKLVLOG.
KS3T673E XML attribute value must be enclosed KS3T678E Invalid character ([first_character])
in single or double quotes found in string
Explanation: This is an internal error. Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does continues, but the operation triggering the error does
not complete. not complete.
Operator response: Contact IBM Software Support. Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine This problem information is stored in the ITMS:Engine
log, RKLVLOG. log, RKLVLOG.
KS3T674E Invalid characters within XML end tag KS3T679E Internal error: couldn’t find
Tk_command variable
Explanation: This is an internal error.
Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does System action: Tivoli OMEGAMON XE for Storage
not complete. continues, but the operation triggering the error does
not complete.
Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine Operator response: Contact IBM Software Support.
log, RKLVLOG. This problem information is stored in the ITMS:Engine
log, RKLVLOG.
KS3T675E End of parse but with incomplete parse
state KS3T685E Unsupported DFSMShsm or
DFSMSdss™ request type
Explanation: This is an internal error.
Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does System action: Tivoli OMEGAMON XE for Storage
not complete. continues, but the operation triggering the error does
not complete.
Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine Operator response: Contact IBM Software Support.
log, RKLVLOG. This problem information is stored in the ITMS:Engine
log, RKLVLOG.
KS3T689E Logic error while parsing XMIT header KS3T694E New XMIT session but no REQ
attribute
Explanation: This is an internal error.
Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does System action: Tivoli OMEGAMON XE for Storage
not complete. continues, but the operation triggering the error does
not complete.
Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine Operator response: Contact IBM Software Support.
log, RKLVLOG. This problem information is stored in the ITMS:Engine
log, RKLVLOG.
KS3T690I STORAGE TOOLKIT INITIALIZATION
HAS COMPLETED KS3T695E There must be exactly one ID attribute
in the XMIT header
Explanation: The Storage Toolkit initialization process
is complete and successful. Explanation: This is an internal error.
System action: None. System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does
Operator response: None. This is an informational
not complete.
message. This information is stored in the ITMS:Engine
log, RKLVLOG. Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine
log, RKLVLOG.
KS3T696E Internal error: PERMUTE attribute not KS3T701I STORAGE TOOLKIT TERMINATION
YES or NO HAS COMPLETED
Explanation: This is an internal error. Explanation: The Storage Toolkit has shut down
during normal shutdown of the Tivoli Enterprise
System action: Tivoli OMEGAMON XE for Storage
Monitoring Server.
continues, but the operation triggering the error does
not complete. System action: None.
Operator response: Contact IBM Software Support. Operator response: None. This is an informational
This problem information is stored in the ITMS:Engine message. This information is stored in the ITMS:Engine
log, RKLVLOG. log, RKLVLOG.
KS3T697E Internal error: No NAME attribute on KS3T702W DELETE FAILED FOR RESPONSE
SUBSTITUTE DATASET [response_dsname]
Explanation: This is an internal error. Explanation: The data set used to temporarily hold
DFSMShsm or DFSMSdss command output cannot be
System action: Tivoli OMEGAMON XE for Storage
deleted.
continues, but the operation triggering the error does
not complete. System action: None.
Operator response: Contact IBM Software Support. Operator response: The data set might not actually
This problem information is stored in the ITMS:Engine exist if the Storage Toolkit ended abnormally before the
log, RKLVLOG. data set status was recorded. This information is stored
in the ITMS:Engine log, RKLVLOG.
KS3T698E Internal error: no VALUE content
KS3T703E Internal error: matching XML end tag
Explanation: This is an internal error.
not found
System action: Tivoli OMEGAMON XE for Storage
Explanation: This is an internal error.
continues, but the operation triggering the error does
not complete. System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does
Operator response: Contact IBM Software Support.
not complete.
This problem information is stored in the ITMS:Engine
log, RKLVLOG. Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine
log, RKLVLOG.
KS3T699E Internal error: First XML tag must be
STORAGE-TOOLKIT
KS3T704E Internal error: unrecognized Storage
Explanation: This is an internal error.
Toolkit command
System action: Tivoli OMEGAMON XE for Storage
Explanation: This is an internal error.
continues, but the operation triggering the error does
not complete. System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does
Operator response: Contact IBM Software Support.
not complete.
This problem information is stored in the ITMS:Engine
log, RKLVLOG. Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine
log, RKLVLOG.
KS3T700I STORAGE TOOLKIT TERMINATION
HAS COMMENCED
KS3T705E Internal error: missing Storage Toolkit
Explanation: The Storage Toolkit is shutting down
command
during normal shutdown of the Tivoli Enterprise
Monitoring Server. Explanation: This is an internal error.
System action: None. System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does
Operator response: None. This is an informational
not complete.
message. This information is stored in the ITMS:Engine
log, RKLVLOG. Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine
log, RKLVLOG.
KS3T707E Internal error: resource count per KS3T717E Internal error: problem deleting
variable is wrong REQUEST results
Explanation: This is an internal error. Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does continues, but the operation triggering the error does
not complete. not complete.
Operator response: Contact IBM Software Support. Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine This problem information is stored in the ITMS:Engine
log, RKLVLOG. log, RKLVLOG.
KS3T708E Internal error: No lock value in Tk_lock KS3T718I Content after start tag ignored
destructor
Explanation: Extraneous characters were found within
Explanation: This is an internal error. XML and were ignored.
System action: Tivoli OMEGAMON XE for Storage System action: None.
continues, but the operation triggering the error does
Operator response: None. This is an informational
not complete.
message. This information is stored in the ITMS:Engine
Operator response: Contact IBM Software Support. log, RKLVLOG.
This problem information is stored in the ITMS:Engine
log, RKLVLOG.
KS3T719E ---End of parse 1---
Explanation: This is an internal error.
KS3T709E Internal error: no Storage Toolkit
command to process System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does
Explanation: This is an internal error.
not complete.
System action: Tivoli OMEGAMON XE for Storage
Operator response: Contact IBM Software Support.
continues, but the operation triggering the error does
This problem information is stored in the ITMS:Engine
not complete.
log, RKLVLOG.
Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine
KS3T721W STORAGE TOOLKIT ANCHOR BLOCK
log, RKLVLOG.
DESTROY ERROR STATUS CODE
[status_code] REASON CODE
KS3T714W SERVICE REQUEST [request_number] [reason_code]
COULD NOT BE CANCELED
Explanation: This is an internal error.
Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage
System action: Tivoli OMEGAMON XE for Storage continues, but the operation triggering the error does
continues, but the operation triggering the error does not complete.
not complete.
Operator response: Contact IBM Software Support.
Operator response: Contact IBM Software Support. This problem information is stored in the ITMS:Engine
This problem information is stored in the ITMS:Engine log, RKLVLOG.
log, RKLVLOG.
KS3T722E Internal error: typeD record eyecatcher KS3T727E Internal error: typeF record eyecatcher
mismatch mismatch
Explanation: This is an internal error. Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does continues, but the operation triggering the error does
not complete. not complete.
Operator response: Contact IBM Software Support. Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine This problem information is stored in the ITMS:Engine
log, RKLVLOG. log, RKLVLOG.
KS3T723E Internal error: typeG record eyecatcher KS3T728E Internal error: typeD record but typeG
mismatch == 0
Explanation: This is an internal error. Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does continues, but the operation triggering the error does
not complete. not complete.
Operator response: Contact IBM Software Support. Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine This problem information is stored in the ITMS:Engine
log, RKLVLOG. log, RKLVLOG.
KS3T724E Internal error: typeF record but typeG KS3T729E Internal error: typeD record eyecatcher
== 0 mismatch
Explanation: This is an internal error. Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does continues, but the operation triggering the error does
not complete. not complete.
Operator response: Contact IBM Software Support. Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine This problem information is stored in the ITMS:Engine
log, RKLVLOG. log, RKLVLOG.
KS3T726E Internal error: typeF last_in_chain KS3T731E Internal error: unknown record type
Explanation: This is an internal error. Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does continues, but the operation triggering the error does
not complete. not complete.
Operator response: Contact IBM Software Support. Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine This problem information is stored in the ITMS:Engine
log, RKLVLOG. log, RKLVLOG.
This problem information is stored in the ITMS:Engine continues, but the operation triggering the error does
log, RKLVLOG. not complete.
Operator response: Contact IBM Software Support.
KS3T742E TSO/E ENVIRONMENT INITIALIZATION This problem information is stored in the ITMS:Engine
FAILED: COULD NOT LOCATE KDF log, RKLVLOG.
ANCHOR BLOCK
Explanation: This is an internal error. KS3T747E Equal sign must follow the XML
attribute name
System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does Explanation: This is an internal error.
not complete.
System action: Tivoli OMEGAMON XE for Storage
Operator response: Contact IBM Software Support. continues, but the operation triggering the error does
This problem information is stored in the ITMS:Engine not complete.
log, RKLVLOG.
Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine
KS3T743E CONDITION VARIABLE INITIALIZATION log, RKLVLOG.
FAILED. ERROR NUMBER
[error_number]
KS3T748E UNABLE TO ADD NEW CHECKPOINT
Explanation: This is an internal error. RECORD FOR REQUEST
[request_number]
System action: Tivoli OMEGAMON XE for Storage
continues, but the operation triggering the error does Explanation: This is an internal error.
not complete.
System action: Tivoli OMEGAMON XE for Storage
Operator response: Contact IBM Software Support. continues, but the operation triggering the error does
This problem information is stored in the ITMS:Engine not complete.
log, RKLVLOG.
Operator response: Contact IBM Software Support.
This problem information is stored in the ITMS:Engine
KS3T744E MUTEX VARIABLE INITIALIZATION log, RKLVLOG.
FAILED. ERROR NUMBER
[error_number]
KS3T749E SERVICE CHECKPOINT DATASET
Explanation: This is an internal error. STORAGE ALLOCATION ERROR
System action: Tivoli OMEGAMON XE for Storage Explanation: This is an internal error.
continues, but the operation triggering the error does
System action: Tivoli OMEGAMON XE for Storage
not complete.
continues, but the operation triggering the error does
Operator response: Contact IBM Software Support. not complete.
This problem information is stored in the ITMS:Engine
Operator response: Contact IBM Software Support.
log, RKLVLOG.
This problem information is stored in the ITMS:Engine
log, RKLVLOG.
KS3T745E Internal error: </STORAGE-TOOLKIT>
end tag not found where expected
KS3T751E STORAGE TOOLKIT COULD NOT
Explanation: This is an internal error. LOCATE ANCHOR BLOCK.
STATUS=[status_code]
System action: Tivoli OMEGAMON XE for Storage
REASON=[reason_code.]
continues, but the operation triggering the error does
not complete. Explanation: This is an internal error.
Operator response: Contact IBM Software Support. System action: Tivoli OMEGAMON XE for Storage
This problem information is stored in the ITMS:Engine continues, but the operation triggering the error does
log, RKLVLOG. not complete.
Operator response: Contact IBM Software Support.
KS3T746E Quoted string found outside XML start This problem information is stored in the ITMS:Engine
tag log, RKLVLOG.
Explanation: This is an internal error.
System action: Tivoli OMEGAMON XE for Storage
KDFAAE01 UNABLE TO OPEN FORM Explanation: A user tried to access a panel or product
AUTHORIZATION TABLE function, but lacked authorization. The destination is the
Tivoli Enterprise Monitoring Server Engine log file,
Explanation: An update of the form authorization table RKLVLOG.
failed. The destination is the Tivoli Enterprise Monitoring
Server Engine log file, RKLVLOG. System action: The user is not granted access to the
panel or function.
System action: The form authorization record is not
stored. User response: None. This message is informational.
Explanation: Logon processing for the specified user System action: The service probes continue
was completed. The destination is the Tivoli Enterprise initialization.
Monitoring Server Engine log file, RKLVLOG. User response: None.
System action: None.
User response: None. This message is informational. KDFAP0001I SERVICE PROBES ANCHOR BLOCK
HAS BEEN CREATED
KDFAPP02 USER user_id HAS LOGGED OFF Explanation: The service probes anchor block has
been created. The destination is the Tivoli Enterprise
Explanation: The specified user has logged off. The Monitoring Server Engine log file, RKLVLOG.
destination is the Tivoli Enterprise Monitoring Server
Engine log file, RKLVLOG. System action: The service probes initialization
continues.
System action: None.
If these messages are not found, then the action KDFAP0023S SERVICE PROBES RUNTIME
services probes have not been initialized. To investigate PARAMETER MEMBER KDFACTIN
further: READ ERROR RETURN CODE
v Search the RKLVLOG of Tivoli Enterprise Monitoring return_code
Server for any related error messages.
Explanation: An error occurred when an attempt was
v Insure that the RKANPAR data sets for Tivoli made to read the service probes runtime parameters
Enterprise Monitoring Server are correct. member KDFACTIN. The destination is the Tivoli
v Insure that the RKANPAR data set members have Enterprise Monitoring Server Engine log file, RKLVLOG.
not been inadvertently modified. Correct any errors
Message Variables: Return codes are:
and restart Tivoli Enterprise Monitoring Server.
0 Function completed successfully.
If further assistance is necessary, contact IBM Software
Support. 2 End of file.
4 Invalid handle for the persistent data store.
5 Get unsuccessful.
System action: The parameter assignment is ignored. User response: Correct or remove the specified
The service probes continue initializing. runtime parameter.
User response: Correct or remove the specified
runtime parameter. KDFAP0039E RUNTIME PARAMETER
parameter_name HAS NOT BEEN
SPECIFIED AND WILL NOT BE
KDFAP0034W PARAMETER parameter_name VALUE
DEFAULTED
parameter_value IS TOO LARGE.
MAXIMUM VALUE IS maximum_value. Explanation: A valid assignment for the specified
parameter cannot be found in the runtime parameters
Explanation: The value assigned to the specified
member KDFACTIN. The parameter cannot be
parameter is too large. The destination is the Tivoli
defaulted.
Enterprise Monitoring Server Engine log file, RKLVLOG.
System action: The service probes terminate.
Message Variables:
User response: Add an assignment for the specified
parameter_name
parameter to the runtime parameters member
The KDFACTIN keyword parameter name.
KDFACTIN and restart the service probes.
parameter_value
The incorrectly specified value of the keyword
KDFAP0040S SERVICE PROBES ADMINISTRATION
parameter.
RECORD READ ERROR
maximum_length
Explanation: An attempt to read the administration
The maximum acceptable length of the value.
record from the checkpoint data set failed. The
System action: The parameter specification is administration record contains information associated
ignored. The service probes continue initializing. with service requests issued during previous executions
of the data collection (Tivoli Enterprise Monitoring
User response: Correct or remove the specified Server) address space. The destination is the Tivoli
runtime parameter. Enterprise Monitoring Server Engine log file, RKLVLOG.
System action: The service probes initialization
KDFAP0035W PARAMETER parameter_name VALUE terminates and service requests are not accepted for
parameter_value IS TOO SMALL. the remainder of the data collection (Tivoli Enterprise
MINIMUM VALUE IS minimum_value Monitoring Server) address space execution.
Explanation: The value assigned to the specified User response: Determine why the administration
parameter is too small. The destination is the Tivoli record cannot be read. If the service request checkpoint
Enterprise Monitoring Server Engine log file, RKLVLOG. data set has been corrupted, restore the data set from a
Message Variables: backup or delete and recreate the data set.
System action: The service probes are warm started. Explanation: The initialization of the service probes
failed. The destination is the Tivoli Enterprise Monitoring
User response: None. Server Engine log file, RKLVLOG.
System action: The service probes indicate they are
KDFAP0046I SERVICE PROBES ARE BEING WARM unable to process service requests.
STARTED
User response: See the previous messages for the
Explanation: The checkpoint data set for service cause of the failure.
requests has been successfully opened and checkpoint
information is used to restore service request
information. The destination is the Tivoli Enterprise KDFAP0100I SERVICE PROBES TERMINATION HAS
Monitoring Server Engine log file, RKLVLOG. BEGUN
System action: Service probes initialization continues. Explanation: The termination of the service probes
Any completed requests and responses at the time of began. The destination is the Tivoli Enterprise
the previous termination are restored. Monitoring Server Engine log file, RKLVLOG.
System action: The service probes termination address space is suspended. WTOR message
completes and the data collection (Tivoli Enterprise KDFS0110A is issued to prompt the console operator to
Monitoring Server) address space continues with delay the shutdown until service requests on DASD
shutdown processing. volumes and data sets complete.
User response: None. User response: If an immediate shutdown is
requested, or the address space is cancelled while the
service requests were in progress, integrity of the DASD
KDFAP0120I SERVICE IN PROGRESS AT
volume or data sets should be reviewed. If necessary,
SHUTDOWN
manual recovery processing should be taken to restore
Explanation: This message precedes the list of active the DASD volume or data sets. The recovery
services requests at data collection (Tivoli Enterprise processing depends on the service in progress:
Monitoring Server) address space shutdown. Message
Any HSM service requests
KDFS0130S follows this message and lists the service
No recovery processing required.
requests in progress. The destination is the Tivoli
Enterprise Monitoring Server Engine log file, RKLVLOG, DFDSS Compress Dataset
and the MVS system console. If the data set is damaged, recover the data
set from the HSM BACKDS taken immediately
System action: See message KDFAP0130I.
before compress processing was initiated.
User response: See message KDFAP0130I.
DFDSS Defragment Volume
DADSM message IEC602 is issued if a data
KDFAP0121W SERVICE PROBES ANCHOR BLOCK set is accessed on a volume where DFDSS
DESTROY ERROR STATUS CODE DEFRAG did not complete. Dataset
status_code REASON CODE SYS.DFDSS.DEFRAG.xxxxxx.volser.DUMMY
reason_code is allocated on the volume by DFDSS and
remains on the volume if the defragmentation
Explanation: The service probes anchor block cannot was interrupted. Resubmit a DFDSS DEFRAG
be destroyed. This message should not have any request on the volume to correct the problem.
significant impact on the service probes. The destination
is the Tivoli Enterprise Monitoring Server Engine log file,
Note: OMEGAMON II also issues an HSM
RKLVLOG.
incremental backup before initiating
System action: Message KDFAP0100 is issued and defragment volume processing. If the
the service probes terminate. IEC602 message is not corrected by
resubmitting the defragmentation
User response: None. request, or if immediate access to data
sets on the volume are required, an
KDFAP0130I service_request ON volser_or_dataset HSM recovery request can be used to
name STARTED AT yy/mm/dd hh:mm:ss restore individual data sets on the
volume, or a HSM dump restore and
Explanation: This message follows message incremental forward recovery can be
KDFAP0120I and is issued for each service request in used to restore the entire volume.
progress at the time of data collection (Tivoli Enterprise
Monitoring Server) address space shutdown. All other DFDSS service requests
No recovery processing required.
Message Variables:
service_request KDFAP0900E DFDSS ACTION REQUEST ADDRESS
The description of the service request in SPACE HAS NOT BEEN CONFIGURED
progress. REFER TO CANDLE DOCUMENT
volser_or_dataset name DF99-4853, DSS VSCR, FOR
The volume serial number of the DASD volume CONFIGURATION INFORMATION
or name of the data set being processed by Explanation: The SLAVESTCNAME parameter was
the service request. not found in the KDFACTIN member of data set
yy/mm/dd rhilev.RKANPAR. This parameter is required to execute
The date at which the service request started DFDSS action requests. The destination is the Tivoli
execution. Enterprise Monitoring Server Engine log file, RKLVLOG.
PUTLINE service failed, contact IBM Software Support reason Specifies the reason code from the TSO/E
providing this message and the message that cannot be services environment initialization routine,
issued. Also, have the abend U0910 dump available. IKJTSOEV.
This message should never be issued. It is issued only
abend Specifies the abend code from the TSO/E
if the TSO/E PUTLINE service responds with a return
services environment initialization routine,
code other than 0, 12, or 16. No other return codes
IKJTSOEV.
should be applicable in the KDFIRACT environment.
System action: Service request processing is disabled
for the remainder of the Tivoli Enterprise Monitoring
KDFAP1292E UNABLE TO ISSUE p0 - INVALID
Server (data collection) address space execution, and
PARAMETERS
OMEGAMON II for SMS service requests are not
Explanation: An attempt to issue the specified accepted.
message using the TSO/E PUTLINE service failed.
User response: Using the return code, reason code,
TSO/E indicated the associated parameters were
and abend code displayed, determine why the TSO/E
invalid. The destination is the MVS control console
environment cannot be initialized. Correct the error and
(WTO).
restart the Tivoli Enterprise Monitoring Server address
System action: An abend U0920 occurs after this space to enable service request processing. If the
message is issued and a dump is taken. cause of the initialization failure cannot be determined,
contact IBM Software Support for assistance. The
User response: See the description of the message
destination is the Tivoli Enterprise Monitoring Server
that cannot be issued. To determine why the TSO/E
Engine log file, RKLVLOG.
PUTLINE service failed, contact IBM Software Support
providing this message and the message that cannot be
issued. Also, have the abend U0920 dump available. KDFAP1430E CONDITION VARIABLE
This message is issued when the TSO/E PUTLINE INITIALIZATION FAILED. ERROR
service provides return code 12. The dump should be NUMBER nnn.
examined to determine why the parameter list was
Explanation: An attempt to initialize a POSIX
invalid.
condition variable used for service requests completion
notification has failed.
KDFAP1293E UNABLE TO ISSUE p0 -
Message Variables:
INSUFFICIENT STORAGE
nnn Specifies the error number set by the POSIX
Explanation: An attempt to issue the specified
pthread_cond_init initialization routine.
message failed. TSO/E indicated that there was
insufficient storage to issue the message. The System action: Service request processing is disabled
destination is the MVS control console (WTO). for the remainder of the Tivoli Enterprise Monitoring
Server (data collection) address space execution, and
System action: The system action depends on the
OMEGAMON II for SMS service requests are not
text of the message that cannot be issued. Refer to the
accepted.
system action of the message.
User response: Contact IBM Software Support for
User response: See the description of the message
assistance. The destination is the Tivoli Enterprise
that cannot be issued. If this message is issued often,
Monitoring Server Engine log file, RKLVLOG.
determine why storage was insufficient to issue the
message.
KDFAP1440E MUTEX VARIABLE INITIALIZATION
FAILED. ERROR NUMBER nnn.
KDFAP1420E TSO/E ENVIRONMENT
INITIALIZATION FAILED. RETURN Explanation: An attempt to initialize a POSIX mutual
CODE rc REASON CODE reason exclusion variable used for service request serialization
ABEND CODE abend. locks has failed.
Explanation: An attempt to initialize the TSO/E Message Variables:
environment for processing of OMEGAMON II for SMS
service requests failed. nnn Specifies the error number set by the POSIX
pthread_cond_init initialization routine.
Message Variables:
System action: Service request processing is disabled
rc Specifies the return code from the TSO/E for the remainder of the Tivoli Enterprise Monitoring
services environment initialization routine, Server (data collection) address space execution, and
IKJTSOEV. OMEGAMON II for SMS service requests are not
accepted.
User response: Contact IBM Software Support for
assistance. The destination is the Tivoli Enterprise data set create, delete, read, and write access to
Monitoring Server Engine log file, RKLVLOG. service response data sets. The destination is the Tivoli
Enterprise Monitoring Server Engine log file, RKLVLOG.
KDFAP1450E UNABLE TO VERIFY PROPER
FORMAT FOR MODULE KDFCRAET KDFAP1530E NEW REQUEST HAS DUPLICATE
KEY OF reqid
Explanation: Module KDFCRAET was loaded but the
data found in the module was not in the format Explanation: The service probes cannot accept a new
expected by the service probes. a service request because a previously issued request
uses the same internal request identifier.
System action: Service request initialization fails, and
OMEGAMON II for SMS service requests are not Message Variables:
accepted for the remainder of the Tivoli Enterprise
reqid Identifies the ID number of the failed service
Monitoring Server (data collection) address space
request.
execution.
System action: The service probes request fails and
User response: This is an internal error. Verify that
returns an error status to the application program
the KDFCRAET module was installed correctly and
making the request.
placed in an APF-authorized library. Contact IBM
Software Support for further assistance. The destination User response: Ensure that the OMEGAMON II
is the Tivoli Enterprise Monitoring Server Engine log file, checkpoint data set has not been overwritten. If the
RKLVLOG. checkpoint data set is damaged, the data set can be
restored to its original state from a data set backup of
the VSAM cluster, or it can be deleted and recreated.
KDFAP1510E SERVICE PROBES COULD LOCATE
Restoration or recreation can cause the loss of service
ANCHOR BLOCK. STATUS=status
requests that have checkpointed. This problem can
REASON=reason.
occur because a large number of service requests were
Explanation: This message indicates that the service issued and never deleted. If a large number of
probes which attempt to locate the anchor block unwanted service requests are retained in the
containing administrative control data have failed. checkpoint data set, issue delete requests to clear the
unwanted requests and allow request identifiers to be
Message Variables:
reused. The destination is the Tivoli Enterprise
status Specifies the return code returned by the Monitoring Server Engine log file, RKLVLOG.
anchor locate service.
reason Specifies the reason code returned by the KDFAP1550S SERVICE REQUESTS DISABLED DUE
anchor locate service routine. TO CHECKPOINT FAILURE
System action: The service probes request fails and Explanation: This message is issued after a fatal
returns an error status to the application program checkpoint failure has been detected. Refer to
making the request. messages issued prior to this message to determine the
exact cause of the failure.
User response: This is an internal error. Contact IBM
Software Support and provide the message. The System action: The service request being processed
destination is the Tivoli Enterprise Monitoring Server fails and an error return code is set for the request.
Engine log file, RKLVLOG. Additionally, service request processing is disabled and
no new service requests are accepted.
KDFAP1520E UNABLE TO CREATE RESPONSE User response: Ensure that the OMEGAMON II
DATASET dsname FOR REQUEST reqid checkpoint data set has not been overwritten and free
space has not been exhausted. If the checkpoint data
Explanation: The service probes cannot create and set is damaged, the data set can be restored to its
catalog the specified service response data set for original state from a data set backup of the VSAM
service request reqid. cluster, or it can be deleted and recreated. Restoration
System action: The service probes request fails and can cause the loss of service requests that were
returns an error status to the application program checkpointed after the backup was taken. This problem
making the request. can occur because a large number of service requests
were issued and never deleted. If a large number of
User response: Ensure that the OMEGAMON II unwanted service requests are retained in the
service request parameters specified in the KDFACTIN checkpoint data set, issue delete requests to allow
member of the runtime parameters data set has been storage in the checkpoint data set to be reused.
configured properly. Also verify that the security access
rights have been granted to the data collection (Tivoli
Enterprise Monitoring Server) address space to allow
status Identifies the error status code returned by User response: This is an internal error. If the cause
thread cancellation service routine. of the error cannot be determined, contact IBM Software
Support. The destination is the Tivoli Enterprise
System action: An error code is returned if the Monitoring Server Engine log file, RKLVLOG.
cancellation failure occurred as a result of a delete
operation. Otherwise data collection (Tivoli Enterprise
Monitoring Server) address space termination KDFAP1620E UNABLE TO UPDATE CHECKPOINT
processing continues. DATASET FOR REQUEST reqid
User response: If this message is issued in response Explanation: This message indicates that the service
to a delete action against a service request awaiting probes cannot update the existing service request reqid
execution, contact IBM Software Support for assistance. in the checkpoint data set.
The destination is the Tivoli Enterprise Monitoring Message Variables:
Server Engine log file, RKLVLOG.
reqid Identifies the ID number of the service request.
KDFAP1600I SERVICE REQUEST reqid STARTED. System action: The service request fails with a
action ON objclass object. nonzero return code; the time of the failure is noted,
and a negative return code value for the request is set.
Explanation: This message indicates that a service
request has begun execution. User response: This is an internal error. If the cause
of the error cannot be determined, contact IBM Software
Message Variables: Support. The destination is the Tivoli Enterprise
reqid Identifies the ID number of the service request. Monitoring Server Engine log file, RKLVLOG.
System action: The deletion of the request fails and a Message Variables:
return code is issued indicating that the delete failure is
reqid Identifies the ID number of the service request.
returned to the application program issuing the delete.
System action: The service request fails with a
User response: This is an internal error. Contact IBM
nonzero return code. The time of the failure is noted,
Software Support. The destination is the Tivoli
and a negative return code value for the request is set.
Enterprise Monitoring Server Engine log file, RKLVLOG.
User response: Determine why the checkpoint data
set cannot be updated. If the checkpoint data set is full,
KDFAP1645E TIMED-OUT WAITING FOR
issue delete operations on unwanted service requests
CHECKPOINT DATASET LOCK
to allow storage in the checkpoint data set to be reused.
(KDFRRAQD)
If the cause of the error cannot be determined, contact
Explanation: The service probes cannot obtain the IBM Software Support for further assistance. The
checkpoint data set lock. destination is the Tivoli Enterprise Monitoring Server
Engine log file, RKLVLOG.
System action: The request fails. A return code is
issued to the application making the request.
KDFAP1690I SERVICE REQUEST reqid COMPLETED.
User response: This is an internal error. Contact IBM RC=rc
Software Support. The destination is the Tivoli
Enterprise Monitoring Server Engine log file, RKLVLOG. Explanation: This message indicates that service
request reqid has completed execution.
KDFAP1650E UNABLE TO READ ADMINISTRATION Message Variables:
RECORD FROM CHECKPOINT
reqid Identifies the ID number of the service request.
DATASET.
rc Identifies the return code value set by the
Explanation: This message indicates that the service
service provider routine. This value is identical
probes cannot recall the administration record from the
to the value displayed on service request
checkpoint data set.
details panels.
System action: The service request fails with a
System action: The next service request in queue (if
nonzero return code time of the failure is noted, and a
any) is executed.
negative return code value for the request is set.
User response: The service request status and detail
User response: This is an internal error. If the cause
panels can be used to review the success or failure of
of the error cannot be determined, contact IBM Software
the completed service request. If the record of the
Support. The destination is the Tivoli Enterprise
service request is no longer needed, a delete operation
Monitoring Server Engine log file, RKLVLOG.
should be issued on the service request to allow
storage in the checkpoint data set to be reused. The
v BUFFER FLUSH
KDFAP1812W SERVICE CHECKPOINT DATASET
CLOSE ERROR INVALID HANDLE v ERASE
v GET
Explanation: The request to close the service
checkpoint data set failed. v GET LOCK
v POINT
System action: The service probes continue
execution. The most likely cause of this error is a failure v PUT
to open the checkpoint data set. This error should not v START
have any significant impact on the service probes. v END
User response: Refer to previously issued messages return code
associated with possible open or dynamic data set Identifies the VSAM return code issued by the
allocation errors. The destination is the Tivoli Enterprise checkpoint data set I/O routine.
Monitoring Server Engine log file, RKLVLOG.
reason code
Identifies the VSAM reason code issued by the
KDFAP1821E SERVICE CHECKPOINT DATASET checkpoint data set I/O routine.
reqtype REQUEST ERROR INVALID
HANDLE System action: Unpredictable, as the system action is
dependent upon the action that failed.
Explanation: A service checkpoint data set request
failed because an invalid buffer was used. This is an User response: Investigate the cause of the error.
internal error. The return code and reason code are from the VSAM
request and are documented in MVS/DFP Macro
Message Variables: Instructions for Data Sets. The destination is the Tivoli
reqtype Enterprise Monitoring Server Engine log file, RKLVLOG.
Identifies the type of the I/O request. Values
are: KDFAP1823E SERVICE CHECKPOINT DATASET
v ACQUIRE BUFFER reqtype REQUEST ERROR BUFFER
v BUFFER FLUSH TOO SMALL
v ERASE Explanation: The request to get a service checkpoint
v GET data set record failed because the buffer provided to
receive the record was too small. This is an internal
v GET LOCK
logic error.
v POINT
Message Variables:
v PUT
v START reqtype
Identifies the type of the I/O request. Values
v END
are:
System action: Unpredictable, as the system action is v ACQUIRE BUFFER
dependent upon the action that failed.
v BUFFER FLUSH
User response: This is an internal error. Contact IBM v ERASE
Software Support and provide the message contents.
v GET
The destination is the Tivoli Enterprise Monitoring
Server Engine log file, RKLVLOG. v GET LOCK
v POINT
KDFAP1822E SERVICE CHECKPOINT DATASET v PUT
reqtype REQUEST ERROR VSAM v START
RETURN CODE return code VSAM v END
REASON CODE reason code
System action: Unpredictable, as the system action is
Explanation: A service checkpoint data set request dependent upon the type of record being read. The
failed. VSAM provided a return code and a reason service probes continue processing, if possible. Other
code. messages issued with this message can provide further
Message Variables: details.
User response: This is an informational message Explanation: Data collection initialization failed while
only. The destination is the Tivoli Enterprise Monitoring attempting to load the module indicated.
Server Engine log file, RKLVLOG. System action: The initialization of the Tivoli
Enterprise Monitoring Server terminates.
User response: Contact IBM Software Support. The
destination is the Tivoli Enterprise Monitoring Server
Engine log file, RKLVLOG.
System action: None. code and contact IBM Software Support. The
destination is the Tivoli Enterprise Monitoring Server
User response: None. This message is informational.
Engine log file, RKLVLOG.
The destination is the Tivoli Enterprise Monitoring
Server Engine log file, RKLVLOG.
KDFD032E KDFDCISS: LOAD ERROR DURING
$CACHENV INITIALIZE
KDFD028I KDFDTERM: DATASET COLLECTOR
TERM NOT DONE; container reason Explanation: The cache collection environment failed
because of an error during an attempt to load the
Explanation: During termination of the Tivoli
module KCCCOLL.
Enterprise Monitoring Server address space, the data
set collector did not require termination for the reason System action: DASD and control unit cache data
specified. collection does not occur.
System action: None. User response: Make sure that the module KCCCOLL
is available to the Tivoli Enterprise Monitoring Server
User response: None. This message is informational.
address space, then restart the Tivoli Enterprise
The destination is the Tivoli Enterprise Monitoring
Monitoring Server. Otherwise, contact IBM Software
Server Engine log file, RKLVLOG.
Support. The destination is the Tivoli Enterprise
Monitoring Server Engine log file, RKLVLOG.
KDFD029E KDFDTERM: DATASET COLLECTOR
STOP DEVICE FAILED; container SSRQ
KDFD033W KDFDCISS: ERROR IN $CACHRTR
RC=return_code STOP RC=return_code
INITIAL CUSCAN; RC=return_code
Explanation: During termination of the Tivoli REASON=reason_code
Enterprise Monitoring Server address space, the data
Explanation: An error occurred in initializing cache
set collector failed to stop collecting for devices
control unit information; the return and reason codes are
specified in the KDFDSCIN member of the data set
displayed.
pointed to by the RKANPAR DD statement.
System action: Control unit cache data collection
System action: Data set collection can continue for
does not occur.
devices even though the Tivoli Enterprise Monitoring
Server address space is not active. User response: If no cache controllers are installed
on the system, this message is normal and
User response: If you no longer want data set
informational only. If cache controllers are installed,
collection for devices, and previous messages issued
record the return code and reason code and contact
during the Tivoli Enterprise Monitoring Server
IBM Software Support. The destination is the Tivoli
initialization indicate that it was successfully started,
Enterprise Monitoring Server Engine log file, RKLVLOG.
stop the subsystem address space, when convenient. If
the data set collector is left operating, you can
experience some overhead degradation. The destination KDFD034W KDFDCISS: ALLOCATION FAILED FOR
is the Tivoli Enterprise Monitoring Server Engine log file, W#CCUWRK; SIZE=bytes
RKLVLOG.
Explanation: Cache control unit collection initialization
failed during the allocation of a required work area. The
KDFD030I KDFDCISS: $CACHENV INITIALIZED size required for the area is displayed.
SUCCESSFULLY
System action: Control unit cache data collection
Explanation: The cache collection environment has does not occur.
been successfully initialized.
User response: Restart the Tivoli Enterprise
System action: None. Monitoring Server address space with a larger region
size. If the error still occurs, contact IBM Software
User response: None. This message is informational.
Support. The destination is the Tivoli Enterprise
Monitoring Server Engine log file, RKLVLOG.
KDFD031E KDFDCISS: ERROR IN $CACHENV
INITIALIZE; container RC= return_code
KDFD035W KDFDCISS: EXTRA SPACE FOR
REASON= reason_code
CONTROL UNITS USED; DATA LOST
Explanation: The cache collection environment failed FOR: cache_control_unit
to initialize for the return and reason codes displayed.
Explanation: An attempt was made to add the cache
System action: DASD and control unit cache data control unit specified to the control unit work area after
collection does not occur. initialization and all extra space allocated for such
additions was used. The Tivoli Enterprise Monitoring
User response: Record the return code and reason
Server was not able to keep and report data about the Tivoli Enterprise Monitoring Server Engine log file,
specified control unit. The control unit is specified by the RKLVLOG.
SSID (ssidFF00) or the SDID (FFFFcc00, where cc is
the SDID).
KDFD039W KDFDCISS: ERROR IN $CACHRTR
System action: None. DEVICE ACCUM. SCAN;
RC=return_code REASON=reason_code
User response: Although not immediately required,
restart the Tivoli Enterprise Monitoring Server address Explanation: An error occurred in retrieving DASD
space to remedy the situation. The destination is the cache information, which was to be accumulated at the
Tivoli Enterprise Monitoring Server Engine log file, cache control unit level. The return and reason codes
RKLVLOG. are given in the message. All cache control unit
statistics might not be current.
KDFD036W KDFDCISS: ERROR IN $CACHRTR System action: None.
UPDATE CUSCAN; RC=return_code
User response: One occurrence of this message does
REASON=reason_code
not indicate a problem. If the message persists, record
Explanation: An error occurred in retrieving cache the return and reason codes and contact IBM Software
control unit information for the return and reason codes Support. The destination is the Tivoli Enterprise
displayed. All cache control unit status information might Monitoring Server Engine log file, RKLVLOG.
not be current.
System action: None. KDFD040W KDFDCISS: $CACHTAB
FUNCTION=REFRESH (n) FAILED;
User response: Record the return and reason codes
RC=return_code REASON=reason_code
and contact IBM Software Support. The destination is
the Tivoli Enterprise Monitoring Server Engine log file, Explanation: An error occurred while refreshing
RKLVLOG. current cache information; the return and reason codes
are displayed. Cache information might not be as
current as specified in the CACHINTV parameter in
KDFD037W KDFDCISS: CU NOT FOUND IN
member KDFDEVIN.
W#CCUWRK DURING DEVICE
ACCUMULATION PHASE: System action: None.
cache_control_unit
User response: One occurrence of this message does
Explanation: The specified cache control unit not indicate a problem. If the message persists, record
associated with a DASD device was not represented in the return and reason codes and contact IBM Software
the control unit work area. The control unit is specified Support. The destination is the Tivoli Enterprise
by the SSID (ssidFF00) or the SDID (FFFFcc00, where Monitoring Server Engine log file, RKLVLOG.
cc is the SDID).
System action: Data pertaining to this DASD device is KDFD041W KDFDCISS: $CACHTAB
not included in cache control unit information. FUNCTION=RESET FAILED;
RC=return_code
User response: One occurrence of this message does
REASON=reason_code
not indicate a problem. If the message persists, contact
IBM Software Support. The destination is the Tivoli Explanation: An error occurred while resetting cache
Enterprise Monitoring Server Engine log file, RKLVLOG. base statistics; the return and reason codes are given in
the message. Cache information covers a longer period
than specified in the CACHINTV parameter in the
KDFD038W KDFDCISS: CU UPDATED IN DEVICE
KDFDEVIN member.
ACCUM PHASE BUT NOT DURING
CUSCAN PHASE: cache_contro_unit System action: None.
Explanation: The specified cache control unit User response: Record the return and reason codes
associated with a DASD device has not had its data and contact IBM Software Support. The destination is
updated during the current collection interval. The the Tivoli Enterprise Monitoring Server Engine log file,
control unit is specified by the SSID (ssidFF00) or the RKLVLOG.
SDID (FFFFcc00, where cc is the SDID).
System action: None. All data is still there; however, KDFD042W COLLECTION INTERVAL TABLE
the control unit status information might not be current. INQUIRY FAILED - reason
User response: One occurrence of this messages Explanation: The probe that collects data collection
does not indicate a problem. If the message persists, interval information failed because of the reason
contact IBM Software Support. The destination is the appended to the end of the message.
System action: Processing continues. A default persists, contact IBM Software Support. The destination
collection interval is adopted. is the Tivoli Enterprise Monitoring Server Engine log file,
RKLVLOG.
User response: None. The destination is the Tivoli
Enterprise Monitoring Server Engine log file, RKLVLOG.
KDFD048I DEVICE COLLECTION TABLE UPDATE
SUCCESSFUL
KDFD043W COLLECTION INTERVAL TABLE
UPDATE REJECTED - UPDATE IN Explanation: An attempt to update the device
PROGRESS collection table completed successfully.
Explanation: An attempt to update data collection System action: OMEGAMON II continues monitoring
interval information failed because of contention. using the updated device collection table.
System action: The update is rejected. User response: This is an informational message
only. The destination is the Tivoli Enterprise Monitoring
User response: Retry the request. If the problem
Server Engine log file, RKLVLOG.
persists contact IBM Software Support. The destination
is the Tivoli Enterprise Monitoring Server Engine log file,
RKLVLOG. KDFD049W DEVICE COLLECTION TABLE ADD
FAILED - xxxxxxxxxx
KDFD044W COLLECTION INTERVAL TABLE Explanation: An attempt to add a device to the
UPDATE FAILED - $DEVWRK NOT collection table failed. The reason for the failure is
FOUND stated in the message. Possible reasons are:
Explanation: An attempt to update data collection v KDFX REQUEST FAILED
interval information failed because an internal control v MEMORY NOT AVAILABLE
block cannot be found. v MONITOR RESET FAILED
System action: The update is rejected. v DUPLICATE ENTRY
User response: Contact IBM Software Support. The This message might be preceded by an additional
destination is the Tivoli Enterprise Monitoring Server KDFD049W message containing diagnostic information
Engine log file, RKLVLOG. in the following format:
KDFX cccc REQUEST ERROR - CN RC=9999 KDFX RC=9999
KDFD045I COLLECTION INTERVAL TABLE System action: OMEGAMON II continues monitoring
UPDATE SUCCESSFUL using the existing device collection table.
Explanation: An update of the data collection interval User response: Try the update again. If the problem
information successfully completed. persists, contact IBM Software Support. The destination
System action: Normal processing continues. is the Tivoli Enterprise Monitoring Server Engine log file,
RKLVLOG.
User response: None. The destination is the Tivoli
Enterprise Monitoring Server Engine log file, RKLVLOG.
KDFD055W parameter KEYWORD SYNTAX INVALID
KDFD047W DEVICE COLLECTION TABLE UPDATE Explanation: An error was detected during the parsing
FAILED - xxxxxxxxxx of the KDFDEVSU member of the RKANPAR data set.
Explanation: An attempt to update the device System action: The DASD exclusion list is
collection table failed. The reason for the failure is incomplete.
stated in the message. Possible reasons are: User response: Correct the keyword syntax. The
v KDFX REQUEST FAILED destination is the Tivoli Enterprise Monitoring Server
v STORAGE UNAVAILABLE Engine log file, RKLVLOG.
v MONITOR RESET FAILED
KDFD056W STORAGE SHORTAGE PROCESSING
This message might be preceded by an additional
parameter KEYWORD
KDFD047W message containing diagnostic information
in the following format: Explanation: A getmain failure occurred while
KDFXcccc REQUEST ERROR - CN RC=9999 KDFX RC=9999 processing the listed parameter of the KDFDEVSU
member of the RKANPAR data set.
System action: OMEGAMON II continues monitoring
using the existing device collection table. System action: The DASD exclusion list is
incomplete.
User response: Try the update again. If the problem
User response: None. The destination is the Tivoli Explanation: The recording of DASD information to
Enterprise Monitoring Server Engine log file, RKLVLOG. the persistent data store is disabled as an internal
control block cannot be found.
KDFD063W parameter KEYWORD VALUE INVALID System action: Normal processing continues, but
historical dasd information is unavailable.
Explanation: A syntax error was discovered while
processing the KDFDEVSU member of the RKANPAR User response: Contact IBM Software Support. The
data set. destination is the Tivoli Enterprise Monitoring Server
Engine log file, RKLVLOG.
System action: The DASD exclusion list is
incomplete.
KDFD072W KDFDPDEV: DASD PDS RECORDING
User response: Correct the erroneous syntax. The SKIPPED THIS INTERVAL - NO
destination is the Tivoli Enterprise Monitoring Server ENTRIES FOUND IN DEVICE TABLE
Engine log file, RKLVLOG.
Explanation: No DASD are currently being monitored
and no historical information is recorded for this interval.
System action: Normal processing continues.
User response: None. The destination is the Tivoli
Enterprise Monitoring Server Engine log file, RKLVLOG.
v DEVRANGE
KDFD096E KDFDPAPL: APPL PDS RECORDING
DISABLED - reason v VOLSERS
Explanation: An attempt to initialize historical System action: The volume in error is bypassed for
application data recording in the Persistent Data Store data set level monitoring. Normal processing continues.
failed because of reason. Possible values for reason User response: Correct the error in KDFDSCIN and
include: issue the DFREF command to refresh the KDFDSCIN
v $DEVWRK ADDRESS ZERO ON ENTRY parameters. The destination is the Tivoli Enterprise
v OM2SM VECTOR TABLE NOT FOUND Monitoring Server Engine log file, RKLVLOG.
v $APPLWRK WORK AREA NOT FOUND
v DFPDSWKA WORK AREA NOT FOUND KDFD104W KDFDEVSU PARM KEYWORD
parameter INVALID
v INVALID DFPDSWKA DETECTED
v LOAD FAILED FOR KDFDRMFI Explanation: A syntax error was discovered while
parsing the contents of the KDFDEVSU member of the
System action: Historical collection for application RKANPAR data set.
data is bypassed for the life of this Tivoli Enterprise
Monitoring Server address space. System action: The DASD exclusion list is
incomplete.
User response: Contact IBM Software Support. The
destination is the Tivoli Enterprise Monitoring Server User response: Correct the erroneous syntax. The
Engine log file, RKLVLOG. destination is the Tivoli Enterprise Monitoring Server
Engine log file, RKLVLOG.
KDFD103W parm KEYWORD - MSR KEYWORD KDFD109E KDFDCHPS - RMF API NOT AVAILABLE
REQUIRES MONITOR STATUS ON Explanation: IBM module ERBSMFI was not found in
Explanation: OFF and MSR= were specified together on an available library.
keyword parm in member KDFDSCIN of the RKANPAR System action: Processing continues but all data, that
data set. The specification of an MSR value requires is normally obtained through the RMF API, appears as
monitoring status to be specified as (or allowed to zeros or ″n/a″ on the screen.
default to) ON. Possible values for parm include:
v DEVICES User response: Find the library containing the RMF
KDFD112E KDFDCHPS: RMF API RETURN System action: No further attempt is made to gather
ERROR, RC= xxxxxxxx HSM related data.
Explanation: Attempting to execute the RETURN User response: None. The destination is the Tivoli
function of the RMF interface, an error (xxxxxxxx) was Enterprise Monitoring Server Engine log file, RKLVLOG.
returned.
System action: The collector stops using the RMF KDFD1171 KDFDUDGI INPUT PARMS: xxxxxxxx
API for the duration of this collection interval. However, Explanation: The input parameters from the
a new attempt to use the interface is made during the KDFDUDGI member of the rhilev RKANPAR data set
next and subsequent collection intervals. were written as xxxxxxxx.
User response: Contact IBM Software Support. The System action: None. Processing continues.
destination is the Tivoli Enterprise Monitoring Server
Engine log file, RKLVLOG. User response: This message is output as a result of
an error. There should be an error message in the Tivoli
Enterprise Monitoring Server SYSOUT log. Follow the
instructions for the error. The destination is the Tivoli
Enterprise Monitoring Server address space log file,
RKLVLOG.
then no action is necessary. If the intention was to the Tivoli Enterprise Monitoring Server address space
define user DASD groups, use the Configuration Tool to log file, RKLVLOG.
try again. If the problem persists, contact IBM Software
Support. The destination is the Tivoli Enterprise
KDFD130E KDFDUDGI - TOO MANY xxxxx
Monitoring Server address space log file, RKLVLOG.
ENTRIES
Explanation: The allowable number of entries of type
KDFD126E KDFDUDGI - INVALID INTERNAL
xxxxx was exceeded. The xxxxx field specifies one of
CHAIN, RC = xx
the keyword parameters.
Explanation: An internal control block chain was
System action: The processing of the user DASD
invalid. The xx field indicates the chain with the
group definition with the problem halts. Other
problem.
processing continues normally.
System action: The processing of user DASD group
User response: Review the definition for the user
definitions halts.
DASD group with the problem. Reduce the number of
User response: Generate a running dump of the Tivoli entries for which the limit is exceeded. The destination
Enterprise Monitoring Server address space and contact is the Tivoli Enterprise Monitoring Server address space
IBM Software Support. The destination is the Tivoli log file, RKLVLOG.
Enterprise Monitoring Server address space log file,
RKLVLOG.
KDFD131E KDFDUDGI - INVALID DEVICE RANGE
Explanation: A value in the DEVRANGE keyword was
KDFD127E KDFDUDGI - VOLSER INPUT INVALID
invalid.
System action: The input from the VOLSER keyword
System action: The processing of the user DASD
had invalid syntax. The processing of the user DASD
group definition with the problem halts. Other
group definition with the problem halts. Other
processing continues normally.
processing continues normally.
User response: Review the definition for the user
User response: Review the rules for the VOLSER
DASD group with the problem. Correct the DEVRANGE
keyword and correct the mistake. Then restart Tivoli
parameter with the problem. The destination is the Tivoli
Enterprise Monitoring Server. The destination is the
Enterprise Monitoring Server address space log file,
Tivoli Enterprise Monitoring Server address space log
RKLVLOG.
file, RKLVLOG.
KDFD141E KDFDUDSI - input parameter values KDFD145E KDFDUDSI - INVALID FEATURE NAME
SPECIFIED
Explanation: An unrecognized keyword was
encountered during the parsing of the KDFDUDSI Explanation: An invalid feature name was specified.
member of the RKANPAR data set.
System action: Normal operation continues. The
System action: Normal operation continues. The invalid definition is discarded.
specified parameter value is ignored.
User response: Specify only valid feature names in
User response: Correct the specified parameter. To the KDFDUDSI member of the RKANPAR data set. To
ensure correct input, use the Configuration Tool to ensure correct input, use the Configuration Tool to
specify parameters again. The destination is the Tivoli specify parameters again. The destination is the Tivoli
Enterprise Monitoring Server Engine log file, RKLVLOG. Enterprise Monitoring Server Engine log file, RKLVLOG.
KDFD142E KDFDUDSI ALLOCATION FAILURE FOR KDFD146E KDFDUDSI - FEATURE STATUS NOT
DATASET GROUP CORRECTLY SPECIFIED
Explanation: A GETMAIN request failed. Explanation: A valid feature status was not specified.
System action: Tivoli Enterprise Monitoring Server System action: Normal operation continues. The
start-up continues. User data set groups are not incorrect definition is discarded.
available.
User response: Ensure that feature names have an
User response: Restart the Tivoli Enterprise accompanying valid feature status in the KDFDUDSI
Monitoring Server with a larger region size. If the error member of the RKANPAR data set. To ensure correct
persists, contact IBM Software Support. The destination input, use the Configuration Tool to specify parameters
is the Tivoli Enterprise Monitoring Server Engine log file, again. The destination is the Tivoli Enterprise Monitoring
RKLVLOG. Server Engine log file, RKLVLOG.
KDFD143E KDFDUDSI - GROUP NAME MAY ONLY KDFD147E KDFDUDSI - INVALID FEATURE
BE SPECIFIED ONCE STATUS SPECIFIED
Explanation: The GRPNAME keyword was specified Explanation: An invalid feature status was specified.
more than once in a single data set group definition.
System action: Normal operation continues. The
System action: Normal operation continues. The invalid definition is discarded.
specified group is discarded.
User response: Specify a valid feature status in the
User response: Correct the data set group definition KDFDUDSI member of the RKANPAR data set. To
in the KDFDUDSI member of the RKANPAR data set. ensure correct input, use the Configuration Tool to
To ensure correct input, use the Configuration Tool to specify parameters again. The destination is the Tivoli
specify parameters again. The destination is the Tivoli Enterprise Monitoring Server Engine log file, RKLVLOG.
Enterprise Monitoring Server Engine log file, RKLVLOG.
KDFD148E KDFDUDSI - FEATURE MAY ONLY BE
KDFD144E KDFDUDSI - GROUP NAME MUST BE SPECIFIED ONCE
UNIQUE
Explanation: The FEATURE keyword was specified
Explanation: The same name was defined to two more than once in a single data set group definition.
different data set groups.
System action: Normal operation continues. The
System action: Normal operation continues. The incorrect group is discarded.
duplicate definition is discarded.
User response: Correct the data set group definition
User response: Correct the data set group definition in the KDFDUDSI member of the RKANPAR data set.
in the KDFDUDSI member of the RKANPAR data set. To ensure correct input, use the Configuration Tool to
To ensure correct input, use the Configuration Tool to specify parameters again. The destination is the Tivoli
specify parameters again. The destination is the Tivoli Enterprise Monitoring Server Engine log file, RKLVLOG.
Enterprise Monitoring Server Engine log file, RKLVLOG.
KDFD149E KDFDUDSI - MAXIMUM NUMBER OF
DSNAMES EXCEEDED
Explanation: The limit of 100 data set names per data
set group was exceeded.
System action: Normal operation continues. The
User response: Correct the data set name length in User response: Examine the error messages
the data set group definition in the KDFDUDSI member immediately preceding this message for the cause of
of the RKANPAR data set. To ensure correct input, use the failure. To ensure correct input, use the
the Configuration Tool to specify parameters again. The Configuration Tool to specify parameters again. The
destination is the Tivoli Enterprise Monitoring Server destination is the Tivoli Enterprise Monitoring Server
Engine log file, RKLVLOG. Engine log file, RKLVLOG.
System action: Normal operation continues. User response: Review the RKLVLOG log for
previous error messages. The destination is the Tivoli
User response: This error should not occur. Contact Enterprise Monitoring Server Engine log file, RKLVLOG.
IBM Software Support. The destination is the Tivoli
Enterprise Monitoring Server Engine log file, RKLVLOG.
KDFDSCTE DATASET COLLECTOR STOPPED.
SUCCESSFUL COUNT= count FAILURE
KDFDHSML LOGY GET FAILED, DSN= dsname, RC= COUNT=failures
xxx REASON= yyy
Explanation: The data set collector ran successfully.
Explanation: An attempt to read the HSM log data set
failed with the specified return and reason code. System action: None.
System action: The request is attempted up to twice, User response: None. The destination is the Tivoli
as necessary. If the third attempt fails, HSM log analysis Enterprise Monitoring Server Engine log file, RKLVLOG.
terminates.
RETURNED = hhmmss
KDFLAU05 INITIALIZATION OF USER TABLE IN
Explanation: No qualifying data can be found for the PROGRESS
historical request.
Explanation: This message is written to the Tivoli
System action: Normal processing continues, but no Enterprise Monitoring Server Engine log data set during
data is returned. product initialization, and indicates that the user
authorization table is being initialized.
User response: None. The destination is the Tivoli
Enterprise Monitoring Server Engine log file, RKLVLOG. System action: Table initialization continues.
User response: None. This message is informational.
KDFLAU01 INITIALIZATION OF FORM TABLE IN The destination is the Tivoli Enterprise Monitoring
PROGRESS Server Engine log file, RKLVLOG.
Explanation: This message is written to the Tivoli
Enterprise Monitoring Server Engine log data set during KDFLAU06 INITIALIZATION OF USER TABLE IS
product initialization, and indicates that initial loading of COMPLETE
the form authorization table is in progress.
Explanation: This message is written to the Tivoli
System action: Table initialization continues. Enterprise Monitoring Server Engine log data set during
product initialization, and indicates that initialization of
User response: None. This message is informational. the user authorization table has completed successfully.
The destination is the Tivoli Enterprise Monitoring
Server Engine log file, RKLVLOG. System action: The user authorization table is
initialized.
KDFLAU02 INITIALIZATION OF FORM TABLE IS User response: None. This message is informational.
COMPLETE The destination is the Tivoli Enterprise Monitoring
Server Engine log file, RKLVLOG.
Explanation: This message is written to the Tivoli
Enterprise Monitoring Server Engine log data set during
product initialization, and indicates that initialization of KDFLAU07 LOADING OF USER TABLE IN
the form authorization table has completed successfully. PROGRESS
System action: The table is initialized. Explanation: This message is written to the Tivoli
Enterprise Monitoring Server Engine log data set during
User response: None. This message is informational. product initialization, and indicates that loading of the
The destination is the Tivoli Enterprise Monitoring user authorization table is in progress.
Server Engine log file, RKLVLOG.
System action: The table loads into virtual storage.
KDFLAU03 LOADING OF FORM TABLE IN User response: None. This message is informational.
PROGRESS The destination is the Tivoli Enterprise Monitoring
Server Engine log file, RKLVLOG.
Explanation: This message is written to the Tivoli
Enterprise Monitoring Server Engine log data set during
product initialization, and indicates that the form KDFLAU08 LOADING OF USER TABLE IS
authorization table is being loaded into virtual storage. COMPLETE
System action: The table loads into virtual storage. Explanation: This message is written to the Tivoli
Enterprise Monitoring Server Engine log data set during
User response: None. This message is informational. product initialization, and indicates that loading of the
The destination is the Tivoli Enterprise Monitoring user authorization table has completed successfully.
Server Engine log file, RKLVLOG.
System action: The user authorization table is loaded.
KDFLAU04 LOADING OF FORM TABLE IS User response: None. This message is informational.
COMPLETE The destination is the Tivoli Enterprise Monitoring
Server Engine log file, RKLVLOG.
Explanation: This message is written to the Tivoli
Enterprise Monitoring Server Engine log data set during
product initialization, and indicates that loading of the
form authorization table has completed successfully.
System action: The table is loaded.
User response: None. This message is informational.
The destination is the Tivoli Enterprise Monitoring
Server Engine log file, RKLVLOG.
KDFS015A CANDLE DATASET I/O module DEVICE KDFS022W CANDLE DATASET I/O module
TABLE FULL SUBTASK task_id FAILED - STOPPING
Explanation: The module specified attempted to add a Explanation: A prior attempt to restart subtask task_id
device type to an internal table, but the table had no by routine module was unsuccessful.
free entries.
System action: The collector terminates.
System action: The collector continues; however, data
User response: Contact IBM Software Support. The
is not collected for all devices.
destination is the MVS system console.
User response: Contact IBM Software Support. The
destination is the MVS system console.
KDFS023A CANDLE DATASET I/O module
ROUTINE routine FAILED return_code
KDFS016I CANDLE DATASET I/O - NO DEVICE reason_code
TYPES TO MONITOR
Explanation: The module specified called routine, and
Explanation: During initialization the collector found the called routine returned with the return and reason
that there were no device types installed that it was able codes displayed.
to monitor. It can monitor 3375, 3380, 3390, and future
System action: The collector attempts to continue
DASD devices.
functioning.
System action: The collector terminates.
User response: Review the appropriate user
User response: If there are device types installed that response:
the collector should monitor, contact IBM Software
OMEGAMON II for SMS
Support. Otherwise, no action is required.
This is an informational message only.
All other products
KDFS019A CANDLE DATASET I/O module ATTACH
Contact IBM Software Support.
OF task_id FAILED, RC=return_code
Explanation: An attempt by module to attach the MVS The destination is the MVS system console.
subtask specified failed with the return code displayed.
System action: The collector terminates. KDFS024A CANDLE DATASET I/O module service
INSTALLATION FAILED
User response: Refer to IBM Application
Development Reference: Services for Authorized Explanation: An attempt by routine module to install
Assembler Language Programs for an explanation of the service specified was not successful.
the return code. If the return code does not indicate an
installation problem, contact IBM Software Support. The System action: The collector terminates.
destination is the MVS system console. User response: Contact IBM Software Support. The
destination is the MVS system console.
KDFS020I CANDLE DATASET I/O module
SUBTASK task_id FAILED KDFS025W CANDLE DATASET I/O module
Explanation: Routine module has determined that RELEASE OF bytes storage RC=return_
subtask task_id has terminated unexpectedly. code
System action: The collector attempts to restart the Explanation: An attempt by routine module to release
subtask. the number of bytes of virtual storage specified failed
with the return code displayed.
User response: Contact IBM Software Support. The
destination is the MVS system console. System action: The collector continues processing
normally.
KDFS021I CANDLE DATASET I/O module User response: Contact IBM Software Support. The
RESTARTING SUBTASK task_id destination is the MVS system console.
KDFS034A CELL POOL FAILURE FOR SERVICE KDFS040W KDFS040W - KDFSPDEV HANG
service, RC=return_code DETECTED; VOLUME=vvvvvv
Explanation: The cell pool service specified failed with Explanation: While collecting space and fragmentation
the return code displayed. The migrator subtask uses information, OMEGAMON XE for Storage was unable to
callable cell pool services to create its internal table complete an LSPACE call for volume vvvvvv in less
entries. than 15 seconds. This might indicate a problem with the
volume or might be the result of a high rate of
System action: The collector terminates.
contention for the volume’s VTOC.
User response: The IBM Reference: Services for
System action: Processing for the specified volume is
Assembler Language Programs manual contains a
bypassed for this collection interval.
description of the return codes associated with the
failing service. Contact IBM Software Support. User response: Consider the amount of contention for
this volume at the time the message occurred. If this
does not explain the problem then you may wish to
KDFS035I UNABLE TO READ FORMAT 4 DSCB
review your EREP reports and check other sources to
WITH LSPACE, RC=return_code
make sure the volume is not under a hardware reserve
Explanation: The LSPACE macro used by the or otherwise improperly enqueued. The destination is
migrator subtask has failed with the return code the Tivoli Enterprise Monitoring Server Engine log file,
displayed. The volume for which the VTOC failure RKLVLOG.
occurred is identified in a separate message displayed
on the system console.
KDFS100E ATTACH FAILED FOR KDFSHSMM,
System action: Some data set names cannot be RC= rc
resolved for the volume’s I/O activity.
Explanation: An ATTACH macro failed with the
User response: Consult the IBM MVS/DFP System indicated return code.
Programming Reference manual for an explanation of
System action: HSM MCDS analysis is unavailable.
the return code and CVSTAT fields returned by
CVAFSEQ. If problems persist, contact IBM Software User response: Contact IBM Software Support. The
Support. The destination is the Tivoli Enterprise destination is the Tivoli Enterprise Monitoring Server
Monitoring Server Engine log file, RKLVLOG. Engine log file, RKLVLOG.
KDFS036I UNABLE TO OBTAIN DEVICE CELL, KDFS101I MCDS ANALYSIS HAS TERMINATED
DATA LOST
Explanation: The HSM MCDS analysis feature
Explanation: The migrator subtask has run out of cell terminated.
pool storage to record data set I/O information.
System action: None.
System action: Some information about data set I/O
User response: None. The destination is the Tivoli
activity is lost.
Enterprise Monitoring Server Engine log file, RKLVLOG.
User response: Ensure that the archive subtask is
running in the subsystem address space. If problems
KDFS102E ACB ACQUISITION FAILED,
persist, contact IBM Software Support. The destination
COMPLETION CODE compl_code
is the MVS system console.
Explanation: A request for an ACB failed with the
indicated completion code.
KDFS037A INSUFFICIENT STORAGE TO READ
VTOC FOR VOLUME volser System action: The HSM MCDS analysis feature is
unavailable.
Explanation: The migrator subtask was unable to fit
the VTOC for the volume specified in the space it had User response: Contact IBM Software Support. The
allocated. destination is the Tivoli Enterprise Monitoring Server
Engine log file, RKLVLOG.
System action: The collector terminates.
User response: Contact IBM Software Support. The
KDFS103E UNABLE TO ALLOCATE MIGRATION
destination is the MVS system console.
CONTROL DATASET, RC= rc
Explanation: A request to allocate the HSM MCDS
failed with the indicated return code.
System action: The HSM MCDS analysis feature is
unavailable.
100 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
KDFSHL01 • KDFSHSML
102 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Chapter 8. KRC Messages
This section provides OMEGAMON II for SMS messages with the prefix of KRC.
This section summarizes the types of problem determination information that is available and includes links
to that information:
Troubleshooting overview
This chapter describes the troubleshooting process and provides summary descriptions of the logs
that provide essential troubleshooting information:
v “The troubleshooting process” on page 107
v “Sources of troubleshooting data” on page 109
Note: The Appendix A, “General problem determination for Tivoli OMEGAMON XE monitoring
agents on z/OS,” on page 133 appendix provides information that is valid for all
OMEGAMON XE monitoring agents, including specific locations of log files.
Troubleshooting tips
These chapters describe common problems that can occur with Tivoli OMEGAMON XE for
Storage on z/OS and available workarounds. These problems are grouped into the following
categories:
v Chapter 10, “Troubleshooting installation and configuration,” on page 113
v Chapter 11, “Troubleshooting data collection,” on page 115
– “Tips regarding the collection of diagnostic data” on page 146
– “Collection of monitoring data” on page 115
– “Generation of data reports” on page 118
v Chapter 12, “Troubleshooting performance issues,” on page 123
v Chapter 13, “Troubleshooting error conditions,” on page 125
v Chapter 14, “Troubleshooting specific product features,” on page 129
Note: IBM Tivoli Monitoring Problem Determination Guide, GC32-9458 provides information about
problems and workarounds for the basic components of IBM Tivoli Monitoring.
Other sources of troubleshooting information
Consult the following resources for additional help with troubleshooting:
v Product Support Web page for Tivoli OMEGAMON XE for Storage on z/OS:
http://www-306.ibm.com/software/sysmgmt/products/support/
IBMTivoliOMEGAMONXEforStorage.html. This Web page provides links to Technotes, PSP
Buckets, and Shop zSeries information, among many other topics.
v Appendix C, “Support information,” on page 161 appendix for other sources of support for
problem determination and problem solving.
v IBM Tivoli Open Process Automation Library at the following Web site: http://catalog.lotus.com/
wps/portal/tm. The Web site includes problem-solving topics such as the following items:
106 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Chapter 9. Troubleshooting overview
This section describes the troubleshooting process and provides summary descriptions of the logs that
provide essential troubleshooting information.
Note: Avoid a basic problem with Tivoli OMEGAMON XE for Storage on z/OS by understanding the
basic product architecture, as described here. The Tivoli OMEGAMON XE for Storage on z/OS
monitoring agent must report to a local Tivoli Enterprise Monitoring Server that is installed and
configured in the same z/OS address space. The local server for each agent must report to a
hub server. The hub server can be running on any supported system. (If located in a z/OS
system, the hub server can also act as the local server for a specific monitoring agent.)
Do not worry if you cannot answer this question with certainty at this stage. Later in this process, you
generate trace logs that can pinpoint the source of a problem.
2. Has required maintenance been applied?
v To answer this question for the monitoring agent, consult the Program Directory to confirm that all
required PTFs have been installed. Also check the PSP bucket for updated requirements, as follows:
a. Access the “Technical help database page for mainframe Preventive Service Planning (PSP)
buckets” Web page: http://www14.software.ibm.com/webapp/set2/psp/srchBroker
b. Find relevant PSP Buckets. Search for PSP Buckets that have the Tivoli OMEGAMON XE for
Storage on z/OS, V4.1.0 prefix: OMXES4100.
c. Consult each PSP Bucket to learn what PTFs are required.
d. Access the Shop z-Series Web site to obtain the PTFs: https://www14.software.ibm.com/
webapp/ShopzSeries/ShopzSeries.jsp
v For the Tivoli Management Services Components:
– Consult IBM Software Support Technotes, if any.
– Determine whether fix packs are available for any components that run on distributed computers.
For example, a fix pack might be available for a Tivoli Enterprise Portal that is running on a
Windows computer.
– See IBM Support Assistant for updates.
3. When does the problem occur, or how does the problem occur?
Note: During this step, you might review the cross-referenced documentation and fail to recognize a
the solution to your problem. The remaining steps of this process help you understand the
* If the cross-references in this step do not provide solutions to your problem, go to Step 4.
4. Can trace logs reveal details about the problem?
Note: There is CPU and I/O overhead associated with detailed RAS1 tracing that might degrade
performance of the monitoring agent. You must restore RAS1 tracing to the minimal
KBB_RAS1=ERROR setting after problem diagnosis is completed.
5. Can more focussed trace logs reveal more details about the problem?
108 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Note: There is CPU and I/O overhead associated with detailed RAS1 tracing that might degrade
performance of the monitoring agent. You must restore RAS1 tracing to the minimal
KBB_RAS1=ERROR setting after problem diagnosis is completed.
6. Is there documentation for the problem that the logs reveal?
The trace logs might provide helpful key words regarding your problem, including unique message
numbers. Use key words regarding your problem to search in the following sources:
v Problem Determination Guide for the monitoring agent
v IBM Tivoli Monitoring Problem Determination Guide, GC32-9458
v RETAIN database
Typically, text messages relay information about the state and performance of a system or application.
Messages also alert the system administrator to exceptional conditions when they occur. Consult the
explanation and operator response associated with the displayed messages to determine the cause of the
failure.
Trace data captures information about the current operating environment when a component or application
fails to operate as designed. IBM Software Support personnel use trace information to determine the
source of an error or unexpected condition. Refer to the chapter on diagnostic tools in the IBM Tivoli
Monitoring: Problem Determination Guide for more information about trace tools.
Collecting data
If you have a problem that you are unable to solve using the information in this guide, gather the following
information that relates to the problem and contact IBM Software Support for further assistance.
v Monitored application file.
v Appropriate RAS1 trace output.
v Description of the operation scenario that led to the problem.
v Incorrect output, such as Tivoli Enterprise Portal screen prints or a description of what you observed, if
applicable.
v Log files from failing systems. You can collect all logs or logs of a certain type such as, RAS (reliability,
availability, and serviceability) trace logs or message logs. Refer to “About log files for product
components” on page 110 for information about the locations of logs.
v Application information, such as version number and patch level.
v Operating system version number and patch level.
Note: The version number of the Tivoli Enterprise Portal and the Tivoli Enterprise Portal Server must
always be synchronized.
v If the systems stops on Windows, collect the drwtsn32.log and user.dmp files, if available. The files
are located in the following path:
\Documents and Settings\All Users\Documents\DrWatson
See the chapter on diagnostic tools in the IBM Tivoli Monitoring: Problem Determination Guide for more
information about trace tools.
1. Enter the following command at the command prompt to enable the Dr. Watson tool as default
debugger:
drwtsn32 –i 2
2. Enter the following command at the command prompt to open the configuration window of the Dr.
Watson tool:
drwtsn32
When you encounter a problem, check the messages in the log files to determine if the source is a
problem in your environment or with an IBM Tivoli Monitoring product. If you determine that the problem is
caused by a product defect, follow the instructions for contacting IBM Software Support in the Appendix C,
“Support information,” on page 161. See “Collecting logs for reproducible problems that are reported as
Tivoli Enterprise Portal client problems” on page 134 for the locations of log files. The location of the log
depends on the client type and operating system the client is running on. The following sections provide
locations of the fundamental types of logs:
v Logs for components on distributed systems:
– “Collecting logs for the Tivoli Enterprise Portal desktop client” on page 134
– “Collecting logs for the Tivoli Enterprise Portal browser client” on page 135
– “Additional logs to collect: Tivoli Enterprise Portal Server logs, Tivoli Enterprise Monitoring Server
logs, and data warehousing logs” on page 135
v Logs for components on z/OS systems: “Collecting logs on the z/OS system” on page 137
IBM Software Support might request some or all of these files while investigating a problem you have
reported. Also, you might be asked to set a trace in the client and then collect the log. Trace logging is a
fundamental tool for troubleshooting in cases where a problem is reproducible.
Note: Some of the tracing options produce large amounts of trace information. Therefore, monitor the disk
or spool space when activating tracing to prevent your disk or spool from reaching capacity. Return
the trace settings to the default settings after the desired trace information has been collected.
Log files for each of the components are explained in the following sections.
110 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Tivoli Enterprise Monitoring Server on z/OS
The log files for Tivoli Enterprise Monitoring Server on z/OS are created as defined in the started
procedure when you start the Tivoli Enterprise Monitoring Server. View the log files with any text editor.
When you investigate problems with Tivoli Enterprise Monitoring Server, view the sysout data sets or spool
files in the job output and view the z/OS system log for any messages that might pertain to the problem.
When you investigate problems with Tivoli Enterprise Monitoring Server, use the Windows Event Viewer to
check that the Tivoli Enterprise Monitoring Server started correctly and to look for errors.
In desktop mode, the log files are named kcjras1.log and KCJ.log. KCJ.log contains any errors that
might have been written by the Sun Java™ libraries that are used by the Tivoli Enterprise Portal desktop
client. In browser mode, the log file is named javalog.txt or is viewed in Java Console of Internet Explorer.
You might need to edit your Internet Explorer browser options to enable the error log file on your local
system. Refer to the Tivoli Enterprise Portal online help for information on enabling the log file. You can
change the level of tracing by using the File > Trace Options... window.
In addition, logon prompts and progress messages are displayed in the Logon window status bar. This
area is also used to display error messages.
When you investigate problems with Tivoli Enterprise Portal, use the Windows Event Viewer to check that
the Tivoli Enterprise Portal Server started correctly and to look for errors.
When the log file reaches a 5 MB size limit, it is closed. A new file is created, with the sequential number
added to make the file name unique. By default, 5 files are saved over the life of the Tivoli Enterprise
Portal Server, up to a total of 32 files maximum. You can change these values through the Manage Tivoli
Monitoring Services application as follows:
1. Right-click the Tivoli Enterprise Portal Server row.
2. Select Advanced in the pop-up menu.
3. Select the Edit Trace Parms menu item to access the dialog box where you can configure logging
behavior.
When you investigate problems with Tivoli Enterprise Portal Server, use the Windows Event Viewer to
check that the Tivoli Enterprise Portal Server started correctly and to look for errors.
For more information about troubleshooting problems on Tivoli Enterprise Portal Server, refer to IBM Tivoli
Monitoring: Problem Determination Guide.
In the warehouse proxy, you can set error tracing on to capture additional error messages that can be
helpful in detecting problems. Refer to IBM Tivoli Monitoring: Installation and Setup Guide for more
information.
112 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Chapter 10. Troubleshooting installation and configuration
This chapter describes potential problems and workarounds regarding the installation and configuration of
the product.
If you see this situation, ensure that you correctly configured the run-time environment (RTE) in which the
monitoring agent is running. Check the sequence of protocols that the monitoring agent uses to connect to
the server and ensure that the correct values are provided for each protocol.
Use the information found in IBM Tivoli Monitoring: Installation and Setup Guide to configure historical data
collection and retry the operation.
If you see these failed connection messages, perform the following steps so that the Tivoli Enterprise
Portal Server can connect to the Tivoli Enterprise Monitoring Server.
1. From the Configuration Tool Configure the Tivoli Enterprise Monitoring Server steps, select
Specify configuration values > Integrated Cryptographic Service Facility (ICSF) installed?.
2. Specify N in the Integrated Cryptographic Service Facility (ICSF) installed? field.
This problem can occur when the port that you defined for communication among the Tivoli Management
Services components was already reserved for a different application in the PORT statement of your
TCP/IP profile.
114 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Chapter 11. Troubleshooting data collection
This chapter describes potential problems and workarounds regarding data collection by the product,
including the following subtopics:
v “Collection of monitoring data”
v “Generation of data reports” on page 118
Workspace displays no data or does not show all the data you
expected
You have clicked on a navigation item or you have clicked on a link and the workspace either displays no
data or does not show all the data that you are expecting.
Many of the workspaces that are provided in the Tivoli OMEGAMON XE for Storage on z/OS product are
defined with filters. Each view in the workspace may have filters defined. These filters restrict the data that
is displayed to the rows that may be interesting to the user. To view the filters that are defined to a
workspace, right-click in the view and select Properties. Click the Filters tab to view or change the filters
that are defined for the view. Adjust the filters to meet the needs of your enterprise. The data displayed on
a workspace view is dependant on the Query supplying that data.
In some cases, the Query itself does not return the desired data. To view the Query that is returning data
to the workspace view, right-click in the view and select Properties. Click the Click here to assign a
query button, and examine the columns and any selection criteria.
Note: Do not modify product-provided Queries. (In many cases, modification of these queries is blocked.)
If you need to change a query, make a copy of the query with a new name.
Refer to the IBM Tivoli OMEGAMON XE for Storage on z/OS: User’s Guide for information on the
product-provided workspaces. Refer to the IBM Tivoli Monitoring: User’s Guide for information on defining
customizing workspaces and views.
Workaround: This problem can occur when you are not collecting related data; the following items are
prerequisites for enabling the collection of VTS data:
v Tape device collection, which you enable when you configure Tivoli OMEGAMON XE for Storage on
z/OS.
v Collection of SMF record type 94.
Workaround: No workaround is available. This information is extracted from SMF data written by the tape
controllers. VTS controllers only write SMF records hourly. For example, you can specify a tape interval of
900 seconds (15 minutes), and a refresh operation takes place every 15 minutes. However, during a given
one-hour period, only data from the previous interval is available for the refresh operation. New data is
available only after the one-hour interval.
Typically the STORAGE command is used in conjunction with the EVERY command schedule period issuance
of the STORAGE command. The KDSSTART member of RKANCMD has the following line by default.
EVERY 00:60:00 STORAGE D * LOG STORAGE USE
Where:
EVERY
Is a command that is used to schedule another command for periodic execution.
00:60:00
Shows the hours, minutes, and second. For example, a value of 00:60:00 says run this command
every 60 minutes.
STORAGE
Displays statistics of ITMS:Engine storage usage.
D Stands for Detail. STORAGE provides both primary and extended storage statistics. This
information is helpful in tuning ITMS:Engine memory management.
The default entry causes the STORAGE D command to be issued every 60 minutes. The interval at which
the command is automatically issued is defined during the Tivoli Enterprise Monitoring Server configuration
with the Enable storage detail logging parameter on the Specify Advanced Configuration Options
panel, where the values are Y or N. There are two other settings associated with the Enable storage
detail logging parameter:
v Set the Storage detail logging interval to monitor storage. The interval values are written as part of the
second EVERY command in &rhilev.&midlev.RKANCMDU(KDSSTART). The default is 60 minutes.
v Set the Flush VSAM buffers interval to force all deferred VSAM writes to DASD. The interval values
are written as part of the third EVERY command in &rhilev.&midlev.RKANCMDU(KDSSTART). The default
is 30 minutes.
v To disable storage detail logging, set this parameter to N, which then generates the second EVERY
command as a comment.
To control storage detail logging dynamically, you can issue the following command from the z/OS console
to the monitoring server started task to enable storage detail logging:
MODIFY procname,STORAGE D
Where:
MODIFY
Is the z/OS operator command.
116 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
procname
Is the name of the monitoring server started task. The default name of monitoring server started
task is CANSDSST.
STORAGE
Displays statistics of ITMS:Engine storage usage.
D Stands for Detail. STORAGE provides both primary and extended storage statistics. This
information is helpful in tuning ITMS:Engine memory management.
After you issue this command, look in the RKLVLOG for the output. See the following sample output of this
command, with explanations.
01 KLVSD001 PRIMARY MAIN STORAGE INFORMATION:
02 KLVSD003 ALLOCATION DETAIL:
03 KLVSD004 SIZE(1-16) USE(1629) TOTAL(1652) ACCESSED(2122)
04 KLVSD004 SIZE(17-32) USE(1222) TOTAL(1256) ACCESSED(1804)
05 KLVSD004 SIZE(33-48) USE(43) TOTAL(51) ACCESSED(989)
06 KLVSD004 SIZE(49-64) USE(30) TOTAL(321) ACCESSED(789)
07 KLVSD004 SIZE(65-80) USE(190) TOTAL(299) ACCESSED(474)
08 KLVSD004 SIZE(81-96) USE(277) TOTAL(432) ACCESSED(492)
09 KLVSD004 SIZE(97-112) USE(27) TOTAL(43) ACCESSED(412)
10 KLVSD004 SIZE(113-128) USE(39) TOTAL(43) ACCESSED(311)
11 KLVSD004 SIZE(129-160) USE(79) TOTAL(374) ACCESSED(222)
12 KLVSD004 SIZE(161-192) USE(84) TOTAL(111) ACCESSED(205)
13 KLVSD004 SIZE(193-224) USE(96) TOTAL(127) ACCESSED(177)
14 KLVSD004 SIZE(225-256) USE(148) TOTAL(259) ACCESSED(192)
15 KLVSD004 SIZE(257-320) USE(342) TOTAL(365) ACCESSED(144)
16 KLVSD004 SIZE(321-384) USE(40) TOTAL(54) ACCESSED(98)
17 KLVSD004 SIZE(385-512) USE(5) TOTAL(35) ACCESSED(80)
18 KLVSD004 SIZE(513-768) USE(21) TOTAL(26) ACCESSED(92)
19 KLVSD004 SIZE(769-1024) USE(14) TOTAL(17) ACCESSED(12)
20 KLVSD004 SIZE(1025-2048) USE(28) TOTAL(35) ACCESSED(8)
21 KLVSD004 SIZE(2049-4096) USE(81) TOTAL(97) ACCESSED(2)
22 KLVSD004 SIZE(4097-8192) USE(8) TOTAL(9) ACCESSED(1)
23 KLVSD004 SIZE(8193-16384) USE(1) TOTAL(1) ACCESSED(1)
24 KLVSD005 LIMIT(65536) SLOPE(9) SIZES(23) TOTAL(2916K) FREE(2055K)
25 OVERHEAD(44936)
27 KLVSD031 BUFFER POOL INFORMATION
28 KLVSD032 POOL BUFSIZE(3564) SEGSIZE(65536) MASK(3FFFF) SIDEQ(0)
29 KLVSD033 BUFFERS INUSE(0) MAX(0) GETS(0) FREES(0)
30 KLVSD033 SEGMENTS INUSE(0) MAX(0) GETS(0) FREES(0) Q(0) QMAX(0)
31 KLVSD032 POOL BUFSIZE(3440) SEGSIZE(65536) MASK(7FFFF) SIDEQ(0)
32 KLVSD033 BUFFERS INUSE(3) MAX(9) GETS(245) FREES(242)
33 KLVSD033 SEGMENTS INUSE(1) MAX(1) GETS(1) FREES(0) Q(1) QMAX(1)
34 KLVSD032 POOL BUFSIZE(2560) SEGSIZE(65536) MASK(1FFFFFF) SIDEQ(0)
35 KLVSD033 BUFFERS INUSE(53) MAX(57) GETS(340) FREES(287)
36 KLVSD033 SEGMENTS INUSE(3) MAX(3) GETS(13) FREES(10) Q(1) QMAX(2)
37 KLVSD032 POOL BUFSIZE(1920) SEGSIZE(65536) MASK(FFFFFFFF) SIDEQ(0)
38 KLVSD033 BUFFERS INUSE(1) MAX(2) GETS(60) FREES(59)
39 KLVSD033 SEGMENTS INUSE(1) MAX(1) GETS(36) FREES(35) Q(1) QMAX(1)
40 KLVSD039 END OF BUFFER POOL INFORMATION
Where:
01 Is an ITMS:Engine header message.
02 Is an ITMS:Engine header message.
03 - 23
Is an ITMS:Engine message specifying the following values:
v SIZE: The range (m-n, in bytes) of the sizes of data blocks in the storage area. For example,
SIZE(1-16) indicates that this area contains all of the blocks that are from 1 to 16 bytes long.
v USE: The number of blocks in use.
v TOTAL: The total number of storage blocks allocated.
Workaround: When you want row identifiers such as SSID or LCU to be exported, you must select those
columns from the available columns, prior to exporting a report.
v The ″Assigned″ option exports all columns that you see.
v The ″Available″ option exports additional invisible columns, such as Timestamp and SSID.
118 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Monitoring agent cannot insert all requested data rows into the persistent data
store
Failure to write data to the persistent data store can indicate a number of problems that sometimes
manifest themselves as tuning problems. See the following resources for information that might help
resolve the problem:
v Chapter 12, “Troubleshooting performance issues,” on page 123 in the current document
v IBM Tivoli OMEGAMON XE for Storage on z/OS: Tuning Guide
v OMEGAMON II for SMS Tuning Guide, GC32-9283
v The following workaround:
This workaround resolves the problem of a persistent data store that is full. In this situation, log
messages are displayed showing problems with components prefixed by KPD or KPX in the RKPDLOG
SYSOUT data set. These prefixes correspond to problems with the persistent data store.
Perform the following steps to determine whether the persistent data store files (Short-Term History) are
full:
1. From TSO SDSF log (=S.LOG) enter the following commands against the Tivoli Enterprise
Monitoring Server started task (for example, CANSDSST):
/F CANSDSST, KPDCMD QUERY CONNECT
/F CANSDSST, KPDCMD QUERY DATASTORE
2. View the RKPDLOG, as follows:
From the TSO SDSF Status panel (=S.ST), type a question mark (?) beside the name of the Tivoli
Enterprise Monitoring Server started task (for example, CANSDSST). This action causes the
RKPDLOG to be presented.
3. Enter an S beside the RKPDLOG entry to open it.
4. Scroll to the bottom of the RKPDLOG to see the output of the QUERY command and determine
whether the RKDF or RKS3 files are full.
5. If that log shows that these files are filling up too quickly, allocate more space so that you can keep
a larger amount of short-term historical data available online. See the Administrators Guide for
information on allocating the Persistent Data Store.
Also, monitor CPU usage and memory usage in the Tivoli Enterprise Monitoring Server started task
address space. Excessive CPU or memory consumption could be caused by persistent data store
activity.
Workaround: No workaround is available. Not all historical tables for Tivoli OMEGAMON XE for Storage on
z/OS are eligible for data warehousing. For a list of tables whose data can be warehoused, see
Appendix B, “Historical data collection disk space requirements,” on page 155.
SQL queries to IBM Tivoli Data Warehouse fail because of invalid column name
When you are writing a Structured Query Language (SQL) query against IBM Tivoli Data Warehouse
(without using the Tivoli Enterprise Portal) where your database manager is DB2® or Oracle, the query
sometimes fails, indicating that the column name is invalid.
The warehouse proxy creates the table with the abbreviated column names. These abbreviations are
shown in the WAREHOUSEID database table.
Additionally, column names that seem to meet the fewer than 30 characters rule might also fail when the
summarization and pruning agent is used because this agent adds a four-character prefix to the column
name (for example, AVG_).
To avoid this problem, revise your SQL queries to match the abbreviated column names in the
WAREHOUSEID table.
If the summarization and pruning agent fails to run on schedule, determine whether the KSYCAT and
KSYATR members are missing from the RKANDATV data set on the Tivoli Enterprise Monitoring Server. If
the files are missing, you must copy the required files to your z/OS monitoring server installation, as
follows:
1. Obtain the following files from an IBM Tivoli Monitoring installation path on a distributed computer, for
example, a Windows computer. These files exist in an installation of either the monitoring server or the
portal.
a. Obtain a copy of the ksy.atr file from either of the following relative paths:
..\IBM\ITM\cms\attrlib OR
..\IBM\ITM\CNPS\CMSATR
b. Obtain a copy of the ksy.cat file from either of the following relative paths:
..\IBM\ITM\cms\rkdscatl OR
..\IBM\ITM\CNPS\RKDSCATL
2. Use FTP to send the files ksy.atr and ksy.cat files from the Windows installation to be members of
&hilev.RKANDATV
3. Ensure the members are named ksyatr and ksycat.
4. Recycle the Tivoli Enterprise Monitoring Server that is running on z/OS.
5. Recycle the monitoring agent.
6. Recycle the Summarization and Pruning agent.
120 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
To install the catalog and attribute data files on the hub Tivoli Enterprise Monitoring Server on z/OS,
complete the following process:
1. Copy the following members from a CSI where the Tivoli OMEGAMON XE for Storage on z/OS
monitoring agent has been installed and configured to the CSI where the hub Tivoli Enterprise
Monitoring Server is installed:
v TKANDATAV (KS3ATR)
v TKANDATAV (KS3CAT)
v TKANPAR (KS3PDICT)
2. Restart your hub Tivoli Enterprise Monitoring Server.
Workaround: Data set I/O collection refers to the feature of Tivoli OMEGAMON XE for Storage on z/OS
which allows customers to get millisecond response time information at the data set level. Use one or both
of the following methods to manage this feature:
v Turn the feature on or off at the volume level. In general, monitor only volumes for which data set
response time is a critical issue or volumes that are known to have problems.
v Regulate the feature by using parameters that specify when data set level I/O monitoring starts for a
volume. Apply these parameters whenever you need to monitor a large number of volumes.
Use one of the following methods to collect data set level I/O statistics for a device:
v Monitor I/O events based on a fixed interval, called sample count. Sample count specifies how often I/O
events are monitored. If the sample count for a device is set to 1 (the default), every I/O event is
monitored. If the sample count is set to 5, every fifth I/O is monitored. Valid values are 1 through 99.
v Activate device monitoring when there is an extended period of response-time degradation, and
deactivate monitoring during periods of acceptable response time. You specify a millisecond response
(MSR) trigger value for a device and a global trip count that controls the number of times an MSR
exception occurs before monitoring resumes for the device. Valid values are 1 through 999.
Use the Configuration Tool to set these parameters.
124 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Chapter 13. Troubleshooting error conditions
This section describes messages that the system provides to indicate performance problems.
Limitation
The U0001 abend itself generates an unnecessary memory dump. If the memory dumps occur frequently,
system performance might be affected.
Workaround
Avoid this problem by adding a SLIP command to the SYS1.PARMLIB to bypass memory dumps for
U0001 abends in the address space of the Tivoli Enterprise Monitoring Server. An example of the SLIP
command to add to the IEASLPxx member in your parmlib is as follows:
SLIP SET, C=U0001,JOBNAME=tems_taskname,A=NOSVCD,ID=xxxx,END
Tivoli OMEGAMON XE for Storage on z/OS is the only OMEGAMON product that uses the U0001 abend.
Notice that the interrupt code for the bottom request block is 0x4E, (WLIC..... 0002004E). This code
represents the LSPACE macro.
4. A service request block (SVRB) exists above that line. This SVRB contains the registers that were
generated when the LSPACE macro was issued.
5. Inspect the contents of the R1 register.
6. Look up the address from the R1 register in the memory dump.
Note: Instead of referring to the contents of the R1 register in Step 6, you can inspect the contents of the
R8 register. This register points directly to the device entry in the OMEGAMON device table, as
shown in the bolded parts in this example. The VOLSER is displayed at offset +6.
296D59C0 020FF190 196F5052 49F3F0F0 0F8C0801 | ..1..?PRI300....
296D59D0 00020008 321B0008 FF000200 02D000CC | .............}..
296D59E0 0000009C 00000189 00000000 00000003 | .......i........
296D59F0 00000128 0000005C 00000090 0000012F | .......*........
These RPC calls may indicate that the warehouse proxy agent locks up temporarily and cannot respond to
new requests. Eventually, the proxy clears and continues processing. These kinds of problems are
symptoms of insufficient database tuning.
If you plan to install your Tivoli Data Warehouse on DB2, you must update the DB2 configuration to reduce
the likelihood of database deadlocks when large amounts of monitor data are transferred to the
warehouse. Use the following examples as a guide to making the configuration changes. It is best to make
these changes before installing the warehouse proxy and Summarization and Pruning agent and creating
the warehouse database. To ensure that tablespaces are created correctly, use the database creation
support provided during installation (or reinstallation) of the Tivoli Data Warehouse agent from the Manage
Tivoli Enterprise Services window.
Other Errors
The base components of IBM Tivoli Monitoring can generate other errors in the RKLVLOG. See the IBM
Tivoli Monitoring Problem Determination Guide, GC32-9458 for information and messages to assist with
troubleshooting framework problems.
Note: The unique utilities in Tivoli OMEGAMON XE for Storage on z/OS, such as the Storage Toolkit and
the Dataset Attributes Database, log their messages to the Tivoli Enterprise Portal log. When you
are troubleshooting these utilities you must consult the Tivoli Enterprise Portal log.
User impact: Performance issues occur during the Dataset Attribute data collection cycle.
Workaround: Data collection runs as set of subtasks within the address space of the Tivoli Enterprise
Monitoring Server. Consider the following options when a new collection cycle is started:
v Clear the Collect Catalog data option. This setting greatly reduces the resource consumption and
elapsed time of the collection cycle, but any attributes that might have been obtained from the catalog
are unavailable.
v Exclude any unneeded volumes or storage groups from collection, specifying them explicitly and/or
using masks.
v Schedule the collection to run only as often as necessary to rebuild the memory-resident database, and
at a time when impact on the overall system will be minimal.
Workaround: You cannot see Dataset Attribute data until a collection cycle has elapsed. The data is
displayed after the collection cycle is completed. Also, data for this feature is stored in memory, not on the
hard disk. Data might not be displayed for the following reasons:
v A collection cycle has not run. For example, collection is scheduled to begin at 2:00 AM and the Tivoli
Enterprise Monitoring Server was stopped and started at 6:00 AM. No data is displayed until a collection
cycle is completed.
v You restart the monitoring agent. Any data that was displayed is cleared from memory. No new data is
displayed until the collection cycle is completed.
v A task from another application has exclusive control. Because the Dataset Attributes Database feature
accesses every online volume, there is the potential for contention with other applications that use those
resources simultaneously. If another task has exclusive control of a volume and Dataset Attributes
Database is unable to gain access, the volume is bypassed and a message is issued to RKLVLOG.
Workaround: Issue the S3DA STATUS command twice over the course of approximately 1 minute to see if
the number of volumes processed is increasing. (The IBM Tivoli OMEGAMON XE for Storage on z/OS:
© Copyright IBM Corp. 2006, 2007 129
User’s Guide provides information on commands in the “Command-line option” section of “Appendix D.
Dataset Attributes Database”). If the remaining volumes are not being processed, issue the S3DA STOP
command to halt the collection cycle. If data collection still does not stop normally, or you suspect the
process is in a loop (in other words, very high CPU consumption within the TEMS address space), issue
the S3DA TERM command to terminate all Dataset Attribute processing.
Data for the feature is not sent to the Tivoli Data Warehouse
User impact: Dataset Attributes tables are not being sent to the Tivoli Data Warehouse as expected.
Workaround: Ensure that both the History Collection and Warehouse intervals are set to 1 hour in the TEP
Historical Configuration dialog box. Because the Dataset Attribute tables normally only change once per
day when the collection cycle occurs, the Warehouse Proxy does not send tables to the warehouse if it
detects they have not been updated frequently enough to satisfy the historical collection interval.
Workaround: Examine the appropriate attribute from a different source program (for example, ISPF,
IDCAMS) to determine whether the values are being displayed incorrectly. For example, a data set that is
displayed as having negative Free space may, in fact, show a larger amount of space Used than Allocated
in its VTOC entry. This indicates that the VTOC had been incorrectly updated in the past (for example, a
program reaches an ABEND (abnormal end) condition before correctly setting the values).
If a cross-product link is missing from the link list, contact your system administrator to verify the following
information:
v Your user ID is authorized to access the target product.
v The target workspaces of the product are installed. OMEGAMON XE help files, workspaces, and
situations are installed using the IBM Tivoli OMEGAMON Data Files for z/OS CD.
Product workspaces are installed using the IBM Tivoli OMEGAMON Data Files for z/OS CD. After the
workspaces are installed, all predefined links to the workspaces become enabled, and links to the target
workspaces are included in the link list when an operator right-clicks a link icon.
130 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
If you installed the workspaces for products that you have not installed in your environment, links to these
products are displayed as valid destinations for dynamic cross-product links. To prevent the inclusion of
misleading links, install only the help files, workspaces, and situations for products that you have installed.
In this migration scenario, using dynamic workspace linking to link from an OMEGAMON XE V4.1
workspace to the workspace of another OMEGAMON XE V3.1 product works correctly, as long as the
target workspace exists in the V3.1 product. If the target workspace does not exist, you receive the
KFWITM081E message.
This appendix provides an overview of service information that you must collect about a z/OS monitoring
agent and instructions for setting traces and collecting logs for your own use and to forward to IBM
Software Support, if necessary. The following topics are covered:
v “Problem determination flow for an OMEGAMON XE monitoring agent on z/OS”
v “Determining whether the problem was caused by an OMEGAMON XE monitoring agent on z/OS” on
page 134
v “Setting up trace logging for Tivoli OMEGAMON XE for Storage on z/OS” on page 138, including the
following subtopics:
– “Using the KDC_DEBUG environment variable” on page 138
– “Setting up RAS1 tracing” on page 139
– “Redirecting output of RAS1 tracing” on page 144
– “Setting trace levels on a Tivoli Enterprise Monitoring Server on z/OS using the Configuration Tool”
on page 145
v “Tips regarding the collection of diagnostic data” on page 146
v “Understanding RAS1 logs and component prefixes” on page 147
v “Maintaining the persistent datastore” on page 154
For information about submitting problems to IBM Software Support, refer to the support appendix found in
every IBM Tivoli Monitoring book. The support information includes information on this topic: “Capturing
z/OS logs to send to IBM Software Support” on page 165.
Tracing, on the other hand, creates a record of the processing of a computer program or transaction.
Trace logs capture information about the operating environment when component software fails to operate
as intended to help you diagnose problems. The principal log type is the reliability, availability, and
serviceability (RAS1) trace log. When the Tivoli Management Services z/OS components are initialized,
RAS1 service initialization is one of the first processes started. RAS logs are in the English language only.
The RAS trace log mechanism is available on the Tivoli Enterprise Monitoring Server, the Tivoli Enterprise
Portal Server, and the monitoring agents. Most logs are located in a logs subdirectory on the host
computer.
By default, an OMEGAMON XE monitoring agent on z/OS has minimal tracing enabled. The setting
RAS1=ERROR means that only error messages are captured. When you report a problem, IBM Software
Support might ask you to enable a more in-depth and detailed form of tracing, such as one of those
discussed under “Syntax for RAS1 traces” on page 139.
Attention: There is CPU and I/O overhead associated with detailed RAS1 tracing that might degrade
performance of the monitoring agent. You must restore RAS1 tracing to the minimal KBB_RAS1=ERROR
after problem diagnosis is completed.
In any problem scenario, gather all documentation at the time of the error, when all potentially useful
troubleshooting data is available. What seems to be a client problem might be a server problem, especially
in a scenario where data is not showing up at the client. The following sections describe guidelines for
collecting the correct information about any problems reported.
As you collect logs, create an exact description of the problem. For reproducible problems, document the
exact navigation path that produced the error. Screen captures might also help in the problem
determination. For further information, see “Using IBM Support Assistant” on page 161.
In your problem report, try to use the correct terminology when describing the problem (for example,
workspaces, views, navigators, events, and links). Consistent use of the terminology will help IBM
Software Support to understand the problem quickly.
The sections that follow discuss types of problems that you might see and how to capture information
needed to diagnose those problems.
134 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Table 2. Log locations for Tivoli Enterprise Portal desktop client
Component Windows systems UNIX and Linux systems
Tivoli v install_dir\CNP\logs\kcjras1.log where all of install_dir/cnp/logs/host_cj_timestamp.log
Enterprise the RAS1 tracing for the Tivoli Enterprise Portal
Portal desktop client is found.
client v install_dir\CNP\logs\kcj.log and
kcjerror.log any errors generated by the Java
libraries used in the Tivoli Enterprise Portal
client.
where:
install_dir
Specifies the directory where IBM Tivoli Monitoring is installed.
host (On UNIX and Linux systems only)
Specifies the name of the system that hosts the product.
Product code
The cj product code stands for the Tivoli Enterprise Portal. Refer to the product code
appendix of IBM Tivoli Monitoring: Problem Determination Guide for a complete list of
product codes for distributed components of IBM Tivoli Monitoring.
timestamp (On UNIX and Linux systems only)
A decimal representation of the time at which the process was started.
Where user_id is the user's ID on the computer. The plugin1.4.2.trace file contains the RAS1 tracing for
the Tivoli Enterprise Portal browser client and any Java exceptions. The Tivoli Enterprise Portal client logs
contain environmental information, such as the version and build level of the Tivoli Enterprise Portal client.
The log also contains the host and port of the Tivoli Enterprise Monitoring Server that the client is
connecting to.
Additional logs to collect: Tivoli Enterprise Portal Server logs, Tivoli Enterprise
Monitoring Server logs, and data warehousing logs
A problem that is reported as a Tivoli Enterprise Portal client problem might originate in a server failure.
This section provides log locations for the following servers:
v Table 3 on page 136 shows the location of logs for the Tivoli Enterprise Portal Server.
v See the following resources for the location of logs for the Tivoli Enterprise Monitoring Server:
– For the location of logs for a Tivoli Enterprise Monitoring Server on z/OS systems, see “Problems
reported as Tivoli Enterprise Portal Server problems” on page 137.
– For the location of logs for a Tivoli Enterprise Monitoring Server on distributed platforms, see Table 4
on page 136.
v Table 5 on page 137 shows the location of logs for IBM Tivoli Data Warehouse, the warehouse proxy,
and the Summarization and Pruning agent.
Appendix A. General problem determination for Tivoli OMEGAMON XE monitoring agents on z/OS 135
Table 3. Log locations for Tivoli Enterprise Portal Server
Component Windows systems UNIX and Linux systems
Tivoli \install_dir\logs\host_PC_HEXtimestampnn.log install_dir/logs/host_PC_timestamp.log
Enterprise
where:
Portal Server
install_dir
Specifies the directory where IBM Tivoli Monitoring is installed.
host Specifies the name of the system that hosts the product
Product code
The cq product code stands for the Tivoli Enterprise Portal Server. Refer to the product code
appendix of IBM Tivoli Monitoring: Problem Determination Guide for a complete list of
product codes for distributed components of IBM Tivoli Monitoring.
HEXtimestamp (On Windows-based systems only)
A hexadecimal representation of the time at which the process was started.
timestamp (On UNIX and Linux systems only)
A decimal representation of the time at which the process was started.
nn (On Windows-based systems only)
Represents the circular sequence in which logs are rotated. Ranges from 01-05, by default.
However, the first item is always retained, because it includes configuration parameters.
Also, on UNIX and Linux systems look for log information in this file:
kfwservices.exe
Table 4. Log locations for Tivoli Enterprise Monitoring Server on distributed platforms
Component Windows systems UNIX and Linux systems
Tivoli \install_dir\logs\host_PC_HEXtimestampnn.log install_dir/logs/host_PC_timestamp.log
Enterprise
where:
Monitoring
Server install_dir
Specifies the directory where IBM Tivoli Monitoring is installed.
host Specifies the name of the system that hosts the product
Product code
The ms product code stands for the Tivoli Enterprise Monitoring Server. Refer to the product
code appendix of IBM Tivoli Monitoring: Problem Determination Guide for a complete list of
product codes for distributed components of IBM Tivoli Monitoring.
HEXtimestamp (On Windows-based systems only)
A hexadecimal representation of the time at which the process was started.
timestamp (On UNIX and Linux systems only)
A decimal representation of the time at which the process was started.
nn (On Windows-based systems only)
Represents the circular sequence in which logs are rotated. Ranges from 01-05, by default.
However, the first item is always retained, because it includes configuration parameters.
Every successful export of historical data is logged in IBM Tivoli Data Warehouse in the
WAREHOUSELOG table. Errors encountered by the warehouse proxy are recorded in the Windows
Application Event Log.
136 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Table 5. Log locations for IBM Tivoli Data Warehouse, the warehouse proxy, and the Summarization and Pruning
agent on distributed platforms
Component Distributed system
Summarization and install_dir\logs\host_sy_nn.log and
Pruning agent install_dir\logs\host_sy_java_nn.log *
IBM Tivoli Data install_dir\logs\host_hd_nn.log and
Warehouse and the install_dir\TMAITM6\logs\host_Warehouse.lg0 *
warehouse proxy
* where:
host Specifies the name of the system that hosts the product.
install_dir
Specifies the directory where IBM Tivoli Monitoring is installed.
Product code
The sy and hd product code stand for the Summarization and Pruning agent and the IBM Tivoli Data
Warehouse, respectively. Refer to the product code appendix of IBM Tivoli Monitoring: Problem
Determination Guide for a complete list of product codes for distributed components of IBM Tivoli Monitoring.
nn Represents the circular sequence in which logs are rotated. Ranges from 01-05, by default. However, the
first item is always retained, because it includes configuration parameters.
Log files and trace information is collected in the same way for all OMEGAMON XE monitoring agents on
z/OS and the z/OS components of the Tivoli Management Services, as shown in Table 6 on page 138.
Appendix A. General problem determination for Tivoli OMEGAMON XE monitoring agents on z/OS 137
Table 6. Locations of log and trace information for z/OS components
Log location Details
An OMEGAMON XE RKLVLOG for the monitoring agent started task is the single most helpful piece of service
monitoring agent on information for an OMEGAMON XE monitoring agent on z/OS. The RKLVLOG (R = runtime,
z/OS KLV = the prefix associated with IBM Tivoli Monitoring Services:Engine or ITMS:Engine) is
the sysout data set or spool file that contains log and trace messages. Instructions on how to
save the contents of this log to a data set are provided under “Capturing z/OS logs to send
to IBM Software Support” on page 165.
These additional zSeries log files (if available) are also useful:
v The RKLVSNAP sysout data set or spool file contains formatted dump output.
v The RKPDLOG sysout data set or spool file relates to persistent data stores and is
described later in this table.
Refer to your started procedures for the locations of these serviceability log files.
Tivoli Enterprise Because the Tivoli Enterprise Monitoring Server on z/OS runs under ITMS:Engine just as an
Monitoring Server on OMEGAMON XE monitoring agent on z/OS does, all logging under ITMS:Engine is handled
z/OS the same way, that is log and trace data are written to RKLVLOGs and RKPDLOGs.
IBM Tivoli Monitoring ITMS:Engine is a collection of basic operating system and communication service routines
Services:Engine built specifically for z/OS. All address spaces used by OMEGAMON XE monitoring agent on
(ITMS:Engine) z/OS load and use the services of ITMS:Engine.
For troubleshooting information about ITMS: Engine problems, refer to the z/OS initialization
section of IBM Tivoli Monitoring: Problem Determination Guide.
ITMS:Engine writes messages to the same RKLVLOG as the product it is running. If you
search the RKLVLOG for a OMEGAMON XE monitoring agent on z/OS, product-specific
messages start with the product code (for example, KS3 for Tivoli OMEGAMON XE for
Storage on z/OS) but messages for the ITMS:Engine start with the KLV component prefix.
OMEGAMON The OMEGAMON subsystem does not allocate an RKLVLOG. This component issues
subsystem messages directly to the z/OS system console (or SYSLOG).
Persistent data store The RKPDLOG sysout data set or spool file contains the information and error messages
related to the handling of persistent data stores. To dump this log, follow the procedures
described for RKLVLOG in the sections that follow.
For locations of log files for all the components of Tivoli Management Services and information about
enabling tracing for distributed components, refer to IBM Tivoli Monitoring: Problem Determination Guide.
138 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
To obtain the level of tracing required to have these TCP/IP initialization messages echoed to the RAS1
log, the string KDC_DEBUG=Y must be added to member KDSENV of RKANPARU (or the appropriate
initialization member named KppENV, where pp is the two-letter prefix associated with the monitoring agent,
such as S3 for Tivoli OMEGAMON XE for Storage on z/OS).
Then TCP/IP initialization was successful. If KDC_DEBUG is set to Y and none of these
messages are displayed in RKLVLOG, then initialization of the TCP/IP service failed.
N The data flow between the monitoring agent and Tivoli Management Services components during
TCP/IP initialization is not recorded. This is the default and the recommended setting for normal
operation.
For OMEGAMON monitoring agents on z/OS, this environment variable can be used during TCP/IP
service initialization to diagnose connectivity problems with application-layers such as telnet and FTP, and
with the IBM Tivoli Monitoring Server, Tivoli Enterprise Portal Server, and the Tivoli Enterprise monitoring
agents.
The KDC_DEBUG environment variable controls all DCS communications tracing. Use the KDC_DEBUG
parameter to track DCS errors or activity between the agent and the Tivoli Enterprise Monitoring Server.
Note: You must place the KDC_DEBUG environment variable statement immediately after the
KDC_FAMILIES environment variable.
Refer to the environment variables appendix in IBM Tivoli Monitoring: Problem Determination Guide for a
list of environment variable associated with other components.
Not all OMEGAMON products or functions support RAS1 tracing, and not all OMEGAMON products or
functions use the filters and classes in the same way. For example, two monitoring agents might use the
filters and classes specified in RAS1 tracing differently and with different frequencies.
Again, be aware that RAS1 tracing log files can grow very large with the wrong amount of filtering. There
is no log management function or feature, so be careful with the levels of tracing that you specify. You may
want to run error tracing for all components and then any additional levels depending on diagnostic needs.
Appendix A. General problem determination for Tivoli OMEGAMON XE monitoring agents on z/OS 139
effect. After that, it remains in effect for the life of the address space. To end this RAS1 trace, you must
edit the KppENV file again and reset the trace level and stop and start the address space.
The basic syntax of the RAS1 trace commands for error tracing is as follows:
KBB_RAS1= global_class
(COMP: component_type) (ENTRY: entry_point)
(UNIT: unit_name, class)
Where:
global_class
Indicates the level of tracing that you want to see. This is a global setting that applies to all RAS1
filters within the process. If you set this global class by itself, it is global in scope and the trace
cannot filter on any of the other keywords. Separate combined classes with a space. The following
are possible values. Valid abbreviations are in parentheses.
v ERROR (ER): returns severe error messages only (this is the default for most applications).
v STATE (ST): records the condition or current setting of flags and variables within the process. If
state tracing is enabled, you can see the current state of particular variables or flags as the
process is running.
v FLOW (FL): causes a message to be generated at an entry or exit point of a function.
v DETAIL (DE): produces a detailed, verbose level of tracing.
v INPUT (IN): records data that is created in the execution of a particular API, function, or
process.
v ALL: causes all available messages to be recorded, a combination of all the other forms of
tracing.
COMP Is the keyword that indicates this trace will include a component type. The COMP keyword is used
to trace groups of routines related by function (or component). Do not use this parameter unless
requested to do so by IBM Software Support.
component_type
Is the identifier for a component type. If an IBM Software Support representative instructs you to
perform a component trace, you will be provided with a code for that component. Do not use this
parameter unless requested to do so by IBM Software Support.
ENTRY
Is the keyword used to narrow a filtering routine to specify a specific ENTRY POINT. Since
multiple entry points for a single routine are not common, this keyword is not commonly used and
should only be used at the explicit request of an IBM Software Support representative.
entry_point
Is a variable representing the name of the entry point. If you are asked to specify a value for the
ENTRY keyword, an IBM Software Support representative will tell you what value to specify for
entry_point .
UNIT Is the keyword that indicates this trace will include collecting information using the compilation unit,
fully qualified or partially qualified. A match is performed between the compilation unit dispatched
and the compilation unit specified on the RAS1 statement. A match results in a trace entry.
unit_name
Is a variable representing the name of the compilation unit. This name can be anything that is
related to the object file name or unit compilation name. In most instances, this name defines the
component that is being traced. This value might be one of the components in one of the
component prefixes, but in practice will most likely be the three-character component identifier for
the monitoring agent (for example, ks3 for Tivoli OMEGAMON XE for Storage on z/OS).
140 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
class One of the same values specified for global_class but, because of its position inside the
parentheses, it is narrowed in scope to apply only to the unit_name specified.
Notes:
1. The default setting for all components is KBB_RAS1=ERROR, meaning that only error tracing is enabled.
2. You can specify any combination of UNIT, COMP, and ENTRY keywords. None of these keywords is
required. However, the RAS1 value you set with the global class applies to all components.
Some examples of RAS1 trace syntax follow.
Example 1 – Tracing requests to and answers from the Tivoli Enterprise Monitoring Server: To
show requests to and answers from the Tivoli Enterprise Monitoring Server, specify this trace:
KBB_RAS1=ERROR (UNIT:KRA ST ERR)
The unit values ST and ERR indicate that you will be collecting state and error information for the agent
framework component (KRA).
This type of agent trace is used only if you are trying to debug a specific problem, because it greatly
increases the number of messages generated by agent. With this type of trace, messages will include a
memory dump of all rows of agent data that have passed filtering, which includes attribute names and
values, request names, table names, and collection interval. Remember to disable this resource-intensive
form of tracing immediately after you have completed your trace.
Example 2 – Tracing proxy controller and distributed agent issues: From the Tivoli Enterprise
Monitoring Server, to trace proxy controller and Tivoli Enterprise Monitoring Server distributed agent
issues, issue this command:
KBB_RAS1=ERROR (COMP:KUX ST ER) (UNIT:KRA ALL) (UNIT:KDS FL)
In this example:
v KUX is a component identifier provided to you by a representative of IBM Software Support so that you
can collect state and error information about this subcomponent.
v KRA is the unit name for the agent framework component. All trace information about this component is
being captured.
v KDS is the Tivoli Enterprise Monitoring Server component and the flow (FL) of entry or exit points
through this component will be documented with records written to RKLVLOG.
Setting trace levels by editing RKANPARU: One of the simplest ways to set trace levels for an
OMEGAMON XE monitoring agent on z/OS is to edit the RKANPARU(KppENV) member.
The text in bold is an example of what an IBM service representative might ask you to add to this member.
File Edit Edit_Settings Menu Utilities Compilers Test Help
sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss
EDIT KAN.V4R1.RKANPARU(KS3ENV) - Columns 00001 00072
Command ===> Scroll ===> CSR
****** ***************************** Top of Data ******************************
==MSG> -Warning- The UNDO command is not available until you change
==MSG> your edit profile using the command RECOVERY ON.
000001 KDE_TRANSPORT=\
000002 SNA.PIPE PORT:135 USE:N\
000003 IP6.PIPE PORT:19184 USE:N\
000004 IP6.UDP PORT:19184 USE:N\
000005 IP.SPIPE PORT:3660 USE:N\
000006 IP6.SPIPE PORT:3660 USE:N\
Appendix A. General problem determination for Tivoli OMEGAMON XE monitoring agents on z/OS 141
000007 IP.PIPE PORT:1918 EPHEMERAL:Y\
000008 IP.UDP PORT:1918
000009 KBB_RAS1=ERROR (UNIT:KS3TN ALL) (UNIT:KS3IRAFT ALL)
000010 CT_CMSLIST=\
000011 IP.PIPE:x.xx.xxx.xx;\
000012 IP.UDP:x.xx.xxx.xx;
000013 CTIRA_STANDALONE=N
000014 CTIRA_IP_PORT=0
000015 LANG=en_US.ibm-037
****** **************************** Bottom of Data ****************************
Setting trace levels dynamically using IBM Tivoli Monitoring Services console: You can also use
the IBM Tivoli Monitoring Services console to set trace levels for OMEGAMON XE monitoring agents on
z/OS, as well as for a Tivoli Enterprise Monitoring Server on z/OS or a distributed system.
The IBM Tivoli Monitoring Services console enables you to read logs and turn on traces for remote product
diagnostics and configuration. The IBM Tivoli Monitoring Service Console is uniquely identified by its
service point name. All IBM Tivoli Monitoring Services consoles for a host are linked and presented on the
IBM Tivoli Monitoring Services Index for that host. Point a browser to the HTTP port 1920 on a specific
host (for example, http://goby:1920) to launch the IBM Tivoli Monitoring Services Index. You can also
launch the service console by connecting through the HTTPS protocol and port 3661. You can perform
operations on a specific IBM Tivoli Monitoring process by selecting the IBM Tivoli Monitoring Services
console associated with a service point name.
Starting the IBM Tivoli Monitoring Service Console: Use the following procedure to start the IBM Tivoli
Monitoring Services console.
1. Start Internet Explorer V5 or higher.
2. In the Address field, type the URL for the Tivoli Enterprise Portal browser client installed on your Web
server. The URL for the Tivoli Monitoring Services Web server is
http://hostname:1920
Where hostname specifies the computer where the Tivoli Enterprise Portal Server was installed. If the
IBM Tivoli Monitoring Services console is not displayed, a system administrator might have blocked
access to it. Refer to the IBM Tivoli Monitoring: Problem Determination Guide for information about
blocking access to the IBM Tivoli Monitoring Services console. An HTML window displayed with a list
of hyperlinks to all available instances of the IBM Tivoli Monitoring Services console.
3. Click theIBM Tivoli Monitoring Services console link associated with the desired process (service point
name).
4. When the login window opens, click OK.
In secure environments, you need a valid user ID and password to proceed. Upon successful login, the
IBM Tivoli Monitoring Services console opens with three areas:
v Header
v Command Results
v Command Field
You can now issueIBM Tivoli Monitoring Services console commands in the command input area. For a list
of available commands, type a question mark (?) and click Submit.
The IBM Tivoli Monitoring Services console supports the following commands, most of which are useful for
problem determination:
bss1 Manages BSS1 (Basic System Services). This command is paired with one of the following
subcommands:
v dumpcvt: Display KBBSS_cvt_t
v listenv: Display the resident CT® variables
142 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
v getenv: Display environment variables
v setenv: Assign environment variable
v info: Display BSS1_Info() data
v config: Manage configuration variables
config Used to modify the settings of the ITMS: Engine debug environment variables: RES1_DEBUG,
KDH_DEBUG, KDC_DEBUG, and KDE_DEBUG . For example, the following config command
can be used to alter the setting of KDC_DEBUG:
CONFIG KDC_DEBUG=Y
The setting of KDC_DEBUG can be restored to its original value using the following command:
CONFIG KDC_DEBUG=N
For more information about setting KDC_DEBUG for the Tivoli Enterprise Monitoring Server, refer
to “Setting trace levels on a Tivoli Enterprise Monitoring Server on z/OS using the Configuration
Tool” on page 145.
ctbld The ctbld command is used to determine the maintenance level of the product.
http Displays HTTP server management
kdcstat
Displays the status of KDC (RPC Service) component
kdestat
Displays the status of the KDE (Transport Service) component
ras1 Manage RAS1 (Reliability, Availability, and Serviceability). This command is paired with one of the
following subcommands:
v dumpcvt: Display KBBRA_cvt_t
v log: Display RAS1 log capture buffer
v list: List the RAS1 filters
v interpret: Interpret the control string
v ctbld: Display the resident CTBLD data
v units: Display the registered compilation units
The RAS1 (with no operands) command can be used to view the current ITMS:Engine log capture
buffer. When operands are supplied with the RAS1 command, the operands are assumed to be
keywords applicable to the KBB_RAS1 environment variable.
The RAS1 command is especially useful for dynamically enabling and disabling RAS1 traces. The
process of gathering documentation for IBM Software Support might conflict with your company's
need for 24 X 7 product availability. The RAS1 command can be used to alter KBB_RAS1 tracing
parameters dynamically without the need to recycle the product. For example, to enable the
standard IRA traces, you can use the following IBM Tivoli Monitoring Services Console command:
RAS1 ’error (unit:kpx all) (unit:kra all)’
The (single) quoted string is passed to RAS1 as operands of the KBB_RAS1 environment
variable.
After this trace is captured, the IRA trace can be disabled with the following IBM Tivoli Monitoring
Services Console command:
RAS1 ’error (unit:kpx error) (unit:kra error)’
This command restores the RAS1 logging level from ALL to ERROR for units kpx and kra.
res1 Displays the status of RES1 Logical Resource Manager
Appendix A. General problem determination for Tivoli OMEGAMON XE monitoring agents on z/OS 143
Setting trace levels dynamically from the IBM Tivoli Monitoring Service Console command line:
Dynamic RAS1 agent tracing allows the you to send commands to the monitoring agent to alter its RAS1
tracing dynamically while a process is running. This type of tracing tracks particular types of problems as
they occur.
You cannot issue this command if RAS1 agent tracing is not enabled. Enable the RAS1 agent tracing first
before attempting to dynamically alter RAS1 agent tracing with these commands documented here.
You can send these commands using the Tivoli Enterprise Portal Take Action facility.
Dynamic RAS1 agent tracing uses syntax similar to RAS1 agent tracing, but with several differences to
keep in mind. The syntax is:
action FILTER ID= id [UNIT= ras1_unit]
[CLASS= (ras1_class)]
Where:
action Can be one of the following values:
ADD Enables a specific filter,
REMOVE
Disables a specific filter.
ENABLE
Enables a global class.
DISABLE
Disables a global class.
id Is a unique key for each filter specified that commands act upon. The ID is usually a three-letter
component identifier for the component to which the add, remove, enable, or disable action is
being applied.
UNIT Is the keyword that indicates this trace will include collecting information for a certain component.
Units IDs are specific to a product or component. This component ID will be provided to you by an
IBM Software Support representative. Do not use this keyword unless you are doing a component
trace under the direction of IBM Software Support. Only one of these can be specified at a time.
ras1_unit
Is a variable representing the name of the filter. This name can be anything that is related to the
object file name or unit compilation name. In most instances, this variable defines the component
that is being traced. This value can be any one of the components in the Table 7 on page 148.
Typically the value is the three-character component identifier for the monitoring agent (for
example, ks3 for Tivoli OMEGAMON XE for Storage on z/OS).
CLASS
Is the keyword specifying the type of trace.
ras1_class
One of the same values specified for global class. However, because of its position inside the
parentheses, it is narrowed in scope to apply only to the unit_name specified.
Often, Tivoli users redirect the initialization member using the ITMS:Engine INITLIST processing. INITLIST
processing is always echoed to the RKLVLOG with the KLVIN411 message.
144 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
The following example shows a typical KBBENV override to a different member, KDSENV:
KLVIN410 INITLIST MEMBER KDSINIT BEING PROCESSED
KLVIN411 KLVINNAM=KDSINNAM
KLVIN411 KLVINTB=KDSINTB
KLVIN411 KLVINVLG=KDSINVLG
KLVIN411 KLVINNAF=KDSINNAF
KLVIN411 KLVINVPO=KDSINVPO
KLVIN411 KLVINSTG=KDSINSTG
KLVIN411 KLVINVAM=KDSINVAM
KLVIN411 KBBENV=KDSENV
The advanced configuration values affect logging and tracing on the Tivoli Enterprise Monitoring Server on
z/OS:
Enable startup console messages
Set this parameter to Y if you want a SYSLOG message on the console to indicate when the
TEMS finishes initializing. You can use this message in an automation script. Refer to the
automation package for your site for further instructions on how to capture the KO4SRV032 and
KDSMA001 TEMS automation message IDs. The default is Y.
Enable communications trace
Set this parameter to Y if you want KDC_DEBUG=Y as the override setting in
&hilev.HLPLX.NV.RTE1.RKANPARUU(KDSENV) member. Otherwise, the default setting of
KDC_DEBUG=N is used. This default parameter instructs the data communications layer to report
communications problems using a minimal, summary format. This parameter is intended for stable
applications in production. Note that the default KDC_DEBUG=N generates standard RAS1 trace
data in the TEMS RKLVLOG, in addition to the summary information diagnosing possible timeout
conditions
Appendix A. General problem determination for Tivoli OMEGAMON XE monitoring agents on z/OS 145
The following settings report on data communications problems:
v KDC_DEBUG=N: minimal tracing (default)
v KDC_DEBUG=Y: full-packet tracing
v KDC_DEBUG=D: KDC_DEBUG=Y plus STATE & FLOW tracing
v KDC_DEBUG=M: KDC_DEBUG=D plus INPUT & OUTPUT HELPs tracing
v KDC_DEBUG=A: KDC_DEBUG=M plus all format tracing
Do not set KDC_DEBUG=A unless directed by an IBM Software Support representative.
Enable storage detail logging
Set this parameter to Y to enable storage allocation detail logging. You can use the storage detail
command output to analyze storage utilization within the TEMS address space. Specifying Y
generates the second EVERY command in &hilev.HLPLX.NV.RTE1.RKANCMDU(KDSSTART).
To disable storage detail logging, set this parameter to N, which generates the second EVERY
command as a comment. To further control storage detail logging, you can also dynamically issue
the following modify command to the CANSDSST started task:
==> /F CANSDSST,STORAGE D
This modify command is useful if the TEMS is already running with storage detail logging initially
disabled. Issuing the modify command activates storage detail logging without having to recycle
the TEMS. The default is Y.
If you set this parameter to Y, you must also define the times for storage detail logging and
flushing the VSAM buffers.
v For Storage detail logging, set the interval to monitor storage. The interval values are written as
part of the second EVERY command in: &hilev.HLPLX.NV.RTE1.RKANCMDU(KDSSTART). The
default is 0 hours (hh) and 60 minutes (mm).
v For Flush VSAM buffers, set the interval to force all deferred VSAM writes to DASD. The
interval values are written as part of the command in:
&hilev.HLPLX.NV.RTE1.RKANCMDU(KDSSTART). The default is 0 hours (hh) and 30 minutes
(mm).
For additional information about the values on this panel, refer to Configuring IBM Tivoli Enterprise
Monitoring Server on z/OS.
KDFDEVIN DEBUG
User impact: You might experience a problem in Tivoli OMEGAMON XE for Storage on z/OS and IBM
Software Support requests that you turn on debugging.
Workaround: Add the DEBUG(ON) parameter to the RKANPAR member KDFDEVIN . The parameter
enables debugging messages in the Tivoli OMEGAMON XE for Storage on z/OS product only. These
messages come from a wide variety of modules and components within the Tivoli OMEGAMON XE for
Storage on z/OS product and substantially increase output to the RKLVLOG. For this reason, enable
debugging only when you are working with IBM Software Support. And run debugging only until you have
collected sufficient data, as defined by your IBM Software Support contact. To turn off debugging, remove
the DEBUG(ON) parameter from the KDFDEVIN member.
146 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
!Trace in VTAMDATA
User impact: You might experience a problem with the OMEGAMON II interface to Tivoli OMEGAMON XE
for Storage on z/OS, and IBM Software Support requests that you turn on tracing in the OMEGAMON II
address space.
Workaround: Tracing in the OMEGAMON II interface is performed on a per-session basis. To enable this
type of tracing, you must be able to pass VTAM USER parameters in your logon command string. Some
types of session manager give you this capability. If you are not using a session manager, the VTAM USS
screen the your support staff provides can give you this capability.
The parameter to pass in your logon command string is !Trace. The generated trace messages
substantially increase output to the RKLVLOG. For this reason, enable tracing only when you are working
with IBM Software Support. And run tracing only until you have collected sufficient data, as defined by your
IBM Software Support contact.
STBDEBUG(X)
User impact: You might notice signs of a storage overlay or storage creep and contact IBM Software
Support. Your IBM contact person might request that you set storage debugging to X, which is the setting
that generates the highest level of detail. (The other possible settings are N, no debugging, and Y, minimal
debugging.)
Workaround: IBM Software Support might instruct you to add this parameter to the RKANPAR member
KDFSYSIN as part of the debugging process. Depending on the state that IBM Software Support asks you
to set, you may also need to modify the MINIMUM parameter in the same member. STGDEBUG(Y) adds
a small amount (32 bytes) to each block of storage allocated from our internal storage manager. Normally,
this does not cause problems because most systems have sufficient extra space in their engine storage
allocation to allow for this. STGDEBUG(X) however, adds a total of 96 bytes to each allocated block of
storage, which can quickly exceed your storage allocation. In most cases, double the value specified in the
MINIMUM parameter whenever you specify STGDEBUG(X). Also, ensure that you run this type of
debugging with the region set to 0M (REGION=0M).
Workaround: Use the following SDATA parameters to all memory or console dumps taken for the Tivoli
OMEGAMON XE for Storage on z/OS product, unless IBM Software Support instructs you otherwise.
SDATA=(ALLNUC,CSA,LPA,PSA,RGN,SQA,SUM,TRT)
Most messages with IDs are documented in the problem determination guides for each monitoring agent.
You can also determine the meaning of a message by entering the message number into an Internet
search engine such a Google. The information that follows help you interpret the messages and status
lines in a z/OS log.
Appendix A. General problem determination for Tivoli OMEGAMON XE monitoring agents on z/OS 147
– Operating system and CPU data. This information is prefaced with the following string:
PPPxxmmm
Where:
PPP Is the component prefix (See Table 7 for a list of component prefixes).
xx Is the component code (for example, NS Node Status).
mmm Is the module name (for example mdg/mgr for Model/Manager).
– Initial command-line settings
v Component summary, including the following:
– The name of the module
– Information about where the library was loaded from
– The date and time the module was compiled
– The version (if this detail was specified)
v Formatted output, including entry and exit points and text strings. Entry and exit points show flow into
and out of a given function. The exit shows the return code, if applicable. The text depends on the kind
of trace specified. Here is an example:
(00D41 F9C-1{99%}:KV4MAIN.CPP,953,"MainWnd::MainWnd") Entry
(00D41 FD3-1{99%}:KV4MAIN.CPP,959,"MainWnd::MainWnd") Exit
Time,Thread,{%stack avail},pgm_name,Line#,function,text
Not all functions are RAS1 enabled, and trace level may exclude some paths.
It is not always apparent what component has generated a message. To help you understand the
messages, Table 7 shows the prefixes for the components of all Tivoli Management Services components
and OMEGAMON XE monitoring agents that might be displayed in a log and trace file. The message
begins with one of the three-letter prefixes documented in the following table.
Table 7. Prefixes that might be displayed in message and trace files
Prefix Component
AOP AF/OPERATOR®, OMEGACENTER® Gateway for MVS
ATF OMEGAMON II for IMS™
BG OMEGAMON II for CICS®
BPO IBM Tivoli OMEGAMON XE for DB2 Performance Expert
CI OMEGAMON Base
CNDL OMEGAMON Base
CSAA Classic OMEGAMON
CV OMEGAMON for VM
DGO IBM Tivoli OMEGAMON XE for DB2 Performance Expert
DSM OMEGAMON II for IMS
DX DEXAN®
EA OMEGAMON II for MVS
EB EPILOG®
EC EPILOG
ED EPILOG
148 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Table 7. Prefixes that might be displayed in message and trace files (continued)
Prefix Component
EI EPILOG
EO EPILOG
EP EPILOG
™
ETE End to End
ETX OMEGAMON II for IMS
EU OMEGAMON for VM
EV OMEGAMON for VM
EVS OMEGAMON II for IMS
EX OMEGAMON II for Mainframe Networks
FPE IBM Tivoli OMEGAMON XE for DB2 Performance Expert
H2C OMEGAMON II for DB2
IA Classic OMEGAMON
ICF OMEGAMON II for IMS
IN Classic OMEGAMON
KA2 Tivoli Enterprise Monitoring Server
KA4 Tivoli Enterprise Monitoring Server
KAB OMEGACENTER Gateway for MVS
KAG Configuration Tool, Tivoli Enterprise Monitoring Server
KAM Alert Adapter for OG/MVS, Alert Adapter for OMC Gateway MVS, Configuration Tool
KAO AF/OPERATOR, OMEGACENTER Gateway for MVS
KAT AF/OPERATOR, OMEGACENTER Gateway for MVS, OMEGACENTER Status Manager for MVS
KAU AF/Integrated Resource Manager, OMEGACENTER Gateway for MVS
KBB IBM Tivoli Monitoring Services:Engine or ITMS:Engine, Tivoli Enterprise Monitoring Server
KBF CASP Native Connector
KBL OMEGAMON XE for CASP
KBR OMEGAMON XE for CASP
KBX OMEGAMON XE for CASP, Configuration Tool
KC2 OMEGAMON II for CICS, Configuration Tool
KC3 Configuration Tool, OMEGAMON XE for CICS, IBM Tivoli OMEGAMON XE for CICS on z/OS
KC5 IBM Tivoli OMEGAMON XE for CICS on z/OS
KCA OMNIMON Base
KCC OMNIMON Base
KCF Candle Command Center for MQSeries® Configuration, IBM Tivoli OMEGAMON XE for WebSphere®
MQ, Generic Configuration, Configuration Tool
KCG OMEGAMON XE for IBM Cryptographic Coprocessors, Configuration Tool
KCI IBM Tivoli OMEGAMON XE for CICS on z/OS, Configuration Tool
KCN Configuration Tool, OMNIMON Base
KCO Tivoli Enterprise Monitoring Server
KCP Configuration Tool, IBM Tivoli OMEGAMON XE for CICS on z/OS
KCS OMEGAMON II for MVS
Appendix A. General problem determination for Tivoli OMEGAMON XE monitoring agents on z/OS 149
Table 7. Prefixes that might be displayed in message and trace files (continued)
Prefix Component
KD2 OMEGAMON II for DB2, Configuration Tool, IBM Tivoli OMEGAMON XE for DB2 Performance Expert
KD3 Configuration Tool, OMEGAMON XE for DB2, OMEGAMON XE for DB2 on z/OS
KD4 ITCAM for SOA
KD5 Configuration Tool, OMEGAMON XE for DB2 on z/OS, IBM Tivoli OMEGAMON XE for DB2
Performance Expert
KDB Configuration Tool, OMEGAMON II for DB2, IBM Tivoli OMEGAMON XE for DB2 Performance Expert
KDC IBM Tivoli Monitoring Services:Engine or ITMS:Engine
KDE IBM Tivoli Monitoring Services:Engine or ITMS:Engine
KDF OMEGAMON II for SMS, Configuration Tool, OMEGAMON II for IMS, Shared Probes
KDH IBM Tivoli Monitoring Services:Engine or ITMS:Engine
KDP Configuration Tool, OMEGAMON XE for DB2, OMEGAMON XE for DB2 on z/OS, IBM Tivoli
OMEGAMON XE for DB2 Performance Expert, OMEGAMON XE for DB2plex
KDS Tivoli Enterprise Monitoring Server, Configuration Tool
KDZ Configuration Tool
KEB OMNIMON Base
KED OMEGAMON II for MVS
KEF Tivoli Enterprise Monitoring Server
KEI OMEGAMON II for IMS
KEP OMEGAMON II for MVS
KET Configuration Tool, End to End, OMEGAMON II for Mainframe Networks
KEX Tivoli Enterprise Monitoring Server
KEZ Tivoli Enterprise Monitoring Server
KFA Tivoli Enterprise Monitoring Server
KFAA Tivoli Enterprise Monitoring Server
KFW Tivoli Enterprise Monitoring Server
KFX Configuration Tool, CASP File Transfer
KGL Tivoli Enterprise Monitoring Server
KHI Tivoli Enterprise Monitoring Server
KHL IBM OMEGAMON z/OS Management Console
KHO Tivoli Enterprise Monitoring Server
KI2 Configuration Tool, OMEGAMON II for IMS
KI3 Configuration Tool, OMEGAMON XE for IMS, IBM Tivoli OMEGAMON XE for IMS on z/OS
KI5 IBM Tivoli OMEGAMON XE for IMS on z/OS
KIA OMNIMON Base
KIB Tivoli Enterprise Monitoring Server
KID Configuration Tool, OMEGAMON II for IMS
KIE IBM Tivoli OMEGAMON XE for WebSphere InterChange Server
KIH Tivoli Enterprise Monitoring Server
KIN Configuration Tool
KIP IBM Tivoli OMEGAMON XE for IMS on z/OS, Configuration Tool, OMEGAMON XE for IMSplex,
OMEGAMON XE for IMS, IBM Tivoli OMEGAMON XE for IMS on z/OS
150 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Table 7. Prefixes that might be displayed in message and trace files (continued)
Prefix Component
KJI OMNIMON Base
KKC Configuration Tool
KKI Configuration Tool
KLB IBM Tivoli Monitoring Services:Engine or ITMS:Engine
KLC Tivoli Enterprise Monitoring Server, CL/CONFERENCE®
KLD IBM Tivoli Monitoring Services:Engine or ITMS:Engine
KLE IBM Tivoli Monitoring Services:Engine or ITMS:Engine
KLF IBM Tivoli Monitoring Services:Engine or ITMS:Engine
KLG Tivoli Enterprise Monitoring Server, CL/SUPERSESSION®
KLH CL/SUPERSESSION, IBM Tivoli Monitoring Services:Engine or ITMS:Engine
KLI Tivoli Enterprise Monitoring Server, CL/SUPERSESSION
KLS Tivoli Enterprise Monitoring Server, CL/SUPERSESSION
KLT IBM Tivoli Monitoring Services:Engine or ITMS:Engine
KLU IBM Tivoli Monitoring Services:Engine or ITMS:Engine
KLV IBM Tivoli Monitoring Services:Engine or ITMS:Engine
KLX IBM Tivoli Monitoring Services:Engine or ITMS:Engine
KLZ Tivoli Enterprise Monitoring Server
KM2 OMEGAMON II for MVS, Configuration Tool
KM3 IBM Tivoli OMEGAMON XE on z/OS, Configuration Tool, OMEGAMON XE for OS/390®, IBM Tivoli
OMEGAMON XE on z/OS
KM5 IBM Tivoli OMEGAMON XE on z/OS, IBM Tivoli OMEGAMON XE on z/OS
KMA Tivoli Enterprise Monitoring Server
KMC Candle Command Center for MQSeries Configuration, IBM Tivoli OMEGAMON XE for WebSphere
MQ, Configuration Tool, OMEGAMON XE for WebSphere MQ Configuration
KMH OMEGAMON II for MVS
KMQ Candle Command Center for MQSeries, Configuration Tool, OMEGAMON XE for WebSphere MQ
Monitoring
KMR OMEGAMON II for MVS
KMS Tivoli Enterprise Monitoring Server
KMV OMEGAVIEW®, Configuration Tool
KN3 IBM Tivoli OMEGAMON XE for Mainframe Networks, Configuration Tool
KNA IBM Tivoli NetView® for z/OS
KNS Tivoli Enterprise Monitoring Server
KNT Tivoli Enterprise Monitoring Server
KNV Tivoli Enterprise Monitoring Server
KNW Tivoli Enterprise Monitoring Server
KO2 Configuration Tool, OMEGAMON II for DB2, IBM Tivoli OMEGAMON XE for DB2 Performance Expert
KO4 Tivoli Enterprise Monitoring Server
KOB Configuration Tool, OMNIMON Base
KOC Configuration Tool, OMEGAMON II for CICS
KOCJ OMEGAMON II for CICS
Appendix A. General problem determination for Tivoli OMEGAMON XE monitoring agents on z/OS 151
Table 7. Prefixes that might be displayed in message and trace files (continued)
Prefix Component
KOE IBM Tivoli OMEGAMON XE on z/OS, Configuration Tool, OMEGAMON XE for OS/390 UNIX System
Services
KOG AF/OPERATOR, OMEGACENTER Gateway for MVS
KOI Configuration Tool, OMEGAMON II for IMS
KOM OMEGAMON II for MVS
KON OMEGAMON II for Mainframe Networks, Configuration Tool
KOQ Tivoli Enterprise Monitoring Server
KOR Tivoli Enterprise Monitoring Server
KOS Candle Command Center for Sysplex, IBM Tivoli OMEGAMON XE on z/OS, Configuration Tool,
OMEGAMON II for MVS, IBM Tivoli OMEGAMON XE on z/OS, OMEGAMON XE for Sysplex
KOX Tivoli Enterprise Monitoring Server
KOU Tivoli Enterprise Monitoring Server
KPD Configuration Tool, Tivoli Enterprise Monitoring Server
KPM OMEGAMON II for MVS
KPS Tivoli Enterprise Monitoring Server
KPT Tivoli Enterprise Monitoring Server
KPZ Configuration Tool
KQI CCC for MQSeries Integrator, IBM Tivoli OMEGAMON XE for WebSphere Integration Brokers,
Configuration Tool, Tivoli Enterprise Monitoring Server, OMEGAMON XE for WebSphere Message
Broker Monitoring
KQM Tivoli Enterprise Monitoring Server
KRA IBM Tivoli OMEGAMON XE on z/OS, Configuration Tool, Tivoli Enterprise Monitoring Server,
OMEGAMON XE for OS/390, IBM Tivoli OMEGAMON XE on z/OS
KRC OMEGAMON II for SMS
KRI OMEGAMON II for IMS
KRR CASP Conversion with XML
KRT Configuration Tool
KRU CASP Analyze and Gather, CASP Conversion with XML
KS3 IBM Tivoli OMEGAMON XE for Storage on z/OS, Configuration Tool
KSA Tivoli Enterprise Monitoring Server
KSB Shared Probes
KSD OMEGAVIEW
KSH Tivoli Enterprise Monitoring Server
KSJ OMEGAMON XE for WebSphere Application Server
KSL OMEGACENTER Gateway for MVS
KSM Tivoli Enterprise Monitoring Server
KSS Tivoli Enterprise Monitoring Server
KTN Tivoli Enterprise Monitoring Server
KTR Tivoli Enterprise Monitoring Server
KTV Tivoli Enterprise Monitoring Server
KTX Tivoli Enterprise Monitoring Server
152 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Table 7. Prefixes that might be displayed in message and trace files (continued)
Prefix Component
KUC CASP Universal Connector
KUD Tivoli Enterprise Monitoring Server
KUL Tivoli Enterprise Monitoring Server
KUM Tivoli Enterprise Monitoring Server
KUT Tivoli Enterprise Monitoring Server
KUX Tivoli Enterprise Monitoring Server
KVI Tivoli Enterprise Monitoring Server
KVT Tivoli Enterprise Monitoring Server
KVW IBM Tivoli NetView for z/OS
KWD Configuration Tool, OMEGAMON XE for OS/390
KWE Tivoli Enterprise Monitoring Server
KWO OMEGAVIEW II® for the Enterprise
KWW Configuration Tool, OMEGAMON XE for WebSphere Application Server
KXC Configuration Tool, CASP Analyze and Gather, CASP eBusiness Platform
KXD OMEGAMON II for MVS, IBM Tivoli OMEGAMON XE on z/OS
KXDF OMEGAMON II for MVS
KXM Configuration Tool, CASP Conversion with XML
KXO IBM Tivoli OMEGAMON XE on z/OS, CASP Access for WebSphere
KXS CASP eBusiness Platform, CASP Directory Services
KYN ITCAM for WebSphere, Tivoli Enterprise Monitoring Agent
KZ2 Configuration Tool
LAT OMEGAMON II for IMS
LSCX Classic OMEGAMON
ML OMEGAMON II for IMS
MRG OMEGAMON II for IMS
O2 OMEGAMON II for DB2
OB OMEGAMON Base
OBV OMEGAMON Base
OC OMEGAMON II for CICS
OGN OMEGAMON for VM
OM Classic OMEGAMON
OM2 OMEGAMON II for MVS
OMV OMEGAMON Base
OM0 Classic OMEGAMON
OMG AF/OPERATOR, OMEGACENTER Gateway for MVS
OR OMEGAMON II for IMS
OS OMEGAMON II for IMS
OTR OMEGAMON II for IMS
OV OMEGAMON for VM
PWA OMEGAMON II for IMS
Appendix A. General problem determination for Tivoli OMEGAMON XE monitoring agents on z/OS 153
Table 7. Prefixes that might be displayed in message and trace files (continued)
Prefix Component
REG OMEGAMON II for IMS
TRF OMEGAMON II for IMS
VEB OMEGAMON II for MVS
Tivoli Management Services V6.1 with Fix Pack 3 included a new tool, the Log and Trace Analyzer, that
helps you view, analyze and correlate log files. With the Log and Trace Analyzer, you can evaluate multiple
event and error logs with time synchronization. This tool makes it easier and faster to debug and resolve
problems within multi-tier systems by consuming data in the Common Base Event format and providing
specialized visualization and analysis of the data.
The Log and Trace Analyzer tool is launched from the Tivoli Enterprise Portal Event Tools view, which is
displayed as part of the Event Details workspace. You use the tool to view logs from Tivoli Enterprise
Portal Server or Tivoli Enterprise Monitoring Server
In addition to the Log and Trace Analyzer, specialized OMEGAMON adapters have been provided to aid in
problem determination for some of the more common problems that you might experience when using
Tivoli Management Services (Tivoli Enterprise Portal, Tivoli Enterprise Portal Server, and Tivoli Enterprise
Monitoring Server). The OMEGAMON adapters uses the Generic Log Adapter (GLA) to process
application log files and transform their contents into a common format for logging, management, and
problem determination and to facilitate communication between tools in a consistent way.
Additional information related to the Log and Trace Analyzer and the Generic Log Adapter is available at
http://www-128.ibm.com/developerworks/autonomic/probdet.html. OMEGAMON adapters and associated
documentation will be available for download from http://www.ibm.com/software/tivoli/
opal?NavCode=1TW10TM2U as they are developed.
154 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Appendix B. Historical data collection disk space
requirements
This chapter provides the system administrator with the following information about warehousing historical
data:
v Configuring data export for the Dataset Attribute feature
For Dataset Attribute tables, set the History Collection Interval and the Warehouse Interval to one hour.
Otherwise export of the data to the warehouse might occur at undesirable intervals.
v Basic record sizes for each of the tables from which data is collected.
The following assumptions govern Table 8 on page 156:
– Items in the table that are marked "Yes" in the "Eligible for warehouse?" column are eligible to be
warehoused in IBM Tivoli Data Warehouse. See IBM Tivoli Monitoring: Installation and Setup Guide
for information on setting up the warehouse.
– Space estimates apply to one managed system for a 24-hour period.
– Space estimates assume a 15-minute Resource Monitoring Facility (RMF) interval or 15-minute
collection interval, as appropriate.
– The following formula is used to estimate space requirements: ((60/15) x 24 x Record size x
frequency)
156
File name for Eligible for
Attribute history table historical data warehouse? Record size Frequency Estimated space requirement
Application Dataset APPL_DSDET Yes 142 bytes 1 record per data set per 5325 kilobytes (assumes 20 monitored
Details monitored application per applications with 20 active data sets each)
interval
Application Monitoring APPL Yes 198 bytes 1 record per monitored 371 kilobytes (assumes 20 monitored
application applications)
Cache Control Unit CACHE_CU No 276 - 1364 1 record per cache control 828 kilobytes (assumes 32 control units)
bytes. 276 + unit per RMF interval
(68 per raid
rank on 2105)
Channel Path CHAN_PATH No 148 bytes 1 record per channel path per 888 kilobytes (assumes 64 channel paths
RMF interval online)
DASD Volume DASDPDS No 808 bytes 1 record per logical volume 606000 kilobytes (assumes 8000 devices)
Performance, DASD per RMF interval
Volume Space, Cache
Devices *
Dataset Attribute DA_ALCSUM Yes 148 (1 record * Top N value) per 3 kilobytes (assumes 1 Dataset Attribute
Allocated Space Dataset Attribute collection collection cycle per 24 hours and default Top
Summary * cycle N value of 20)
Dataset Attribute DA_BLKSUM Yes 178 (1 record * Top N value) per 1 kilobytes (assumes 1 Dataset Attribute
Blocksize Distribution Dataset Attribute collection collection cycle per 24 hours)
Summary * cycle
158
File name for Eligible for
Attribute history table historical data warehouse? Record size Frequency Estimated space requirement
Dataset Attribute System DA_SYSSUM Yes 158 1 record * (number of SMS 0.4 kilobytes (assumes 1 Dataset Attribute
Summary * Data + Storage + collection cycle per 24 hours)
Management Classes +
Storage Groups) per Dataset
Attribute collection cycle
Dataset Attribute DA_UNCDTL Yes 394 1 record per Dataset Attribute 870 kilobytes (assumes 1 Dataset Attribute
Uncataloged Dataset collection cycle collection cycle per 24 hours, 250 volumes
Detail * with Uncataloged data sets and default Top N
value of 20)
Dataset Attribute DA_UNCSUM Yes 174 (1 record * Top N value * 30 kilobytes (assumes 1 Dataset Attribute
Uncataloged Dataset number of volumes with collection cycle per 24 hours and 250 volumes
Summary * Uncataloged data sets) per with Uncataloged data sets)
Dataset Attribute collection
cycle
Dataset Attribute DA_NRFSUM Yes 122 (1 record * number of 4 kilobytes (assumes 1 Dataset Attribute
Unreferenced Dataset volumes with Uncataloged collection cycle per 24 hours and default Top
Summary * data sets) per Dataset N value of 20)
Attribute collection cycle
Dataset Attribute Unused DA_UNUSUM Yes 190 (1 record * Top N value) per 3 kilobytes (assumes 1 Dataset Attribute
Space Summary * Dataset Attribute collection collection cycle per 24 hours and default Top
cycle N value of 20)
* See “Configuring data export for the Dataset Attribute feature” on page 155 for configuration tips.
160
File name for Eligible for
Attribute history table historical data warehouse? Record size Frequency Estimated space requirement
Symmetrix Devices SYM_DSK_DV No 104 - 32744 1 record per Symmetrix 15219 kilobytes (assumes 4 Symmetrix
bytes. 44 + storage facility per RMF storage facilities with 2024 devices each)
(20 per interval
device)
Symmetrix Directors SYM_DSK_DR No 196 - 8512 1 record per Symmetrix 1560 kilobytes (assumes 4 Symmetrix storage
bytes. 64 + storage facility per interval facilities with 64 directors each)
(132 per
director)
Tape Device TAPE_DEV Yes 115 bytes 1 record per tape device per 345 kilobytes (assumes 32 tape drives)
interval
Tape Group TAPE_GRP Yes 258 bytes 1 record per tape group per 193 kilobytes (assumes 8 tape groups)
interval
TotalStorageDS Array TDS_ARRAY No 124 bytes 1 record per TotalStorageDS 372 kilobytes (assumes 128 arrays)
array per RMF interval
TotalStorageDS TDS_CONFIG No 142 bytes 1 record per TotalStorageDS 53 kilobytes (assumes 4 TotalStorage® DS
Configuration storage facility per RMF storage facilities)
interval
TotalStorageDS Extent TDS_EXPOOL No 197 bytes 1 record per TotalStorageDS 591 kilobytes (assumes 32 extent pools)
Pool extent pool per RMF interval
TotalStorageDS Rank TDS_RANK No 210 bytes 1 record per TotalStorageDS 2520 kilobytes (assumes 128 ranks)
rank per RMF interval
The IBM Support Assistant saves you time searching product, support, and educational resources. The
IBM Support Assistant helps you gather support information when you need to open a problem
management record (PMR), which you can then use to track the problem.
If you cannot find the solution to your problem in the IBM Support Assistant, you can also check the
following Internet resources for information that might help you resolve your problem:
v Forums and news groups
v Google.com
For more information about the types of fixes that are available, see the IBM Software Support Handbook
at http://techsupport.services.ibm.com/guides/handbook.html.
162 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
9. Click Add products.
10. After selecting all products that are of interest to you, click Subscribe to email on the Edit profile
tab.
11. Select Please send these documents by weekly email.
12. Update your e-mail address as needed.
13. In the Documents list, select Software.
14. Select the types of documents that you want to receive information about.
15. Click Update.
If you experience problems with the My support feature, you can obtain help in one of the following ways:
Online
Send an e-mail message to erchelp@ca.ibm.com, describing your problem.
By phone
Call 1-800-IBM-4YOU (1-800-426-4968).
Before contacting IBM Software Support, your company must have an active IBM software maintenance
contract, and you must be authorized to submit problems to IBM. The type of software maintenance
contract that you need depends on the type of product you have:
v For IBM distributed software products (including, but not limited to, Tivoli, Lotus®, and Rational®
products, as well as DB2 and WebSphere products that run on Windows, or UNIX operating systems),
enroll in Passport Advantage® in one of the following ways:
Online
Go to the Passport Advantage Web site at http://www-306.ibm.com/software/howtobuy/
passportadvantage/pao_customers.htm .
By phone
For the phone number to call in your country, go to the IBM Software Support Web site at
http://techsupport.services.ibm.com/guides/contacts.html and click the name of your geographic
region.
v For customers with Subscription and Support (S & S) contracts, go to the Software Service Request
Web site at https://techsupport.services.ibm.com/ssr/login.
v For customers with IBMLink™, CATIA, Linux®, OS/390, iSeries™, pSeries®, zSeries, and other support
agreements, go to the IBM Support Line Web site at http://www.ibm.com/services/us/index.wss/so/its/
a1000030/dt006.
v For IBM eServer™ software products (including, but not limited to, DB2 and WebSphere products that
run in zSeries, pSeries, and iSeries environments), you can purchase a software maintenance
agreement by working directly with an IBM sales representative or an IBM Business Partner. For more
information about support for eServer software products, go to the IBM Technical Support Advantage
Web site at http://www.ibm.com/servers/eserver/techsupport.html.
If you are not sure what type of software maintenance contract you need, call 1-800-IBMSERV
(1-800-426-7378) in the United States. From other countries, go to the contacts page of the IBM Software
Support Handbook on the Web at http://techsupport.services.ibm.com/guides/contacts.html and click the
name of your geographic region for phone numbers of people who provide support for your location.
Submitting problems
You can submit your problem to IBM Software Support in one of two ways:
Online
Click Submit and track problems on the IBM Software Support site athttp://www.ibm.com/
software/support/probsub.html. Type your information into the appropriate problem submission
form.
By phone
For the phone number to call in your country, go to the contacts page of the IBM Software Support
Handbook at http://techsupport.services.ibm.com/guides/contacts.html and click the name of your
geographic region.
If the problem you submit is for a software defect or for missing or inaccurate documentation, IBM
Software Support creates an Authorized Program Analysis Report (APAR). The APAR describes the
problem in detail. Whenever possible, IBM Software Support provides a workaround that you can
implement until the APAR is resolved and a fix is delivered. IBM publishes resolved APARs on the
Software Support Web site daily, so that other users who experience the same problem can benefit from
the same resolution.
164 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Capturing z/OS logs to send to IBM Software Support
This section describes how to capture z/OS logs to send to IBM Software Support. To save a log to a file
rather than viewing it online, you need to know how to do the following:
v “Saving the contents of a z/OS log such as RKLVLOG”
v “Ending one RKLVLOG and starting another” on page 166
Then press Enter. A message in the upper right corner of the panel tells you how many lines have
been printed.
9. Type print close on the SDSF command line to close the file. The log is now saved in the data set
that was specified in Step 6 on page 165.
For more information about SDSF commands, see z/OS SDSF Operation and Customization (SA22-7670).
, FCB= fcb , FORM= form NO , MAXLINES= maxlines
HOLD=
YES
, UCS= ucs , USER= user , WTRNAME= wtrname
Where:
SWITCH
Is the keyword that dynamically allocates a new RKLVLOG file using the current values, begins
recording on the new file, and closes the current RKLVLOG file, releasing it for processing by JES.
class Is the one-character JES SYSOUT class. CLASS=A is the ITMS:Engine startup value.
copies Is the copy count. The valid range is 1-254. COPIES=1 is the startup value.
Note: If HOLD=YES is specified, you must issue the appropriate JES release command for the
SYSOUT data set to be processed by JES.
maxlines
Is the maximum number of lines to be written to RKLVLOG, in thousands (for example,
MAXLINES=2 means a maximum of 2000 lines). The valid range is 0 through 16000 (16 million
lines). When this number is reached, an automatic TLVLOG SWITCH is performed, closing the
current RKLVLOG and allocating a new one If the specified value is 0, there is no maximum; you
must manually enter TLVLOG SWITCH to switch log files. MAXLINES=0 is the startup value.
166 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Note: Unlike the other values, MAXLINES takes effect immediately. If the new MAXLINES value
is less than the number of lines that have already been written to the current RKLVLOG, a
switch is immediately performed.
ucs Specifies the 1-character to 4-character UCS name to be used. UCS=() is the startup value.
user Is the 1-8 character user ID to which the SYSOUT is to be spooled. Ignored if DEST is blank.
USER=() is the startup value.
wtrname
Is the 1-8 character external writer name to be used. WTRNAME=() is the startup value.
Usage Notes:
1. The TLVLOG command performs up to three functions, depending on the keywords that are specified.
Assuming that you selected all three functions, they are performed in the following order:
a. Updates the dynamic allocation values. With the exception of MAXLINES, these values are used
when the next dynamic allocation is performed. Values are updated whenever they are coded on
the command.
b. Lists the current dynamic allocation values. This is always done.
c. Switches RKLVLOGs. This is done only when SWITCH is specified on the command.
Note: You may update values and request a switch with the same command; the values are updated
first, then the switch is performed.
2. RKLVLOGs may be automatically closed after a certain number of records have been written to them,
similar to the MVS SYSLOG processing. Refer to the MAXLINES keyword for more information.
3. To set up an automatic RKLVLOG switch whenever the ITMS:Engine address space is started, add the
following command to your RKANCMD startup CLIST:
TLVLOG MAXLINES=nnn
This command causes RKLVLOG to be automatically closed and released to JES whenever nnn
thousands of lines have been written. If needed, you can add other installation-dependent values (for
example, CLASS) to this command.
4. Many diagnostic messages are recorded in RKLVLOG. If you set RKLVLOG to spin off automatically,
or if you explicitly switch RKLVLOG, you must ensure that the SYSOUT files are kept at least for the
life of the ITMS:Engine run, in case they are required for problem solving.
5. You might want to issue a TLVLOG SWITCH command after a problem occurs. This command spins off
the RKLVLOG data relating to the problem into a separate spool data set, which can be included as
part of the ITMS:Engine standard problem documentation. Be sure to include all previously spun-off
RKLVLOG files
6. Because RKLVLOG is managed with standard IBM data management routines, records are buffered
before being written. If you are viewing the currently active RKLVLOG with a product such as SDSF,
you will not see the latest messages. Issue the command FLUSH TLVLOG to force the current data
management buffer to be written. Do not use the TLVLOG SWITCH to spin off the current RKLVLOG for
this purpose, as it will unnecessarily fragment the messages recorded in RKLVLOG.
7. Unless you explicitly set a non-zero MAXLINES value, RKLVLOG will never automatically switch.
8. If any error occurs when writing to RKLVLOG, ITMS:Engine will issue a message and disable
RKLVLOG recording. However, messages will still be written to VIEWLOG and all active operator
interfaces. Depending on the error, you may be able to restart RKLVLOG by issuing a switch request.
Where:
string Is a character string to be echoed back to the operator screen where the ECHO command was
entered.
Usage Notes::
1. Use ECHO to verify that the ITMS:Engine operator facility is functioning properly and to force all
buffered messages to the log.
2. Even after an ECHO, log output may not be visible in JES3 systems. This is a result of the way JES3
manages spool buffers.
3. Enclosing string in single quotes is not necessary unless you want to preserve leading blanks.
168 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Appendix D. Notices
This information was developed for products and services offered in the U.S.A. IBM not offer the products,
services, or features discussed in this document in other countries. Consult your local IBM representative
for information on the products and services currently available in your area. Any reference to an IBM
product, program, or service is not intended to state or imply that only that IBM product, program, or
service be used. Any functionally equivalent product, program, or service that does not infringe any IBM
intellectual property right be used instead. However, it is the user’s responsibility to evaluate and verify the
operation of any non-IBM product, program, or service.
IBM have patents or pending patent applications covering subject matter described in this document. The
furnishing of this document does not give you any license to these patents. You can send license inquiries,
in writing, to:
For license inquiries regarding double-byte (DBCS) information, contact the IBM Intellectual Property
Department in your country or send inquiries, in writing, to:
The following paragraph does not apply in the United Kingdom or any other country where such
provisions are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATION
PROVIDES THIS PUBLICATION “AS IS” WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR
IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT,
MERCHANTABILITY, OR FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer
of express or implied warranties in certain transactions, therefore this statement not apply to you.
This publication might include technical inaccuracies or typographical errors. Changes are periodically
made to the information herein; these changes will be incorporated in new editions of the publication. IBM
make improvements and/or changes in the products and/or the programs described in this publication at
any time without notice.
Licensees of this program who want to have information about it for the purpose of enabling: (i) the
exchange of information between independently created programs and other programs (including this one)
and (ii) the mutual use of the information which has been exchanged, should contact:
IBM Corporation
2Z4A/101
11400 Burnet Road
Austin, TX 78758 U.S.A.
Such information be available, subject to appropriate terms and conditions, including in some cases,
payment of a fee.
The licensed program described in this document and all licensed material available for it are provided by
IBM under terms of the IBM Customer Agreement, IBM International Programming License Agreement, or
any equivalent agreement between us.
Intel, Intel Inside (logos), MMX, Celeron, Intel Centrino, Intel Xeon, Itanium, Pentium, and Pentium II Xeon
are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States, other
countries, or both.
Java and all Java-based trademarks and logos are trademarks or registered trademarks of Sun
Microsystems, Inc. in the United States, other countries, or both.
Linux is a trademark of Linus Torvalds in the United States, other countries, or both.
Microsoft, Windows, and the Windows logo are trademarks of Microsoft Corporation in the United States,
other countries, or both.
UNIX is a registered trademark of The Open Group in the United States and other countries.
Other company, product, and service names may be trademarks or service marks of others.
170 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Index
Special characters data collection (continued)
troubleshooting 115
!Trace in VTAMDATA, enabling 147
data missing in persistent data store 119
data row identifiers not exported 118
data set I/O collection, tuning 123
A data warehousing
abends logs 136
U200 Port in use message 114 data, collecting diagnostic 146
accessibility x Dataset Attributes Database
attributes checking for looping 129
space required for historical data collection 155 checking VTOC 130
checking warehousing 130
contrasted with DCOLLECT 129
B data collection 129
books problem determination 129
see publications vii, ix DCOLLECT contrasted with Dataset Attributes
browser client logs 135 Database 129
buffers, flushing log 168 DCS communications tracing 138
debugging, collecting data 146
!Trace in VTAMDATA 147
C disabling KDFDEVIN DEBUG 146
Candle and IBM terms xi enabling KDFDEVIN DEBUG 146
capturing log files for IBM Software Support 165 enabling STBDEBUG(X) 147
cmwras1.log 111 preferred dump options for SDATA 147
collecting diagnostic data 146 desktop client logs 134
collecting log files 134, 135 DFSMShsm space-size values exceeded 115
collection of monitoring data 115 diagnostic data, collecting 146
communications trace, enabling 145 directory names, notation xi
component prefixes, understanding 148 disk space requirements
components, messages for 5 historical data collection 155
Configuration Tool documentation
specifying startup console messages 145 IBM Tivoli Monitoring vii
specifying storage detail logging 145 OMEGAMON II for SMS ix
specifying trace logging 145 OMEGAMON XE for Storage on z/OS vii
Configuration Tool used to set up tracing 145 other resources viii
configuring trace logging 138 RedBooks viii
console dumps, setting a SLIP 147 drwtsn32.log 110
conventions dump, console, for debugging 147
terminology ix dumpcvt, ras1 subcommand 143
typeface x dynamic workspace linking 130
cross-product linking
problem determination 130
cross-product links missing 130 E
customer support 161 ECHO command for flushing log buffers 168
See Software Support education 161
see Tivoli technical training x
enabling storage allocation detail logging 116
D enabling summarization and pruning agent 120
data 118 ending RKLVLOG spool data set 166
generation of reports 118 environment variables for trace logging 138
historical 118 environment variables, notation xi
long-term 118 error conditions 125
real-time 118
short-term 118
data collection F
Dataset Attributes Database 129 features, messages for 5
problem determination 115 fixes, obtaining 162
172 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
log files (continued)
KFWRAS1.LOG 111
N
notation
KS3ACTCS 137
environment variables xi
locations 134
path names xi
RKLVLOG 137
typeface xi
RKLVLOG spool data set 166
RKLVSNAP 137
RKPDLOG 119, 137
Summarization and Pruning agent 136 O
timestamping 136 OMEGAMON II for SMS
Tivoli Data Warehouse 110, 112 library ix
Tivoli Enterprise Monitoring Server 136 OMEGAMON II for SMS messages
Tivoli Enterprise Monitoring Server on UNIX 111 KDF and KDFA prefix 55
Tivoli Enterprise Monitoring Server on Windows 111 KDFC prefix 71
Tivoli Enterprise Monitoring Server on z/OS 111 KDFD prefix 73
Tivoli Enterprise Portal 110, 111 KDFH to KDFL prefix 91
browser client 135 KDFS prefix 93
desktop client 134 KRC prefix 103
Tivoli Enterprise Portal Server 111, 136 OMEGAMON XE for Storage on z/OS
TLVLOG and flushing log buffers 168 library vii
user.dmp 110 OMEGAMON XE general issues 133
warehouse proxy 110, 112, 136 online publications
WAREHOUSELOG 137 accessing ix
z.OS components 110 opening RKLVLOG spool data set 166
logging ordering publications ix
overview 108 overview
storage detail 116 problem determination 105
logging contrasted with tracing 133
logs
RAS1 trace log 133 P
looping, checking for in Dataset Attributes path names, notation xi
Database 129 performance
Dataset Attributes Database 129
historical data collection 124
M problem determination 119, 123
maintenance Tivoli Data Warehouse 123
applying 107 troubleshooting 119, 123
maintenance of the persistent datastore 154 tuning data set I/O collection 123
manuals persistent data store problems 119
see publications vii, ix persistent datastore, maintenance of the 154
message IDs, searching for in Google 147 plugin1.4.2.trace file 135
messages preferred dump options 147
for product components or features 5 prefixes of monitoring components in logs 148
format 3 printing contents of RKLVLOG 165
format of, in logs 147 printing contents of z/OS logs 165
identifiers 3 problem determination 105
introduction 3 agent is running out of storage 116
KDF and KDFA prefix 55 capturing log files for IBM Software Support 165
KDFC prefix 71 collecting diagnostic data 146
KDFD prefix 73 !Trace in VTAMDATA 146
KDFH to KDFL prefix 91 KDFDEVIN DEBUG parameter 146
KDFS prefix 93 Preferred dump options 146
KRC prefix 103 STBDEBUG(X) 146
locations 3 communications trace 145
prefixes 148 component prefixes 148
Tivoli Data Warehouse 136 cross-product linking 130
types 3 cross-product links missing 130
monitoring agent data collection 115
problem determination 113 data reports 118
historical (long-term) data reports 119
monitoring data 115
Index 173
problem determination (continued) problem determination (continued)
data collection (continued) trace logging (continued)
real-time data 118 setting dynamically 142
short-term data 118 setup with Configuration Tool 145
data to collect 109 V4.1 workspace links to V3.1 workspaces 131
data warehousing logs 135 VTS data 115
Dataset Attributes Database 129 warehousing data 119
default port for TCP/IP profile 114 workspace data 115
describing problems 164 workspace links to prior product versions 131
determining business impact 164 z/OS system logs 137
dynamic workspace linking 130 problem determination flow, logging 133
error conditions 125 problem resolution 161
example, trace logging syntax 141 product features 129
format of RAS1 messages 147 PSP bucket
general issues for OMEGAMON XE 133 finding 107
historical data PTFs
summarization and pruning agent 120 obtaining 107
historical workspaces 113 publications vii
hubs, multiple 113 accessing online ix
identifiers for data rows not exported 118 ordering ix
information sources 105, 109
installation and configuration 113
Integrated Cryptographic Service Facility 113 R
KDC_DEBUG environment variable 138 ras1 command 143
KFWITM081E link target not found 130 RAS1 messages, format 147
log files 110 RAS1 trace log 133
monitoring agents RAS1 tracing 139
historical data collection 123 setup 139
remote procedure calls during warehousing 126 syntax 139
overview 105 trace levels 141, 142
performance 123 real-time data 118
persistent data store 119 record size
process 107 historical data collection 155
product features 129 remote procedure call error 126
RAS1 setup 139 reports 118
RAS1 syntax 139 Dataset Attributes Database 129
RAS1 trace levels 141 generation of 118
reproducible problems 134 historical data 118
RKANPARU 141 long-term data 118
setup trace logging with Configuration Tool 145 real-time data 118
sources of problems 134 short-term data 118
space-size values exceeded 91, 115 reproducible problems 134
SQL queries 119 return code 0, Take Action commands 113
startup console messages 145 RKANPAR member KDFDEVIN, debugging
storage detail logging 145 parameter 146
submitting problems 164 RKANPAR member KDFSYSIN, debugging
tape refresh interval 116 parameter 147
tips 105 RKANPARU member and trace logging 141
Tivoli Enterprise Monitoring Server 113 RKLVLOG
connection to wrong hub 113 flushing log buffers 168
Tivoli Enterprise Monitoring Server logs 135 printing contents of 165
Tivoli Enterprise Portal client problems 137 saving contents of 165
Tivoli Enterprise Portal Server logs 135 spool data set, ending one and starting another 166
Tivoli Enterprise Portal Server problems 137 RKLVLOG data storage messages 116
trace logging 138 RKLVLOG log 114
communications trace 145 RKLVLOG sysout data set or spool file 137
KDC_DEBUG environment variable 138 RKLVSNAP sysout data set or spool file 137
RAS1 setup 139 RKPDLOG 119
RAS1 syntax 139 RKPDLOG sysout data set or spool file 137
RAS1 trace levels 141
RKANPARU 141
174 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
S tape refresh interval 116
TCP/IP initialization and trace logging 138
S3DA commands for Dataset Attributes Database 129
TCP/IP profile
saving contents of RKLVLOG 165
problem determination 114
saving contents of z/OS logs 165
technical support 161
scheduling
terminology ix
summarization and pruning agent 120
terms, Candle and IBM xi
SDATA options for SLIP console dump 147
timestamped logs 136
SDSF print to database panel, for log output 165
tips
setting trace levels dynamically
problem determination 105
IBM Tivoli Monitoring Services console 142
Tivoli Data Warehouse
setting up trace logging 138
and Dataset Attributes Database 130
short-term data 118
database degraded 123
SLIP command to bypass memory dumps for U0001
gaps in historical data 123
abends 125
log files 112
SLIP console dumps 147
problem determination 119
software support 161
Tivoli Data Warehouse, messages for 136
Software Support
Tivoli Enterprise Monitoring Server
contacting 163
logs 136
describing problems 164
problem determination 113
determining business impact 164
Tivoli Enterprise Monitoring Server on UNIX
receiving weekly updates 162
log files 111
submitting problems 164
Tivoli Enterprise Monitoring Server on Windows
source of problems, determining 134
log files 111
space requirements
Tivoli Enterprise Monitoring Server on z/OS
historical data collection 155
log files 111
space-size values exceeded 91, 115
Tivoli Enterprise Portal
Specify Advanced Configuration Values panel
browser client logs 135
specifying startup console messages 145
desktop client logs 134
specifying storage detail logging 145
ENV file 124
specifying trace logging 145
log files 111
SQL queries 119
Tivoli Enterprise Portal client problems,
starting RKLVLOG spool data set 166
unreproducible 137
startup console messages, enabling 145
Tivoli Enterprise Portal Server
STBDEBUG(X) parameter 147
log files 111
storage allocation detail logging, enabling 116
logs 136
STORAGE command 116
Tivoli Enterprise Portal Server problems 137
storage debugging parameter STBDEBUG(X) 147
Tivoli Monitoring Services console
storage detail logging 116
setting trace levels dynamically 142
storage detail logging, enabling 146
Tivoli Monitoring Services Index for finding
storage for agent
consoles 142
troubleshooting 116
Tivoli OMEGAMON XE for Storage on z/OS
storage for monitoring agent
messages 5
problem determination 116
Tivoli software information center ix
summarization and pruning agent 120
Tivoli technical training x
enabling 120
TLVLOG and flushing log buffers 168
scheduling 120
Trace Analyzer tool, using 154
Summarization and Pruning agent
trace files
logs 136
component prefixes 148
support 161
trace levels, setting 141
support assistant 161
trace logging 138
support information x
communications trace 145
syntax
configuring RKANPARU 141
RAS1 tracing 139
environment variables 138
syntax of messages 3
example, distributed agent issues 141
example, proxy controller issues 141
example, trace logging syntax 141
T example, tracing Tivoli Enterprise Monitoring Server
Take Action commands requests 141
return code 0 113 KDC_DEBUG environment variable 138
unsuccessful 113 KDC_FAMILIES environment variable 138
Index 175
trace logging (continued) troubleshooting (continued)
RAS1 setup 139 space-size values exceeded 115
RAS1 syntax 139 SQL queries 119
RAS1 trace levels 141 startup console messages 145
setting levels dynamically 142 storage detail logging 145
setting up with Configuration Tool 145 tape refresh interval 116
trace logs tips 105
overview 108 Tivoli Enterprise Monitoring Server 113
tracing contrasted with logging 133 connection to wrong hub 113
training, Tivoli technical x Tivoli Enterprise Monitoring Server logs 135
troubleshooting 105 Tivoli Enterprise Portal client problems 137
agent is running out of storage 116 Tivoli Enterprise Portal Server 135
capturing log files for IBM Software Support 165 Tivoli Enterprise Portal Server problems 137
collecting diagnostic data 146 trace logging 138
!Trace in VTAMDATA 146 communications trace 145
KDFDEVIN DEBUG parameter 146 KDC_DEBUG environment variable 138
Preferred dump options 146 RAS1 setup 139
STBDEBUG(X) 146 RAS1 syntax 139
communications trace 145 RAS1 trace levels 141
component prefixes 148 RKANPARU 141
cross-product linking 130 setting dynamically 142
cross-product links missing 130 setup with Configuration Tool 145
data collection 115 V4.1 workspace links to V3.1 workspaces 131
data reports 118 VTS data 115
historical (long-term) data reports 119 warehousing data 119
monitoring data 115 workspace data 115
real-time data 118 workspace links to prior product versions 131
short-term data 118 z/OS system logs 137
data to collect 109 tuning data set I/O collection 123
data warehousing logs 135 typeface conventions x
Dataset Attributes Database 129
dynamic workspace linking 130
error conditions 125 U
example, trace logging syntax 141 U0001 abend 125
format of RAS1 messages 147 U200 Port in use message 114
general issues for OMEGAMON XE 133 UNIX-based systems, messages on 134, 136
historical data unsuccessful Take Action commands 113
summarization and pruning agent 120 user.dmp 110
historical workspaces 113 using the Log and Trace Analyzer tool 154
hubs, multiple 113
identifiers for data rows not exported 118
information sources 105, 109 V
installation and configuration 113 V4.1 workspace links to V3.1 workspaces 131
Integrated Cryptographic Service Facility 113 variables, notation for xi
KDC_DEBUG environment variable 138 viewing log files 3
KFWITM081E link target not found 130 volume identification for the U0001 abend 125
log files 110 VTAMDATA, enabling !Trace 147
monitoring agents VTOC and Dataset Attributes Database 130
remote procedure calls during warehousing 126 VTS data absent 115
overview 105
performance 123
persistent data store 119
process 107
W
warehouse proxy
product features 129
log files 112
RAS1 setup 139
logs 136
RAS1 syntax 139
WAREHOUSEID table 119
RAS1 trace levels 141
WAREHOUSELOG table 136, 137
reproducible problems 134
warehousing
RKANPARU 141
space requirements 155
setup trace logging with Configuration Tool 145
warehousing data 119
sources of problems 134
warehousing of Dataset Attributes Database 130
176 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Windows, messages on 134, 136
workspace linking 130
workspace links to prior product versions 131
workspaces
no data, missing data 115
no historical data 113
Z
z/OS log files
capturing 165
z/OS logs
printing contents of 165
saving contents of 165
z/OS system logs 137
z/OS, messages on 137
Index 177
178 IBM Tivoli OMEGAMON XE for Storage on z/OS: Problem Determination Guide
Printed in USA
SC32-1836-01