Skip Headers

Oracle9i Net Services Administrator's Guide
Release 2 (9.2)

Part Number A96580-02
Go to Documentation Home
Home
Go to Book List
Book List
Go to Table of Contents
Contents
Go to Index
Index
Go to Master Index
Master Index
Go to Feedback page
Feedback

Go to previous page Go to next page
View PDF

17
Troubleshooting Oracle Net Services

Oracle Net Services provides methods for understanding and resolving network problems through the use of log and trace files. These files keep track of the interaction between network components as errors occur. Evaluating this information will help you to diagnose and troubleshoot even the most complex network problems.

This chapter describes common network errors and outlines procedures for resolving them. It also describes methods for logging and tracing error information to diagnose and troubleshoot more complex network problems. This chapter contains these topics:

Diagnosing Oracle Net Services

If an attempt to make a basic peer-to-peer (single protocol network) connection returns an ORA Error, this section may help you diagnose the cause of the problem.

Any underlying fault, noticeable or not, is reported by Oracle Net Services with an error number or message that is not always indicative of the actual problem. This section helps you determine which parts of Oracle Net Services do function properly rather than the parts that do not work. It also helps you to decide in which of the following categories the fault belongs:

Testing the various network layers progressively should in most cases uncover any problem.

Server Diagnostics


Note:

You may need assistance from your server administrator to follow the instructions in this section.


Answer the following questions:

If you answered YES to any of the preceding questions/statements, then skip this section and continue to "Client Diagnostics".

If you are unsure, or answered NO to any of the preceding questions, then continue.

Diagnosing Oracle Net Services on the server involves the following tasks:

Task 1: Verify the Database Is Running

To check that the database is up, login to the database and connect with a valid username and password. For example:

SQLPLUS system/manager 

A message appears, confirming that you are connected with the database. If you receive the following errors, ask your Database Administrator to assist you:

Task 2: Perform a Loopback Test

To perform a loopback test from the server to the database:

  1. Ensure that the listener.ora, tnsnames.ora, and sqlnet.ora files exist in the correct locations, as described in "Localized Configuration File Support".
  2. Follow the instructions in "Testing Configuration on the Database Server" to perform a loopback test.
    • If the loopback test continues to fail, continue to the next step.
    • If the loopback test passes, skip to "Client Diagnostics".
  3. Check the Problem/Solution Database Web site at http://support.oracle.com for more specific information on the error received, or contact Oracle Worldwide Support.

Client Diagnostics

At this point, you know the serverside listener works properly, because you could verify at least one of the following statements:

To perform diagnostics on the client:

  1. Check that you have installed the same protocol support as was installed on the database server.

    On UNIX you can use the ADAPTERS utility to verify protocol support. On the database server, run the adapters 'which oracle' command from $ORACLE_HOME/bin to display the protocol support, naming methods, and security options linked with the oracle executable. The adapters utility displays output similar to the following:

    Oracle Net transport protocols linked with ./oracle are:
    
        IPC
        BEQ
        TCP/IP
        SSL
        RAW
    
    Oracle Net naming methods linked with ./oracle are:
    
        Local Naming (tnsnames.ora)
        Oracle Directory Naming
        Oracle Host Naming
        Oracle Names Server Naming
        NIS Naming
    
    Oracle Advanced Security options linked with ./oracle are:
    
        RC4 40-bit encryption
        RC4 56-bit encryption
        RC4 128-bit encryption
        RC4 256-bit encryption
        DES40 40-bit encryption
        DES 56-bit encryption
        3DES 112-bit encryption
        3DES 168-bit encryption
        AES 128-bit encryption
        AES 192-bit encryption
        AES 256-bit encryption
        MD5 crypto-checksumming
        SHA crypto-checksumming (for FIPS)
        SHA-1 crypto-checksumming
        Kerberos v5 authentication
        CyberSAFE authentication
        RADIUS authentication
        ENTRUST authentication
    
    

    On the client, run the adapters command from $ORACLE_HOME/bin to display the configured Oracle protocol support, naming methods, and security options. The ADAPTERS utility displays output similar to the following:

    Installed Oracle Net transport protocols are:
    
        IPC
        BEQ
        TCP/IP
        SSL
        RAW
    
    Installed Oracle Net naming methods are:
    
        Local Naming (tnsnames.ora)
        Oracle Directory Naming
        Oracle Host Naming
        Oracle Names Server Naming
        NIS Naming
    
    Installed Oracle Advanced Security options are:
    
        RC4 40-bit encryption
        RC4 56-bit encryption
        RC4 128-bit encryption
        RC4 256-bit encryption
        DES40 40-bit encryption
        DES 56-bit encryption
        3DES 112-bit encryption
        3DES 168-bit encryption
        AES 128-bit encryption
        AES 192-bit encryption
        AES 256-bit encryption
        MD5 crypto-checksumming
        SHA-1 crypto-checksumming
        Kerberos v5 authentication
        CyberSAFE authentication
        RADIUS authentication
    

    Note:

    RAW is an internal protocol used by Oracle Net.


    See Also:

    Oracle UNIX operating system-specific Administrator's Reference for further information about the adapters utility

  2. Check base connectivity for underlying network transport. Oracle Net technology depends on the underlying network for a successful connection.

    Protocol Verify that you can...

    TCP/IP

    Use terminal emulation or file transfer utilities, (PING, FTP, TELNET) from the client to the database server.

    Named Pipes

    • See other computers or servers on the Microsoft network.
    • Ensure that you are able to share drives within the network.
  3. To ensure that both the Oracle Net foundation layer and the appropriate Oracle protocol support are present, verify that all Oracle Net Services software for the client has been installed.
  4. Ensure that the client computer has the tnsnames.ora and the sqlnet.ora files exist in the correct locations.

    See Also:

    "Localized Configuration File Support"

    If you have any other working client computers connecting to the selected Oracle database, back up your existing files and copy both the working tnsnames.ora and sqlnet.ora files from the working computer onto the non-working client workstations. This eliminates the possibility of errors in the files.

  5. Test the Oracle Net foundation layer.

    See Also:

    "Testing Network Connectivity from the Client"


    Note:

    Do not use the TNSPING utility. The TNSPING utility works like the TCP/IP PING utility and does not create and open a socket, nor does it connect with the listener. It ensures that the listener is present on the database server.


  6. If the connection still fails:

Resolving the Most Common Error Messages for Oracle Net Services

Due to the complexity of network communications, network errors may originate from a variety of sources, for a variety of reasons. If an error occurs, applications such as SQL*Plus, that depend on network services from Oracle Net Services, will normally generate an error message.

A list of the most common network error messages follows:


ORA-12154: TNS:could not resolve service name

Cause: Oracle Net could not locate the net service name specified in the tnsnames.ora configuration file.

Action: Perform these steps:

  1. Verify that a tnsnames.ora file exists.

    See Also:

    "Localized Configuration File Support" for configuration file location information

  2. Verify that there are not multiple copies of the tnsnames.ora file.
  3. In the tnsnames.ora file, verify that the net service name specified in your connect string is mapped to a connect descriptor.
  4. Verify that there are no duplicate copies of the sqlnet.ora file.
  5. If you are using domain names, verify that your sqlnet.ora file contains a NAMES.DEFAULT_DOMAIN parameter. If this parameter does not exist, you must specify the domain name in your connect string.
  6. If you are not using domain names, and this parameter exists, delete it or disable it by commenting it out.
  7. If you are connecting from a login dialog box, verify that you are not placing an "@" symbol before your connect net service name.
  8. Activate client tracing and repeat the operation.

Cause: Oracle Net could not locate the database service name or net service name specified in the directory server.

Action: Perform these steps:

  1. Verify that the database service or net service name entry exists in the directory that this computer was configured to use.

    See Also:

    Chapter 8, "Setting Up Directory Server Usage" for directory setup instructions

  2. Verify that the sqlnet.ora file includes the following entry:
    NAMES.DIRECTORY_PATH=(ldap, other_naming_methods)
    

ORA-12170: TNS:Connect timeout occurred

Cause: The client failed to establish a connection and complete authentication in the time specified by the SQLNET.INBOUND_CONNECT_TIMEOUT parameter in the sqlnet.ora file. This error may be a result of network or system delays, or it may indicate that a malicious client is trying to cause a denial-of-service attack on the database server.

See Also:

"Configuring the Listener and the Oracle Database To Limit Resource Consumption By Unauthorized Users" for further information about setting the SQLNET.INBOUND_CONNECT_TIMEOUT parameter

Action: If the error occurred due to system or network delays that are normal for the particular environment, then perform these steps:

  1. Turn on tracing to determine where clients are timing out.

  2. Reconfigure the SQLNET.INBOUND_CONNECT_TIMEOUT parameter in sqlnet.ora to a larger value.

If you suspect a malicious client, then perform these steps:

  1. Locate the IP address of the client in the sqlnet.log file on the database server to identify the source.

    For example, the following sqlnet.log excerpt shows a client IP address of 10.10.150.35.

    Fatal NI connect error 12170.
    
      VERSION INFORMATION:
       TNS for Solaris: Version 9.2.0.2.0 - Production
       Oracle Bequeath NT Protocol Adapter for Solaris: Version 9.2.0.2.0 - 
    Production
       TCP/IP NT Protocol Adapter for Solaris: Version 9.2.0.2.0 - Production
      Time: 03-JUL-2002 13:51:12
      Tracing to file: /ora9i/trace/svr_13279.trc
      Tns error struct:
        nr err code: 0
        ns main err code: 12637
        TNS-12637: Packet receive failed
        ns secondary err code: 12604
        nt main err code: 0
        nt secondary err code: 0
        nt OS err code: 0
      Client address: 
    (ADDRESS=(PROTOCOL=tcp)(HOST=10.10.150.35)(PORT=52996))
    
    

    Beware that an IP address can be forged.

    If the timeout occurs before the IP address can be retrieved by the database server, then enable listener tracing to determine the client that made the request.

  2. Restrict access to the client. For example, you can configure parameters for access rights in the sqlnet.ora file.


ORA-12198: TNS:could not find path to destination

ORA-12203: TNS:unable to connect to destination

Cause: The client cannot find the desired database.

Action: Perform these steps:

  1. Verify that you have entered the net service name you wish to reach correctly.
  2. Verify that the net service name ADDRESS parameters in the connect descriptor.
  3. If using local naming, verify that the tnsnames.ora file is stored in the correct directory.

    See Also:

    "Localized Configuration File Support" for configuration file location information

  4. Verify that the listener on the remote node has started and is running. Enter:
    lsnrctl
    LSNRCTL> STATUS [listener_name]
    
    

    listener_name is the name of the listener defined in the listener.ora file. It is not necessary to identify the listener if you are using the default listener, named LISTENER.

    If the output indicates the listener is not running, try starting it with the command:

    LSNRCTL> START [listener_name]
    
    
  5. If you are connecting from a login box, verify that you are not placing an "@" symbol before your connect net service name.

ORA-12203: TNS:unable to connect to destination

Cause: ORA-12203 error is a generic error that often shields secondary errors.

Action: Check the latest sqlnet.log file for secondary ORA messages.

Cause: An invalid net service name was supplied in the connect string.

Action: Verify that the net service name supplied in the connect string exists in the tnsnames.ora file or directory server and the ADDRESS information for that net service name is valid. Ask yourself the following questions:

  • Is the SERVICE_NAME correct?
  • Is the HOST correct?
  • Is the PORT specified correct?

Cause: The tnsnames.ora file is not located in the proper directory.

Action: Make sure that the tnsnames.ora file is in the proper location.

See Also:

"Localized Configuration File Support" for configuration file location information

Cause: The (HOST=server_name) parameter for TCP/IP addresses is not consistent on the client and server computers.

Action: Ensure that the values for these parameter are the same on the server and client.

For TCP/IP, make sure that the HOST parameter in listener.ora on the server and in the tnsnames.ora file on the client point to the same name, or at least to names that are then translated to the same IP address by each system. This is especially important for servers with multiple IP addresses assigned to the various network interfaces on the server.

Cause: The destination system's listener is not listening.

Action: Verify that the remote system's listener is running. Enter:

lsnrctl
LSNRCTL> STATUS [listener_name]

listener_name is the name of the listener defined in the listener.ora file. It is not necessary to identify the listener if you are using the default listener, named LISTENER.

If the output indicates the listener is not running, try starting it with the command:

LSNRCTL> START [listener_name]

Cause: There are underlying network transport problems.

Action: Use the utilities supplied with the underlying networking protocol to verify that the protocol itself is functional. For example, with TCP/IP, try to ping the remote system.

Cause: The incorrect Oracle protocol for the selected networking protocol is installed. A missing protocol support driver usually produces the following errors in the sqlnet.log file or any client trace file:

  • ORA-12203
  • ORA-12538
  • ORA-00508

Action: Check that you have installed the appropriate Oracle protocol. On UNIX, you can run the ADAPTERS utility.

See Also:

"Client Diagnostics"


ORA-12224: TNS:no listener

Cause: The connection request could not be completed because the listener is not running.

Action: Perform these steps:

  1. Ensure that the supplied destination address matches one of the addresses used by the listener.
  2. Verify that this is not a version compatibility problem.

ORA-12533: TNS:illegal ADDRESS parameters

Cause: The protocol specific parameters in the ADDRESS section of the designated connect descriptor are incorrect.

Action: Correct the protocol address.

See Also:

Oracle9i Net Services Reference Guide for correct protocol syntax


ORA-12514: TNS:listener could not resolve SERVICE_NAME given in connect descriptor

Cause: The service name specified in the connect descriptor is incorrect, or the database service is not registered with the listener.

Action: Perform these steps:

  1. Check to make sure the SERVICE_NAME specified in the connect descriptor is correct.
  2. Ensure that the database instance is running. If the instance not running, start it so that it can register with the listener. You can use the Listener Control utility SERVICES command to see what services are currently registered with the listener.

    See Also:

    "SERVICES Command"


ORA-12520: TNS:listener could not find available handler for requested type of server

Cause: The type of service handler requested by the client is incorrect or not registered for the requested SERVICE_NAME/INSTANCE_NAME, or the database instance is not registered with the listener.

Action: If you suspect the problem is the wrong type of service handler, perform these steps:

  1. If (server=value) is set is in the connect descriptor, ensure that the value is set to the appropriate service handler type for the database, that is, dedicated for dedicated server or shared for dispatchers. You can use the Listener Control utility SERVICES command to see what service handlers are currently registered with the listener.

    See Also:

    "SERVICES Command"

  2. If USE_DEDICATED_SERVER is set to ON in the sqlnet.ora file, then ensure the database is configured to use dedicated servers. If it is not, set this parameter to off.
  3. Ensure that the database instance is running. If the instance not running, start it so that it can register with the listener.

ORA-12521: TNS:listener could not resolve INSTANCE_NAME given in connect descriptor

Cause: The INSTANCE_NAME in the connect descriptor is incorrect, or the database instance is not registered with the listener.

Action: Perform these steps:

  1. Check to make sure the service name specified in the connect descriptor is correct.
  2. Ensure the database instance is running. If the instance not running, start it so that it can register with the listener. You can use the Listener Control utility SERVICES command to see what instances are currently registered with the listener.

    See Also:

    "SERVICES Command"


ORA-12525: TNS:listener has not received client's request in time allowed

Cause: The client failed to complete its connect request in the time specified by the INBOUND_CONNECT_TIMEOUT_listener_name parameter in the listener.ora file. This error may be a result of network or system delays, or it may indicate that a malicious client is trying to cause a denial-of-service attack on the listener.

See Also:

"Configuring the Listener and the Oracle Database To Limit Resource Consumption By Unauthorized Users" for further information about setting the INBOUND_CONNECT_TIMEOUT_listener_name parameter

Action: If the error occurred due to system or network delays that are normal for the particular environment, then reconfigure the INBOUND_CONNECT_TIMEOUT_listener_name parameter in listener.ora to a larger value.

If you suspect a malicious client, then perform these steps:

  1. Locate the IP address of the client in listener.log to identify the source.

    For example, the following listener.log excerpt shows a client IP address of 10.10.150.35.

    03-JUL-2002 16:42:35 * <unknown connect data> * 
    (ADDRESS=(PROTOCOL=tcp)(HOST=10.10.150.35)(PORT=53208)) * establish * 
    <unknown sid> * 12525
    TNS-12525: TNS:listener has not received client's request in time 
    allowed
    TNS-12604: TNS: Application timeout occurred
    
    

    Beware that an IP address can be forged.

  2. Restrict access to the client. For example, you can configure parameters for access rights in the sqlnet.ora file.


ORA-12545: TNS:name lookup failure

Cause: The listener on the remote node cannot be contacted.

Action: Perform these steps:

  1. Verify that the ADDRESS in the tnsnames.ora file and the listener.ora file is correct.
  2. Verify that the listener on the remote node has been started. Enter:
    lsnrctl
    LSNRCTL> STATUS [listener_name]
    
    

    listener_name is the name of the listener defined in the listener.ora file. It is not necessary to identify the listener if you are using the default listener, named LISTENER.

    If the output indicates the listener is not running, try starting it with the command:

    LSNRCTL> START [listener_name]
    
    

ORA-12560: TNS:protocol adapter error

Action: The listener was unable to start a process connecting the user to the database server.

Cause: Perform these steps:

  1. Turn on tracing and repeat the operation.
  2. Evaluate the contents of the trace file to diagnose the problem.


ORA-3113: TNS:End of file on communication channel

Cause: An error has occurred on the database server.

Action: Check the alert_sid.log on the server. The location of alert_sid.log is specified by the BACKGROUND_DUMP_DEST initialization parameter.

Cause: An unexpected end of file was processed on the communication channel. This may be an indication that the communications link may have gone down at least temporarily; it may indicate that the server has gone down.

Action: You may need to modify your retransmission count.

See Also:

Oracle operating system-specific documentation for more information about troubleshooting this error


ORA-3121: No interface driver connection - function not performed

Cause: A SQL*Net version 1 prefix was erroneously used in the connect string.

Action: Do not use the following prefixes in the connect string.

  • T:
  • X:
  • P:

Cause: The username and password were specified from a client computer that had no local Oracle database installed.

Action: Specify a connect string.

Troubleshooting Directory Naming Errors

Directory naming issues associated with connectivity errors such as ORA-12154, ORA-12203, or ORA-12224 for database service or net service name entries in a directory server require analysis of the data. You can analyze the data contained within a directory server with the ldifwrite command line tool.

ldifwrite enables you to convert all or part of the information residing in a directory server to LDAP Data Interchange Format (LDIF). The ldifwrite tool performs a subtree search, including all entries following the specified distinguished name (DN), including the DN itself.

The ldifwrite tool syntax is as follows:

ldifwrite -c net_service_name/database_service -b base_DN -f ldif_file 
Table 17-1  ldapwrite Arguments
Argument Description

-c net_service_name/database_service

Specify the net service name or database service name that will connect you to the directory server.

-b base_DN

Specify the base of the subtree to be written out in LDIF format.

-f ldif_file

Specify the input file name.

The following example writes all the directory naming entries under dc=us,dc=acme,dc=com to the output1.ldi file:

ldifwrite -c ldap -b "dc=us,dc=acme,dc=com" -f output.ldif

Oracle Names LDAP Proxy Server Error Reporting

Errors in the region load operation will be reported in the Oracle Names server log file (names.log). These errors may range from failure to contact the directory server to errors with the query for all, some, or one of the records.

Some directories, such as Oracle Internet Directory, have limits on ldapsearch operations. There are settings in the directory server that limit the number of objects returned by the search and the amount of time spent performing a search.

Increasing Search Size Limit

The size limit specifies how many objects can be returned from a search. The default limit is 1000. If this limit is exceeded, you will see the following errors in the names.log file:

NNO-00062: cannot load domain data from configuration database
NNO-00850: Error: LDAP query returns 4

You can also use the ldapsearch command line tool to mimic what the Oracle Names server will do when it loads its region. The following syntax shows loading data from DN (dn:dc=acme,dc=com):

ldapsearch -p 389 -h host -b "dc=acme,dc=com" 
"(objectclass=orclNetService)(objectclass=orclService)"

After returning the allowed number of object, ldapsearch returns the following error message:

ldapsearch: Sizelimit exceeded

You can modify the size limit using the following sample LDIF file output. Enter the appropriate DN. In addition, set orclsizelimit high enough to allow for the number of databases defined in the region in the directory server, with a little room for future expansion.

dn:
changetype: modify
replace: orclsizelimit
orclsizelimit: 5000

Increasing the Search Time Limit

The time limit specifies the amount of time that can be spent performing a search. The default time limit is 10 seconds. Ten seconds is sufficient to query for roughly 1,000 object, which is sufficient for most searches. If the query exceeds the time limit, you will see the following errors in the names.log file:

NNO-00062: cannot load domain data from configuration database
NNO-00850: Error: LDAP query returns 105

You can modify the time limit using the following sample LDIF file output. Enter the appropriate DN.

dn:
changetype: modify
replace: orcltimelimit
orcltimelimit: 20

The time limit is applied at both the directory server and API levels. Therefore, in addition to resetting the directory server time limit, you will also need to set the TIMEOUT subparameter of NAMES.ADMIN_REGION. For example:

NAMES.ADMIN_REGION= 
 (REGION= 
  (TIMEOUT=20)
  (TYPE=ldap)
  (HOST=ldap_server)
  (PORT=389)
  (SUBTREE=(BASE=dc=acme,dc=com)))

Troubleshooting Tips from the Field for Oracle Net Services

Here are some tips you may find helpful when you are having difficulty diagnosing network problems:

Questions to Ask When Troubleshooting Oracle Net Services

Here are some questions to ask yourself when diagnosing a problem:

Troubleshooting Network Problems Using Log and Trace Files

Oracle Net Services provide detailed information about the source and context of problems as they arise. This information is generated and stored in log and trace files. The process of logging and tracing error information will help you to diagnose and resolve network problems.

Logging Error Information for Oracle Net Services

All errors encountered in Oracle Net Services are appended to a log file for evaluation by a network or database administrator. The log file provides additional information for an administrator when the error message on the screen is inadequate to understand the failure. The log file, by way of the error stack, shows the state of the software at various layers.

To ensure that all errors are recorded, logging cannot be disabled on clients or Names Servers. Furthermore, only an administrator may replace or erase log files. The log file for the listener also includes Audit Trail information about every client connection request, as well as most listener control commands.

This section contains these topics:

Oracle Net Error Stacks

Log files provide information contained in an error stack. An error stack refers to the information that is produced by each layer in an Oracle communications stack as the result of a network error. Figure 17-1 depicts the relationship among error stack components and Oracle Net.

Figure 17-1 Error Stack Components Mapped to Oracle Net

Text description of net81121.gif follows
Text description of the illustration net81121.gif


The error stack components in Figure 17-1 are described in Table 17-2.

Table 17-2  Error Stack Components
Error Stack Component Description

NI

Network Interface. This layer provides a generic interface for Oracle clients, servers, or external processes to access Oracle Net functions. The NI layer handles the "break" and "reset" requests for a connection.

NI uses the Network Routing (NR) layer to obtain network route information for pre-Oracle9i clients, and the Network Naming (NN) layer to resolve names to connect descriptors. For Oracle9i clients, NI goes directly to the Network Session (NS) layer.

NN

Network Naming (Oracle Names). This layer resolves connect identifiers to connect descriptors.

NS

Network Session (main and secondary layers). These layers receive requests from NI, and settle all generic computer-level connectivity issues, such as: the location of the server or destination (open, close functions); whether one or more protocols will be involved in the connection (open, close functions); and how to handle interrupts between client and server based on the capabilities of each (send, receive functions).

NS uses NR to route the network session to the destination and Network Authentication (NA) to negotiate any authentication requirements with the destination.

NR

Network Routing. This layer routes the network session to the destination.

NA

Network Authentication. This layer negotiates authentication and encryption requirements.

NT

Network Transport (main, secondary, and operating system layers). This layer maps Oracle Net foundation layer functionality to industry-standard protocols.

Example: Error Stack

As an example, suppose that a user of a client application tries to establish a connection with a database server using Oracle Net and TCP/IP, and the user enters:

sqlplus scott/tiger@hrserver.com 

The following error displays:

ORA-12203: TNS:Unable to connect to destination

This message indicates that the connection to the server failed because the database could not be contacted. Although the application displays only a one-line error message, an error stack that is much more informative is recorded in the log file by the network layer.

On the client side, the sqlnet.log file (Figure 17-2) contains an error stack corresponding to the ORA-12203 error.

Figure 17-2 sqlnet.log File

***********************************************************

Fatal OSN connect error 12203, connecting to:
 (DESCRIPTION=(CONNECT_DATA=(SID=trace)(CID=(PROGRAM=)
   (HOST=lala)(USER=sviavant)))(ADDRESS_LIST=(ADDRESS=
   (PROTOCOL=ipc)(KEY=trace))(ADDRESS=(PROTOCOL=tcp)
   (HOST=lala)(PORT=1521))))

VERSION INFORMATION:
TNS for SunOS:
Oracle Bequeath NT Protocol Adapter for SunOS:
Unix Domain Socket IPC NT Protocol Adaptor for SunOS: 
TCP/IP NT Protocol Adapter for SunOS:
  Tracing to file: /home/sviavant/trace_admin.trc
  Tns error struct:
    nr err code: 12203
    TNS-12203: TNS:unable to connect to destination
    ns main err code: 12541
    TNS-12541: TNS:no listener
    ns secondary err code: 12560
    nt main err code: 511
    TNS-00511: No listener
    nt secondary err code: 61
    nt OS err code: 0

Oracle Net Services Log File Names

Each Oracle Net Services component produces its own log file. Table 17-3 provides the default log file names and lists the components that generate the log files.

Table 17-3  Log Files
Log File Component

listener.log

Listener

names.log

Oracle Names Server

sqlnet.log

Client or Database Server

cmadm_pid.log on UNIX

cmadmpid.log on Windows NT

Oracle Connection Manager CMADMIN process

cman_pid.log on UNIX

cmanpid.log on Windows NT

Oracle Connection Manager CMGW process

Setting Logging Parameters

Parameters that control logging, including the type and amount of information logged, as well as the location where the files are stored, are set in the configuration file of each network component as described in Table 17-4.

Table 17-4  Location of Log Parameters
Network Component Configuration File

Oracle Connection Manager Processes

cman.ora

Listener

listener.ora

Oracle Names Server

names.ora

Client

sqlnet.ora

Database Server

sqlnet.ora

This section contains these topics:

sqlnet.ora Log Parameters

Table 17-5 describes the log parameters settings that can be set in the sqlnet.ora file.

Table 17-5  sqlnet.ora Log Parameters
sqlnet.ora Parameter Oracle Net Manager Field Description

LOG_DIRECTORY_CLIENT

Client Information: Log Directory

Establishes the destination directory for the client log file. By default, the client directory is the current working directory.

LOG_FILE_CLIENT

Client Information: Log File

Sets the name of the log file for the client. By default the log name is sqlnet.log.

LOG_DIRECTORY_SERVER

Server Information: Log Directory

Establishes the destination directory for the database server log files. By default the server directory is $ORACLE_HOME/network/log on UNIX and ORACLE_HOME\network\log on Windows NT.

LOG_FILE_SERVER

Not applicable

Sets the name of the log file for the database server. By default the log name is sqlnet.log.

listener.ora Log Parameters

Table 17-6 describes the log parameters settings that can be set in the listener.ora file.

Table 17-6  listener.ora Log Parameters
listener.ora Parameter Oracle Net Manager Field Description

LOG_DIRECTORY_listener_name and LOG_FILE_listener_name

Log File

Establishes the destination directory and file for the log file that is automatically generated for listener events. By default the directory is $ORACLE_HOME/network/log on UNIX and ORACLE_HOME\network\log on Windows NT, and the file name is defaulted to listener.log.

names.ora Log Parameters

Table 17-7 describes the log parameters settings that can be set in the names.ora file.

Table 17-7  names.ora Log Parameters
names.ora Parameter Oracle Net Manager Field Description

NAMES.LOG_DIRECTORY

Log Directory

Establishes the destination directory for log files. By default, the directory is $ORACLE_HOME/network/log on UNIX and ORACLE_HOME\network\log on Windows NT.

NAMES.LOG_FILE

Log File

Sets the name of the log file for the client. By default the log name is names.log.

cman.ora Log Parameters

Table 17-8 describes the log parameters settings that can be set in the cman.ora file.

Table 17-8  cman.ora Log Parameters
cman.ora Parameter Description

LOG_LEVEL

Establishes the level of logging. Five levels are supported:

  • 0--No log output
  • 1--Basic reporting
  • 2--RULE_LIST matching lookup reporting
  • 3--Relay blocking reporting
  • 4--Relay I/O counts reporting

The CMGW gateway process creates a log file called cman_pid.log on UNIX and cmanpid.log on Windows NT. The CMADMIN administrative process creates a log file called cmadm_pid.log on UNIX and cmadmpid.log on Windows NT.

Setting Logging Parameters in Configuration Files

Logging parameters for the sqlnet.ora file, listener.ora files and names.ora file can be set with the Oracle Net Manager. The cman.ora file logging parameters must be set manually.

See Also:

Oracle9i Net Services Reference Guide

To set logging parameters:

  1. Start Oracle Net Manager.

    See Also:

    "Starting Oracle Net Manager"

  2. Specify the log parameters:

    Log File Set logging parameters here...

    sqlnet.log

    1. In the navigator pane, expand Local > Profile.
    2. From the list in the right pane, select General.
    3. Click the Logging tab.
    4. Specify the settings.

    listener.log

    1. In the navigator pane, expand Local > Listeners.
    2. Select a listener.
    3. From the list in the right pane, select General.
    4. Click the Logging and Tracing tab.
    5. Specify the settings.

    names.log

    1. In the navigator pane, expand Oracle Names Servers.
    2. Select an Oracle Names server.
    3. From the list in the right pane, select Configure Server.
    4. Click the Adv. tab.
    5. Specify the log directory and file name.
  3. Choose File > Save Network Configuration.

Setting Oracle Net Log Settings During Runtime of Control Utilities

Logging can be set during runtime of control utilities. Note that setting logging with a control utility will not set parameters in the *.ORA files; the setting is only valid for the session of the control utility:

To set tracing for an Oracle Names server with Oracle Net Manager:

  1. Start Oracle Net Manager.

    See Also:

    "Starting Oracle Net Manager"

  2. In the navigator, expand the Oracle Names Servers.
  3. Select an Oracle Names server.
  4. From the list in the right pane, select Manage Server.
  5. Click the Logging tab.
  6. Specify the log directory and file name.
  7. Choose File > Save Network Configuration.

Using Log Files

To use a log file to diagnose a network error:

  1. Review the log file for the most recent error number you received from the application. Note that this is almost always the last entry in the log file.
  2. Starting from the bottom of the file, locate the first nonzero entry in the error report. This is usually the actual cause.
  3. If that error does not provide the desired information, review the next error in the stack until you locate the correct error information.
  4. If the cause of the error is still not clear, turn on tracing and repeat the statement that produced the error message.

Analyzing Listener Log Files

This section describes what is recorded in the listener log file, including:

Listener Log Audit Trail Information

The listener log file contains audit trail information that enables you to gather and analyze network usage statistics, as well as information indicating the following:

You can use Audit Trail information to view trends and user activity by first storing it in a table and then collating it into a report format. To import the data into a table, use an import utility such as SQL*Loader.

Format of the Listener Log Audit Trail

The audit trail formats text into the following fields:

Timestamp * Connect Data [* Protocol Info] * Event [* SID | Service] * Return 
Code

Properties of the audit trail are as follows:

Example: Listener Log Event for Successful Reload Request

The following output shows a log file excerpt with RELOAD command request.

14-JUL-2002 00:29:54 *
(connect_data=(cid=(program=)(host=sales-server)(user=jdoe))(command=stop)
(arguments=64)(service=listener)(version=135290880))
* stop * 0
Example: Listener Log Events for a Successful Connection Request

The following output shows a log file excerpt with a successful connection request.

14-JUL-2002 15:28:58 * 
(connect_data=(service_name=sales.us.acme.com)(cid=(program=)(host=sales-server)
(user=jdoe))) 
* (address=(protocol=tcp)(host=10.10.150.35)(port=41349)) * establish 
* sales.us.acme.com * 0 
Example: Listener Log Events for an Unsuccessful Connection Request

The following output shows a log file excerpt with a successful execution of the STATUS command by host sales-server, followed by an unsuccessful connection attempt by a client with an IP address of 10.10.150.35. This connection attempt resulted in an ORA-12525: TNS:listener has not received client's request in time allowed error message, which occurs when a client fails to complete its connect request in the time specified by the INBOUND_CONNECT_TIMEOUT_listener_name parameter in the listener.ora file. This client may be attempting a denial-of-service attack on the listener.

03-JUL-2002 16:41:57 * 
(CONNECT_DATA=(CID=(PROGRAM=)(HOST=sales-server)(USER=jdoe))(COMMAND=status)
(ARGUMENTS=64)(SERVICE=LISTENER)(VERSION=153092352)) * status * 0
03-JUL-2002 16:42:35 * <unknown connect data> * 
(ADDRESS=(PROTOCOL=tcp)(HOST=10.10.150.35)(PORT=53208)) * establish * 
<unknown sid> * 12525
TNS-12525: TNS:listener has not received client's request in time allowed
TNS-12604: TNS: Application timeout occurred

Listener Service Registration Event Information

The listener records service registration events. During service registration, the PMON process provides the listener with information about the following:

The service registration-related events listed in Table 17-9 are recorded in the listener.log file:

Table 17-9  Service Registration Event Log Information
Event Description

service_register

The listener received registration information for an instance.

service_update

The listener received updated registration information for a particular instance, such as dispatcher or instance load information.

service_died

The listener lost its connection to PMON. All registration information for the instance is discarded. Clients will be unable to connect to the instance until PMON registers it again.

Format of the Listener Service Registration Information

The service registration events are formatted into the following fields:

Timestamp * Event *  Instance Name * Return Code

Properties of service registration fields are as follows:

Example: Listener Log with Service Registration Events

The following example shows a log file with service registration events. Notice how the listener is able to receive a client request after a successful service_register event, but is unable to receive client requests after a service_died event.

------------------------------- 
14-JUL-2002 15:28:43 * service_register * sales * 0 
14-JUL-2002 15:28:43 * service_register * sales * 0 
14-JUL-2002 15:28:58 * 
(connect_data=(service_name=sales.us.acme.com)(cid=(program=)(host=sales-server)
(user=jdoe))) 
* (address=(protocol=tcp)(host=10.10.150.35)(port=41349)) * establish 
* sales.us.acme.com * 0 
14-JUL-2002 15:38:44 * service_update * sales * 0 
14-JUL-2002 15:38:44 * service_update * sales * 0 
14-JUL-2002 15:48:45 * service_update * sales * 0 
14-JUL-2002 15:48:45 * service_update * sales * 0 
14-JUL-2002 15:50:57 * 
(connect_data=(service_
name=sales.us.acme.com)(cid=(program=)(host=sales-server)(u
ser=jdoe))) 
* (address=(protocol=tcp)(host=10.10.150.35)(port=41365)) * establish 
* sales.us.acme.com * 0 
14-JUL-2002 15:51:26 * service_died * sales * 12537 
14-JUL-2002 15:51:26 * service_died * sales * 12537 
14-JUL-2002 15:52:06 * 
(connect_data=(service_
name=sales.us.acme.com)(cid=(program=)(host=sales-server)(u
ser=jdoe))) 
* (address=(protocol=tcp)(host=10.10.150.35)(port=41406)) * establish 
* sales.us.acme.com * 12514 
TNS-12514: TNS:listener could not resolve SERVICE_NAME given in connect 
descriptor  
--------------------------------

Listener Direct Hand-Off Information

The listener records direct hand-off events to dispatchers. These events are formatted into the following fields:

Timestamp * Presentation * Handoff  * Error Code

Properties of direct hand-off fields are as follows:

Example: Listener Log Event for Direct Hand-Off

A direct hand-off event in the log file is shown in the following example.

21-JUL-2002 10:54:55 * oracle.aurora.net.SALESHttp2 * handoff * 0

Analyzing Oracle Connection Manager Logs

Oracle Connection Manager generates two types of log files: one for its CMGW gateway process (cman_pid.log) and one for its CMADMIN administrative process (cmadm_pid.log).

Figure 17-3 and Figure 17-4 show examples of the log files.

Figure 17-3 cman_pid.log

(TIMESTAMP=20-JUL-2002 18:03:10)(EVENT=10)(VERSION=8.1.6.0.0)
(TIMESTAMP=20-JUL-2002 18:03:10)(EVENT=36)(rule_list= 
(rule=(src=spcstn)(dst=x)(srv=x)(act=accept)))
(TIMESTAMP=20-JUL-2002 18:03:10)(EVENT=32)(PARAMETER_LIST=(MAXIMUM_
RELAYS=1024)(RELAY_STATISTICS=no)(AUTHENTICATION_LEVEL=0)(LOG_LEVEL=1)(SHOW_TNS_
INFO=no)(ANSWER_TIMEOUT=0)(MAXIMUM_CONNECT_DATA=1024)(USE_ASYNC_
CALL=yes)(TRACING=no)(TRACE_DIRECTORY=default)(MAX_FREELIST_BUFFERS=0))
(TIMESTAMP=20-JUL-2002 18:03:10)(EVENT=34)(ADDRESS_LIST= 
(ADDRESS=(PROTOCOL=tcp)(HOST=)(PORT=1610)(QUEUESIZE=32)))
(TIMESTAMP=20-JUL-2002 18:03:12)(EVENT=38)(COMMAND=2)
(TIMESTAMP=20-JUL-2002 
18:03:27)(EVENT=26)(RLYNO=0)(SRC=(ADDRESS=(PROTOCOL=tcp)(HOST=spcstn.us.acme.c
om)(PORT=34758)))(DST=(ADDRESS=(PROTOCOL=tcp)(HOST=10.10.150.35)(PORT=1581)))
(TIMESTAMP=20-JUL-2002 18:03:43)(EVENT=28)(RLYNO=0)(SINCE=20-JUL-2002 
18:03:27)(STATISTICS=(IN=(BYTES=0)(PACKETS=0)(DCDS=0)(OUT=(BYTES=0)(PACKETS=0)(D
CDS=0)))

Figure 17-4 cmadm_pid.log

(TIMESTAMP=20-JUL-2002 18:03:09)(EVENT=Sent Admin Status to UI)
(TIMESTAMP=20-JUL-2002 18:03:10)(EVENT=CMan Registration)
See Also:

"Analyzing Listener Log Files" on page 17-26

cman_pid.log Event Codes

The cman_pid.log on UNIX and cmanpid.log on Windows NT reports events using event code numbers. The event code reported depends upon the log level set with the LOG_LEVEL parameter in the cman.ora file or with the Oracle Connection Manager Control utility command SET LOG_LEVEL. Table 17-10 explains what each of these event codes represents.

Table 17-10  cman_pid.log Log Level 1 Event Codes
Code Description

10

Gateway is starting up

12

Gateway is shutting down

14

Listening on protocol addresses

18

Answer failed

See Also: "Reasons for Event Code 18"

20

Refusing in-coming call

See Also: "Reasons for Event Code 20"

26

Relay is now open

28

Relay is now closed

30

Statistics report

32

<PARAMETER_LIST>

34

<ADDRESS_LIST>

36

<RULE_LIST>

38

Oracle Connection Manager Control utility command

40

Oracle Connection Manager Control utility command refused because the gateway is busy

42

Dead connection detected

44

Relay has timed out

11

Bad <ADDRESS_LIST> argument

13

Bad <PARAMETER_LIST> argument

15

Bad <RULE_LIST> argument

23