Fault data is available for managed chassis, module, and interface objects regarding the overall management connectivity and environmental aspects. Fault management functionality is supplemental to the processing of alarm notifications from the Cisco 10000 router. Some data the fault management windows provide lead to alarms, while other data is purely statistical and may not require further action. For information on the alarms supported, see "Alarms".
Not all the data which the fault management windows provide produce alarms. Alarms occur when specific system occurrences coincide with the definitions of SNMP traps. If the set trap data is met, Cisco EMF translates the trap data into an alarm. For further information on traps and alarms, see the "Alarms".
Fault information for both chassis and module objects provides availability data, including up time, the most recent object change and restart. In addition, module fault data indicates the operational status and the amount of free memory. Chassis fault data extends to environmental fault management information. Environmental fault management data displays in the form of four tables that report on the status of power supplies, voltage, temperature and fans within the chassis. Each table contains a column that indicates the current state of each testpoint. This can be either Normal, Warning, Critical, Shutdown or Not Present.
Interface fault management is only applicable to ATM interfaces. The data which displays consists of statistical count of errors the interface encounters, including total number of errors, transmit errors, SONET errors, and DS1/E1/DS3/E3 errors. Additional status information is available for managed interfaces on the device. Using the status indicators the corresponding windows provides, it is possible to determine if particular objects require attention
The Fault Management chapter covers the following:
The Chassis Fault Management window is a read-only window that provides fault information for a selected chassis.
To view the Chassis Fault Management window, proceed as follows:
Step 1 Right-click (on a relevant object icon in the Map Viewer window or from an object pick list) and choose Cisco 10000 Series Manager > Fault > (Chassis >) Fault Management. For information on which objects allow you to launch the Chassis Fault Management window, see "EM Windows".
The Chassis Fault Management window appears displaying the General tab.
Step 2 Select the Chassis for which you want to view fault data from the Chassis list box at left of the window.
Chassis-level fault information displays in the General tab as follows:
Up Time—The time after the network portion of the system was last re-initialized for the selected module
Last Changed Time—Displays the time the chassis hardware was last modified.
Last Restart Reason—The reason for the most recent system re-initialization for the selected module
Last Authentication Failure Address—The IP address for the last authentication failure for the selected module. The Last Authentication Failure Address field refers to the fact that the SNMP agent on the router has received a protocol message that is not properly authenticated. The IP address is the source of the message. This is a security issue which requires investigation.
An authentication failure occurs when the SNMP agent on the device receives a protocol message that is not properly authenticated.
Clock Source Status—Displays the configured clock source status.
The LED Status area displays colored indicators for the processor card and the Ethernet link status.
The Cisco Contact Details area displays contact resources.
Step 3 Click the Temperature tab.
The temperature details for the selected chassis appear.
The Temperature pane displays the following details for the core temperature status and the inlet temperature status:
Description—Textual information on temperature for the selected chassis
Status Value—Current status value of the temperature of the selected chassis
Threshold—Highest value associated with the object before a shutdown is initiated
Last Shutdown—Status of the chassis when shutdown was last initiated
State—Current temperature state of the selected chassis; possible state values can be Normal, Warning, Critical, Shutdown or Not Present
If required, use the More (arrow) button to view all of the information.
Step 4 Review the data on each tab as necessary.
Step 5 Choose File > Close to close the Chassis Fault Management window.
Module Fault Management
The Module Status window is a read-only window that provides fault information for a selected module.
To view the Module Status window, proceed as follows:
Step 1 Right-click (on a relevant object icon in the Map Viewer window or from an object pick list) and choose Cisco 10000 Series Manager > Fault > (Module >) Fault Management. For information on which objects allow you to launch the Module Status window, see "EM Windows".
The Module Status window appears.
Figure 6-3 Module Status Window
Step 2 Select a chassis from the Chassis list box at left of the window, then select a module from the Module list box.
Fault information for the selected module appears, along with Cisco contact resources. The Module Availability area displays the following:
Up Time—The time after the network portion of the system was last re-initialized for the selected module
Free Memory—The memory space (in bytes) currently unused by the selected module
Last Restart Reason—The reason for the most recent system re-initialization for the selected module
Last Authentication Failure Address—The IP address for the last authentication failure for the selected module
An authentication failure occurs when the SNMP agent on the device receives a protocol message that is not properly authenticated. The Last Authentication Failure Address field refers to the fact that the SNMP agent on the router has received a protocol message that is not properly authenticated. The IP address is the source of the message. This is a security issue which requires investigation.
Operational Status—The current operational status of the selected module; possible values are:
Up—The device recognizes the module and the module is operational
Down—The device does not recognize the module and the module is not enabled for operation
Standby—The module is enabled and is acting as standby. This value is only applicable for redundant modules.
The Cisco Contact Details area displays contact resources.
Step 3 Review the data as necessary.
Step 4 Choose File > Close to close the Module Status window.
Interface Fault and Status Management
The Interface Status window is a read-only window that provides fault information for a selected interface. The Interface Status window provides support to all interface types.
To view the Interface Status window, proceed as follows:
Step 1 Right-click (on a relevant object icon in the Map Viewer window or from an object pick list) and choose Cisco 10000 Series Manager > Fault > (Interface >) Fault Management. For information on which objects allow you to launch the Interface Status window, see "EM Windows".
The Interface Status window appears.
Figure 6-4 Interface Status Window
Step 2 Select a chassis from the Chassis list box at left of the window, select a module from the Module list box, then select an interface from the Interface list box.
Status information for the selected interface appears in the areas on the right. The Interface Details area displays the following:
Type—Displays the type of interface.
Description—Displays general information about the interface such as the product name and the version of the interface hardware/software.
Operational Status—Displays the current operational status of the interface. Possible values are:
Up—Indicates that the interface is ready to pass packets. If Admin Status is changed to up, then Operational Status should change to up if the interface is ready to transmit and receive network traffic.
Down—If Admin Status is down, the Operational Status should also be down.
Testing—While in test mode, no operational packets can be passed.
Unknown—Indicates that the current status can not be determined for some reason
Dormant—Indicates the interface is waiting for external actions.
NotPresent—Indicates that some component is missing (typically hardware.)
LowerLayerDown—Signifies the interface is down due to a state of lower layer interface.
Physical Address—Displays the interface's address at its protocol sub-layer. For example, an 802.x interface normally contains a MAC address. For interfaces that do not have such an address (such as a serial line), this object should contain an octet string of zero length.
Keep Alive—Indicates whether keep alives are enabled or disabled on this interface.
Line Protocol—Displays whether the line protocol is up or down.
Connector Present —Indicates whether the interface sublayer has a physical connector.If there is a physical connector "yes" is displayed if there is no connector then "no" is displayed.
The Last Change Details panel displays the following attributes:
Interface Last Change—Displays the value of system up time at the time the interface entered its current operational state. If the current state was entered prior to the last interface re-initialization of the local network management subsystem, then zero will be displayed.
Reason for Last Change—Displays the reason for the interface's last status change.
The Transmission Details panel displays the following attributes:
Speed—Displays an estimate of the interface's current bandwidth in bits per second.
High Speed—Displays an estimate of the interface's current bandwidth in units of 1,000,000 bits per second.
Maximum Transmission Unit—Displays the size of the largest packet which can be sent/received on the interface, specified in bytes.
Step 3 Review the data as necessary.
Step 4 Choose File > Close to close the Interface Status window.
If the EM provides additional technology-specific fault and status information for the interface you reviewed, you may proceed to one of the following sections:
Fault data for interfaces within the EM is limited to ATM interfaces. The ATM Interface Faults window is a read-only window which provides fault information for a selected ATM interface.
To view the ATM Interface Faults window, proceed as follows:
Step 1 Right-click (on a relevant object icon in the Map Viewer window or from an object pick list) and choose Cisco 10000 Series Manager > Fault > (Interface >) ATM > ATM Faults. For information on which objects allow you to launch the ATM Interface Faults window, see "EM Windows".
The ATM Interface Faults window appears.
Figure 6-5 ATM Interface Faults Window
Step 2 Select a chassis from the Chassis list box at left of the window, select a module from the Module list box, then select an interface from the Interface list box.
Fault information for the selected interface appears in the areas on the right. The General Errors area displays the following:
Transmit Message Errors—Specifies the number of Incorrect Messages transmitted on the interface. The Incorrect Messages counter reflects any sort of incorrect information in a message.
Detected Message Errors—Identifies the number of Incorrect Messages detected on the interface. The Incorrect Messages counter reflects any sort of incorrect information in a message.
SSCOP Errored PDUs—Displays the sum of invalid PDUs plus the PDUs that result in MAA error codes. Invalid PDUs are defined in SSCOP and consist of PDUs with incorrect length (MAA-ERROR code U); undefined PDU type code; or not 32-bit aligned. PDUs that result in MAA error codes are discarded.
The SONET Frame Errors area displays the following:
Path FEBE Errors—Number of G1 (path FEBE) errors on the physical interface.
Line FEBE Errors—Number of Z2 (line FEBE) errors on the physical interface.
Path Parity Errors—Number of B3 (BIP) errors on the physical interface.
Line Parity Errors—Number of B2 (BIP) errors on the physical interface.
Section Parity Errors—Number of B1 (BIP) errors on the physical interface.
The DS1/E1/DS3/E3 Errors area displays the following:
LCV Errors—Number of line code violations (BPV or EXZ) errors on the physical interface.
C-Bit Parity Errors—Number of C-Bit Parity errors on the physical interface.
P-Bit Parity Errors—Number of P-Bit Parity errors on the physical interface.
PLCP BIP Violations—Number of physical layer convergence procedure bit interleaved parity errors on the physical interface.
E1 CRC Errors—Number of E1 cyclic redundancy check errors on the physical interface.
DS1 Bit Errors—Number of DS1 bit errors on the physical interface.
Step 3 Review the data as necessary.
Choose File > Close to close the ATM Interface Faults window.
ATM Interface Status
To view the ATM Interface Status window for ATM, IP, or SONET interfaces, proceed as follows:
Step 1 Right-click (on a relevant object icon in the Map Viewer window or from an object pick list) and choose Cisco 10000 Series Manager > Fault > (Interface >) ATM > ATM Status. Refer to "EM Windows" for information on which objects allow you to launch the ATM Interface Status window.
The ATM Interface Status window appears.
Figure 6-6 ATM Interface Status Window
Step 2 Select a chassis from the Chassis list box at left of the window, select a module from the Module list box, then select an interface from the ATM Interface list box.
Status information for the interface selected displays. Data in the ATM Transmit Status area displays the following:
Available Cell Rate—Available cell rate (cells per second) for traffic sent out of the interface for the selected service category
Allocated Cell Rate—Allocated cell rate (cell per second) for traffic sent out of the interface for the selected service category
LED Status—Transmit LED status color indicator for the selected interface
Maximum Cell Transfer Delay—Maximum cell transfer delay estimated for connections transmitted from the interface and service category; applies only to the cbr and vbr-rt service categories. The units of this object are in microseconds
Peak To Peak Cell Delay Variation—Estimated peak to peak cell delay variation time (in microseconds) for cells of this service category that are transmitted from the interface; applies only to cbr and vbr-rt service categories
Cell Loss Ratio—Estimated cell loss ratio for cells of this selected service category that are transmitted from the interface. This ratio value is reflected as negative powers of ten (i.e., displayed values are integers to the tenth power, where a -8 cell loss ratio equals 10-8); applies only to cbr, vbr-rt, and vbr-nrt service categories
The ATM Receive Status area displays the following:
Available Cell Rate—Available cell rate (cells per second) for traffic received on the interface for the selected service category
Allocated Cell Rate—Allocated cell rate (cell per second) for traffic received on the interface for the selected service category
LED Status—Receive LED status color indicator for the selected interface
The Physical Layer Status area displays the following:
Physical Interface Status—Indicates the status of the physical interface. Applicable only when the interface's Admin Status is Up. Possible statuses include: normal, loss of service (los), loss of frame (lof), loss of cell delineation (loc), alarm indication signal (ais), yellowLine, yellowPath, loss of pointer (lop), idel, yellowAlarm, physical layer convergence procedure loss of frame (plcpLOF), plcpYellow, far-end receive failure (pathAis), and over current detector (ocd).
Clock Source Status—Indicates whether or not this interface is selected as the network clock source
Physical Port Type—Indicates the physical layer medium on the selected interface; other, cpu, Ethernet, DS3, or E3
The ATM Port Status area displays the following:
Number of VPCs—Number of active Virtual Path Connections (PVPs) for this interface
Number of VCCs—Number of VCCs (PVCs and SVCs) for this interface
Number of PVCs—Number of PVCs for this interface
Number of PVPs—Number of PVPs for this interface
Number of PCs—Number of Permanent Connections (virtual channels or virtual paths) for this interface
Number of SCs — Number of Switched Connections (virtual channels or virtual paths) for this interface
Total Connections—Total number of existing connections on the interface
NSAP Address—Network Service Access Point (NSAP) address of the interface
Admin Address—Address assigned for administrative purposes
ATM Address Type—Type of primary ATM address configured on this interface
Configured VP Interface—Number of configured virtual path interfaces on the physical interface
SVC Minimum VCI—Minimum value in the range of values from which VCIs are assigned to new SVCs
Active SVPs—Number of active Switched Virtual Paths (SVP) for the interface
Active SVCs—Number of active Switched Virtual Circuits (SVCs) for the interface
Bit Rate Type—Allows you to view data according the bit rate selection. Options are: cbr, vbrRt, vbrNrt, abr, and ubr.
Step 3 Review the data as necessary.
Step 4 Click Close to close the Action Report window.
Step 5 Choose File > Close to close the ATM Interface Status window.
SONET Interface Status
The presentation of SONET interface status information provides easy to decipher color indicators for several of the values. Possible color indicators which may display are green (OK, no errors), red (errors), or yellow (suppressed errors).
Error suppression occurs when an error in one field prevents data retrieval for another field. The following table lists the SONET status attribute suppression behavior rules for what happens when certain conditions arise. Examples of how to read the table and how the data the table displays related to the status color indicators on the Section, Line, Path, and Virtual Tributary tabs of the SONET Interface Status window follow.
Table 6-1 SONET Status Attribute Suppression Behavior
Tab In Window
Field
Id
Rule 1 (4)
Rule 2 (5)
Rule 3 (11)
Rule 4 (8)
Rule 5 (10)
Rule 6 (7)
Rule 7 (1)
Rule 8 (2)
Section
Loss of Signal
(1)
—
—
—
—
—
—
—
—
Section
Loss of Frame
(2)
—
—
—
—
—
—
S
—
Section
Defect
(3)
—
—
—
—
—
—
—
—
Line
Alarm Indication Signal
(4)
—
—
—
—
—
—
S
S
Line
Remote Defect Indication
(5)
S
—
—
—
—
—
S
S
Line
Defect
(6)
—
—
—
—
—
—
—
—
Path
Signal Label Mismatch
(7)
S
—
S
S
S
—
S
S
Path
STS-Alarm Indication Signal
(8)
S
—
S
—
—
—
S
S
Path
STS-Alarm Indication Signal
(9)
S
S
S
S
—
—
S
S
Path
Unequipped
(10)
S
—
S
S
—
S
S
S
Path
STS-Loss of Pointer
(11)
S
—
—
—
—
—
S
S
Path
Defect
(12)
—
—
—
—
—
—
—
—
"S" indicates that the attribute value is suppressed and the color indicator will be yellow, and "—" indicates that the attribute value is not suppressed.
For example, the Rule 1 column indicates that if item (4), Alarm Indication Signal, is asserted, that is, the color indicator is red, then items (5), (7), (8), (9), (10), and (11) are suppressed, that is, the color indicator is yellow. The fields are yellow because the data cannot be retrieved due to the indication of a failure by the field that is red.
To view the SONET Interface Status window for ATM, IP, or SONET interfaces, proceed as follows:
Step 1 Right-click (on a relevant object icon in the Map Viewer window or from an object pick list) and choose Cisco 10000 Series Manager > Fault > (Interface >) SONET. Refer to "EM Windows" for information on which objects allow you to launch the SONET Interface Status window.
The SONET Interface Status window appears displaying the Medium tab.
Figure 6-7 SONET Interface Status Window—Medium Tab
Step 2 Select a chassis from the Chassis list box at left of the window, select a module from the Module list box, then select an interface from the SONET Interface list box.
Status information for the interface selected displays. Data in the Medium area displays the following:
Type—Signal type used across the interface, SONET or SDH
Line Coding—Type of line coding used in the interface. Can be B3ZS for electrical SONET/SDH signals or NRZ/RZ for optical SONET/SDH signals. Possible values are: sonetMediumOther, sonetMediumB3ZS, sonetMediumCMI, sonetMediumNRZ, and sonetMediumRZ.
Line Type—Line type for the interface. Can be short range single mode, long range single mode, or multi-mode for fiber interfaces; for electrical interfaces, it can be coax or UTP; and for all other line types it will be other.
Valid Intervals—Number of previous (15-minute) intervals for which valid data is stored
Time Elapsed—Time elapsed (in seconds) after the start of the current error-measurement period. Includes partial seconds.
Figure 6-8 SONET Interface Status Window—Section Tab
The Section area displays (LED) status color indictors of green (OK), yellow (error suppression), or red (errored) for the following fields:
Loss of Signal—Displays the presence or absence of signal loss in the SONET section.
Loss of Frame—Displays the presence or absence of section frame loss in the SONET section.
No Defect—Displays the presence or absence of section defects.
Step 4 Click the Line tab.
The Line tab displays.
Figure 6-9 SONET Interface Status Window—Line Tab
The Line area displays (LED) status color indictors of green (OK), yellow (error suppression), or red (errored) for the following fields:
Alarm Indication Signal—Presence or absence of alarm signals in the SONET line
Remote Defect Indication—Presence or absence of remote defects in the SONET line
No Defect—Presence or absence of line defects
Step 5 Click the Path tab.
The Path tab displays.
Figure 6-10 SONET Interface Status Window—Path Tab
The Path area displays (LED) status color indictors of green (OK), yellow (error suppression), or red (errored) for the following fields:
Signal Label Mismatch—Presence or absence of signal label mismatch in the SONET path
STS - Alarm Indication Signal—Presence or absence of alarm signal in the SONET path
STS - Remote Defect Indication—Presence or absence of remote defects in the SONET path
STS - Loss of Pointer—Presence or absence of pointer loss in the SONET path
Unequipped—Presence or absence of path equipment errors
No Defect—Presence or absence of path defects
Step 6 Review the data as necessary.
Step 7 Choose File > Close to close the SONET Interface Status window.
DS3 Interface Status
To view the DS3 Interface Status window for DS3/E3 interfaces, proceed as follows:
Step 1 Right-click (on a relevant object icon in the Map Viewer window or from an object pick list) and choose Cisco 10000 Series Manager > Fault > (Interface >) DS3. Refer to "EM Windows" for information on which objects allow you to launch the DS3 Interface Status window.
The DS3 Interface Status window appears.
Figure 6-11 DS3/E3 Interface Status Window—Status Tab
Step 2 Select a chassis from the Chassis list box at left of the window, select a module from the Module list box, then select an interface from the DS3/E3 Interface list box.
Status information for the interface selected displays. Data in the DS3/E3 Status area displays the following:
Send Code—Indicates what type of code is being sent across the DS3/E3 interface by the device. (These are optional for E3 interfaces.) Possible values are:
NoCode—sending looped or normal data
LineCode—sending a request for a line loopback
PayloadCode—sending a request for a payload loopback (that is, all DS1/E1s in a DS3/E3 frame)
ResetCode—sending a loopback deactivation request
DS1LoopCode—requesting to loopback a particular DS1/E1 within a DS3/E3 frame
TestPattern—sending a test pattern.
Valid Intervals—Displays the number of previous near end intervals for which valid data was collected. The value displayed will be 96 unless the interface was brought online within the last 24 hours, in which case, the value will be the number of complete 15 minute near end intervals since the interface went on line.
Time Elapsed—Number of seconds that have elapsed since the beginning of the near end current error measurement period started. The valid range is 0 to 899 seconds.
Line Coding—Describes the variety of Zero Code Suppression used on this interface, which in turn affects a number of its characteristics. Possible values are Other, dsx3B3ZS, or e3HDB3. dsx3B3ZS and e3HDB3 refer to the use of specified patterns of normal bits and bipolar violations that are used to replace sequences of zero bits of a specified length.
No Error—Indicates the presence or absence of defects in the line.
Loss of Signal—Indicates the presence or absence of signal loss in the line.
Loss of Frame—Indicates the presence or absence of frame loss in the line.
Loopback State—Indicates whether or not the received signals are looped.
Rx Remote Alarm Indication—Indicates whether or not a remote alarm signal is being received.
Rx Alarm Indicate Signal—Indicates whether or not an alarm signal is being received.
Rx Test Code—Indication—Indicates whether or not a remote alarm signal is being transmitted.
Tx Remote Alarm Indication—Indicates whether or not a remote alarm signal is being transmitted.
Tx Alarm Indicate Signal—Indicates whether or not an alarm signal is being transmitted.
The Far End DS3 Status panel displays the following attributes:
Facility ID Code—Displays the code that identifies a specific Far End DS3 path.
Location ID Code—Indicates the Far End location identification code that describes the specific location of the equipment.
Unit Code—Indicates the Far End code that identifies the equipment location within a bay.
Valid Intervals—Displays the number of previous far end interval for which valid data was collected.
Time Elapsed—Displays the time elapsed since the current far end measurement period started.
Equip Code—Indicates the Far End equipment identification code that describes the specific device.
Step 3 Review the data as necessary.
Step 4 Choose File > Close to close the DS3 Interface Status window.
