|
This chapter explains how to isolate faults in the Cisco 6260 system. Most problems in a Cisco 6260 can be traced to one of the system field-replaceable units (FRUs), which include the following:
This chapter consists of three major sections:
All Cisco 6260 FRUs are hot swappable, except the PEM in configurations where only a single PEM is operating. However, hot swapping some FRUs causes an interruption in service. See Table 5-1.
Before using the troubleshooting tables in this chapter, make the following basic checks:
In certain situations, the troubleshooting tables in this chapter direct you to contact the Cisco Technical Assistance Center (TAC) for help. If you have a maintenance contract or if your hardware is under warranty, call the TAC at 800 553 2447 (North America only), 408 526 7209, or visit this URL for a worldwide list of TAC regional telephone numbers:
http://www.cisco.com/warp/public/687/Directory/DirTAC.shtml
Table 5-2 offers suggestions for problems that affect the entire Cisco 6260 system.
Symptom | Steps to Take |
---|---|
System fails to come up. |
1. Check the Power LED on the NI-2, the Status LEDs on the line cards, and the Input OK LED on each PEM. If all LEDs are off, or if the red Out Fail LED on either PEM is on, troubleshoot the PEMs. See the "Alarms" section. 2. If any green LEDs are on, the system has power. Check the STATUS LED on the NI-2 card. If the STATUS LED is off, refer to the "NI-2 Card Problems" section. 3. If the Cisco 6260 is set to boot from a remote device over the network, make sure the remote device is up, that its network connection is solid, and that it contains the boot file. (The Cisco 6260 tries to boot over the network for a configured period, usually 5 to 15 minutes. If it is unable to boot over the network, it will eventually boot from bootflash.) 4. Try to establish a console connection to the Cisco 6260. If you cannot connect, see the steps for the symptom You cannot establish a console or Telnet connection to the system.. 5. If you achieve a console connection |
You cannot establish a console or Telnet connection to the system. |
1. For a console problem, check the terminal settings against the list of settings in the "Connect a Console Terminal" section or the "Connect a Console Terminal" section. 2. For a Telnet problem: 3. For both console and Telnet problems: |
1. Enter the command show facility-alarm status. Note the affected slot and port, if any, and the description of the problem. 2. If no slot number is indicated, enter show environment all and examine the results for an indication of which FRU is at fault. Refer to the "FRU-Specific Problems" section for instructions on troubleshooting that FRU. 3. If ATM0/0, ATM0/1, ATM0/2, or ATM0/3 is indicated: 4. If a line card slot is indicated, consult the "NI-2 Card Redundancy Problems" section. | |
A trunk or subtending port fails to come up (OC-3c or E3). |
1. Check the cable connections at both ends. Refer to "" section to check pinouts. 2. To check the interface status and configuration, enter show interface atm slot#/port#. Check the following in the resulting display: DSLAM> configure terminal
Enter configuration commands, one per line.
End with CNTL/Z.
DSLAM(config-if)# int atm 0/1
DSLAM(config-if)# no shutdown
DSLAM(config-if)#
3. For an E3 interface: enter show controllers atmslot#/port#. Check the following in the resulting display: 4. Check the status and configuration of the interface at the far end. 5. If you need to run a loopback test, do the following: 6. In interface configuration mode, reset the trunk port by executing the shutdown command followed by the no shutdown command. 7. Replace the NI-2 card. 8. If the problem with an E3 interface persists, troubleshoot the I/O module. See the "I/O Module Problems" section. |
A trunk or subtending port fails to come up (E1). |
1. Verify that the trunk port selection is correct. 2. Check the cable connections at both ends. Refer to "Connector and Pinout Specifications," to check pinouts. 3. To check the interface status and configuration, enter show interface atm slot#/port#. Check the following information in the resulting display: DSLAM> configure terminal
Enter configuration commands, one per line.
End with CNTL/Z.
DSLAM(config-if)# int atm 0/2
DSLAM(config-if)# no shutdown
DSLAM(config-if)#
4. Enter show controllers atm slot#/port#. Check the following information in the resulting display: 5. Check the status and configuration of the interface at the far end. 6. If you need to run a loopback test to troubleshoot the E1 links, do the following tasks: 7. In interface configuration mode, reset the trunk port by executing the shutdown command followed by the no shutdown command. 8. Replace the NI-2 card. 9. If the problem with a T1/E1 interface persists, troubleshoot the network I/O module. See the "I/O Module Problems" section. |
A trunk or subtending port fails to come up (E1 IMA). |
1. Before checking IMA interface problems, troubleshoot the E1 links that are configured in the IMA group, as described in the previous section. Verify that the links are up. 2. Check an IMA interface status with the show ima interface atm0/imaX command, where X is the IMA interface ID (0 through 3). Look at the following items in the resulting display: 3. It can take several seconds for an IMA group to synchronize between two IMA systems. Wait 5 minutes after configuring or reconfiguring a group to allow the synchronization to occur. 4. If synchronization does not occur in any one link or in the group after several minutes, or links cannot be successfully added to an active group, and the above IMA parameters have been checked and are found to be correct, clear the interface with a clear interface atm0/imaX command. This resets the IMA group and starts the IMA synchronization process again with all links in the group. 5. To check the interface status and configuration, enter show interface atm slot#/imagroup#. Check the following information in the resulting display: DSLAM> configure terminal
Enter configuration commands, one per line.
End with CNTL/Z.
DSLAM(config-if)# int atm0/ima2
DSLAM(config-if)# no shutdown
DSLAM(config-if)#
6. In interface configuration mode, reset the port by executing the shutdown command followed by the no shutdown command. |
| 7. Replace the NI-2 card. 8. If the problem with an E1 interface persists, troubleshoot the I/O module. See the "I/O Module Problems" section. |
System overheats. | Troubleshoot the fan tray. See the "Fan Tray Problems" section. |
System experiences a clocking problem. | Troubleshoot the NI-2 card. See the "NI-2 Card Problems" section. |
System experiences a power problem. | Troubleshoot the PEMs. See the "Alarms" section. |
The following sections describe symptoms that might occur and the steps that you need to take if you experience problems with any Cisco 6260 FRU.
If you need to remove or replace an NI-2 card as part of the troubleshooting steps below, see "Upgrading and Maintaining the Cisco 6260 System," for instructions.
Symptom | Steps to Take |
---|---|
Power LED is off. | 1. Check the Status LEDs on the line cards and the Input OK LED on each PEM. If all LEDs are off, or if the red Out Fail LED on either PEM is on, troubleshoot the PEMssee the "PEM Problems" section. 2. If the line card STATUS LEDs are lit, remove the NI-2 card from its slot and check for bent or broken pins on both the card and the backplane. If you find damaged pins on the card, replace it. If you find damaged pins on the backplane, contact the Cisco TAC. |
Status LED is off, indicating that the NI-2 card failed to boot or failed its power-on self test. | Press the Reset button on the NI-2 card. If the problem persists, replace the card. |
Critical LED, Major LED, or Minor LED is on. | See the "System-Wide Problems" section. |
A trunk or subtending port fails to come up. | See the "System-Wide Problems" section. |
NI-2 card cannot be fully inserted into its slot. | Inspect connectors on both the card and the backplane, looking for obstructions, bent pins, or other damage. If you find damage to a line card connector, replace the line card. If you find damage to a backplane connector, contact the Cisco TAC. |
Table 5-4 provides information about symptoms and corrective actions related to NI-2 card cold redundancy problems. If you need to remove or replace an NI-2 card as part of the troubleshooting steps below, see "Upgrading and Maintaining the Cisco 6260 System," for instructions.
If you need to remove or replace a line card as part of the troubleshooting steps below, see "Upgrading and Maintaining the Cisco 6260 System," for instructions.
Symptom | Steps to Take |
---|---|
All LEDs are off. | 1. Check the Power LED on the NI-2 card and the Input OK LEDs on the PEMs. If none of the LEDS are lit, or if the red Out Fail LED on either PEM is lit, troubleshoot the PEMsee the "Alarms" section. 2. If the NI-2 card Power LED is off, remove the card from its slot and check for bent or broken pins on both the card and the backplane. If you find damaged pins on the card, replace it. If you find damaged pins on the backplane, contact the Cisco TAC. |
All ports on a card fail to come up (modems do not train). Status LED might be red, indicating that the line card failed to boot or failed its power-on self test. | 1. Enter the show ipc nodes command to find out whether there is a communication problem between the line card and the NI-2 card. There should be an entry in the resulting display for each line card ("SMB IP Slot n") and for the NI-2 card ("IPC Master"). If there is an entry for each card, go to step 4. 2. If one or more cards are not listed, enter show oir status. If the resulting display indicates that the card in question is loading new code, wait a few minutes and reenter the command. (Usually, 2 to 3 minutes is long enough to wait.) The card status should change to 3. Enter the command show dsl int atm slot#/port#. If the status says 4. Check the ALARM LEDs on the NI-2 card or enter show facility-alarm status to determine the alarm status of the system. If any alarms are indicated, see the "System-Wide Problems" section for instructions on how to troubleshoot alarms. 5. Enter the command show dsl status and examine the results to ensure that the card is configured to be in its current slot. (In the Names column of the resulting display, the slot number appears as part of the port ID. For example, in ATM19/2, the slot number is 19. Nothing is displayed for slots that are not configured.) If necessary, use the slot command to update the configuration, or move the card to the correct slot. If the line card is a 4xflexi1, it will not function unless you use the slot command to configure either CAP or DMT operation. 6. Reset the line card by disconnecting it from the backplane and reseating it in its slot. 7. Install the card in another slot. 8. If the problem persists, replace the line card. |
Port fails to come up (modems do not train), or port LED flashes continuously. | 1. Enter the command show dsl int atm slot#/port# to display the port configuration. Check the display to ensure that the port is properly provisioned. Make sure the port is configured to be running ("no shutdown" or IOS admin state = up). Also check the line status; if this reads "No CPE detected," troubleshoot the CPE device and the loop as described below under the symptom "You suspect a problem with the CPE or the subscriber loop." section. 2. In interface configuration mode, reset the port by executing the shutdown command followed by the no shutdown command. 3. Connect the subscriber to another port on the Cisco 6260. If the modems do not train, troubleshoot the CPE device and the loop as described below under the symptom "You suspect a problem with the CPE or the subscriber loop." section. If the modems train, go to the next step to troubleshoot the port that failed. 4. To test the modem on the line card, enter dsl test atmslot#/port# self. Results are displayed automatically after a few seconds. If the modem fails the test, replace the line card. |
1. Disconnect the local loop and replace it with a test setup that consists of a modem or CPE that is known to work, and a few thousand feet of wire. If the modems train over the shorter distance, the problem lies in the local loop or in the CPE. See the steps that follow. If the modems do not train, the port is probably at fault. Replace the line card. 2. Make sure that the CPE at the subscriber site is powered up. 3. Make sure that the CPE is compatible with the Cisco 6260, and that the software version running on the CPE is compatible with the software version running on the Cisco 6260. 4. Power cycle the CPE. When you turn the power on, the WAN Link LED on the CPE should blink. If the LED does not blink, check the CPE configurationif the interface is shut down, bring it up. 5. Perform a continuity check to find out if the cabling to the CPE is connected and intact. For example, if there is a phone on the line, check for a dial tone. 6. If there is no POTS, check DC resistance by shorting tip and ring at the remote end. 7. Make sure there are no load coils on the local loop. 8. Is the local loop too long? The maximum length range is 15,000 to 25,000 feet (4572 to 7620 meters). Within that range, wire gauge, crosstalk, and multiple bridge taps reduce the distance over which the modems can train. 9. Is the local loop too short? DMT modems train best over loops of several thousand feet. In a test situation with a loop just a few feet in length, the modem might fail to train. Add wire to the loop. 10. Replace the CPE. | |
Modems train at a low bit rate, modems retrain continuously, or the line experiences too many errors. |
1. Enter the command show dsl int atmslot#/port# to display the port configuration. Check the display to ensure that the port is properly provisioned. Look in particular for these statistics: 2. Crosstalk is caused by interference between services in adjacent cables. It affects random bits rather than chunks of data; upstream and downstream traffic can be affected differently. If crosstalk is increasing the bit error rate (BER), you can compensate in several ways: 3. If you experience impulse noise or clipping, both of which affect chunks of data rather than random bits, you can compensate by turning on or increasing interleaving and error correction. (However, note that this approach adds delay.) Use the dmt interleaving-delay command for interleaving. Use the dmt encoding-trellis command or the dmt check-bytes command for error correction. If you use dmt check-bytes and if the codeword size is not set to auto, you might need to use the dmt codeword-size command to adjust the codeword setting. |
Modems train at a low bit rate, modems retrain continuously, or the line experiences too many errors (continued). | 4. If errors or retraining occurs while the line is ringing, use the dmt interleaving-delay command to turn on interleaving. 5. In interface configuration mode, reset the port by executing the shutdown command followed by the no shutdown command. 6. Connect the customer to a different port on the Cisco 6260. If the modems train, replace the line card with the faulty port. 7. Troubleshoot the CPE device and the loop as described above under the symptom "You suspect a problem with the CPE or the subscriber loop." section. 8. Replace the line card. |
Card cannot be fully inserted into its slot. | 1. Remove the card and reinsert it, pushing firmly on both the top and the bottom of the faceplate. (The card might jam in the slot if you apply pressure to the top only.) If the chassis is full, you might need to push sideways to insert the card. 2. Inspect connectors on both the card and the backplane, looking for obstructions, bent pins, or other damage. If you find damage to a line card connector, replace the line card. If you find damage to a backplane connector, contact the Cisco TAC. |
Card experiences problems in one slot but operates normally in another. | There may be a fault in your backplane. Contact the Cisco TAC. |
14xflexi = quad-port flexi ATU-C line card |
If you need to remove or replace an I/O module as part of the troubleshooting steps below, see "Upgrading and Maintaining the Cisco 6260 System," for instructions.
Symptom | Steps to Take |
---|---|
A trunk port fails to come up. | See the "System-Wide Problems" section. |
A subtending port fails to come up. | See the "System-Wide Problems" section. |
An alarm relay or BITS circuit fails. | 1. Check the connection at the wire-wrap connector on the I/O module. See Table C-1 for the pin assignments of the wire-wrap connector. 2. Check the connection at the other end of the circuit. 3. For a BITS problem, troubleshoot the E1 line at the other end of the circuit. 4. Replace the I/O module (except in the case of a circuit breaker alarm problem). |
This message appears on the console or in the system log file: 00:00:28:%C6100-4-COOKIE: | 1. Make sure the software release running on your system is compatible with the hardware. The Cisco 6260 requires Cisco IOS Release 12.1(4)DA or greater. 2. Enter the command show hardware chassis. In the resulting display, look for data from the I/O module EEPROM. If the system can read the contents of the EEPROM, the I/O module is likely to be healthy. 3. If the I/O module is missing, install it. 4. If the I/O module is present, reseat it. First, turn off system power. Use a Phillips-head screwdriver to unfasten the screws that secure the I/O module cover, and pull the card off the connectors. Push it firmly back into place and tighten the screws. 5. If the problem persists, replace the I/O module. |
If you need to remove or replace a fan tray as part of the troubleshooting steps below, see "Upgrading and Maintaining the Cisco 6260 System," for instructions.
Symptom | Steps to Take |
---|---|
Fans do not run. | 1. Make sure the fan trays are fully inserted into the chassis and screwed in place. 2. Replace the fan tray. |
Fans run, but the system overheats. | 1. Make sure that the air intake vents at the bottom front of the chassis and the exhaust vents on the top of the chassis are free of blockages, as explained in the Ventilation. 2. Make sure that the ambient temperature and other environmental factors affecting the system are within the ranges specified in the "Environmental Requirements" section. 3. Make sure that all cards, blank faceplates, and covers are in place. The cooling system cannot operate effectively unless the chassis is fully enclosed. 4. Check the fan tray LEDs on the PEMs. If the LEDs show a problem, replace the indicated fan tray. 5. Check the air filter at the bottom of the fan tray, and if necessary clean or replace it. See the "Removing and Replacing the Fan Tray" section for instructions on cleaning or replacing the air filter. 6. Reduce the ambient temperature. |
Air filter is damaged, dirty, or clogged. | Refer to "Upgrading and Maintaining the Cisco 6260 System" for instructions on cleaning or replacing air filters. |
If you need to remove or replace a PEM as part of the troubleshooting steps below, see "Upgrading and Maintaining the Cisco 6260 System," for instructions.
Symptom | Steps to Take |
---|---|
Input OK LED on PEM fails to go on. | 1. Make sure the circuit breaker on the PEM is turned to the ON (1) position. 2. Make sure the PEM is properly seated in the chassis and screwed in place. 3. Make sure the power leads are properly connected to power connectors on the PEM. (If the connections are loose or their polarity is reversed on the DC PEM, the chassis does not receive power.) 4. Check the power cable for breaks, cracked insulation, loose lugs, and signs of wear. Replace the power cable if it is not in good condition. 5. Check the power source. 6. Turn the circuit breaker on the PEM to the OFF (0) position, and move it to the other PEM slot. If the PEM still fails, replace it. |
Out Fail LED on PEM goes on. | 1. Make sure the PEM is fully inserted into its slot and firmly screwed in place. 2. Replace the PEM. 3. If the problem persists, there may be a fault in your backplane. Contact the Cisco TAC. |
Circuit breaker on PEM trips. | A tripped circuit breaker indicates a serious overcurrent situation. The probable cause is a faulty backplane, a faulty power connector on the backplane, or a faulty PEM. Contact the Cisco TAC for assistance. |
PEM has problems in one slot but operates normally in the other. | There might be a fault in your backplane. Contact the Cisco TAC. |
Tables 5-9 through 5-20 describe alarms for the Cisco 6260. In each table, the text in the Alarm column is the text that appears in the description field of the alarm message. Alarm messages appear on the console screen as the alarms occur; to see a list of current alarms, enter the show facility-alarm status command.
Refer to the problem tables in this chapter for more detailed troubleshooting instructions.
The source of the OC-3c alarms in Table 5-13 is one of the following interfaces: ATM0/1 (the trunk) or ATM0/2 (the subtending interface).
The source of the E3 alarms in Table 5-14 is one of the following interfaces: ATM0/1 (the trunk), ATM0/2 (subtending interface), or ATM0/2 (subtending interface).
The source of the E1 alarms in Table 5-15 is one of the following interfaces: ATM0/2 through ATM0/9 (the trunk).
The source of the IMA link alarms in Table 5-16 is one of the following interfaces: ATM0/2 through ATM0/9.
Alarm | Severity | Description |
---|---|---|
LOS Detected | Critical | The IMA link has detected Loss of Signal at the framer. |
LOF Detected | Critical | The IMA link has detected a Physical Layer Convergence Procedure Loss of Frame error. |
AIS Received | Critical | The IMA link is receiving an Alarm Indication Signal. |
RAI Received | Critical | The IMA link is receiving a remote alarm indication. |
LCD | Critical | The IMA link is experiencing a loss of cell delineation. |
LIF1 | Critical | The IMA link is experiencing an LIF defect at the near end. |
LODS2 | Critical | The link differential delay between the link and the other links in the group is over the tolerable value for link differential delay. |
Rx Failed | Critical | A persistent detection of a defect at the receiver. The criteria for entering the condition are implementation specific. |
Tx Link Misconnected | Critical | The Tx link is not connected to the same far end IMA unit as the other Tx links in the group. The detection is implementation specific. |
Rx Link Misconnected | Critical | The Rx link is not connected to the same far end IMA unit as the other Rx links in the group. The detection is implementation specific. |
Persistent NE3 RDI-IMA | Critical | One of the available remote defect indicators (including IMA link specific defect) is in the link-related "Link Information" field. |
Rx Fault | Critical | Implementation specific Rx fault declared at the near end. |
Tx Fault | Critical | Implementation specific Tx fault declared at the near end. |
Tx Link UnusableFE4 | Critical | The far end is reporting that Tx is unusable. |
Rx Link UnusableFE | Critical | The far end is reporting that Rx is unusable. |
1LIF = loss of IMA frame 2LODS = link out of delay sync 3NE = near end 4FE = far end |
The source of the IMA group alarms in Table 5-17 is one of the following interfaces: ATM0/IMA0 through ATM0/IMA3.
Table 5-18 describes NI-2 card redundancy alarms.
Table 5-19 describes fan tray alarms.
Table 5-20 describes power alarms.
Posted: Tue Dec 10 09:43:36 PST 2002
All contents are Copyright © 1992--2002 Cisco Systems, Inc. All rights reserved.
Important Notices and Privacy Statement.