Instrument System Problem-Solving
“Problem-solving” often refers to the solution of abstract problems, such as “word” problems in a mathematics class. However, in the field of industrial instrumentation it most often finds application in the form of “troubleshooting:” the diagnosis and correction of problems in instrumented systems. Troubleshooting is really just a form of problem-solving, applied to real physical systems rather than abstract scenarios. As such, many of the techniques developed to solve abstract problems work well in diagnosing real system problems. As we will see in this chapter, problem-solving in general and troubleshooting in particular are closely related to scientific method, where hypotheses are proposed, tested, and modified in the quest to discern cause and effect.
Like all skills, problem-solving may be improved with practice and persistence. The goal of this chapter is to outline several problem-solving tools and techniques.
Perhaps the most common mistake made by technicians attempting to diagnose a system problem is failing to gather data (i.e. taking measurements and performing simple system tests) during the troubleshooting process. Even a small amount of data gathered from a system may profoundly accelerate the process of diagnosis.
A colleague of mine has a very descriptive term for this poor habit: Easter-egging. The idea is that a technician goes about finding the problem in a system the same way they might go about searching for eggs hidden on Easter morning: randomly. With Easter egg hunting, the eggs could literally be hidden anywhere, and so there is no rational way to proceed on a search. In like manner, a technician who lacks information about the nature or source of a system problem is likely to hunt in random fashion for its source. Not only will this likely require significant time and effort, but it may very well fail entirely.
A much more efficient way to proceed is to gather new data with each and every step in the troubleshooting process. By “gathering data,” I mean the following:
• Taking measurements with test equipment (multimeter, pressure gauges, etc.)
• Observing equipment indicator lights
• Stimulating the system and observing its response(s)
• Using your other senses (smell, hearing, touch) to gather clues
• Documenting new data in a notepad to help track and analyze the results of your measurements and tests
The digital multimeter (DMM) is quite possibly the most useful tool in the instrument technician’s collection1. This one piece of test equipment, properly handled, yields valuable insight into the status and operation of many electrical and electronic systems. Not only is a good-quality multimeter capable of precisely indicating electrical voltage, current, and resistance, but it is also useful for more advanced tests. The subject of this section is how to use a digital multimeter for some of these advanced tests2. For all these tests, I suggest the use of a top-quality field multimeter. I am personally a great fan of Fluke brand meters, having used this particular brand for nearly my whole professional career.
The ability of these multimeters to accurately measure true RMS amplitude, discriminate between AC and DC signals, measure AC signals over a wide frequency range, and survive abuse both mechanical and electrical, is outstanding.
Many modern multimeters have a feature that records the highest and lowest measurements sensed during the duration of a test. On Fluke brand multimeters, this is called the Min/Max function. This feature is extremely useful when diagnosing intermittent problems, where the relevant voltages or currents indicating or causing the problem are not persistent, but rather come and go. Many times I have used this feature to monitor a signal with an intermittent “glitch,” while I attended to other tasks.
The most basic high-low capture function on a multimeter only tells you what the highest and lowest measured readings were during the test interval (and that only within the meter’s scan time – it is possible for a very brief transient signal to go undetected by the meter if its duration is less than the meter’s scan time). More advanced multimeters actually log the time when an event occurs, which is obviously a more useful feature. If your tool budget can support a digital multimeter with “logging” capability, spend the extra money and take the time to learn how this feature works!
My first “trick” is not a feature of a high-quality DMM so much as it is a solution to a common problem caused by the use of a high-quality DMM. Most digital multimeters exhibit very high input impedance in their voltage-measuring modes. This is commendable, as an ideal voltmeter should have infinite input impedance (so as to not “load” the voltage signal it measures). However, in industrial applications, this high input impedance may cause the meter to register the presence of voltage where none should rightfully appear.
Consider the case of testing for the absence of AC voltage on an isolated power conductor that happens to lie near other (energized) AC power conductors within a long run of conduit:
With the power switch feeding wire 5 in the open state, there should be no AC voltage measured between wire 5 and neutral (L2), yet the voltmeter registers slightly over 10 volts AC. This “phantom voltage” is due to capacitive coupling between wire 5 and wire 8 (still energized) throughout the length of their mutual paths within the conduit.
Such phantom voltages may be very misleading if the technician encounters them while troubleshooting a faulty electrical system. Phantom voltages give the impression of connection (or at least high-resistance connection) where no continuity actually exists. The example shown, where the phantom voltage is 10.3 volts compared to the source voltage value of 120 volts, is actually quite modest. With increased stray capacitance between the conductors (longer wire runs in close proximity, and/or more than one energized “neighboring” wire), phantom voltage magnitude begins to approach that of the source voltage3.
The equivalent circuit is shown here, with the DMM modeled as a 10 M resistance:
An analog voltmeter would never have registered 10.3 volts under the same conditions, due to its substantially lower input impedance. Thus, “phantom voltage” readings are a product of modern test equipment more than anything else.
The obvious solution to this problem is to use a different voltmeter – one with a much lesser input impedance. But what is a technician to do if their only voltmeter is a high-impedance DMM? Connect a modest resistance in parallel with the meter input terminals, of course! Fluke happens to market just this type of accessory4, the SV225 “Stray Voltage Adapter” for the purpose of eliminating stray voltage readings on a high-impedance DMM:
With the voltmeter’s input impedance artificially decreased by the application of this accessory, the capacitive coupling is insufficient to produce any substantial voltage dropped across the voltmeter’s input terminals, thus eliminating. The technician may now proceed to test for the presence of AC control signal (or power) voltages with confidence.
While the last multimeter “trick” was the elimination of a parasitic effect, this trick is the exploitation of that same effect: “phantom voltage” readings obtained through capacitive coupling of a high-impedance voltmeter to a conductor energized with AC voltage (with respect to ground). You may use a high-impedance AC voltmeter to perform qualitative measurements of ground-referenced AC power voltage by setting the meter to the most sensitive AC range possible, grounding one test lead, and simply touching the other test lead to the insulation of the conductor under test. The presence of voltage (usually in the range of millivolts AC) upon close proximity to the energized conductor will indicate the energization of that conductor.
This trick is useful for determining whether or not particular AC power or control wires are energized in a location where the only access you have to those wires is their insulating sheaths. An example of where you might encounter this situation is where you have removed the cover from a conduit elbow or other fitting to gain access to a wire bundle, and you find those wires labeled for easy identification, but the wires do not terminate to any exposed metal terminals for you to contact with your multimeter’s probe tips. In this case, you may firmly connect one probe to the metal conduit fitting body, while individually touching the other probe tip to the desired conductors (one at a time), watching the meter’s indication in AC millivolts.
Several significant caveats limit the utility of this “trick:”
• The impossibility of quantitative measurement
• The potential for “false negative” readings (failure to detect a voltage that is present)
• The potential for “false positive” readings (detection of a “phantom voltage” from an adjacent conductor)
• The exclusive applicability to AC voltages of significant magnitude (≥ 100 VAC)
Being a qualitative test only, the millivoltage indication displayed by the high-impedance voltmeter tells you nothing about the actual magnitude of AC voltage between the conductor and ground. Although the meter’s input impedance is quite constant, the parasitic capacitance formed by the surface area of the test probe tip and the thickness (and dielectric constant) of the conductor insulation is quite variable. However, in conditions where the validity of the measurement may be established (e.g. cases where you can touch the probe tip to a conductor known to be energized in order to establish a “baseline” millivoltage signal), the technique is useful for quickly checking the energization status of conductors where ohmic (metal-to-metal) contact is impossible.
For the same reason of wildly variable parasitic capacitance, this technique should never be used to establish the de-energization of a conductor for safety purposes. The only time you should trust a voltmeter’s non-indication of line voltage is when that same meter is validated against a known source of similar voltage in close proximity, and when the test is performed with direct metal-to-metal (probe tip to wire) contact. A non-indicating voltmeter may indicate the absence of dangerous voltage, or it may indicate an insensitive meter.
The presence of harmonic voltages5 in an AC power system may cause many elusive problems. Power-quality instruments exist for the purpose of measuring harmonic content in a power system, but a surprisingly good qualitative check for harmonics may be performed using a multimeter with a frequency-measuring function.
Setting a multimeter to read AC voltage (or AC current, if that is the quantity of interest) and then activating the “frequency” measurement function should produce a measurement of exactly 60.0 Hz in a properly functioning power system (50.0 Hz in Europe and some other parts of the world). The only way the meter should ever read anything significantly different from the base frequency is if there is significant harmonic content in the circuit. For example, if you set your multimeter to read frequency of AC voltage, then obtained a measurement of 60 Hz that intermittently jumped up to some higher value (say 78 Hz) and then back down to 60 Hz, it would suggest your meter was detecting harmonic voltages of sufficient amplitude to make it difficult for your meter to “lock on” to the fundamental frequency.
It it very important to note that this is a crude test of power system harmonics, and that measurements of “solid” base frequency do not guarantee the absence of harmonics. Certainly, if your multimeter produces unstable readings when set to measure frequency, it suggests the presence of strong harmonics in the circuit. However, the absence of such instability does not necessarily mean the circuit is free of harmonics. In other words, a stable reading for frequency is inconclusive: the circuit might be harmonic-free, or the harmonics may be weak enough that your multimeter ignores them and only displays the fundamental circuit frequency.
An aggravating source of trouble in analog electronic circuits is the presence of AC “noise” voltage superimposed on DC signals. Such “noise” is immediately evident when the signal is displayed on an oscilloscope screen, but how many technicians carry a portable oscilloscope with them for troubleshooting?
A high-quality multimeter exhibiting good discrimination between AC and DC voltage measurement is very useful as a qualitative noise-detection instrument. Setting the multimeter to read AC voltage, and connecting it to an signal source where pure (unchanging) DC voltage is expected, should yield a reading of nearly zero millivolts. If noise is superimposed on this DC signal, it will reveal itself as an AC voltage, which your meter will display.
Not only is the AC voltage capability of a high-quality (discriminating) multimeter useful in detecting the presence of “noise” voltage superimposed on analog DC signals, it may also give clues as to the source of the noise. By activating the frequency-measuring function of the multimeter while measuring AC voltage (or AC millivoltage), you will be able to track the frequency of the noise to see its value and stability.
Once on a job I was diagnosing a problem in an analog power control system, where the control device was acting strangely. Suspecting that noise on the measurement signal line might be causing the problem, I set my Fluke multimeter to measure AC volts, and read a noise voltage of several tenths of a volt (superimposed on a DC signal a few volts in magnitude). This told me the noise was indeed a significant problem. Pressing the “Hz” button on my multimeter, I measured a noise frequency of 360 Hz, which happens to be the “ripple” frequency of a six-pulse (three-phase) ACto- DC rectifier operating on a base frequency of 60 Hz. This told me where the likely source of the noise was, which led me to the physical location of the problem (a bad shield on a cable run near the rectified power output wiring).
Modern digital multimeters are fantastically capable measurement tools, but did you know they are also capable of generating simple test signals? Although this is not the design purpose of the resistance and diode-check functions of a multimeter, the meter does output a low DC voltage in each of these settings.
This is useful when qualitatively testing certain instruments such as electronic indicators, recorders, controllers, data acquisition modules, and alarm relays, all designed to input a DC voltage signal from a 250 ohm resistor conducting the 4-20 mA electronic transmitter signal. By setting a multimeter to either the resistance () or diode check function and then connecting the test leads to the input terminals of the instrument, the instrument’s response may be noted.
Of course, this is a qualitative test only, since multimeters are not designed to output any precise amount of voltage in either the resistance or diode-check modes. However, for testing the basic response of a process indicator, recorder, controller, data acquisition channel, DCS input, or any other DC-signal-receiving devices, it is convenient and useful. In every multimeter I have ever tried this with, the diode-check function outputs more voltage than the resistance measurement function6. This gives you two levels of “test signal” generation: a low level (resistance) and a high level (diode check). If you are interested in using your multimeter to generate test voltages, I recommend you take the time to connect your multimeter to a high-impedance voltmeter (such as another digital multimeter set to measure DC volts) and note just how much voltage your meter outputs in each mode. Knowing this will allow you to perform tests that are more quantitative than qualitative.
Often in the course of diagnosing problems in electrical and electronic systems, there is a need to temporarily connect two or more points in a circuit together to force a response. This is called “jumpering,” and the wires used to make these temporary connections are called jumper wires. More than once I have found myself in a position where I needed to make a temporary “jumper” connection between two points in a circuit, but I did not have any wires with me to make that connection. In such cases, I learned that I could use my multimeter test leads while plugged into the current-sensing jacks of the meter. Most digital multimeters have a separate jack for the red test lead, internally connected to a low-resistance shunt leading to the common (black) test lead jack. With the red test lead plugged into this jack, the two test leads are effectively common to one another, and act as a single length of wire.
Touching the meter’s test leads to two points in a circuit will now “jumper” those two points together, any current flowing through the shunt resistance of the multimeter. If desired, the meter may be turned on to monitor how much current goes through the “jumper” if this is diagnostically relevant.
An additional benefit to using a multimeter in the current-measuring mode as a test jumper is that this setting is usually current-protected by a fuse inside the meter. Applying jumper wires to a live circuit may harbor some danger if significant potential and current-sourcing capability exist between those two points: the moment a jumper wire bridges those points, a dangerous current may develop within the wire. Using the multimeter in this manner gives you a fused jumper wire: an added degree of safety in your diagnostic procedure.
1As a child, I often watched episodes of the American science-fiction television show Star Trek, in which the characters made frequent use of a diagnostic tool called a tricorder. Week after week the protagonists of this show would avoid trouble and solve problems using this nifty device. The sonic screwdriver was a similar tool in the British science-fiction television show Doctor Who. Little did I realize while growing up that my career would make just as frequent use of another diagnostic tool: the electrical multimeter.
2I honestly considered naming this section “Stupid Multimeter Tricks,” but changed my mind when I realized how confusing this could be for some of my readers not familiar with colloquial American English.
3I have personally measured “phantom” voltages in excess of 100 volts AC, in systems where the source voltage was 120 volts AC.
4Before there was such an accessory available, I used a 20 k high-power resistor network connected in parallel with my DMM’s input terminals, which I fabricated myself. It was ugly and cumbersome, but it worked well. When I made this, I took great care in selecting resistors with power ratings high enough that accidental contact with a truly “live” AC power source (up to 600 volts) would not cause damage to them. A pre-manufactured device such as the Fluke SV225, however, is a much better option.
5These are AC voltages having frequencies that are integer-multiples of the fundamental powerline frequency. In the United States, where 60 Hz is standard, harmonic frequencies would be whole-number multiples of 60: 120 Hz, 180 Hz, 240 Hz, 300 Hz, etc.
6There is a design reason for this. Most digital multimeters are designed to be used on semiconductor circuits, where the minimum “turn-on” voltage of a silicon PN junction is approximately 500 to 700 millivolts. The diode-check function must output more than that, in order to force a PN junction into forward conduction. However, it is useful to be able to check ohmic resistance in a circuit without activating any PN junctions, and so the resistance measurement function typically uses test voltages less than 500 millivolts.
- Disassembly of a sliding-stem control valve
- Instrumentation Documents - Process and Instrument Diagrams
- Instrumentation Documents - SAMA Diagrams
- Conservation Laws
- Analog Electronic Instrumentation
- Machine Vibration Measurement - Vibration Sensors
- Machine Vibration Measurement - Monitoring Hardware
- Machine Vibration Measurement - Mechanical Vibration Switches
- Signal Characterization
- Doctor Strangeflow, or how I learned to relax and love Reynolds numbers
- Practical Calibration Standards - Temperature Standards
- Practical Calibration Standards - Pressure Standards
- The International System of Units
- Practical Calibration Standards - Flow Standards
- Fluid Mechanics - Torricelli’s Equation
- Fluid Mechanics - Flow Through a Venturi Tube
- Elementary Thermodynamics - Temperature
- Elementary Thermodynamics - Heat
- Industrial Physics Terms and Definitions
- Elementary Thermodynamics - Heat Transfer
- Elementary Thermodynamics - Specific Heat and Enthalpy
- Positive Displacement Flowmeters
- Mathematics for Industrial Instrumentation
- True Mass Flowmeters
- Process/Instrument Suitability of Flowmeters
- Machine Vibration Measurement
- Continuous Analytical Measurement - Safety Gas Analyzers
- Industrial Physics for Industrial Instrumentation
- Metric Prefixes
- Dimensional Analysis for Industrial Physics
- Classical Mechanics
- Elementary Thermodynamics
- Fluid Mechanics
- Chemistry for Instrumentation
- Continuous Analytical Measurement - Conductivity Measurement
- Fluid Mechanics - Pressure
- Fluid Mechanics - Pascal's Principle and Hydrostatic Pressure
- Fluid Mechanics - Manometers
- Fluid Mechanics - Systems of Pressure Measurement
- Fluid Mechanics - Buoyancy
- Fluid Mechanics - Gas Laws
- Fluid Mechanics - Fluid Viscosity
- Fluid Mechanics - Reynolds Number
- Fluid Mechanics - Viscous Flow
- Fluid Mechanics - Bernoulli’s Equation
- Elementary Thermodynamics - Phase Changes
- Elementary Thermodynamics - Phase Diagrams and Critical Points
- Elementary Thermodynamics - Thermodynamic Degrees of Freedom
- Elementary Thermodynamics - Applications of Phase Changes
- Continuous Analytical Measurement - pH Measurement
- Continuous Analytical Measurement - Chromatography
- Continuous Analytical Measurement - Optical Analyses
- Chemistry - Terms and Definitions
- Chemistry - Atomic Theory and Chemical Symbols
- Chemistry - Periodic Table of Elements
- Chemistry - Electronic Structure
- Chemistry - Spectroscopy
- Practical Calibration Standards - Analytical Standards
- Chemistry - Formulae for Common Chemical Compounds
- Chemistry - Molecular Quantities
- Chemistry - Energy in Chemical Reactions
- Chemistry - Periodic Table of the Ions
- Chemistry - Ions in Liquid Solutions
- Chemistry - pH
- Final Control Elements - Control Valves
- Final Control Elements - Variable-Speed Motor Controls
- Principles of Feedback Control
- Basic Feedback Control Principles
- On/Off Control
- Proportional -Only Control
- Proportional-Only Offset
- Integral (Reset) Control
- Derivative (Rate) Control
- Summary of PID Control Terms
- P, I, and D Responses Graphed
- Different PID Equations
- Pneumatic PID Controllers
- Analog Electronic PID Controllers
- Digital PID Controllers
- Practical PID Controller Features
- Classified Areas and Electrical Safety Measures
- Concepts of Probability and Reliability
- Process Characterization
- Before You Tune...
- Quantitative PID Tuning Procedures
- Tuning Techniques Compared
- Process Safety and Instrumentation
- Notes to Students with Regards to Process Dynamics and PID Controller Tuning
- Basic Process Control Strategies
- Lessons in Instrumentation TOC
- Supervisory Control
- Cascade Control
- Ratio Control
- Relation Control
- Feedforward Control
- Feedforward with Dynamic Compensation
- Limit, Selector, and Override Controls
- Safety Instrumented Functions and Systems