




Throughthewall frequency stepped imaging system utilizing near field multiple antenna positions, clutter rejection and corrections for frequency dependent wall effects 
7307575 
Throughthewall frequency stepped imaging system utilizing near field multiple antenna positions, clutter rejection and corrections for frequency dependent wall effects


Patent Drawings: 
(8 images) 

Inventor: 
Zemany 
Date Issued: 
December 11, 2007 
Application: 
11/156,948 
Filed: 
June 20, 2005 
Inventors: 
Zemany; Paul D. (Amherst, NH)

Assignee: 
BAE Systems Information and Electronic Systems Integration Inc. (Nashua, NH) 
Primary Examiner: 
Tarcza; Thomas H. 
Assistant Examiner: 
Chen; Shelley 
Attorney Or Agent: 
Tendler; Robert K. 
U.S. Class: 
342/22; 342/160; 342/453 
Field Of Search: 
342/159; 342/160; 342/162 
International Class: 
G01S 13/52; G01S 13/538 
U.S Patent Documents: 
5592170; 6252396; 6426718; 6799047; 2002/0175849; 2005/0080560; 2005/0208952 
Foreign Patent Documents: 

Other References: 
Seidel, Scott Y. 914 MHz Path Loss Prediction Models for Indoor Wireless Communications in Multifloored Buildings. Feb. 1992, IEEETransactions on Antennas and Propagation, vol. 40 No. 2, pp. 207217. cited by examiner. 

Abstract: 
Lower resolution and clutterprone twotone CW radars can have the displayed images dramatically improved by three techniques involved in the subject invention. The three techniques involved are the stepping of each of the multiple radars for readings at multiple frequencies, weighting the results to compensate for wallinduced distortions and differential image processing. In one embodiment, weights for each frequency counteract the distortion produced by particular wall. For differential image processing, temporal snapshots of the images are subtracted one from the other such that the result is only due to moving objects, thus to provide a dramatic display of the presence and position of moving individuals behind a wall. 
Claim: 
What is claimed is:
1. A method for improving the resolution and clutter resistance of twotone CW throughthewall radars employing signals at two frequencies, the radars detecting and plottingthe position of moving objects behind a wall, comprising the steps of: driving the throughthewall radars at a multiplicity of frequencies in a stepped fashion to obtain multiple radar readings at the multiple frequencies, said frequencies beingseparated by amounts to ensure detection of movement; detecting the phase difference between transmitted energy and returns to obtain phase differences; and, utilizing wallrelated weighting and averaging of the phase differences for improving rangeaccuracy, the wallrelated weighting weighting the results at each frequency to compensate for wallinduced distortions, the weighting being derived from the wall material characteristics and refractive index thereof, the wall material characteristicsand the refractive index thereof being determined empirically.
2. The method of claim 1, and further including the steps of: generating an image of the returns for each radar at a first time and at a second time; and, subtracting one image from the other such that what remains is a result of objectsmoving behind the wall, with images due to stationary objects having been canceled, thus to provide clutter rejection.
3. A method for improving the resolution and clutter resistance of twotone CW throughthewall radars employing signals at two frequencies, the radars detecting and plotting the position of moving objects behind a wall, comprising the stepsof: driving the throughthewall radars at a multiplicity of frequencies in a stepped fashion to obtain multiple radar readings at the multiple frequencies, said frequencies being separated by amounts to ensure detection of movement; detecting the phasedifference between transmitted energy and returns to obtain phase differences; and, utilizing wallrelated weighting and averaging of the chase differences for improving range accuracy, the wallrelated weighting weighting the results at each frequencyto compensate for wallinduced distortions, the weighting being derived from the wall material characteristics and refractive index thereof, the wall material characteristics and the refractive index thereof being estimated.
4. A method for improving the resolution and clutter resistance of twotone CW throughthewall radars employing signals at two frequencies, the radars detecting and plotting the position of moving objects behind a wall, comprising the stepsof: driving the throughthewall radars at a multiplicity of frequencies in a stepped fashion to obtain multiple radar readings at the multiple frequencies, said frequencies being separated by amounts to ensure detection of movement; detecting the phasedifference between transmitted energy and returns to obtain phase differences; and, utilizing wallrelated weighting and averaging of the phase differences for improving range accuracy, the wallrelated weighting weighting the results at each frequencyto compensate for wallinduced distortions, the weighting being derived from the wall material characteristics and refractive index thereof, the wall material characteristics and refractive index being derived from an autofocus process, with the weightsbeing determined when an object is in focus according to the autofocus process.
5. The method of claim 4, wherein the achievement of the focus in the autofocus process specifies the coefficient of refraction of the wall.
6. A method for improving the resolution and clutter rejection with respect to an image formed by the use of multiple multitone CW radars operating at multiple frequencies and positioned at different points about a building for the purpose ofdetecting the presence and location of a moving individual behind a building wall using throughthewall multitone CW radars, comprising the steps of: projecting multifrequency energy from CW radars at different locations relative to the building; generating for each radar an image using throughwall weighting and phase difference processing, the image depicting the position of a moving individual within the building at first and second times, the wallrelated weighting weighting the results ateach frequency to compensate for wallinduced distortions, the weighting being derived from the wall material characteristics and refractive index thereof, the wall material characteristics and the refractive index thereof being determined by one ofempirical analysis, estimation and autofocus; and, for each radar, subtracting one image from the other to remove the effect of returns from stationary objects within the building, thus to declutter a display of position of the moving individual.
7. The method of claim 6, and further including the step of frequency stepping each of the multitone radars.
8. The method of claim 7, and further including the step of averaging the results from projecting multiple frequencies through the wall.
9. The method of claim 7, and further including the step for each radar of applying a throughwall weight to returns at each of the frequencies, the weights being such as to compensate for wallinduced distortions.
10. A method for improving the resolution and clutter rejection with respect to an image formed by the use of multiple multitone CW radars operating at multiple frequencies separated by amounts to ensure detection of movement and positioned atdifferent points about a building for the purpose of detecting the presence and location of a moving individual behind building walls using throughthewall multifrequency CW radars, comprising the steps of: rendering from the outputs of all of saidmultitone radars a set of images derived at different times from returns from objects in the building in terms of the phase difference between transmitted energy and returns, weighting the phase difference results using throughwall weights andsubtracting one image from another to eliminate representations on the generated image that are the result of returns from objects in the building that are not moving, such that what is depicted by the display is only due to a moving object, whereby thelocation of moving individuals within the building can be robustly determined, the wallrelated weighting weighting the results at each frequency to compensate for wallinduced distortions, the weighting being derived from the wall materialcharacteristics and refractive index thereof, the wall material characteristics and the refractive index thereof being determined by one of empirical analysis, estimation and autofocus.
11. The method of claim 10, and further including the steps of frequencystepping each of the multifrequency radars and averaging the results such that the resolution of the range to a moving object is improved by averaging the results fromprojecting multiple frequencies through the wall and into the building.
12. The method of claim 11, and further including the step for each radar of applying a weight to returns at each of the frequencies, the weight being such as to compensate for wallinduced distortions, whereby resolution associated isincreased due to the effective sharpening of returns from objects within the building due to compensation produced by the weighting.
13. A system for reliably determining the presence and location of a moving individual behind a wall, comprising: a number of multitone CW throughthewall radars employing signals at multiple frequencies separated by amounts to ensuredetection of movement and located at different positions relative to the wall, said CW radars being driven at multiple frequencies and including processing for weighting the returns with throughwall weights, taking the phase difference betweentransmitted energy and returns at the different frequencies and averaging the results of the multiple frequencies returns to improve the range resolution of the radar; and, an autofocusing system for determining when a moving object is in focus, saidautofocusing system providing an output used for determining said weights.
14. The system of claim 13, wherein the throughwall weighting includes weighting the returns at each of said frequencies to compensate for wallinduced distortions, whereby the sharpness of the radar returns is increased by removingdistortions caused by said wall.
15. The system of claim 13, wherein said output of said autofocusing system includes the index of refraction of said wall used to determine said weights.
16. The system of claim 13, and further including a visual image generator coupled to said radar for generating sequential images from returns from objects in said building, a differential image processor for subtracting one sequential imagefrom the other and for outputting results only due to objects that have moved between the times associated with the different sequential images.
17. A method for improving the resolution and clutter resistance of twotone CW throughthewall radars that detect and plot the position of moving objects behind a wall, comprising the steps of: driving the throughthewall radars at amultiplicity of twotone frequencies in a stepped fashion to obtain multiple radar readings at the multiple frequencies; averaging the radar return results for improving range accuracy; and, weighting the results at each frequency to compensate forwallinduced distortions, the weighting being derived from the wall material characteristics and refractive index thereof, the wall material characteristics and the refractive index thereof being determined empirically.
18. A method for improving the resolution and clutter resistance of twotone CW throughthewall radars that detect and plot the position of moving objects behind a wall, comprising the steps of: driving the throughthewall radars at amultiplicity of twotone frequencies in a stepped fashion to obtain multiple radar readings at the multiple frequencies; averaging the radar return results for improving range accuracy; and, weighting the results at each frequency to compensate forwallinduced distortions, the weighting being derived from the wall material characteristics and refractive index thereof, the wall material characteristics and the refractive index thereof being estimated.
19. A method for improving the resolution and clutter resistance of twotone CW throughthewall radars that detect and plot the position of moving objects behind a wall, comprising the steps of: driving the throughthewall radars at amultiplicity of twotone frequencies in a stepped fashion to obtain multiple radar readings at the multiple frequencies; averaging the radar return results for improving range accuracy; and, weighting the results at each frequency to compensate forwallinduced distortions, the weighting being derived from the wall material characteristics and refractive index thereof, the wall material characteristics and refractive index being derived from an autofocus process, with the weights being determinedwhen an object is in focus according to the autofocus process.
20. The method of claim 19, wherein the achievement of the focus in the autofocus process specifies the coefficient of refraction of the wall.
21. A system for reliably determining the presence and location of a moving individual behind a wall, comprising: a number of multitone CW throughthewall radars located at different positions relative to the wall, said CW radars being drivenat multiple frequencies and including processing for averaging the returns at the multiple frequencies to improve the range resolution of the radar; and, an autofocusing system for determining when a moving object is in focus, said autofocusing systemproviding an output used for determining said weights.
22. The system of claim 21, wherein said output of said autofocusing system includes the index of refraction used to determine said weights. 
Description: 
FIELD OF THE INVENTION
This invention relates to throughthewall sensors and more particularly to the improvement on accuracy for those throughthewall sensors using twotone CW radars by frequency stepping the radars, weighting the results, and detecting motionthrough differential image formation techniques.
BACKGROUND OF THE INVENTION
As described in PCT Patent Application Ser. No. US2004/036446 filed Nov. 2, 2004 entitled Dual Frequency Throughthewall Motion Detection and Ranging Using DifferenceBased Estimation Technique, invented by Paul Zemany and Eldon Sutphin, andas described in patent application Ser. No. 11/121,787 filed May 3, 2005, multiple dual frequency radars spaced about a building have been used to localize the position of a moving individual in the building so as to provide information about thewhereabouts of personnel, whether it is for the purpose of rescue, such as for firefighters, EMTs and the like, or to pinpoint enemy personnel in a building.
The above patent applications, incorporated herein by reference and assigned to the assignee hereof, describe the use of a multitone set of radars that detect and define the range to a moving object behind a wall, with triangulation techniquesused to detect and track the moving object as it moves within the building or behind a wall.
Multitone CW radars are used, in which the two tones are fairly close together, with it being possible by analyzing the returns from moving objects to determine the range of the object to the various radar transmitters. By using multipletransmitters one can triangulate to be able to pinpoint the individual within the structure from the outside of the structure.
While the systems described in the abovementioned patent applications work very well to detect the presence of a moving object and to detect its range and in fact its location, various problems nonetheless exist due to a number of factors, notthe least of which is the fact that the wall of an edifice of building has material that differently affects radar beams at different frequencies due to the frequencydependent difference in attenuation. It will be appreciated that in synthetic apertureradars, the angular resolution is given by .lamda./d where .lamda. is the wavelength and d is the length of the baseline on which the measurement is to be made. However, resolution is critically dependent on pulse shape, and with pulse shape altered bywall materials, image resolution is adversely affected. There is therefore a requirement to take into account wall density and material to improve image accuracy.
Note that with both range and angle information, 2D representation consisting of range and azimuth pixels can be formed. Note also that if the baseline has both horizontal and vertical extent, 3D representation is possible. In this case eachcell represents range, azimuth and elevation. However, without correction these representations will be fuzzy due to the alteration of the pulse shape as the pulses pass through the wall.
In general, frequency bandwidth provides range resolution and the baseline geometry provides angle resolution. The quality and/or details contained in the image depends on the bandwidth, baseline range, wall distortions, wall uniformity and wallabsorption. In addition, the quality of the image depends on the position accuracy and velocity measurements.
Thus, due to the variability of wall transmissivity, the range measurements are coarse at best and it is only with difficulty that one can establish an accurate range to a moving object behind a wall.
If use could be made of the fact that the interaction of objects and RF energy is linear in the amplitude domain, one could potentially improve upon range accuracy by adding the amplitude response caused by a first signal to the amplituderesponse caused by a second signal to get the response caused by a signal that is the sum of both signals. As will be seen, because of this linearity in amplitude, it would be possible to use a set of closelyspaced, frequencystepped CW measurementstaken at widely different frequencies and closelyspaced points to provide improved resolution.
Moreover, all of the above multitone throughthewall radars require object movement to obtain range. There are, however, returns from nonmoving objects that complicate analysis of the returns. Thus artifacts from nonmoving objects cancorrupt the display of returns from moving objects.
Thus, while it is indeed useful to be able to ascertain whether or not a person is within a building due to the detection of their movement and while it is also useful to pinpoint, to the extent possible, their position and track using multiplemultitone CW radars, there is nonetheless a requirement to obtain more precise measurements and more accurate tracks while at the same time distinguishing other artifacts in the room such as chairs, desk, tables and lamps, etc. These artifacts are ingeneral nonmoving so that theoretically one should be able to distinguish a moving object from one that is not.
SUMMARY OF INVENTION
In the subject invention, a throughthewall frequencystepped imaging system uses nearfield multiple antenna positions, clutter rejection and corrections for frequencydependent wall effects to improve accuracy and readability ofthroughthewall CW radars. The subject system uses frequencystepped radars to obtain multiple readings at different frequencies, with the more frequencies sampled the higher the location accuracy. Secondly, a weighting system is provided thatcorrects range measurements for the characteristics of the particular wall. Thirdly, a differential image technique rejects clutter that is the result of returns from nonmoving objects.
More particularly, in order to ameliorate the effects of different wall thicknesses and materials, the system steps the frequency of the radars and applies a weight for each frequency to correct for pulse distortions through the wall. The resultis that the subject system minimizes the problem of the dispersive frequencydependent effects of the wall. When using stepped frequencies one must compensate for wallinduced effects at each frequency because in typical broadband pulses, there is aconsiderable difference between what happens at the low end of the pulse frequency spectrum and the high end.
In the subject frequency stepping system one applies a correction for each frequency step that inverseweights the effect of the wall and resharpens the pulse. The result is a much better defined range, since the result for each of the steppedfrequencies in maximized, with the process being performed at each antenna position. Thus the system is able to obtain better range measurements from which the system triangulates and renders an indication of the position of a moving individual.
In one embodiment the optimal weights as a function of frequency are determined knowing wall thickness and the index of refraction of the wall. These can either be input from measurements or be estimated.
Alternatively, an autofocus system is provided in which trial wall thicknesses and indices are input to an autofocus program. When focus has been achieved, that wall thickness and index leading to the focus condition yield the wall thicknessand index that actually exist. This wall thickness and index can then be used in the above algorithm to generate the aforementioned weights.
Having applied predetermined weights for each frequency, the use of multiple frequencies for each pair presents the ability to provide an even more accurate range measurement. Note with two frequencies of the twotone radars one can obtain arange solution. With multiple twotone frequencies one can get multiple solutions for each twotone pair that can be averaged to obtain more accurate results.
Moreover, multiple stepped frequencies can be used to reduce range ambiguities. For instance, one pair of frequencies can be selected to be widely separated to provide fine spatial resolution. However, with wide separation comes rangeambiguity. However, at the same time, other separations can be made close together to resolve the range ambiguity.
For instance, if for a given radar one chooses one of the two tones (F1) to be 900 MHz and the other of the two tones (F2) to be 910 MHz, this provides a 15meter range cell, which is 30 meters divided by 4.
On the other hand, for this radar, choosing an additional frequency F3 to be 920 MHz, this provides a 7.5meter range cell, thus improving the resolution.
One then uses the F1F3 spread to obtain the high resolution, albeit with range ambiguity. One then uses the F1F2 spread to resolve the ambiguity.
Thus, by using multiple stepped frequencies for the twotone radars, one can obtain better resolution by averaging; or one can get higherresolution range results using wide frequency spreads, with range ambiguities resolved by narrower frequencyspreads.
The net total result is improved resolution either by the weighting system or by the use of multiple frequencies and different frequency spreads.
Having improved the resolution of a twotone CW radar substantially by readings at multiple frequencies and taking into account wall effects, the system goes further to subtract out clutter that is the result of returns from nonmoving objects. This is accomplished by producing two images at two different times and subtracting one from the other. What remains after the subtraction is only that which is due to a moving object. This permits distinguishing nonmoving objects such as furniture,lighting and nonmoveable objects from moving objects such as an individual moving behind the wall.
The result is that one takes an image that has been generated using corrections for frequencydependent wall effects and provides a display in which the only returns that are displayed are the differences between two snapshots or images formed attwo different times. This allows the system to process out clutter because the images that are generated result only from moving objects. It will be appreciated that the images at two different instants of time initially include all returns fromobjects, whether they are moving or not. Since one is only interested in moving objects such as people moving in a room or behind a wall, displaying only the difference between the two temporal images represents only objects that are in motion. Theresult is that one can readily distinguish moving objects from stationary objects.
As to range accuracy improvement, processing at multiple frequencies using the abovementioned weights increases the accuracy obtainable from noncompensated systems by as much as 50%.
This coupled with the ability to distinguish returns from nonmoving objects when rendering position provides for an exceptionally robust throughthewall radar capable of localizing and tracking individuals in a very precise manner as they movebehind a wall.
In summary, the lower resolution and clutterprone twotone CW radars described above can have the displayed images dramatically improved by the three techniques involved in the subject invention. The three techniques involved are the steppingof each of the multiple radars for readings at multiple frequencies, weighting the results to compensate for wallinduced distortions and differential image processing. In one embodiment, weights for each frequency counteract the distortion produced byparticular wall. For differential image processing, temporal snapshots of the images are subtracted one from the other such that the result is only due to moving objects, thus to provide a dramatic display of the presence and position of movingindividuals behind a wall.
BRIEF DESCRIPTION OF THE DRAWINGS
These and other features of the subject invention will be better understood in connection with a Detailed Description, in conjunction with the Drawings, of which:
FIG. 1 is a diagrammatic illustration of the range detection system used in the subject invention in which the range to a moving object behind a wall is detected by projecting twotoned continuous waves through the wall and detecting the phasedifference between outgoing and incoming waves for each of the two tones, with the phase difference signal for one frequency being applied to a predictor to generate a predicted waveform for the phase difference of the second of the two tones, with thepredicted waveform being compared with a waveform derived from measured data such that when the two waveforms compare favorably, the range associated with the matched waveform is the declared range;
FIG. 2 is a waveform diagram for a pseudorandom moving object behind a wall, showing the phase difference waveforms for the two tones, namely f.sub.1 and f.sub.2, at a location that is adjacent the antenna of FIG. 1, showing the relativeidentity of the two waveforms;
FIG. 3 is a waveform diagram for a pseudorandom moving object behind a wall, showing the phase difference waveforms for the two tones, namely f.sub.1 and f.sub.2, at a location at a distance from the antenna at which the waveforms are180.degree. out of phase;
FIG. 4 is a waveform diagram for a pseudorandom moving object behind a wall, showing the waveforms for the two tones, namely f.sub.1 and f.sub.2, at a location intermediate the zero object position of FIG. 2 and the phase reversal objectposition of FIG. 3, indicating an offset between the two waveforms associated with a location between phase reversal location and the zero position of the pseudorandom moving object;
FIG. 5 is a block diagram of a twotone CW radar for use in the subject invention in which phase difference of the outgoing and incoming signals for each of the two frequencies is detected as the output of respective mixers, with the outputs ofthe respective mixers being applied to a microprocessor for determining not only the presence of motion but also range to the moving object;
FIG. 6 is a waveform diagram of measured temporal phase differences for the two tones, f.sub.1 and f.sub.2, showing a difference in the two waveforms;
FIG. 7 is a series of projected waveforms for the second of the two frequencies at eight different ranges, with the fifth of the predicted waveforms being the closest match to the measured f.sub.2 waveform corresponding to a range ofapproximately 50 meters;
FIG. 8 is a diagrammatic illustration of the intersection of two range bands in a surveilled area from two spacedapart multitone CW radars indicating the beam spread for each of the radars and indicating an intersection area of the range bandsor swaths that determine the location of the moving individual within the surveilled area, with two or more range/motiondetecting radars used to obtain position;
FIG. 9 is a schematic diagram of a system using the multitone radars of FIG. 8 in which the radars of FIG. 5 are used not only to emit radar signals but also have signals that are detected back at a microprocessor where an overlap detection ismade to determine position, the range being a biproduct, and with a histogram of overlaps or positions being used to generate a pathway display;
FIG. 10 is a diagrammatic illustration of the use of multiple frequencystepped radars, the weighting of the results and the use of differential image processing for clutter rejection; and,
FIG. 11 is a diagrammatic illustration of the frequency stepping of a multitone CW radar.
DETAILED DESCRIPTION
Multitone CW Radar
To describe the operation of the multitone CW radar used in the subject invention, it was found that for an object exhibiting constant motion or velocity the phase shift between the two waveforms representing the phase difference betweentransmitted and returned waves for the two tones or frequencies is directly related to range. This is because comparing waveforms corresponding to the phase difference between the outgoing and incoming waves at the two frequencies results in arelationship between the phase shift between the two waveforms and range. For instance, at zero range there is no difference in phase between the two waveforms. At a range equal to .lamda./4 one has a 180.degree. phase shift between the two waveforms. In between, for constant motion objects there is a linear relationship between phase shift and range such that by measuring phase shift between the two waveforms one can deduce range. Here .lamda. is the wavelength associated with the difference inf.sub.1 and f.sub.2, or in this case one megahertz.
However, in reality individuals rarely maintain a constant velocity and it can be shown that the subject system can measure range to objects having a pseudorandom motion.
In order to determine range for random motion, the twotone CW radar used for constant motion is used to drive a single antenna. Here continuous waves at the two frequencies f.sub.1 and f.sub.2 are simultaneously applied to the antenna. Thesystem measures the phase difference between the returned versus transmitted energy for the first tone, f.sub.1 and the second tone, f.sub.2. This results in two waveforms each specifying the temporal phase difference for the two respective tones. Inthe constant motion case, the phase shift between these two waveforms indicates the range from the antenna to the moving object.
In order to accommodate the usual situation in which the object's motion varies over time, a modelbased signal processing algorithm extracts range by comparing the waveform corresponding to the time sequence of phase differences for the detectedreturns at one of the frequencies with the predicted waveforms corresponding to the predicted phase differences for the other frequency at a number of ranges, with the waveform closest to that which is detected being declared as the range to the movingobject.
Due to the use of a modelbased system, movement is not limited to constant velocity or to large movements compared to the carrier wavelength, meaning that even slight hand movement can be sensed.
The model is populated by selecting the first and second tones and setting their frequencies apart by for instance one MHz. For one frequency, f.sub.1, one samples the mixer output used to provide a signal corresponding to the phase differencebetween outgoing and incoming energy. The output of the mixer thus produces a time sequence waveform corresponding to the phase difference between outgoing and incoming waves at f.sub.1. This O.sub.diff f.sub.1 waveform is used by a predictor involvinga mathematical model that predicts the time sequence waveform for f.sub.2 based on information from f.sub.1 for an a specific range value. The other input to the predictor is range. The model is built up in terms of generating stored waveform templatesby sequencing through a number of ranges to produce a set of rangedependant templates, each keyed to a given range. The time sequence waveform for f.sub.2 corresponding to the phase difference between outgoing and incoming waves from realtime data isthen compared to the predicted time sequence waveform for f.sub.2 to ascertain which template and thus which range offers the best fit. Optimal search methods can be employed to obtain the range value (R) that gives the best fit.
Thus, it is possible to determine range to the motion even if the motion is not constant or the target moves only a fraction of the carrier wavelength.
For random motion, the system provides not only an indication of the existence of an individual but also determines the range to the individual by first developing range templates or using an iterative search to find the best range value, and bycomparing the data associated with realtime returns to the templates, with a matching algorithm determining range.
The range templates in one embodiment are generated by a predictor that predicts from one waveform corresponding to the phase differences for the first tone, namely f.sub.1, the predicted phase differences for the second tone.
The predictor algorithm is based on using the time domain signal or temporal waveform corresponding to the temporal phase difference between outgoing and reflected energy at f.sub.1 available from a mixer for f.sub.1 to predict the temporal phasedifference waveform between outgoing and reflected energy at f.sub.2 available as a signal produced by a mixer for f.sub.2. To describe this the following are defined: k.sub.1=2.pi./.lamda..sub.1 Equation 1 k.sub.2=2.pi./.lamda..sub.2=k.sub.1+.DELTA.kEquation 2
The output of the mixer caused by the energy reflected from the moving target is: Y.sub.1(t)=A.sub.1e.sup.ik.sup.1.sup.r(t)/2 for mixer 1 Equation 3 Y.sub.2(t)=A.sub.2e.sup.ik.sup.2.sup.r(t)/2 for mixer 2 Equation 4Y.sub.2(t)=Y.sub.1(t)e.sup.i.DELTA.kr(t)/2 obtained by substitution Equation 5 The above equation predicts waveform Y.sub.2(t) using the difference between k.sub.1 and k.sub.2 and the range r(t).
Here it can be seen that one can predict the expected temporal phase difference waveform for f.sub.2 from the measured phase difference waveform for f.sub.1.
By having a predicted waveform for the temporal phase differences of f.sub.2, one can compare this waveform with a waveform generated from the measured actual phase differences at f.sub.2,
Since the predictor generates predicted waveforms at various ranges, when the waveform generated from measured data is compared with one of the predicted waveforms, a match indicates the range to the moving object.
If the comparison results in a significant disparity between the two waveforms, one can adjust the range input to the predictor to generate another predicted waveform for f.sub.2. When this newly generated waveform is compared to the waveformassociated with measured data, assuming a closer match, the range associated with the newly generated predicted waveform is determined to be the actual range of the moving object.
It will be appreciated that the phase shift between the waveforms replicates at intervals of .lamda..sub.//4 where in this case .lamda. is the wavelength of the difference frequency. In general, a difference between f.sub.1 and f.sub.2 of oneMHz corresponds to a .lamda. of about 300 meters. .lamda..sub.//4 thus corresponds to 75 meters and is termed a "range cell." Returns from moving objects outside of the range cell that would duplicate those inside the range cell can be distinguished interms of the amplitude of the signals returned from the moving object. Thus a muchdecreased amplitude return indicates a moving object in a second or third range cell.
The size of the range cell and thus the resolution of the system is determined by the separation in the two tones. One would normally want to start with a large range cell, in the above example 75 meters, and set the initial range cell byseparating the two tones by one MHz.
If movement is ascertained within this relatively large range cell, one may subsequently decide to reduce the size of the range cell to increase resolution. If one sees activity in the larger range cell one can, for instance, increase theseparation in the two tones to 3 MHz, which makes the range cells onethird the original size.
Having ascertained the range cell that all activity is in, one can increase the resolution of the subject system by increasing the separation between the two tones to decrease the range cell size and thus increase the resolution.
More particularly, this system detects not only motion in a room but also the range of the moving object. One wants to know and locate where in the building the moving object is. If one is able to measure range, this aids in that process oflocating individuals in a room or behind a wall.
In order to provide range, the twotone radar uses two frequencies that are fairly close together, for instance one megahertz apart. One chooses two close frequencies and then looks at the output of each mixer for both frequency 1 and frequency2. By using a model that describes the differences in the frequency 1 and frequency 2 outputs, one adjusts the range parameter for the model so that when the difference between the model predictions are minimized based on observed data collected, therange that gives the best or closest agreement corresponds to the range of the moving object.
Thus, at a given distance there is a twoway trip that the signal has to travel, with a phase shift between the transmitted and received signals corresponding to that distance. If the distance changes, the phase shift will change. Since eachfrequency is slightly different, that phase shift will change a little bit differently for the two frequencies. What the system does is to model the twoway trip for each frequency. One frequency shows how the individual is moving in a nonuniform wayand one makes a comparison with the motion of the same individual as detected by the second frequency, assuming that both frequencies monitor the same motion. The only parameter left is the range, and by adjusting range, when the range parameters cometo the right value, the models for f.sub.1 and f.sub.2 will match and that range is a good prediction of the range of the moving object.
Referring now to FIG. 1, in order to detect the presence of an individual 10 constituting a moving object behind a wall 12, a radar 14 is provided, which transmits continuous waves 16 and 18 through a summation device 20 to an antenna 22. Antenna 22 simultaneously projects the two waveforms at f.sub.1 and f.sub.2 as illustrated at 24 and 26 through wall 12, where they meet object 10 and are reflected backwardly as illustrated at 28 and 30. The phase difference between outgoing andincoming waveforms for each of the frequencies is detected as will be discussed, and in one embodiment the waveform corresponding to the temporal phase difference for tone f.sub.1 is coupled to a predictor 32. It is the purpose of predictor 32 topredict the temporal waveform that would be expected to exist for the temporal phase difference waveform at frequency f.sub.2 for an object at a known distance or range, with the output of the predictor being a waveform on line 34. In order forpredictor 32 to operate, the predictor predicts the f.sub.2 waveform for a predetermined range R.sub.x as illustrated at 36, such that for a given input waveform at one frequency, a set of templates at the other frequencies corresponding to predictedwaveforms at different ranges constitutes the output of predictor 32.
Predictor 32, upon receiving a waveform input on input line 38, for an initial range generates a predicted waveform for the temporal phase difference for the second tone and applies this waveform to a comparator 40.
As illustrated by arrow 42, measured data in terms of the temporal phase difference waveform for tone f.sub.2 is applied to a waveform generator 44. This provides a temporal rendition of the phase difference of the outgoing and incoming waves atfrequency f.sub.2 from measured data. This waveform is applied on line 46 to comparator 40.
If the waveform on line 34 and the waveform on line 46 are sufficiently similar or agree, then one declares that the range to object 10 is the range that has been loaded into predictor 32 to generate the predicted waveform. This range isoutputted at 50 as illustrated.
On the other hand, if there is no significant agreement between the waveforms on lines 34 and 46, then as illustrated at unit 52, the range associated with the predictor 32 is changed and the process is iteratively carried out until there is asufficient match between the waveforms on lines 34 and 46. When there is such a match, the range that was used in the predictor 32 is the declared range to the moving target.
Referring to FIG. 2, assuming that one has phase difference waveforms 60 and 62 that are the result of the radiation from antenna 22 impinging up a randomly moving object behind wall 12, then as can be seen, for a location that is adjacentantenna 22, namely at zero distance, the waveforms themselves are very nearly the same.
Referring to FIG. 3, if the moving object creating the phase difference in the returns to antenna 22 is at a location that is .lamda./4, with .lamda. being the wavelength of the tone separation, in one embodiment one MHz, then waveforms 60 and62 are those as shown as waveforms 60' and 62', which are 180.degree. phase shifted. This means that even for pseudorandom motion that results in nonsinusoidal waveforms 60 and 62, one can nonetheless establish that the distance of the object that ismoving in a pseudorandom fashion is at .lamda./4 away from antenna 22.
Referring to FIG. 4, for waveforms 60'' and 62'', these waveforms are those that result from a pseudorandom moving object at a range between zero and .lamda./4. If it were possible to measure the phase difference between these twononsinusoidal waveforms, one could ascertain the distance from the antenna and therefore the range.
However, and referring back to FIG. 1, since it is not possible to accurately measure the phase shift of phase difference between waveforms 60'' and 62'', at least from inspection, one generates a series of waveform templates relating to one ofthe tones or frequencies that would be expected at one of a plurality of ranges. This waveform is predicted from the measured waveform of the other of the frequencies or tones, with the prediction algorithm being described above.
In this manner, one generates a series of waveform templates at one particular frequency or tone, which is what would be expected at various ranges. This is done by using the waveform associated with the other tone.
Having generated a series of such rangedependent templates, one then seeks to compare a waveform from measured data with the predicted waveform, which his range dependent. One can use any one of a number of curvematching or bestfit techniquesto ascertain to which of the waveform templates the measured data corresponds. When there is a sufficient match, one then declares the range to the moving object to be the range associated with the particular template to which the measured waveform wasattached.
Referring to FIG. 5, apparatus for deriving the temporal phase difference waveforms is shown in terms of a dual frequency radar, although some advantage may be obtained by using more than two different frequencies. However, for the presentpurposes, radar 14 can be characterized as including a pair of frequency sources 70 and 72 respectively at f.sub.1 and f.sub.2, each of which driving a power divider respectively 74 and 76, the outputs of which are respectively coupled to circulators 78and 80, the outputs of which are in turn coupled to a summing or mixing device such as a splitter 84 and thence to an antenna 86.
Power divider 76 provides an output along line 90 to a mixer 92, which mixes it with an output corresponding to the returned signal from a moving object that comes out on line 94. The output of mixer 92 along line 96 is therefore the phasedifference between the outgoing and incoming signals at frequency f.sub.2.
Likewise, for power divider 74, one output is applied over line 100 to a mixer 102, which has as its other input a signal on line 104 such that the output along line 106 from mixer 102 is a phase difference waveform associated with the phasedifference between outgoing and incoming signals associated with f.sub.1.
Microprocessor 110 performs the functions of detecting not only motion but the range to the object in motion as described above, with a motion detector and rangedetermining unit 120 outputting the range to the moving target, be it in continuousmotion or pseudorandom motion.
It will be appreciated that microprocessor 110 contains the predictor, comparator and range adjustment functions that are described in connection with FIG. 1.
As illustrated in FIG. 6, the measured phase difference waveforms applied to unit 110 are illustrated at 122 for the first tone or f.sub.1 and 124 for the second tone or f.sub.2. Here it will be appreciated that for these signals, an objectbehind wall 12 has reflected the signals such that the phase difference waveforms can be generated. The range at which the object reflects the radar energy is not known and, as can be seen, the phase difference waveforms are slightly different one toneto the other.
Referring to FIG. 7, a number of waveforms 130, 132, 134, 136, 138, 140, 142 and 144 constitute a number of templates, with these waveforms being the predicted f.sub.2 waveforms for different ranges. In this case the ranges are separated by 10meters.
If, as is done by unit 110, one compares the measured waveform at f.sub.2, namely waveform 122, with each of these templates, one ascertains that the closest match to the measured f.sub.2 waveform is waveform 140. This leads to the declarationthat the range to the object is 50 meters.
What will be seen, even though the object in question may be exhibiting a pseudorandom motion, and even though this pseudorandom motion produces phase difference waveforms that are nonsinusoidal, one can nevertheless, with waveform matchingtechniques, determine which of the templates is closest to the measured waveform, whereby range to the object producing this waveform can be readily ascertained with high certainty.
It will be appreciated that if one has multiple twotone radar units at different positions and if one establishes the range to each of these radars by the techniques described herein, one can establish the position of the moving object bytriangulation or other techniques.
As mentioned hereinabove, in order to get an unambiguous range determination, one has to ascertain in which range cell the moving object is. This is simply accomplished by adjusting the frequency separation between the tones to establish a largeenough range cell so that one with confidence can ascertain that the moving object is within the range cell. Also, as mentioned before, amplitudesensitive techniques can determine which range cell the object is in, since the amplitude of returns fromobjects farther away will be considerably reduced.
Position Determination
What has been described hereinabove is a system for robustly detecting the presence and range of a moving object within a building or behind the walls of a structure in which a multitone CW beam is projected through the wall and in which therange of a moving object or individual from this particular radar is determined. How to obtain instantaneous position is now described.
Assuming that one duplicates the radar of FIG. 5 at two locations, here shown at 14 and 14', then one projects RF energy into a surveilled area or region of interest 150 from two different directions, subtended by beam 152 from radar 14 and beam154 from radar 14' respectively.
The result of using the twotone system of FIG. 5 is that a band or swath 156 of possible ranges for a moving individual from radar 14 can be generated which locates the moving individual at any given instant of time in the area subtended by Band1, namely swath 156.
Likewise, swath 158 defines the possible positions of an individual or moving object relative to the second radar, radar 14', such that the swath of ranges is indicated by swath 158 as Band 2.
From this point it is possible to detect the overlap of Band 1 and Band 2 at position 160 to be able to compute the instantaneous position of the moving individual.
The use of multiple multitone CW radar range finding systems, each projecting a beam at different angles through the area to be surveilled, provides not only for the range of a moving individual or object from each of the radars but also theoverlap provides for the position as well.
The area of overlap 160 is determined by the width of the various swaths, which is in turn determined by the difference in frequencies of the multitone radars, it being noted that the range bands can be determined ahead of time as describedhereinbefore. The range bands are to occur in the nearest zone to each of the radars such that by projecting RF energy through walls of a building or other structure from two spacedapart radars, one can triangulate on the position of the moving objector individual.
In order to do so and referring now to FIG. 9, it can be seen that radars 14 and 14', while projecting radar signals through a particular wall, also may be used to communicate the results of the radar interrogation by modulating the selfsamesignals, which results are picked up at a microprocessor 162 that carries a microwave receiver (not shown).
The signals from antennas 86 and 86' are picked up for this purpose by antenna 164, with the output of the receiver being coupled to an overlap detector 166 that taking the range derived from the two radars and the position of their antennasavailable over line 167 calculates the overlap area and its position relative to the positions of the two radars used in the throughthewall sensing system.
The result of the overlap detection at its position is available over line 168, coupled in one embodiment to a histogram 170 that calculates and generates a histogram of overlaps, thus to be able to determine the pathway 172 of the moving objector individual within the surveilled area 150 of FIG. 8.
This pathway, namely pathway 172, is shown by a breadcrumb trail 174 as illustrated to indicate the path of the individual through the area behind a wall through which the RF energy is projected.
It will be appreciated that overlap detector 166 can also provide a range indication 174, which can be used either to indicate the detection of the presence of an individual or for other purposes.
Two or more units can provide ranges to the target. The known locations of the units are used along with the range values to produce a target location. With three units, it is possible to produce a 3D location. It is not required that the beamwidth of the radar be narrow to get an accurate position. Only the locations of each radar unit need be known. An accurate position can be produced as long as the target is within the beam pattern of each radar.
The algorithm for determining the triangulated position is now presented.
Each dual frequency radar produces a range estimate. The range estimate has an uncertainty that is as a range dependent likelihood function P(r). P(r) defines an arc whose center is located at the position (xi, yi, zi) of the ith radar unit. With two or more radar units a joint likelihood function L(x,y,z,P(ri),xi,yi,zi)) is formed. The target position is obtained by doing a search over x,y,z to find the peak value of L. The algorithm to do the search can be based on a number of knownmethods including gradient search methods.
In operational trials, with a moving object behind a wall and spaced between 10 and 30 meters from the radars, it has been found that the positional accuracy can be as little as one meter in terms of the overlap area of the various range swaths. This is sufficient accuracy to be able to locate a trapped firefighter, a hiding enemy soldier or combatant, or in fact to provide a realtime track of a moving individual behind the wall or building structure.
Other factors for determining positional accuracy are now presented.
Tests were conducted using two radars. Best results were obtained when the target was located such that the centerlines of each beam were perpendicular to each other. In this case a 2D location can be produced to an accuracy of DR in eachdirection. DR is the accuracy that a single radar can measure range and is roughly 1 meter at ranges of up to 20 meters for the test unit. As the angle is reduced to less than 90.degree., the accuracy degrades as 1/Cos(theta) in the cross rangedirection.
Stepped Frequency and Differential Image Compensation
The above description supports the notion that one can pinpoint the location of a moving individual behind a wall or in a building and to track the movement of the individual using multiple multitone CW radars. The following describes how thissystem can be enhanced to improve range accuracy and therefore positional accuracy, while at the same time providing a display of position that discriminates against nonmoving objects such as furniture, light fixtures, cabinets and the like.
Referring now to FIG. 10, a building 180 has walls 182 that surround an area in which a moving individual 184 is located.
Individual 184 moves through the building amongst nonmoving objects 186. It is the purpose of the subject invention to robustly detect the presence of a moving individual, to more accurately pinpoint his or her position and to reject clutterfrom radar returns that are reflected by nonmoving objects.
In order to triangulate on the moving individual, a number of multitone CW radars 190 are positioned about building 180 such that radiation from the radars penetrates walls 182 so as to probe the interior of the building. Note that eithermultiple radars may be positioned about the building or a radar may be moved from one position to the next.
Regardless, in order to cancel out the variable effects of wall thickness and changes in index of refraction due to the passage of pulses through the wall, each of radars 190 have their twotone frequencies stepped from a low frequency of 700 MHzto a high frequency of 2.3 GHz as illustrated at 192 for the purpose of sharpening the pulses that are smeared out or distorted as the pulses pass through the wall. As illustrated, the stepped frequency sweep provided by unit 192 results in improvedrange measurements to all objects in the field of view of the radars. Note that the use of multiple frequencies in and of itself improves range accuracy. The range and the triangulation measurements are made in accordance with the aforementionedapparatus.
The purpose of stepping the frequency of each of the radars is to be able to project through walls 182 a range of frequencies to be able to provide a set of weights, here illustrated at 194, that correct for the distortion of the pulses as theypass through the walls in both directions. This means for each frequency that post processing eliminates the distortion of a pulse as it is projected through a wall and then corrects out the wall effect for the returned pulses.
The reason that one can sharpen the pulses by removing distortion is because the wall affects the pulses differently at different frequencies. Thus lower frequencies are distorted differently from higher frequencies.
The distortion is a function of both the wall thickness and its index of refraction, which depends on the material of which the wall is constructed. Since all of these parameters affect the pulses differently at different frequencies, a set ofweights is developed to weight the radar results to cancel out the distortion effects at each frequency.
One way to establish the weights is to take a known material and thickness and to measure the attenuation. Then knowing the attenuation, one generates weights that are proportional to the inverse of the attenuation.
If one starts off with the above, the weights can be refined by starting with a onedimensional image through the wall, followed by the detection of a strong scatterer behind the wall. One then does a number of subfrequency sweeps. Then foreach frequency sweep one obtains an amplitude of the scatterer. The ratio of the amplitudes then yields the frequencydependent attenuation. One can basically use the lowest frequency which has the lowest attenuation, whereupon one can derive theweighting at other frequencies. These are then the weights used.
With all of the frequencies compensated by the weighting scheme, the composite is equivalent to a sharpened pulse, which improves the range accuracies by as much as 50%.
One way of obtaining the parameters for the wall material is to either physically measure them or to estimate them.
Another way to obtain the wall material parameters is to perform an autofocusing function which, when an object is in focus, specifies the wall thickness and index of refraction. How this is done is that one starts off with initial estimationsof the index of refraction, absorption and wall thickness, i.e., the initial parameters. Then one forms an image, after which one adjusts the parameters and reforms the image. This is repeated using a method for sharpening gradient descent to maximizeimage sharpness. The parameters are for the sharpest image. These parameters are then used to generate the weights. This process can be repeated, i.e., forming an image and adjusting it in an iterative process to refine the weights.
Having sharpened the range results of the radars, the results are rendered into images as shown at 196 and 198. These images contain clutter in the sense that these images relate to both returns from moving objects and returns from nonmovingobjects. However, the images are the result of measurements taken at different times, here time T.sub.1 and time T.sub.2. By subtracting one image from the other as illustrated at 200, one can generate an uncluttered image 202 whose pixels are causedonly by objects in motion. The result as illustrated by display 204 is that a pixel 206 is a result of only reflections from moving objects, with images that are the result of reflections from nonmoving objects canceled. As will be appreciated, pixel206 provides an uncluttered view of moving object location.
Referring to FIG. 11, what is shown is an expanded view of one of the radars 190 in FIG. 10, in which each radar includes a stepped frequency source 210 coupled to a power divider 212, which feeds a circulator 214 coupled to an antenna 216. Asignal from power divider 212 and a signal from mixer 214 is applied to a multiplier 218 so as to detect the absolute phase differences for each frequency as illustrated at 220. Then for each antenna position one detects range to all moving objects foreach frequency step as illustrated at 222.
It is this range for each frequency step for each antenna position that is weighted in accordance with the subject invention.
In summary, the use of multiple frequencies results in better range measurements. Secondly, better range measurements are obtained by using the subject weighting system. Thirdly, antennas at a large number of different locations result inbetter triangulation. Finally, the use of differential clutter rejection discriminates against returns from nonmoving objects.
With multiple multitone radars, frequency stepping and differential image clutter rejection, one has provided an extremely robust system for detecting a moving individual 224 behind a wall 226.
While the present invention has been described in connection with the preferred embodiments of the various figures, it is to be understood that other similar embodiments may be used or modifications or additions may be made to the describedembodiment for performing the same function of the present invention without deviating therefrom. Therefore, the present invention should not be limited to any single embodiment, but rather construed in breadth and scope in accordance with therecitation of the appended claims.
* * * * * 








Randomly Featured Patents 
