Next Patent: Vehicle suspension control system
Next Patent: Vehicle suspension control system
Plaque It!
|
[0001] This application is a divisional of U.S. patent application Ser. No. 09/970,728 filed on Oct. 4, 2001. The entire disclosure of which is incorporated herein by reference.
[0002] The present invention relates to a system for automatically detecting the presence of moisture on a surface, such as the surface of a windshield of a vehicle for an automobile, in order to automatically actuate the vehicle's windshield wipers and/or defroster or defogging system.
[0003] In conventional windshield wiper systems, the windshield wipers are actuated based on the elapsed time between wipes rather than the moisture level on the exterior of the windshield. During conditions of relatively consistent rainfall, for example, the time interval can be adjusted to correspond to the amount of time in which the rain accumulates to the point of the desired visibility level. Unfortunately, the rate of rainfall may vary dramatically over a given period of time. Additionally, traffic conditions may also cause varying amounts of rain to fall on the windshields, such as when a truck passes by. As a result, during such conditions, the driver must frequently adjust the wiper time interval, which can be cumbersome.
[0004] Various systems are known which automatically control the interval between wipes of the windshield wipers based upon moisture on the vehicle windshield. In some known systems, various coatings are applied to the vehicle windshield. Electrical measurement of those coatings is used to provide an indication of the moisture content on the windshield. Unfortunately, such methods require relatively expensive processes, which makes such systems commercially non-viable. Other systems for automatically sensing the moisture content on a vehicle windshield are also known. For example, optical systems are known which measure the difference of reflected light of a dry windshield versus a wet windshield. Unfortunately, such optical systems are susceptible to interference from external light sources and thus provide inadequate performance. Other known systems must be adhered to the windshield, which complicates the windshield replacement. As a result of such complications, moisture sensors are rarely found on vehicles.
[0005] Another system for automatically detecting the moisture content on a windshield is disclosed in Japanese Laid Open Patent Application No. Hei (1995)-286130, which describes the use of a charge coupled device (CCD) image sensor to image a portion of the vehicle windshield in order to detect raindrops. The system described therein computes the sum of the differences between each pixel and the average of all pixels. Unfortunately, headlamps of oncoming vehicles will create a bright spot in the image, which would be difficult to completely blur and likely be interpreted as rain. Moreover, in order for such a system to work effectively, distant objects within the imaged scene must be completely blurred. Otherwise, there will be dark and light regions in the imaged scene corresponding to the distant objects. Although there is no optical system disclosed in the Japanese laid open patent application for accomplishing this objective, it would be very difficult to develop an optical system to completely blur an oncoming headlamp. Failure to blur oncoming headlamps could cause false triggering of the system disclosed in the above-identified Japanese laid open patent application.
[0006] Another problem with automatic rain detection systems is the inability of the system to detect the operation of the windshield wipers. In certain cold climate conditions, the windshield wipers are known to freeze to the windshield. In such a situation, since the moisture is not being removed by the wipers, an automatic rain sensing device would continuously command the wipers to actuate, even though the wipers are frozen to the windshield, potentially damaging the windshield wiper system.
[0007] Another problem with known systems is the inability to detect fog on the interior and exterior of the windshields. As mentioned above, automatic moisture detection systems, such as disclosed in the above-identified Japanese laid open patent application, are based upon the ability to detect raindrops on the windshield. When a uniform fog or mist covers the vehicle windshield, systems, such as the system disclosed in the Japanese laid open patent application, are unable to sense such moisture on the exterior of the windshield. As a result, during such a condition, the windshield wipers will have to be manually actuated, thereby partially defeating the purpose of an automatic rain sensor and windshield wiper control system making the feature a lot less desirable.
[0008] In other situations, fog develops on the inside of the windshield independent of the moisture content on the exterior of the windshield. In such a condition, automatic rain sensing systems, such as disclosed in the Japanese laid open patent application, are unable to detect the moisture content on the exterior of the vehicle windshield until after the fog on the interior of the windshield is cleared. In such a condition, a defroster or defogger system would have to be manually actuated to remove the interior fog on the windshield. The automatic rain sensor would not be operable during such a condition until the fog on the interior of the windshield is sufficiently cleared.
[0009] In commonly assigned U.S. Pat. Nos. 5,923,027, 6,097,024, and 6,262,410, a moisture sensing system is disclosed that overcomes the problems noted above. Nevertheless, it would be desirable to further improve the ability of the disclosed system to distinguish from light sources within the imaged scene that may cause false triggering of the windshield wipers.
[0010] According to one embodiment of the present invention, a moisture sensing system is provided that comprises: a sensor that is divided into a plurality of subwindows each having a sensitivity that is variable independent of the other subwindows; an optical system operative to direct light rays from at least a portion of the surface onto the sensor; and a processing system in communication with the sensor and operative to adjust the sensitivity of the subwindows and to analyze data from the sensor to detect moisture on the surface.
[0011] According to another embodiment of the invention, a system is provided for detecting moisture on a surface that comprises: a sensor that is divided into a plurality of subwindows, at least one of the subwindows having a sensitivity that is independently variable; an optical system operative to direct light rays from at least a portion of the surface onto the sensor; and a processing system in communication with the sensor and operative independently to adjust the sensitivity of the at least one subwindow and to analyze data from the sensor to detect moisture on the surface.
[0012] According to another embodiment of the present invention, a windshield wiper control system for a vehicle is provided that comprises: a sensor that is divided into a plurality of subwindows; an optical system operative to direct light rays from at least a portion of the surface of the windshield onto the sensor; and a processing system in communication with the sensor and operative to analyze data from the sensor to determine whether moisture is detected in each subwindow and to control the windshield wipers based upon a number of subwindows in which moisture is detected.
[0013] According to another embodiment of the present invention, a windshield wiper control system for a vehicle is provided that comprises: a sensor; an optical system operative to direct light rays from at least a portion of the surface of the windshield onto the sensor; and a processing system in communication with the sensor and operative to analyze data from the sensor to detect moisture on the windshield and to automatically activate the windshield wipers when moisture is detected. The processing system is responsive to at least one remote device to enable or disable automatic control of the windshield wipers.
[0014] According to another embodiment of the present invention, a system for detecting moisture on a surface is provided that comprises: an image sensor array including a plurality of light sensors; an optical system operative to image at least a portion of the surface onto the image sensor array; a supplemental illuminator for selectively illuminating the portion of the surface imaged onto the image sensor array; memory for storing a first image obtained by the image sensor array when the supplemental illuminator is illuminating the portion of the surface, and for storing a second image obtained by the image sensor array when the supplemental illuminator is not illuminating the portion of the surface; and a processing system in communication with the memory, the supplemental illuminator, and the image sensor array. The processing system is operative to compare the first and second images stored in the memory and to analyze results of the comparison to detect moisture on the surface.
[0015] According to another embodiment of the present invention, a fog detector system is provided for detecting fog on an inside surface of a vehicle window. The fog detector system comprises: an emitter for selectively projecting radiation onto a region of the inside surface of the vehicle window; a sensor disposed with its optical axis substantially in parallel with that of the emitter, the sensor being sensitive to the radiation projected by the emitter for sensing levels of incident radiation both when the emitter projects radiation and when the emitter does not project radiation; and a control circuit coupled to the emitter for selectively activating the emitter, and coupled to the sensor for receiving signals from the sensor representing the level of incident radiation. The control circuit determines the difference between levels of incident radiation when the emitter is activated and when the emitter is deactivated, and compares the difference to a threshold to determine whether fog is present. When fog is present, the control circuit generates a signal indicating the presence of fog on the vehicle window.
[0016] These and other features, advantages, and objects of the present invention will be further understood and appreciated by those skilled in the art by reference to the following specification, claims, and appended drawings.
[0017] In the drawings:
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027] A moisture sensing system in accordance with the present invention is able to detect moisture on a surface such as the windshield of a vehicle. Such a system is useful for automatically controlling the vehicle's windshield wipers, defroster, and/or defogging systems. The system for sensing moisture on a vehicle windshield eliminates many of the performance deficiencies of known moisture sensing systems and provides a moisture sensing system at a commercially viable cost. As used herein, the term “moisture” is used to designate various types of moisture and precipitation which can be found on the windshield of a vehicle during various climatic conditions, such as rainfall, snowfall, ice, and fog, as well as other substances that are commonly deposited on a vehicle windshield such as bugs, dust, and the like. The system is able to provide superior performance to other known systems during rather common climatic conditions, such as ice, fog, and varying levels of rain, snowfall, and the like.
[0028] Referring to
[0029] There are four components to the inventive moisture sensing system
[0030] The imaging optical system is used to image a predetermined portion of the windshield
[0031]
[0032] The imaging optical system preferably includes a single aspheric lens
[0033] The image sensor array
[0034] More elaborate optical systems, for example, with additional elements, aspherical elements, or defractive objects, could all be used especially if a shorter distance from the windshield is a desired feature. However, since the collected images are not for photographic purposes, such optical quality is not necessary in an application for moisture detection.
[0035] The image sensor array
[0036] While CMOS active pixel image sensors have substantial advantages, other image sensors are also suitable and are considered to be within the scope of the present invention. The size and number of pixels is determined to image an area of the windshield sufficiently large and in enough detail to adequately detect light rain while remaining cost effective. A 64×80 active pixel array may be utilized or alternatively, a one-dimensional sensor array may be utilized. According to a more preferred example, a Photobit PB-0111 Common Intermediate Format (CIF) Imager is used that has a 352×288 active pixel array with pixel spacing of 7.8 μm.
[0037]
[0038] As shown in
[0039] Window
[0040] A block diagram of the moisture sensing circuitry is shown in
[0041] A suitable microcontroller
[0042] Once an image is acquired by the image sensor
[0043] To further enhance the accuracy of the system and to enable the system to distinguish between raindrops and windshield cracks or debris on the windshield, the processing system
[0044] As shown in
[0045] The processing system analyzes the images from each of the plurality of subwindows
[0046] The system is also able to adapt to varying light levels. In particular, during selected cycles, the average grayscale value of the image may be computed. If this value is high, indicating an overexposure to light, the exposure time of the image sensor may be reduced to lower the average brightness. Similarly, if the light level is low, the exposure time may be increased. The specific manner in which the exposure time of the image sensor is adjusted is discussed further below.
[0047] When the image obtained by image sensor array
[0048] By independently controlling the sensitivity of subwindows within image sensor array
[0049] Regardless of whether exposure is adjusted on a per subwindow basis, the basic automatic gain control (AGC) algorithm, which may be performed by microcontroller
[0050] In addition to the AGC algorithm discussed above, the exposure level of the array or of subwindows or individual pixels may also be adjusted by varying the analog-to-digital conversion parameters of ADC 35, or adjusting the analog gain of the sensor outputs.
[0051] As noted above, it is preferable to make use of the “distributed” property of rain to help identify rain images. When it is raining, in general the raindrops tend to be spread somewhat evenly across the entire image. Far-field lights, however, tend to show up in a more localized manner. To detect bright lights in the subwindows, the average pixel variation is determined. The average pixel variation is defined as the average absolute difference between the pixel value and the pixel grayscale average across the entire subwindow. The bright far-field lights cause extremely high contrast in the imaged subwindows, which also results in a high pixel variation in the subwindow. Normally exposed raindrops cause lower pixel variations. Thus, each subwindow may be tested against a maximum pixel variation threshold to determine if the subwindow should be considered for further rain processing. If the average pixel variation for a subwindow exceeds the maximum pixel variation threshold, microcontroller
[0052] Although the preferred embodiment has been disclosed as utilizing eighty subwindows of 8×8 pixels each, it will be appreciated by those skilled in the art that any number of subwindows may be utilized of any resolution. In general, the greater the number of subwindows, the greater the ability of the system to block out and ignore bright far-field objects or faulty pixels. However, arbitrarily increasing the number of subwindows will decrease the resolution within each subwindow due to the limited number of pixels in the entire array. If the number of pixels within a subwindow is too small, then the average value computed for the subwindow will vary more significantly and be more likely to produce inconsistent results across the entire image sensor array. Also, it will become more likely that an edge lies between subwindows that could go undetected.
[0053] An example of an image sensor suitable for use in the present invention is disclosed in commonly assigned U.S. Pat. No. 6,008,486, entitled “WIDE DYNAMIC RANGE OPTICAL SENSOR,” by Joseph S. Stam et al., the entire disclosure of which is incorporated herein by reference.
[0054] By taking advantage of the inherent memory in the sensor circuits, correlated double samples may be obtained directly from the image sensor to subtract out the ambient light and thus reduce the memory requirements of the processor or associated external memory. Another method for preserving memory in the event that the above-noted correlated double sampling inherent in the sensor circuit is not utilized, is for microcontroller
[0055] The system described above may also be used to detect the passing of the wiper blades past the imaged area of the windshield. If the wipers of the automobile are designed in such a way that the wipers are never approximately vertical when it crosses the imaged area, the filters described above can be modified to accommodate such a configuration. For example, various other edge detection methods well known in the art of image processing can also be used. Additionally, if the wiper speed for the vehicle windshield wipers is so fast that it blurs slightly in the image for the necessary exposure time, the horizontal filter can be modified to subtract the pixels two positions to the left and right of the current pixel instead of the pixels immediately next to the current pixel.
[0056] After the wiper has cleared the imaged area, additional images of the windshield are acquired. These images may be used as a zero point measurement that may be subtracted from all subsequent measurements until the next wipe. In this way, long-term high frequency spatial components in the image of dirty windshield, cracks, scratches, and frozen ice will not contribute to the detected amount of rain.
[0057] If the windshield wiper is not detected within a given time frame, the system assumes that a malfunction has occurred, which can be caused as a result of the windshield wiper being frozen to the windshield. During such a condition, the operation of the moisture sensor in accordance with the present invention can be suspended for a period of time to allow the ice to thaw. If outside temperature information is available, freezing climate conditions can be taken into account to decide if the wipers are failing because of a mechanical malfunction or due to ice.
[0058] In order to provide selectivity of a system, a driver on/off sensitivity control circuit
[0059] Other mechanisms by which operation of the automatic wiper system could be disabled are disclosed in commonly assigned U.S. patent application Ser. No. 09/827,304 entitled “VEHICLE REARVIEW MIRROR ASSEMBLY INCORPORATING COMMUNICATION SYSTEM,” by Robert R. Turnbull et al., on Apr. 5, 2001, which was published as U.S. Patent Application Publication No. 2002/0032510 A1, the entire disclosure of which is incorporated herein by reference. For example, microcontroller
[0060] The system of the present invention may also include a mechanism for detecting fog on the inside or outside surface of the windshield. Such a mechanism is disclosed in U.S. Pat. No. 5,923,027, the entire disclosure of which is incorporated herein by reference. To implement such a fog detecting mechanism with the moisture sensing system of the present invention, an illuminator
[0061] According to another embodiment of the present invention, a fog detector
[0062] Emitter
[0063] Sensor
[0064] Fog detector
[0065] In general, control circuit
[0066] While fog detector
[0067] By minimizing the spacing between the optical axes of emitter
[0068] Unlike other fog detecting systems previously known, the fog detector
[0069] As shown in
[0070] Also, by combining the system shown in
[0071] Occasionally when driving up a hill, the vehicle could be positioned in such a way that the sun is directly imaged by the device. The radiative loading caused by this alignment may damage the image sensor
[0072] Although the present invention has been described as utilizing a two-dimensional array of sensors to capture a single image of a portion of the windshield, one or more one-dimensional sensor arrays or more than one two-dimensional sensor arrays may be utilized as disclosed in commonly assigned U.S. Pat. No. 6,617,564, entitled “MOISTURE SENSOR UTILIZING STEREO IMAGING WITH AN IMAGE SENSOR,” filed concurrently herewith by Harold C. Ockerse et al., the entire disclosure of which is incorporated herein by reference.
[0073] While the invention has been described in detail herein in accordance with certain preferred embodiments thereof, many modifications and changes therein may be effected by those skilled in the art without materially departing from the novel teachings and advantages of this invention. Accordingly, all such modifications are intended to be included within the scope of this invention as defined in the following claims and, therefore, it is our intent to be limited only by the scope of the appending claims and not by way of the details and instrumentalities describing the embodiments shown herein.