CN102324013B - There is the apparatus for reading of bar code that global electronic shutter controls - Google Patents

There is the apparatus for reading of bar code that global electronic shutter controls Download PDF

Info

Publication number
CN102324013B
CN102324013B CN201110220832.0A CN201110220832A CN102324013B CN 102324013 B CN102324013 B CN 102324013B CN 201110220832 A CN201110220832 A CN 201110220832A CN 102324013 B CN102324013 B CN 102324013B
Authority
CN
China
Prior art keywords
bar code
module
pixel
image sensor
sensor array
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201110220832.0A
Other languages
Chinese (zh)
Other versions
CN102324013A (en
Inventor
印军·王
H·海温斯 威廉姆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hand Held Products Inc
Original Assignee
Hand Held Products Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US11/077,975 external-priority patent/US7568628B2/en
Priority claimed from US11/077,976 external-priority patent/US7611060B2/en
Application filed by Hand Held Products Inc filed Critical Hand Held Products Inc
Publication of CN102324013A publication Critical patent/CN102324013A/en
Application granted granted Critical
Publication of CN102324013B publication Critical patent/CN102324013B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The characteristic of the present invention is the method for the clear undistorted image of a kind of cis and the corresponding target for catching the most one-dimensional or two-dimensional bar.In one embodiment, cis includes based on the two dimension image sensor array of CMOS, time block, lighting module, control module.The period irradiating target is referred to as illuminating the phase.Image sensor array catches image and is driven by time block, and in one embodiment, time block can simultaneously essentially all of pixel in exposed array.The common pixel that activates determines the exposure cycle of sensor array with the cycle that light incident illumination light is converted to electric charge.In one embodiment, in illumination period, there is at least some of of exposure cycle.

Description

There is the apparatus for reading of bar code that global electronic shutter controls
Invention field
The intersection application of related application
This PCT application requires the Application No. 11/077 submitted on March 11st, 2005,975, theme be U.S. of " have global electronic shutter control apparatus for reading of bar code " arrange application case and submit on March 11st, 2005, Application No. 11/077,976, theme be the priority of " system and method for auto-focusing cis ".Require the priority of each above-mentioned application, and the full content of each above-mentioned application is hereby expressly incorporated by reference.
Present invention relates in general to image data acquiring, more specifically, relate to that there is the image and data collector adjusting illumination with global shutter control.
Background technology
Many traditional images readers (the most hand-held and bar code of embedding installation and machine code reader) use imageing sensor based on charge-coupled device (CCD).Imageing sensor based on CCD includes the photodiode array of the heliosensitivity of electric coupling, and incident optical energy is converted to charge packet by light sensitive diode.In operation, charge packet is transferred out of ccd image sensor for next step process.
Some ciss use imageing sensor based on CMOS as optional imaging technique.As CCD, imageing sensor based on CMOS includes the photodiode array of heliosensitivity, and incident optical energy is converted to electric charge by light sensitive diode.But, unlike CCD, imageing sensor based on CMOS allows each pixel in two-dimensional array by direct addressin.One of such benefit is, the subregion of whole frame image data can be individually accessed.Another benefit of imageing sensor based on CMOS is that the cost of generally their each pixel is lower.This is produced the standard CMOS process manufacture of equipment mainly due to cmos image sensor by the considerable wafer of the normal integrated circuit producing such as microprocessor etc..In addition to reducing cost, common manufacturing process is meant to be integrated on a single-chip cmos pixel array and such as other standard electronic device such as clock driver, Digital Logical Circuits, A/D converter.And such further benefit is to reduce space requirement, and reduce power consumption.
The conventionally used belt-type shutter of cis based on CMOS is with the multiple pixels in exposed light transducer array.In rolling shutter mechanism, activate multirow pixel and read successively.Exposure or the time of integration of pixel reset between the time of pixel and the time reading pixel value.Show this conception of species in fig. 2.In Fig. 2 A, the exposure often gone in row a to row n is by multiple lines 4a ... 4n(is usually 4) diagram.The horizontal width 8 of each lines is configured to correspond with the time of exposure of an independent row.The horizontal displacement of each lines 4 represents the time shift cycle (shifting time period), in the time shift cycle, exposes often row pixel.It will be seen that consecutive rows of exposure period is crossover from Fig. 2 A.Fig. 2 B illustrates in greater detail the sequential chart about rolling shutter mechanism.The Article 2 line 12 of this sequential chart and Article 3 line 16 represent the replacement timing signal of row a respectively and read timing signal.The fourth line 20 and Article 5 line 24 represent the replacement timing signal of row b respectively and read timing signal.As shown in two Fig. 2 A, Fig. 2 B, before the value of row a being read, start to expose row b.Owing to must expose and read hundreds of row pixel when catching Frame, so the normally exposure period of adjacent row pixel substantially crossover.As shown in the illumination timing signal on Article 1 line 28, having the rolling shutter mechanism requirement of crossover exposure period, in catching the most all times needed for Frame, light source is held open, and provides illumination therefore to all row.
In operation, rolling shutter mechanism suffers at least two unfavorable conditions: image fault and image blurring.Image fault is the often capable typical product in different time exposure of pixel.When the object that reported visual sensation quickly moves, the impact of image fault is the most obvious.Fig. 3 shows the representative image using belt-type shutter shooting from left to right bus image pixel 50 through the visual field, it is shown that image table understand this impact.When the top line of the image 54 of bus is taken early than the bottom row of pixel 58, and when bus drives to the left side, the end pixel of the image pixel 58 of bus moves to the left side of the top line relative to bus pixel 54.
Image blurring is the typical product typically requiring long exposure period in rolling shutter mechanism in cis.As noted above, the light source in rolling shutter mechanism must be held open within the most all times needed for catching Frame.Due to battery and/or the restriction of light source, during catching whole frame data, the interior light provided is generally inadequate for short exposure time.There is no short exposure time, cause the impact obscured to become obvious.The common examples causing Fuzzy Influence includes such as making imageing sensor move due to the handshaking of hand-held image reader.
Image fault that cis needs to overcome existing cmos image reader to have and image blurring shortcoming.
Summary of the invention
On the one hand, the invention is characterised in that for gathering view data, cis based on complementary metal oxide semiconductors (CMOS) (CMOS) from target.Cis based on CMOS includes image sensor array based on CMOS and the time block of image sensor array telecommunication based on CMOS.Time block can expose the whole frame pixel of image sensor array based on CMOS at exposure period simultaneously.Cis based on CMOS also includes lighting module, and lighting module can irradiate target in the illumination phase.Lighting module and time block telecommunication.Cis based on CMOS farther includes and time block and the control module of lighting module telecommunication.Control module can make, in the illumination phase, at least some of exposure period occurs.In an embodiment of cis based on CMOS, target illumination is included in lighting module overdriving light source.In another embodiment of cis based on CMOS, light source includes light sensitive diode.In another embodiment of cis based on CMOS, the illumination phase starts to start afterwards exposure period, and terminates exposure period before the illumination phase terminates.In another embodiment of cis based on CMOS, start to start afterwards to illuminate the phase at exposure period, and exposure period terminates to terminate the illumination phase before.In another embodiment of cis based on CMOS, started to illuminate before exposure period starts the phase, and exposure period terminates to terminate the illumination phase before.In the further embodiment of cis based on CMOS, the duration of exposure period is less than 3.7 milliseconds.In the various embodiments of cis based on CMOS, target includes symbolism, such as one-dimensional bar code (such as 39 yards or UPC code) or two-dimensional bar (such as PDF417 bar code, Aztec's (Aztec) symbol or data matrix symbol).
On the other hand, it is a feature of the present invention that a kind of from target gather view data, cis based on complementary metal oxide semiconductors (CMOS) (CMOS).Cis based on CMOS includes integrated circuit, and integrated circuit includes at least one image sensor array based on CMOS and global electronic shutter control circuit.Global electronic shutter control circuit can generate phototiming pulse, and phototiming pulse can make the most all of whole frame pixel of image sensor array based on CMOS expose simultaneously.Cis based on CMOS also includes and the light source of integrated circuit telecommunication.Light source can irradiate the target including symbolism in response to Lighting control commutator pulse.During exposure control timing pulse, there is at least some of of Lighting control commutator pulse.In an embodiment of cis based on CMOS, include target illumination overdriving light source.In another embodiment of cis based on CMOS, light source includes light sensitive diode.In the further embodiment of cis based on CMOS, the illumination phase starts to start afterwards exposure period, and the phase that illuminates terminates to terminate before exposure period.In another embodiment of cis based on CMOS, exposure period starts to start to illuminate the phase afterwards, and exposure period terminates to terminate the illumination phase before.In another embodiment of cis based on CMOS, exposure period starts to start before to illuminate the phase, and terminates the illumination phase before exposure period terminates.In the further embodiment of cis based on CMOS, the duration of exposure period is less than 3.7 milliseconds.In the various embodiments of cis based on CMOS, target includes symbolism, such as one-dimensional bar code (such as 39 yards or UPC code) or two-dimensional bar (such as PDF417 bar code, Aztec's symbol or data matrix symbol).
On the other hand, the invention is characterised in that a kind of cis for gathering view data from target.Cis includes having at least one image sensor array and the integrated circuit of phototiming control circuit.Phototiming control circuit can generate exposure control timing pulse, and exposure control timing pulse can the simultaneously the most all of pixel in exposure image sensor array.Cis also includes and the lighting module of integrated circuit telecommunication.Lighting module includes to irradiate the light source of target in response to Lighting control commutator pulse.During exposure control timing pulse, at least some of generation of Lighting control commutator pulse.In an embodiment of cis, Lighting control commutator pulse is generated by lighting module.In another embodiment of cis, the crossover between Lighting control commutator pulse and exposure control timing pulse is adjusted by control module, control module and integrated circuit and lighting module telecommunication.In another embodiment of cis, control module includes microprocessor.In an embodiment of cis, include target illumination overdriving light source.In another embodiment of cis, light source includes light emitting diode.In another embodiment of cis, the illumination phase starts to start afterwards exposure period, and the phase that illuminates terminates to terminate before exposure period.In another embodiment of cis, exposure period starts to start afterwards to illuminate the phase, and exposure period terminates to terminate the illumination phase before.In another embodiment of cis, exposure period starts to start before to illuminate the phase, and exposure period terminates to terminate the illumination phase before.In the further embodiment of cis, the duration of exposure period is less than 3.7 milliseconds.In the various embodiments of cis based on CMOS, target includes symbolism, such as one-dimensional bar code (such as 39 yards or UPC code) or two-dimensional bar (such as PDF417 bar code, Aztec's symbol or data matrix symbol).
Another further aspect, it is a feature of the present invention that a kind of method gathering view data from target.The method includes according to Lighting control commutator pulse activating light source with illumination target.Within the duration of Lighting control commutator pulse, activating light source.The method also includes activating multiple pixel so that incident radiation is carried out light conversion simultaneously.Multiple pixel is activated according to exposure control timing pulse.The method further includes in each masked segment in multiple pixel, stores by the view data of each collection in multiple pixels.According to exposure control timing pulse, view data is stored.This method still further comprises and reads view data from multiple pixels, and wherein during Lighting control commutator pulse, at least some of exposure control timing pulse occurs.In one embodiment, the method farther includes to adjust illumination and adjusts the crossover controlled between commutator pulse and exposure control timing pulse.Adjust and managed by control module.In this embodiment of the method, control module includes microprocessor.In another embodiment of this method, include target illumination overdriving the light source in lighting module.In the additional embodiment of the method, light source includes light emitting diode.In the further embodiment of the method, in response to the stop section of spectrum assignment time block, carry out the storage of view data.In the additional embodiment of the method, the illumination phase starts to start afterwards exposure period, and the phase that illuminates terminates to terminate before exposure period.In another embodiment of the method, exposure period starts to start afterwards to illuminate the phase, and exposure period terminates to terminate the illumination phase before.In the further embodiment of the method, exposure period starts to start before to illuminate the phase, and exposure period terminates to terminate the illumination phase before.In another embodiment of the method, the duration of exposure period is less than 3.7 milliseconds.In the various embodiments of cis based on CMOS, target includes symbolism, such as one-dimensional bar code (such as 39 yards or UPC code) or two-dimensional bar (such as PDF417 bar code, Aztec's symbol or data matrix symbol).
On the other hand, it is a feature of the present invention that a kind of for from bar code symbol collection and process bar code data bar code image reader.Cis includes the two-dimensional array of the light radiation for receiving bar code symbol reflection, two-dimensional array includes more than first pixel and more than second pixel, two-dimensional array can read more than first pixel and unrelated with the reading of the second pixel, each in pixel includes photosensitive area and exhausted light shield data storage area.Cis also includes the optical module for being directed in two-dimensional array from the reflected light radiation of bar code symbol.Cis still further comprises the global electronic shutter relevant with two-dimensional array, and global electronic shutter can expose the most all of pixel in two bit arrays simultaneously.Cis also includes processor module, processor module and two-dimensional array telecommunication, and processor module can process the view data from two bit array pixels, to generate the bar code data through decoding.In an embodiment of bar code image reader, two-dimensional image sensor array is complementary metal oxide semiconductors (CMOS) (CMOS) sensor.In another embodiment of bar code image reader, process view data and include automatically identifying the output data of multiple bar code type to generate.
On the other hand, it is a feature of the present invention that a kind of cis based on complementary metal oxide semiconductors (CMOS) (CMOS) for gathering view data from target.Cis based on CMOS includes image sensor array based on CMOS, image sensor array based on CMOS includes more than first pixel and more than second pixel, image sensor array based on CMOS can read more than first pixel, and unrelated with the reading of more than second pixel, each pixel of image sensor array based on CMOS includes photosensitive area and exhausted light shield data storage area.Cis based on CMOS also includes the time block with image sensor array telecommunication based on CMOS, and time block is set to expose the whole frame pixel of image sensor array based on CMOS at exposure period simultaneously.Image sensor array based on CMOS also includes lighting module, lighting module to be set in the illumination phase irradiating target, and lighting module and time block telecommunication.Image sensor array based on CMOS also includes and time block and the control module of lighting module telecommunication, and control module is set to occur at illumination phase at least some of exposure period.
On the other hand, it is a feature of the present invention that a kind of for from target gather view data, cis based on complementary metal oxide semiconductors (CMOS) (CMOS).Image device based on CMOS reads the integrated circuit including having at least one image sensor array based on CMOS, image sensor array includes more than first pixel and more than second pixel, image sensor array based on CMOS can read more than first pixel, and unrelated with the reading of more than second pixel, each pixel of imaging array based on CMOS includes photosensitive area and exhausted light shield data storage area.Image sensor array based on CMOS also includes global electronic shutter control circuit, global electronic shutter control circuit is set to generate exposure control timing pulse, and exposure control timing pulse can expose the most all of whole frame pixel of image sensor array based on CMOS simultaneously.Image sensor array based on CMOS also includes that light source, light source are set to according to Lighting control commutator pulse irradiation target, light source and integrated circuit telecommunication.In the operation of cis based on CMOS, Lighting control commutator pulse and at least some of crossover of exposure control timing pulse.In an embodiment of cis based on CMOS, include target illumination overdriving the light source in lighting module.In another embodiment of reader based on CMOS, light source includes light emitting diode.In another embodiment of cis based on CMOS, the duration of exposure control timing pulse is shorter than Lighting control commutator pulse.In another embodiment of cis based on CMOS, the duration of Lighting control commutator pulse is shorter than exposure control timing pulse.In another embodiment of cis based on CMOS, exposure control timing pulse starts to start Lighting control commutator pulse before, and exposure control timing pulse terminates to terminate Lighting control commutator pulse before.In another embodiment of cis based on CMOS, the duration of exposure control timing pulse is less than 3.7 milliseconds.In the further embodiment of cis based on CMOS, target includes symbolism.In this embodiment, symbolism is one-dimensional bar code.In another this embodiment, symbolism is two-dimensional bar.In this embodiment, two-dimensional bar is PDF417 bar code.
On the other hand, it is a feature of the present invention that a kind of bar code image reader for gathering view data from bar code.Cis includes the integrated circuit with at least one two-dimensional image sensor array, two-dimensional image sensor array includes multiple active pixel, each active pixel includes that at least one shields data storage area, and two-dimensional image sensor array can apply transmission function (transfer Function), so that incident intensity is converted to output voltage, transmission function includes having the first area of the first slope and have the second area of the second slope, when incident intensity is higher than specified level, two-dimensional image sensor array can apply the second area of transmission function, when incident intensity is less than specified level, and two-dimensional image sensor array can apply the first area of transmission function.Bar code image reader also includes phototiming control circuit, phototiming control circuit is set to generate exposure control timing pulse, and phototiming controls pulse simultaneously all of the or the most all of pixel in exposure image sensor array can change incident radiation with light.In one embodiment, the duration of exposure control timing pulse is less than 3.7 milliseconds.In another embodiment, the dynamic range of two-dimensional image array sensor is more than 65 decibels.
Another further aspect, a kind of method that it is a feature of the present invention that automatic focusedimage reader.The method includes using optical system will to be directed on imageing sensor by the luminous energy of target reflection.The method is additionally included in the multirow pixel in exposed frame phase exposure image sensor successively, and the exposed frame phase is defined as first exposure from multirow and starts to last till in multirow the persistent period of last end exposure.The method also includes that arranging the second setting from first changes optical system stepwise, first is set to the setting when being positioned at the picture rich in detail of object of cis the first distance and being formed on the image sensor, and second is set to the setting when the picture rich in detail of the object being positioned at cis second distance is formed on the image sensor.The method also includes that the multirow pixel from imageing sensor reads multi-line images data, and wherein, at least some of exposed frame phase, optical system changes optical system stepwise.In one embodiment, the method also includes the picture rich in detail according to the target formed on the image sensor, analyzes multi-line images data, thinks that optical system determines suitably setting.In another embodiment, the while that the method also including, the multirow in exposure image sensor is to generate target image.In an embodiment of the method, in cis, the exposure period of adjacent row pixel overlaps each other.In another embodiment of the method, target includes symbolism.In this embodiment, symbolism is one-dimensional bar code.In another this embodiment, symbolism is two-dimensional bar.
On the other hand, the invention is characterised in that a kind of cis with automatic focusing performance.Cis includes the integrated circuit with at least one image sensor array.Cis also includes the optical system that can be directed on image sensor array by the reflection light of target, optical system has multiple focal length and arranges, first focal length setting corresponds to the object of cis the first distance and forms picture rich in detail on the image sensor, and the second focal length arranges the object corresponded at cis second distance and forms picture rich in detail on the image sensor.Cis also includes the multirow pixel that belt-type shutter control module, belt-type shutter control module are set in exposure image sensor array successively, to gather the view data focused on.Cis also includes automatic focus module, automatically focus module is set to analyze the view data focused on, to determine that the focal length of target is arranged, the focal length of this target arranges the picture rich in detail corresponding to forming target on the image sensor, wherein, in at least one of period that belt-type shutter control module exposes multirow pixel successively, optical system can arrange the second focal length from the first focal length and arrange step change.In one embodiment, cis also includes that global electronic shutter control module, global electronic shutter control module are set to once it is determined that the focal length of target is arranged, then the multirow pixel in exposure image sensor array while, with acquisition frame view data.In the further embodiment of cis, belt-type shutter control module and global electronic shutter control module are integrated on the same integrated circuit, and this integrated circuit comprises image sensor array.In the further embodiment of cis, belt-type shutter control module and global electronic shutter control module are included in a pattern matrix control module.In another embodiment of cis, roller shutter type control module can make the exposure period of the pixel of adjacent row overlap each other.
On the other hand, it is a feature of the present invention that a kind of cis being minimized for making ambient-light images deteriorate.Cis includes the integrated circuit with at least one image sensor array, and image sensor array provides one to be applicable to the signal that light intensity judges.Cis also includes the multirow pixel that belt-type shutter control module, belt-type shutter control module are set in exposure image sensor array successively.Cis also includes global electronic shutter control module, multirow pixel in exposure image sensor array while that global electronic shutter control module being set to, wherein, can be according to being applicable to the signal that light intensity judges, and select in belt-type shutter control module and global electronic shutter control module, to control image sensor array.In an embodiment of cis, the signal judged for light intensity includes the signal relevant with the intensity of light source of cis.In another embodiment of cis, the signal being suitable for light intensity judgement can be used for determining that the minimum integration time is enough.In the further embodiment of cis, it is suitable for the signal of light intensity judgement for judging that whether the time of exposure (the also referred to as time of integration) of current environmental condition is less than the minimum integration time calculated.In another embodiment of cis, belt-type shutter control module and global electronic shutter control module are integrated on the same integrated circuit, and this integrated circuit comprises image sensor array.
On the other hand, it is a feature of the present invention that a kind of method that view data degeneration making cis collection is minimized.The method includes determining at least one parameter relevant with ambient light intensity, and analyzes this parameter.This method also includes the analysis according at least one parameter, to the image sensor array in cis from global electronic shutter control model to the conversion and control of belt-type shutter control model.In an embodiment of the method, this at least one parameter includes the time of exposure of current environmental condition.In another embodiment of the method, the analysis of this at least one parameter includes the ratio of time of exposure and the scheduled exposure time calculating current environmental condition.In one suchembodiment, scheduled exposure time is the illumination that light source based on cis provides.In another embodiment of the method, analyze at least one parameter and include determining whether ambient light intensity exceedes predetermined threshold with the ratio of the intensity of light source of cis.
With reference to description given below and claims, the present invention is aforesaid and other purpose, aspect, feature and beneficial effect will be apparent from.
Accompanying drawing explanation
With reference to following accompanying drawing, claims, the purpose of the present invention and feature be will be better understood.Accompanying drawing is not intended to protection domain, and should lay stress in the description of the principle of the present invention.In the accompanying drawings, identical being noted for indicates the same parts in each different views.
Figure 1A is the block diagram of an embodiment of the cis of the principle structure according to the present invention;
Figure 1B is the schematic block diagram of the automatic identification module for the present invention;
Fig. 1 C is the flow process realizing being included between different pieces of information form types the principle of the invention of identification automatically;
Fig. 2 A shows the operation of the imageing sensor using rolling shutter mechanism according to prior art;
Fig. 2 B is relative to the sequential chart for prior art rolling shutter mechanism shown in Fig. 2 A;
Fig. 3 is the image shot by the imageing sensor of prior art;
Fig. 4 A is and one corresponding circuit block diagram of specific embodiment of the present invention;
Fig. 4 B is and the present invention corresponding circuit block diagram of another specific embodiment;
Fig. 5 A is the block diagram of an embodiment of the lighting module in the cis of constructed in accordance with the principles;
Fig. 5 B is the block diagram of an embodiment of the image capture module in the cis of constructed in accordance with the principles;
Fig. 6 is the perspective view of an embodiment of the hand-held image reader of constructed in accordance with the principles;
Fig. 7 is the schematic diagram of an embodiment of the cis of constructed in accordance with the principles;
Fig. 8 A is to be applied to the partial schematic diagram of one embodiment of image sensor array in the prior art of one embodiment of cis shown in Fig. 7;
Fig. 8 B and 8C is the sectional view of the dot structure details of the prior art of the embodiment being applied to the cis shown in Fig. 7;
Fig. 9 is for gathering the flow chart of an embodiment of the process of view data according to the principle of the invention;
Figure 10 A, 10B, 10C and 10D are the sequential charts of the various embodiments of process shown in Fig. 9;
Figure 10 E shows the Lighting control commutator pulse including multiple independent pulse;
Figure 11 is the partial schematic diagram of the imageing sensor according to prior art;
Figure 12 is the sequential chart of the imageing sensor of the prior art shown in Figure 11;
Figure 13 is for the flow chart of an embodiment of automatic focusing according to the principle of the invention;
Figure 14 is for changing the flow chart of an embodiment of the process of operator scheme according to the principle of the invention;
Figure 15 A, 15B and 15C are the various views of an embodiment of constructed in accordance with the principles portable data terminal cis;
Figure 16 is the circuit block diagram of one embodiment of portable data terminal cis shown in Figure 15 A, 15B and 15C;
Figure 17 A shows an embodiment of the multiple Curved dectection figures that can be applicable to the present invention;
Figure 17 B shows another embodiment of the multiple Curved dectection figures that can be applicable to the present invention;
Figure 18 is the histogram analysis schematic diagram that can use in one embodiment of the invention;
Figure 19 A to Figure 19 D is the schematic diagram that view data separation according to embodiments of the present invention processes;
Figure 20 is the theory diagram of an embodiment of the lens actuator of constructed in accordance with the principles;
Figure 21,22A and 22B are the chart explanations of focus level detection process according to embodiments of the present invention;
Figure 23,24,25,26 and 27 are the flow charts implementing adaptable various focusing according to the present invention;
Figure 28 A, 28B and 28C show image sensor pixel array, and wherein, shadow region represents when image sensor array is operated with window frame operator scheme, pixel neighbouring on the many groups position that can optionally be addressed and be read;
Figure 29,30A, 30B show the chart of the focus level detection process that may be used for the embodiment of the present invention;
Figure 31 and 32 shows the flow chart of the additional treatments can carried out according to embodiments of the invention;
Figure 33 is the decomposition assembled view of the image-forming module according to the present invention;
Figure 34 is the front view of the image-forming module shown in Figure 33;
Figure 35 is the side view of the image-forming module of the assembling shown in Figure 33;
Figure 36 is the base plate of the illumination figure and target figure with bar code symbol, having projection on it and the whole frame ken describing with good grounds cis of the present invention on it, and this base plate is projected out illumination figure and target figure;And
Figure 37 is the chart describing the various embodiments of the present invention with the LED luminous with different-waveband.
The detailed description of invention
Inventive feature is the method for the clear and distortionless image of a kind of cis and a kind of corresponding seizure target.In one embodiment, cis includes: image sensor array based on CMOS, time block, lighting module and the control module of two dimension, they are telecommunication each other.Light is impinged upon in the target of such as symbolism (the most one-dimensional or two-dimensional bar) by lighting module, in order to image sensor array can gather reflection light and process.The target irradiated time referred to as illuminates the phase.The seizure of image is driven by image sensor array by time block, and in one embodiment, time block can expose all of or the most all of pixel in this array simultaneously.In sensor array, while pixel, exposure can make cis capture the image of non-distorted.Jointly activating pixel with the timing definition exposure period as sensor array that incident illumination light is converted to electric charge.At the end of exposure period, the memory block that electric charge is transferred to shield will be assembled, until data are read.In one embodiment, exposure period and illumination phase are controlled by control module.In this embodiment, there is at least one section of exposure period in control module during making illumination.By fully shortening illumination phase or exposure period in the case of weak ambient light, or fully shortening exposure period in the case of strong ambient light, the cis of the present invention can capture the most unambiguous image.
With reference to Figure 1A, it is shown that the block diagram of normal image reader 100 constructed according to the invention.Normal image reader includes one or more in following modules: lighting module 104, image capture module 108, control module 112, memory module 116, input/output module 120, stimulating module 124, user feedback module 128, display module 132, Subscriber Interface Module SIM 134, radio-frequency discriminating (RFID) module 136, smart card module 140, magnetic stripe card module 144, decoder module 150, automatically identification module 152, and/or one or more power module 168, and lens driver module 165.In different embodiments, each in these modules can combine with one or more other module.In one embodiment, cis 100 includes the bar code image reader with imageing sensor based on whole frame electronic global shutter, and imageing sensor can simultaneously the most all of pixel in exposure image sensor.In one suchembodiment, imageing sensor is imageing sensor based on CMOS.In another such embodiment, imageing sensor is imageing sensor based on CCD.
When receiving the view data transmitted by control module 112, data form decoder module 150(can also be for bar code symbol data form decoder module) may search for the view data for labelling, such as quiescent centre, the instruction that data form exists, the most one-dimensional or two-dimensional bar.If potential data form is positioned, then view data is applied one or more data form decoding algorithms by data form decoder module 150.If decoding trial and success, then cis passes through the data form data of decoding by I/0 module 120 output, and sends the successful alarm signal of reading, is such as sounded a buzzer by Subscriber Interface Module SIM 134.
Cis 100 can also include automatic identification module 152.With reference to Figure 1B, automatic identification module 152 can comprise data form decoder module 150 and image procossing and analysis module 1208, mutual telecommunication between data form decoder module 150 and image procossing and analysis module 1208.
As shown in this embodiment, image procossing and analysis module 1208 include characteristic extracting module 1212, universal classification module 1216, signed data processing module 1218, OCR decoder module 1222 and image analysis module 1224, mutual telecommunication between these modules.It addition, as shown in Figure 1B, characteristic extracting module 1212 includes binary data compilation module 1226, line thinning module 1228 and convolution module 1230, mutual telecommunication between these modules.
Fig. 1 C shows the process 1300 of application one embodiment of the invention, and this embodiment of the present invention make use of the automatic identification module shown in Figure 1B.Process 1300 includes that cis record makes event (such as when the trigger signal that action module 124 detects) (step 1302), and as response, uses cis 100 to gather view data (step 1304) from target.The acquisition step of view data is used twice with such as process 300, this process of process 400(, sees Figure 13, Figure 23, Figure 24), process 600, process 800 etc. consistent.After collection, view data is sent to data form decoder module 150(step 1308).The labelling of data form decoder module search view data, such as quiescent centre, the instruction that data form exists, the most one-dimensional or two-dimensional bar (step 1310).If potential data form is determined, then data form decoder module 150 applies one or more data forms decoding algorithm (step 1314) to view data subsequently.If decoding trial and success, then cis 100 output is through data form data (step 1318) of decoding, and uses the warning of such as buzzer to send the successful signal (step 1322) of reading.
In one embodiment, if decoding is attempted unsuccessfully, then view data is sent to image procossing and analyzes module 1208(step 1326).In another embodiment, the process of view data and the trial to the decoding of data form data are carried out parallel.In such an embodiment, the process (such as, data form decoding is attempted or image procossing) first completed exports its data (such as, bar code or the feature of seizure through decoding), and terminates another parallel processing.In a further embodiment, view data is processed according to the decoding of data form.In such an embodiment, it should catch the project information of bar code code, such as transport label number and the information of indicative character labelling.
In image procossing and analysis module 1208, view data is processed by characteristic extracting module 1212.Generally, characteristic extracting module generates the numeral output representing view data feature.As it appears from the above, view data feature refers to the data type feature comprised in view data.The usual type of feature includes one-dimensional or two-dimensional bar feature, marker characteristic, graphic feature, print text feature, handwritten text feature, picture or characteristics of image and photo eigen etc..In which kind of category feature in office, the subcategory of feature can be identified sometimes.
Process a part for view data as characteristic extracting module 1212, view data is processed (step 1328) by binary data compilation module 1226.Grey scale image binary data compilation, according to local threshold and target image size standardization, is binary picture by binary data compilation module 1226.Along with view data is collected by binary data, view data is processed by line thinning module 1228, so that many pixels thick segment to be reduced to single pixel thick line (step 1332).Along with by binary data line thinning view data, view data is processed (step 1336) by convolution module 1230.
Generally, convolution module 1230 uses one or more detection figure according to present invention design, the view data processed is carried out convolution, to identify the feature in various view data.In one embodiment, convolution module 1230 is a pair numeral of detection figure generation of each convolution, i.e. average and variance (or standard deviation).Figure 17 A shows that one group 12 2x3 binary curve ripples detect Figure 125 0, curve element present in the inspection image data.Owing to each curve ripple detects Figure 125 0 and view data convolution, the meansigma methods of generation and variance provide density or the instruction of existence of the element in the line thinning view data with the binary compilation detecting Figure 125 0 similar shape with convolution.Owing to each pixel map generates a pair numeral, 12 curve ripples detect Figure 125 0 and generate altogether 24 numerals.According to an embodiment, the curve of the view data that these 24 digital representative office managed or marker characteristic.
Processing further of view data includes that the output of characteristic extracting module 1212 enters universal classification module 1216(step 1340).Universal classification module 1216 uses numeral that characteristic extracting module generates as the input to neutral net, mean square error grader etc..These instruments are used these view data to be assigned in universal classification.In the embodiment using neutral net, different neural network structures are consistent with the present invention, to complete different operation optimizations and characteristic.In the embodiment using neutral net, universal classification module 1212 includes that 24+12+6+1=43 node feedovers, propagates multilayer neural network afterwards.Input layer has 24 nodes, for the average generated by the convolution module 1230 using 12 curve ripples to detect Figure 125 0 and variance output.In the neutral net of this embodiment, including there is the hidden layer of 12 nodes and there is the hidden layer of 6 nodes.The most also there is an output node, with reporter marker feature presence or absence.
In another embodiment using neutral net, convolution module 1230 employs 20 shown in Figure 17 B curve ripple and detects Figure 126 0.As it can be seen, 20 curve ripples detect Figure 126 0 and include that 12 curve ripples initial in Figure 17 A detect Figure 125 0.Other 8 pixel maps 1260 are for providing the directional information about marker characteristic.Using 20 curve ripples to detect in an embodiment of Figure 126 0, universal classification module 216 is to have 40+40+20+9=109 node feedforward, backpropagation multilayer neutral net.Input layer has 40 nodes, for the 20 pairs of averages generated by the convolution module 1230 using 20 curve ripples to detect Figure 126 0 and variance input.In the neutral net of this embodiment, being respectively provided with two hidden layers of 40 nodes and 20 nodes, an output node is for reporter marker feature presence or absence, and the orientation angle of 8 output node reporter marker features.8 output nodes provide 28=256 kinds of possible orientation mode.Therefore, orientation angle is set between the angle of 0 to 360, increases with 1.4 angles.
In certain embodiments, universal classification module 1216 can sort data in the expanded set of kind.Such as, in certain embodiments, universal classification module 1216 determines whether view data includes different data types, such as signature, data form, handwritten text, print text, machine-readable text, OCR data, figure, picture, image, form are (such as, transport manifest, bill of lading, identity card etc.), fingerprint, bioassay (such as fingerprint, facial image, retina scanning etc.) and/or other type of identifier.In a further embodiment, universal classification module 1216 determines whether view data includes the various combinations of these data types.In certain embodiments, universal classification module 1216 determines whether view data includes specific data type.In this embodiment, image procossing and analysis module 1208 are included in identification module, and identification module is according to whether there is specific data type (such as signature or bioassay) in view data, and exports affirmative or negative acknowledge.
In one embodiment, once confirm marker characteristic and exist, and determine its substantially orientation, then view data is sent to marker characteristic data processing module 1218.In one embodiment, marker characteristic data processing module 1218 border of signature in inspection image data.In one embodiment, histogram analysis is used to detect the border of signature.As shown in figure 18, histogram analysis includes a series of along the one-dimension slice both vertically and horizontally defined relative to marker characteristic direction.In one embodiment, the value of each one-dimension slice is corresponding with the quantity of the black pixel along pixel slices (that is, 0 value).In certain embodiments, if bar code is not decoded, then catch some appointments district (such as center) of whole frame image data, for signature analysis.Once completing, histogram analysis provides the X-Y scheme of the density of data element pixel in view data.Signature border determines relative to minimum density, and a number of serial section must reach this minimum density.In one embodiment, histogram analysis is along vertically and horizontally at inner search, until picture element density is increased to more than predetermined by threshold value.Low by threshold value owing to generally using so that marker characteristic data will not be cropped because of carelessness.
In one embodiment, once it is determined that the border of marker characteristic, then marker characteristic data processing module 1218 cutting view data and extract marker characteristic view data.In this embodiment, image modification module carry out cutting, and image modification module generates amended view data, does not include that the part of the view data of marker characteristic has been deleted in amended view data.In other embodiments, apply various compress technique to reduce the storage demand of marker characteristic view data.One this technology includes by haul distance coding symbols character image data.According to this technology, for each haul distance (that is, each haul distance of 1 or 0) of similar binary data compilation value of each scan line as rebuilding the means of bitmap and record.Another decoding technique is using marker characteristic view data as data structure, and wherein, the element of data structure includes vector.According to this decoding technique, marker characteristic is decomposed into vector set.The position of each vector is combined with length and the direction of each vector, is used for rebuilding original marking feature.In this embodiment, as long as the curvature of contiguous pixels stroke exceedes designated value, then decoding process generates new vector.Further compress technique application B-spline curve fitting.This technology can strictly regulate curvature and scaling study.
In various embodiments, the marker characteristic view data of marker characteristic view data or compression or decoded version is stored on the private memory equipment of this locality.In this embodiment, local memory device can be the storage device that such as Compact Flash following detailed description of etc. can be spaced apart.In another embodiment, marker characteristic view data is stored in the volatilization of general-purpose storage or nonvolatile part, and downloads in the future.In a further embodiment, catching when or later time point (time such as, when data acquisition speech channel), it is possible to by wired or wireless means emission mark character image data.
In another embodiment, once it is determined that the existence of marker characteristic, marker characteristic data processing module 218 does not perform histogram analysis, and storage complete image or the image of compressed version the most in memory.In another embodiment, in order to save the process time, the image of low resolution carries out initial pictures analysis.In this embodiment, once it is determined that the existence of marker characteristic, by the image of shooting higher resolution.In this embodiment, execution flag feature extraction histogram analysis on this image.It follows that image is stored on a memory with compression or unprocessed form.In certain embodiments, view data is combined with other data to form the record of specific project (such as, parcel envelope or transport envelope).As mentioned above, cis 100 can gather some additional datas, and and store together with marker characteristic data or it is spaced from marker characteristic data and separates, but additional data includes being not limited to data form data, handwritten text data, typewriting text data, graph data, image or image data etc..
Can be designed as performing the particular task of different types of data as a part for operation, image procossing and analysis module 1208.Such as, if universal classification module 1216 judges that view data includes typewriting or machine-readable text, then view data can be collected, or by histogram analysis, and store, or alternatively, view data can be transmitted to OCR decoder module 1222.Similarly, if universal classification module 1216 judges that view data includes graphic element, then view data can be transmitted to image analysis module 1224 and processes.In one embodiment, image analysis module 1224 is set to identify and decoding predetermined image.In this embodiment, pattern analysis can include determining that the file bill that have selected on shipping label and which frame (if any) installed in instruction.In a further embodiment, the typewriting during pattern analysis can include the zip box on location and decoding shipping label or hand-written text.In an alternate embodiment of the invention, cis 100 could be arranged to, and before activating characteristic extracting module 1212, automatically attempts to the decoding operation in addition to data form decodes, such as OCR decoding or graphic decoder.
In another embodiment, view data is divided into multiple region by image procossing and analysis module 1208, and then each region carries out feature extraction and general classification analysis.In shown in Figure 19 A a embodiment, standard rectangular image data window is divided into the sub-rectangle of four equivalent size.In another embodiment shown in Figure 19 B, separate and include overlapping areas, so that the whole area of separated region is more than the whole field of view data.Fig. 8 B has 7 shown overlapping areas, shows each label at the center of each overlapping areas.In the further embodiment shown in Figure 19 C and 19D, separate the sample area in the whole field being included in view data (as intersected shown in hachure).In another embodiment, sample area can user template based on prestrain, such as the region of interest (such as, the marker characteristic district in such as shipping label and/or bar code area) during user template can identify such as shipping label.
In one embodiment, segmentation procedures is for identifying the position of marker characteristic in view data, and view data can include the additional elements of such as data form, and data form includes bar code data list, text, figure, image etc..In this embodiment, the classifying content in each region of the universal classification module 1216 view data to separating.Then the region comprising marker characteristic is extracted by marker characteristic data processing module 1218.In one embodiment, if it is indicated that multiple region comprises marker characteristic data, then marker characteristic data processing module 1218 analyzes the arrangement in these regions to identify the region that most probable comprises graph data.In a further embodiment, when indicating multiple regions to comprise marker characteristic data, then image procossing and analysis module set up feedback loop, here generate other separated region and are analyzed, until the single separated region comprising marker characteristic data is positioned.
Application No. 10/958,779, filing date October 5, theme in 2004 are " system and method automatically identified between signature and bar code " (" System And Method To Automatically Discriminate Between A Signature And A Bar code ") United States Patent (USP) in describe the other image processing operations that cis 100 can perform, entire contents is hereby expressly incorporated by reference.
With reference to the optional feature of the cis 100 of instruction in Figure 1A and Fig. 5 A, lighting module can include light source 160, lighting control module 164, mains lighting supply module 168a and interface module 172.In various embodiments, light source 160 can include the LED of white or colour, such as 660nm illumination LED, infrared LEDs, ultraviolet LED, laser, halogen light modulation, arc light or incandescent light modulation, they can produce enough light intensities under given cis power constraint and image sensor exposure/sensitivity requirement.In many examples, owing to the Effec-tive Function of LED makes power consumption relatively low, so selecting LED as light source.Lighting control module 164 controls the operation of lighting module 104, and can include timing and light source activation and the circuit of deactivation.Mains lighting supply module 168a provides the energy of necessity to drive light source 160, and it can include battery, electric capacity, inductance, transformator, quasiconductor, integrated circuit etc..In an alternate embodiment of the invention, some or all elements of mains lighting supply module 168a is positioned at the outside of lighting module.The cis 100 with a common power is this embodiment.Interface module 172 is for needing other module communication of simultaneously operating in cis 100.This can include, such as, and above-mentioned illumination phase and the regulation of exposure period.
Outside drawing with reference to Figure 33 to Figure 36, it is shown that and describe the various parts of lighting module 104 according to an embodiment of the invention and image capture module 108.Such as the embodiment of Figure 15 A to 15C, the cis 100 of the present invention can include the image-forming module of such as image-forming module 1802.Image-forming module 1802 as shown in Figure 33 to Figure 35 combine herein with reference to some characteristics of IT400 image-forming module and additional characteristic.Image-forming module 1802 includes the first circuit board 1804 being provided with light source 160a, 160b, second circuit board 1806 be provided with light source 160c, 160d, 160e, 160f, 160g, 160h, 160i, 160j, 160k, 1601,160m, 160n, 160o, 160p, 160q, 160r, 160s and 160t(be hereinafter referred to as 160c to 160t).First circuit board 1804 is also equipped with imaging array 182.Image-forming module 1802 also includes a support component 1810 with lens mount 1812, and a support component 1810 supports the lens barrel 1814 being provided with imaging lens 212.Light source 160a, 160b focus lighting source, and light source 160c to 160t is lighting source.With reference to Figure 36, base plate is provided with the decodable code labelling of such as bar code symbol 1835, and two-dimensional illumination pattern 1830 is projected on base plate by lighting source 160c to 160t, and focus lighting source 160a, 160b are projected as focusing patterns 1838.Illustrate and in the embodiment that describes combining Figure 33 to Figure 36, the light of focusing lighting source 160a, 160b is combined lens 1842 by Shan seam (slit apertures) 1840 and shapes, slit 1840 is imaged onto on base plate to form focus image 1838 by lens, in embodiment in Figure 33 is to 36, focus image 1838 is wire type pattern 1838.The whole frame visual field of the generally corresponding cis 100 specified by frame 1850 of lighting pattern 1830.Focusing patterns 1838 is horizontal-extending linear of the central region of cis 100.When operating all of lighting source 160c to 160t simultaneously, lighting pattern 1830 can be projected as.When being energized to the subset of light source 160c to 160t simultaneously, it is also possible to be projected as lighting pattern 1830.When only one of which energising in light source 160c to 160t, such as LED 160s or 160t, it is also possible to be projected as lighting pattern 1830.The projection angle of LED 160s and 160t of image-forming module 1802 projection angle than LED 160c to 160t is wide.
As shown in Figure 5 B, image capture module 108 in one embodiment includes optical module 178, sensor array module 182 and sensor array control module 186, these modules telecommunication each other.Optical module 178 includes the imaging len for guiding and focus on reflected radiation or other optical element.In certain embodiments, optical module 178 includes auxiliary circuit and disposal ability, and they can serve as automatically determining a part for imaging object proper focal length.
(85) sensor array control module 186 includes the addressing of global electronic shutter control module 190, row and column and decoder module 194 and read module 198, each of which module and other module telecommunications one or more in sensor array control module 186.In one embodiment, sensor array module 182 includes having the IC chip 1082(of two-dimensional image sensor array 182 based on CMOS as shown in Figure 4 A) parts.In various embodiments, the auxiliary circuit of such as analog-to-digital conversion etc. can be spaced apart out from image sensor array or be integrated in the chip as image sensor array.In an alternate embodiment of the invention, sensor array module 182 may be configured to expose the ccd sensor array storing whole frame image data simultaneously.As described in one embodiment above, global electronic shutter control module 190 can all and simultaneously all of or the most all of pixel in exposure image sensor array.In one embodiment, global electronic shutter control module 190 includes time block.Row and column addressing and decoder module 194 are for selecting specific pixel for various operations (such as, gathering activation, the storage of electronic shutter data and digital independent).Read module 198 is organized and is processed and reads data from sensor array.In certain embodiments, sensor array control module 186 farther includes roller shutter type control module 202, the pixel column that roller shutter type control module 202 can expose successively and read in image sensor array.
With reference to Fig. 4 A, the particular embodiment of cis 100 is described.In the embodiment of Fig. 4 A, there is the image sensor array 182 of two-dimensional array 250,182a is attached on CMOS integrated circuit (IC) chip 1082,1082a.As described in below with reference to Fig. 8 A, image sensor array 182a is the cmos image sensor array being suitable for making in global shutter mode of operation.Each pixel 250 of cmos image sensor array 182a has on sheet pixel amplifier 254(as shown in Figure 8 A) and sheet on light shield memory block 286(as shown in Fig. 8 B, 8C).As shown in Figure 8 A, image sensor array 182a can also have two-dimentional telecommunication grid 262, and grid 262 and pixel 250 telecommunication are electrically interconnected.Image sensor array 182a can also have the row circuit 296 on chip and column circuits 270.Row circuit 296 and column circuits 270 can enable one or more various process and operation task (such as, address pixel, decoding signal, the amplification of signal, the conversion of analog-to-digital signal, apply timing, reading and reset signal etc.).Another aspect with reference to cmos image sensor IC chip 182a, on the chip identical with pixel 250, CMOS image sensor IC chip 182a includes: row circuit 296, column circuits 270, process and control circuit 254 including pixel amplifier 255, light shield memory block 258, line 262 mutually, gain circuitry 1084, a/D converter circuit 1086, and line drive circuit 1090, CMOS image sensor IC chip 182a generates the multidigit (such as 8 of the incident illumination in each pixel 250 of instruction array, 10) signal, occur on one group of output pin of chip 1082a.Element on the other sheet of reference picture sensor IC chip 1082a, cmos image sensor IC chip 1082a includes that timing/control circuit 1092, regularly/control circuit 1092 can include that this base part is as bias circuit, clock/regularly generative circuit and agitator etc..Regularly/control circuit 1092 can form a part for the sensor array control module 108 relevant with Fig. 5 B.
With reference to the another aspect of the cis 100 of Fig. 4 A, cis 100 includes primary processor IC chip 548, memory module 116, lighting module 104 and exciting module 124.Primary processor IC chip 548 can be the multi-functional IC chip with integrated frame grabber 549 and CPU (CPU).The processor IC chip 548 with integrated frame grabber can be the XSCALE such as with " quickly catching camera interface " PXA27X(INTEL supplies) processor IC chip.Cis 100 farther includes active module 124, and active module 124 produces the triggering signal started for making bar code decoding process.Active module 124 can include manual actuation trigger 216.Cis 100 farther includes imaging len 212 and memory module 116, and memory module 116 includes the storage devices such as such as RAM, EPROM, flash memory.Memory module 116 is communicated with processor IC chip 548 by system bus 584.Processor IC chip 548 can be programmed or be set to, to perform the difference in functionality needed with reference to the module 104,108,112,120,124,128,132,134,136,140,144,150,152,168,165 that Fig. 1 describes.In the embodiment of Fig. 4 A, the function of data decoder module 150 and automatic identification module 152 is performed by processor IC chip 548, and processor IC chip 548 operates according to the specific software being stored in memory module 116.Therefore, the embodiment being combined in Fig. 4 A of processor IC chip 548 and memory module 116 is denoted as 150,152.
With reference to Fig. 4 B, it is shown that have the embodiment of the cis 100 of ccd image sensor chip 1082,1082b.Ccd image sensor IC chip 1082b includes the area array of pixel 250, depositor 1094 and out amplifier 1096, and they are combined on chip 1082b.The electric charge relevant with each pixel is converted to voltage successively by output register 1094 with auxiliary circuit, and pixel image signal is sent to the parts outside chip 1082b.When starting reading out view data, the electric charge in the first row of pixel 250 is sequentially transmitted to output register 1094.Output register 1094 injects charge into amplifier 1096 successively, and amplifier 1096 converts pixel charge to voltage, and image processing circuit 1070 is applied signal.When electric charge is sent to output register 1094 from the first row pixel, the electric charge line down of next line, so, when the first row electric charge has been translated into voltage when, output register 1094 receives the electric charge of the second row pixel.Continue with until reading the view data of the pixel of all row corresponding to image sensor array 182b.Cis 100 also includes the imaging signal processing circuit 1070 outside chip 1082b.Imaging signal processing circuit 1070 includes the element of such as gain circuitry 1072, analog-digital converter 1074 and line drive 1076 etc..The timing and control circuits 1078 of circuit 1070 can include the element of such as bias generator, agitator, clock and timing generator etc..Gain circuitry 1072 can include that the additional function realizing such as correlated-double-sampling is to reduce pixel-shift and effect of noise.Fig. 4 A shows the optional feature of cis 100.In the IC chip (IC chip) that imaging signal processing circuit 1070 can be included in outside image sensor IC chip 1082b.
In one embodiment, IMAGETEAMTMArea(2D) any one in imaging engine can provide image capture module 108 and the parts of lighting module 104 of constructed in accordance with the principles, the 4000 OEM 2D imaging engines such as constructed according to the principle of the present invention, by being positioned at 700 Visions Drive, P.O. Box 208, Skaneateles Falls, the Hand Held Products, Inc. of NY provides.
(90) with reference to Fig. 6, it is shown that the perspective view of the hand-held image reader 100a constructed according to one embodiment of present invention.Hand-held image reader 100a includes housing 208, multiple light source 160, lens 212, trigger 216 and interface cable 200.In various embodiments, the function of cis 100a can be by area (2D) IMAGETEAMTMAny one of cis provides, such as model 4410,4600 or 4800(Hand Held Products, Inc supply), and can be constructed according to the invention.The all modules 104,108,112,116,120,124,128,132,134,136,140,144,150,152,165 and 168 described in conjunction with Figure 1A can be combined as a whole, and can be supported by the optional housing 506 shown in hand-held housing 208 or Figure 15 A, so, housing 208 or housing 506 encapsulate and support various module.Similarly, all parts shown in Fig. 4 A, Fig. 4 B and Figure 16 can be combined as a whole, and is supported by housing 208 or housing 506, and so, housing 208 or housing 506 encapsulate and support various parts.Lens 212 can include glass and/or Merlon.Lens 212 can be simple lens, or includes multiple lenticular unit, i.e. lens 212 can be paired lens, three lens etc..
With reference to Fig. 7, it is shown that combine the generalized section of the schematic diagram of cis 100.Cis 100 includes light source 160, lighting control module 164, power module 168b and interface module 172, the mutual telecommunication of these modules.Luminous energy 162 is shone directly into the target 166 including symbolism 170 by light source 160.The reflected radiation 174 of target 166 is focused on image sensor array 182 by lens 212, image sensor array 182 and sensor array control module 186 and power module 168b telecommunication.In one embodiment, image sensor array 182 is image sensor array based on CMOS.In another embodiment, image sensor array 182 is image sensor array based on CCD.Sensor array control module 186 and memory module 116 telecommunication, control module 112, with power module 168b and interface module 172 telecommunication.Generally, optical window (not shown) is placed on before scanning device, to reduce the probability of unit infringement.
With reference to Fig. 8 A, illustrate in greater detail the Local map of image sensor array 182a based on CMOS.Image sensor array 182a includes the two-dimensional array of pixel 250.Each pixel includes photosensitive area 252 and processes and control circuit 254, process and control circuit 254 include that amplifier 255 and shielding memory block 258(are clear in order to describe, only provide the label 252,254,255,258 relevant with single pixel).The existence of amplifier 255 means that cmos image array 182a is considered active pixel array, i.e. each pixel of cmos image array 182a can amplify the signal that incident optical energy generates through light conversion.The change-over circuit of charge-voltage makes cmos image array 182a that the electric charge of gathering is converted to output signal.Shielding memory block 258 stores the pixel value gathered, until reading pixel value so that at the exposure period of definition, the collision other incident radiation on cmos image array 182a does not destroy the value of reading.In addition to pixel amplifier 255, the process of each pixel 250 and control module 254 can include the reset in other element and select transistor.
In one embodiment, by processing and control circuit 254 providing other message to extend the dynamic range of image sensor array 182a based on CMOS.Especially, divergence process circuit is to have the performance of the conversion factor dynamically changed between incident radiation input intensity and output voltage.That is, process circuit application and there is the transfer curve of multi slope.The concrete form of the transfer curve with multi slope can take various forms, including a series of linear relationships connected in flex point, the low intensive linear segment being connected with the logarithm transfer curve of high intensity, or there is at low-intensity steeper slope and there is at higher intensity the complete full curve of arbitrary shape of higher slope.
In the embodiment of multi slope, owing to each independent pixel can be according to thereon
The intensity of incident radiation independently uses the different piece of transfer curve, the dynamic range of imageing sensor 182a based on CMOS substantially to expand.In operation, the region of the imageing sensor 182a based on CMOS receiving less incident radiation uses precipitous conversion slope corresponding to higher sensitivity, and, receive more region and use change slope gently corresponding to relatively low sensitivity.Using multi slope transmission function, imageing sensor 182a based on CMOS can realize the dynamic range of 65 to 120dB.From Belgium FillFactory NV, Schalienhoevedreef 20B, B-2800 Mechelen, entitled " diclinic rate dynamic range expansion " (" Dual Slope Dynamic Range Expansion ") technical documentation in describe in further detail the operation of imageing sensor of the transfer curve with multi slope.This document can be at Fill HTTp in Factory (www.fillfactory.com): //www.fillfactory. Com/htm/technology/htm/dual_slope.htm downloads, and entire contents is hereby incorporated by.From Switzerland Photonfocus AG, Bahnhofplatz 10, CH-8853 Lachen, entitled " LinLog Technology " technical documentation in described in more detail the operation of imageing sensor of the transfer curve with log slope.This document can be from Photonfocus (www.photonfocus.com) in, http://www.photonfocus.com/html/eng/cmos/linlog.php downloads, and entire contents is hereby incorporated by.
Cover pixel 250 in Fig. 8 A is the two-dimensional grid of electrical interconnection 262, is electrically interconnected 262 with pixel 250, row circuit 296(the most in Figure 4 A)
, and column circuits 270 telecommunication.Row circuit 296 and column circuits 270 enable one or more and process and operation task, such as, address pixel, decode signal, signal amplification, the conversion of analog-to-digital signal, applying timing, reading and reset signal etc..Use the row circuit 296 on chip and column circuits 270, image sensor array 182a based on CMOS can be operated, optionally to address in X-Y coordinate, and from independent pixel, read data.In the properly programmed mode of cis 100, image sensor array 182a based on CMOS can also be operated, optionally the part of whole frame pixel is addressed and reads.Such as, in these embodiments, the unexpected pixel outside expectation pixel region can be foreclosed by the pixel portion of reading.Being read pixel portion and can also represent the pixel sampling in region, the independent pixel in such region of interest, pixel column, pixel column are not read.In conjunction with the further detail below of the cis 100 in Figure 28 A, 28B, 28C detailed description window frame operator scheme, wherein, cis 100 is from less than optionally addressing all pixels of image sensor array 182 and reading view data.Generally, cis 100 can be programmed or be set to from image sensor array 182a based on CMOS optionally addressing and read the view data of more than first pixel in array, and unrelated with more than second pixel optionally addressing and reading in array.
In one embodiment, dot structure can be as described in authorize the United States Patent (USP) of the Application No. 5,986,297 of Eastman Kodak Company.This patent entitled " there is the protection of electronic shutter blooming and the color active element sensor of low string shadow " (Color Active Pixel Sensor with
Electronic Shuttering, Anti-blooming and Low Cross-talk).Especially, arranging the 35th row the 3rd and arrange in the 25th row to the 55th row to the 55th row and the 5th, this application describes application accompanying drawing 1A, 2A(and copies as Fig. 8 B, Fig. 8 C at this) shown in the cross section in relevant region of dot structure.The disclosure indicates that the pixel in Fig. 8 B includes that light sensitive diode 270, light sensitive diode 270 have vertical overflow drain 274, middle revolving door 276, floating diffusion 280, reset gate 282, reset leakage 284 and light shield 286.Light shield aperture 288, colored filter 290 and lenticule 292.Lenticule 292 is placed on photoelectric detector, so, after light passes colored filter 290, is focused the light in light shield aperture 288 by lenticule 292.Therefore, the light entering light sensitive diode 270 has the wavelength in the bandwidth determined by colored filter 290.This patent describes the second dot structure shown in Fig. 8 C, the second dot structure is similar to the embodiment in Fig. 8 B at a lot of aspects, except Fig. 8 C has two transmission gates 294,296, and memory block 298.In both cases, by using exhausted photosphere or overlapping layer effective over all regions except photoelectric detector (in this case, be photodiode 270) to construct light shield, so that incident illumination is directed only to photodiode region.The generation of the aperture in light shield district inhibits the string shadow between pixel, light shield district that photoelectronic generation is limited in photodetector region.In Fig. 8 C, floating diffusion be designated 281, reset gate be designated 283, the leakage that resets be designated 285.In certain embodiments, the dot structure described in the United States Patent (USP) of application Application No. 5,986,297, it is convenient to omit colored filter 290, in other embodiments, it is convenient to omit lenticule 292.
With reference to Fig. 9,10A, 10B, 10C, 10D, describe and use cis 100 to gather the process 300 of view data from target.In various embodiments, target can comprise the most one-dimensional or symbolism of two-dimensional bar.In step 302, according to such as depression of trigger 216 or the existence of object in cis 100 visual field, active module 124 start-up course 300 detected.In one embodiment, according to process 300, control module 112 can receive in response to depression of trigger 216 or signal that object detected, and sends signal responsively to various modules (such as, lighting module 104 and image capture module 108).Process 300 includes activating light source to use illumination light 162 to irradiate target (step 304).In one embodiment, light source is activated in response to Lighting control time block 350.Within the persistent period of Lighting control commutator pulse 350, the light source activated target is illuminated.In one embodiment, light source is light source 160, and Lighting control commutator pulse 350 is generated by the lighting control module 164 in lighting module 104.Process 300 also include activating global electronic shutter with while exposure image sensor array in multiple pixels of multirow, thus incident radiation light is converted to electric charge (step 312).In response to exposure control timing pulse 354, and activate multiple pixel simultaneously.In one embodiment, in response to the beginning 360 of exposure control timing pulse 354, and activate multiple pixel simultaneously.In a further embodiment, exposure control timing pulse 354 is by global electronic shutter control module 190(Fig. 5 B of sensor array control module 186) generate.
In the embodiment gathering target image of the image fault minimizing conversion, irradiate target by overdriving the light source of such as LED, to generate the illumination of several times of becoming clear than standard operation.nullExample with reference to the present invention,Wherein,Cis 100 includes that image-forming module 1802(is if Figure 33 is to shown in 35)、LED 160c to 160t is (i.e.,160c、160d、160e、160f、160g、160h、160i、160j、 160k、 1601、 160m、 160n、 160o、 160p、 160q、 160r、 160s、And 160t),The illumination commutator pulse 350 being described herein as or pulse 350'、 350"、350' " in any one whole persistent period,Each LED has maximum DC operation current drain rate (LED current of 100%) of the standard recommendation of 40mA,But can be overdrive and be consumed the electric current that is greater than 60mA(150%) or the electric current of 80mA(200%).LED 160e to 160t has the maximum DC of the standard recommendation of 40mA and operates current drain rate, the commutator pulse 350 that can also be described herein as or pulse 350', any one whole persistent period in 350 ", 350' " are overdrive to consume the electric current more than such as 120mA(300%), 160mA (electric current of 400%), 200mA (electric current of 500%), 500mA (1, the electric current of 250%).Show the illumination commutator pulse 350 as DC drive current, 350', 350 ", 350' ".But, according to the present invention shown in Figure 10 E, pulse 350,350', 350 ", 350' " can also be the pulse through ovennodulation or the pulse of " being strobed ", so, pulse 350,350', include the independent pulse of a series of short persistent period for driving LED 160 350 ", 350' ".Replacing DC with pulse drive signal drives signal to decrease the output duty cycle of LED, and therefore decreases the power consumed in LED.Owing to, in a lot of situations, the working life of LED is determined by the maximum junction temperature of LED structure, and the power consumption reduced decreases junction temperature.Net effect refers to the higher peak point current of tolerance and operates the junction temperature limit less than the maximum of LED structure.Generally, the output duty cycle of the LED 160 of minimizing improves the magnitude of current that can be driven safely by LED.This " filtering " or " impulse modulation " described Lighting control pulse gate pulse rate can for example, 1,000Hz to 10,000Hz.According to this embodiment, be combined with global electronic shutter is allowed the short exposure phase by over excited light source.That is, bright illumination allows to use the short time of integration for each pixel, and global electronic shutter allows all pixels in imageing sensor the most photosensitive.The short exposure phase of the target owing to being irradiated brightly, even if when target moves relative to cis, the cis of the present invention can gather non-distorted image clearly.In one embodiment, exposure period is less than 3.7 milliseconds.In one embodiment, wherein, overdrive light source, and use the light source of different colours.Such as, in this embodiment, cis includes that the LED of Bai Hehong, red and green LED, white, red and green LED or some of color in response to the most common imaged characters of such as cis select combination.In this embodiment, the LED of different colours each according to total power budget at certain level by impulse modulation alternatively.In another this embodiment, two color LEDs are pulse modulation every time, but each are pulse modulation at relatively low power, so, have remained in that total power budget.In a further embodiment, red, green, blue LED can be interleaved to emulate white light.
The various embodiments of the image-forming module 1802 of cis 100 are described with reference to Figure 37.The LED 160 of image-forming module 1802 can be divided into group as shown in figure 37.It is luminous with certain emission band that cis 100 can be arranged to often organize LED.In the embodiment 8 described in the table of Figure 37, cis 100 is set to LED 160a, 160b green light of focusing, and all of illumination LED 160c to 160t glows.The table of Figure 37 describes other embodiments.Cis 100 could be arranged to the light source to difference group simultaneously powered up (such as 4 simultaneously powered up to group 1, group 2, group 3, group) or by illumination timed control pulse 350,350', 350 ", 350 " ' power up (such as successively, group 1, then organize 2, then organize 3, then organize 4).
Referring still to Fig. 9, Figure 10 A, Figure 10 B, Figure 10 C and Figure 10 D, process 300 also includes that process processes the electric charge converted and generate through light to produce view data (step 316).Can include as it has been described above, process, such as, amplify the data that incident radiation generates.Process the image data value that each masked segment storage being additionally included in multiple picture generates.Process 300 also includes the image data value (step 320) reading and processing storage from multiple pixels.Can include amplifying the data that incident radiation generates as it has been described above, process, and the data of generation are converted to digital signal.Process to be additionally may included in multiple pixels of image sensor array module 182 and store the set of number signal value corresponding to incident illumination as frame image data (step 320).Cis 100 in step 320 can store the frame image data including multiple N-bit (gray scale) pixel value in memory module 116, and each pixel value represents the incident illumination in multiple pixel on.In one embodiment, reading timed control pulse 368 control the reading of multiple pixel, read timed control pulse 368 and generated by the reading module 198 of sensor array control module 186.In one embodiment, read timed control pulse 368 to include being transferred to multiple pulses each in multiple pixel.In one embodiment, during exposure control timing pulse 354, there is at least some of of Lighting control commutator pulse 350.In this embodiment, the operation of operation and the lighting module 104 with lighting control module 164 including having the image capture module 104 of the sensor array control module 186 of global electronic shutter control module 190 is coordinated, to realize the crossover in illumination 350 and exposure 354 control commutator pulse by control module 112.
In shown in Figure 10 A a embodiment, exposure control timing pulse 354 starts after Lighting control commutator pulse 350, and terminates before Lighting control commutator pulse 350.Read control commutator pulse 368 to start when Lighting control commutator pulse 350 finishes.In another embodiment shown in Figure 10 B, Lighting control commutator pulse 350' starts after exposure control timing pulse 354 ', and terminates before exposure control timing pulse 354 '.In this embodiment, read control commutator pulse 368' to start when exposure control timing pulse 354' finishes.In a further embodiment, when exposure control timing pulse and Lighting control commutator pulse occur successively, they overlap each other.In this embodiment shown in Figure 10 C, this continuous operation can include starting Lighting control commutator pulse 350 ", start exposure control timing pulse 354 ", terminate Lighting control timed signal bursts 350 ", and terminated exposure control timing pulse 354 later ".In this embodiment, at exposure control timing pulse 354 " at the end of, start reading out control commutator pulse 368 ".In this embodiment further shown in Figure 10 D, operation successively can include starting exposure control timing pulse 354' ", start Lighting control commutator pulse 350' ", terminating exposure control timing pulse 354' " and terminating Lighting control timed signal bursts 350' later "." when finishing, control commutator pulse 368' is started reading out " in this embodiment, as Lighting control timed signal bursts 350'.As combined shown in Figure 10 E, each Lighting control commutator pulse 350 described herein, 350', 350 ", 350 " ' the independent pulse of multiple short persistent period can be included.
Referring still to image-forming module 1802, the cis 100 with image-forming module 1802 can have this operator scheme, and in this mode of operation, in exposure control timing pulse 354,354', 354 " or 354' ", focus LED 160a, 160b control as closing or power-off, thus LED The light of 160a, 160b does not affect collected and is sent to decoder module 150 or the image of automatic identification module 152.In another embodiment, at exposure control timing pulse 354, 354', 354 ", " period, in addition to illumination LED 160c to 160t, focusing illumination LED 160a, 160b are controlled as powering up or 354'.In exposure control timing pulse 354,354', 354 " or 354' " period, the control of focusing illumination LED 160c to 160t, for powering up, therefore improves and has the signal intensity of the view data of the base section of focusing patterns 1838 corresponding to projection on it.
Reference process 300(Fig. 9), it is simultaneously powered up at least one at least one and illumination LED 160c to the 160t in focusing LED 160a, 160b that cis 100 could be arranged to Lighting control pulse 350 in step 304,350', 350 " or 350' ", and to bring up to base plate, especially projection simultaneously has the intensity of illumination of the baseplate zone of lighting pattern 1830 and focusing patterns 1838 on it.Decoder module 150 or the decoding process that identification module 152 performs automatically, can include that the view data corresponding to pattern 1838 is (i.e., corresponding imaging thereon has the view data of the pel array of pattern 1838) selectively through decoding process, localization process, the linear bar code symbol of finder pattern is e.g. decoded and attempts or quiescent centre localization process by decoding process.Wherein, image is gathered according to exposure period.Wherein, focusing LED 160a, 160b and illumination LED 160c to 160t is simultaneously powered up.Such as, in order to finder pattern location, decoding linear packet bar code symbol or quiescent centre, location, (herein, gathering image according to exposure period, wherein, focus LED At least one in 160a, 160b and illumination LED At least one in 160c to 160t is simultaneously powered up), along with focusing patterns 1838 is horizontally extending in the visual field, the decoder module 150 processing the whole two field picture gathered can optionally analyze the central row view data (that is, corresponding to the view data of the row 2802 shown in Figure 28 a) corresponding to imageing sensor 182.In process 300, Lighting control pulse 350,350', 350 " or 350' " are simultaneously simultaneously powered up at least one focusing illumination LED (such as 160a) and at least one illumination LED (such as 160t), in step 320, cis 100 can gather whole frame or " window frame " view data, and this is described in more detail in Figure 28 A to Figure 28 C.Cis 100 could be arranged to, cis 100 acquisition window frame image data in step 320, and irradiating at least one focusing illumination LED and at least one illumination LED, window frame is corresponding to the size and shape of lighting pattern 1838 the most simultaneously.Such as, when cis 100 projects the linear focusing patterns 1838 of level, window frame view data in step 320 reading can be corresponding to the window frame view data of row 2802 in Figure 28 A, on row 2802, imaging has pattern 1838, and pattern is through process (such as, attempting attempting decoding linear bar code symbol by quiescent centre, location or positioning view finding device pattern) described herein thereafter.In an embodiment of the present invention, wherein focusing illumination LED and illumination LED are simultaneously driven by Lighting control pulse 350,350', 350 " or 350' ", and as described here, focus LED 160a, 160b and illumination LED 160c to 160t can be overdrive in pulse 350,350', the whole persistent period of 350 " or 350' ".
In the embodiment of, it is possible to use the KAC-0331 of Eastman Kodak Company supply 640x480 VGA cmos image sensor realizes cmos image array 182a.At entitled " KAC-0311 The fully integrated timing of 640x480 VGA cmos image sensor, simulation digital processing and 10 ADC " (" KAC-0311 640x480 VGA CMOS IMAGE SENSOR Fully Integrated Timing, Analog Signal Processing 10 bit ADC ") technical instruction (version number 1; August 5 2002 date, at http://www.kodak.com/global/plugins/acrobat/en/digital/ccd/prod ucts/cmos/KAC_ 0311LongSpec.pdf can download) described more fully KAC-0311, entire contents is hereby expressly incorporated by reference.Following editor's summary is the operation of the KAC-0311 won from above-mentioned complete specification.According to the summary of this technical instruction, KAC-0311 is to be integrated with analog image acquisition, digitized and the Solid State Active cmos imager of Digital Signal Processing on a single-chip.Imageing sensor includes the VGA format pixel array with 640x480 active component.Picture size can be programmed to define window interested by user.Especially, by starting row and column and the programming of end operation, user can define the window interested of the pixel resolution of minimum 1x1.In an embodiment of KAC-0311 imageing sensor, window may be used for enabling the digital zoom operation in the viewport that can translate.In another embodiment of KAC-0311 imageing sensor, when double sampling is for the resolution of the image reducing collection, keep the constant visual field.
The pixel of KAC-0311 imageing sensor is the pitch of 7.8um.Dot structure is pinned photodiode (pinned photodiode) structure of Kodak.KAC-0311 imageing sensor is available when not using lenticular monochromatic version or not using the color filter array of lenticular Bayer pattern (Bayer) (CMY).In an embodiment of KAC-0311 imageing sensor, integrated timing and programming Control are for enabling the step-scan pattern in video and still image capture operation.In the further embodiment of KAC-0311 imageing sensor, when keeping constant master clock rate, user can program to frame frequency.
In KAC-0311 imageing sensor, the analog video of pel array exports by chip analog signals pipeline.In an embodiment of KAC-0311 imageing sensor, correlated-double-sampling is for eliminating noise in time domain and the fixed pattern noise of pixel-reset.In the further embodiment of KAC-0311 imageing sensor, frame frequency clamp (frame rate clamp) is used for enabling the calibration of synchronous optical blackness and offset correction.In another embodiment, the programmable analog gain of KAC-0311 imageing sensor includes that overall situation exposure gain to be mapped to analog-digital converter input range by signal swing.Programmable analog gain also includes white balance gains, to be simulated color balance in territory.In an additional embodiment, the analog signal processing chain of KAC-0311 imageing sensor includes the process of row amplifier, the regulation of column of figure offset voltage, white balance, programmable automation controller, overall situation programmable automation controller and overall situation digimigration voltage-regulation.In one embodiment, Digitally programmable amplifier is for providing color gain correction simultaneously and exposure gain to regulate for AWB.In various embodiments, offset calibration is completed based on each column and the overall situation.It addition, in depositor, storage value can carry out each column offset calibration on use chip, and analog data is converted into ten digits word stream by ten redundant symbol numeral analog-digital converters.In the various embodiments of KAC-0311 imageing sensor, use different analog signal processing pipeline to improve noise immunity, signal to noise ratio and Dynamic Range.In one embodiment, the serial ports of KAC-0311 is and compatible industrial standard two line I2C serial interface.In another embodiment, the power supply of KAC-0311 imageing sensor is provided by the single supply of a 3.3V.In various embodiments, KAC-0311 imageing sensor has a single master clock, and runs with the speed of the highest 20MHz.
Can be used in the present invention and authorize the operation of imageing sensor of Eastman Kodak (Eastman Kodak Company) and physical details in Application No. 6,714,239, entitled " there is the CMOS active pixel sensor of color balance able to programme " (" Active Pixel Sensor with Programmable Color Balance ") U.S. patents and applications number be 6,552,323, entitled " sharing the imageing sensor of output signal line " (" Image Sensor with Shared Output Signal Line ") United States Patent (USP) in be also described, the full content of each of which is hereby expressly incorporated by reference.The material that the following is United States Patent (USP) 6,522,323 is brief.Especially, Application No. 6,522, the United States Patent (USP) of 323 discloses and includes with multirow and the imageing sensor of multiple pixels of multi-column version arrangement.Further disclose the image sensor including global electronic shutter.Pixels share pixel output node in the colleague mutually of disclosed imageing sensor and output signal line.Further, the disclosure indicates the holding wire often gone by making two independent row select, one in row every a pixel, and the 1:2 row output signal line demultiplexing table for every pair of row, it is achieved that being spaced apart of the picture signal in Hang.Schematic diagram (this time copying as Figure 11) shows two neighborhood pixels 5.The identifier used in schematic diagram includes following: has the reset transistor (RG) of reset gate, transmission gate (TG), signal transistor (SIG), have row the selection row selecting transistor (RSEL) of door, photoelectric detector (PD), floating diffusion (FD).The embodiment provided about Figure 11 and sequential chart (herein copying as Figure 12), Application No. 6,552,24-25 row the 3rd row of the United States Patent (USP) of 323 describe the operation of global shutter.This disclosure indicates by integrated signal electric charge being sent to floating diffusion 10a, 10b from photoelectric detector 30a, 30b in each pixel of sensor simultaneously, and starts reading out.Then, row select 1(15) be driven high and floating diffusion 1(10a) and signal potential be sampled, and by impulse modulation SS1 row circuit 20a holding.Then row select 1(15) be pulled low, row select 2(25) be driven high, and floating diffusion 2(10b) signal potential be sampled, and by impulse modulation SS2 row circuit 20b holding.Floating diffusion 10a, 10b in row are read, and are then resetted by impulse modulation RG.Next line select 2(25) be pulled low, and row select 1(15) be driven high, and floating diffusion 1(10a) reset potential be sampled, and by impulse modulation SR1 column circuits 20a holding.Then row selects 1(15) be pulled low, and row selects 2(25) be driven high, and floating diffusion 2(10b) reset potential be sampled, and kept by impulse modulation SR2.Then, before the same pixel reading table in imageing sensor next line starts, being sampled and being kept signal of column circuits 20a, 20b is read.
In another embodiment, cmos image array 182a can be realized by KAC-9630 128 (H) x98 (V) cmos image sensor.At entitled " equipment performance description-Kodak's KAC-9630 cmos image sensor " (Device Performance Specification-Kodak KAC-9630 CMOS Image Sensor) in JIUYUE, 2004, version 1.1 technical instruction in be more fully described by KAC-9630.The full content of this document is hereby expressly incorporated by reference.This document can be from the http://www.kodak.com/global/plugins/acrobat/en/ of such as Eastman Kodak (www.kodak.com)
Digital/ccd/products/cmos/KAC_9630LongSpec.pdf downloads.This technical instruction describes the KAC-9630 imageing sensor as the low power CMOS active pixel image sensor that can catch monochrome image with 580 frames per minute.Additionally describe KAC-9630 imageing sensor and include on chip 8 analog-digital converters, fixed pattern noise cancelling circuit and video gain amplifier.Further describe KAC-9630 and there is the integrated programmable timing and control circuits allowing the time of integration and frame frequency to regulate.The reading circuit describing KAC-9630 imageing sensor can be supported to read whole frame on single 8 bit digital data/address bus within the time less than 2 milliseconds.As it has been described above, describe KAC-9630 imageing sensor to include integrated electronic shutter.
(109) in another embodiment, cmos image array 182a can be by Micron imageing sensor Wide VGA MT9V022(Micron Technology Inc (Micron Technology, Inc supply, and general headquarters are positioned at 8000 South Federal Way, Post Office Box 6, Boise, ID 83707-0006) realize.From Micron The product MTgV099 products propaganda list that Technology (www.micron.com) http://download.micron.com/pdf/flyers/mt9v022_ (mi-0350)-flyer.pdf downloads describe in further detail MT9V022 imageing sensor.The full content of the document is hereby expressly incorporated by reference.
In certain embodiments, cis 100 can either also be able under global electronic shutter pattern operation under roller shutter type pattern.In this embodiment, roller shutter type pattern is for the part of automatic focusing operation, and once it is determined that suitable focal length, global electronic shutter pattern is used for gathering view data.Process 400 shown in Figure 13 describes process and the process of collection image later determining proper focal length.In response to such as operator's depression of trigger 216 or in response to the object moved in cis 100 visual field, active module 124 can generate triggering signal with beginning process 400.In operation, when cis 100 gathers new images, cis 100 irradiates the target (such as bar code) (step 404) comprising object, and subsequently into roller shutter type operator scheme (step 408), wherein the multirow in the imageing sensor of cis is exposed successively.As a part for operation, the exposed frame phase can be defined as the first row exposure from multirow and start in multirow the time of last column end exposure.In one embodiment, at least some of period of exposed frame phase, the imaging len 212 of cis 100 is controlled as in continuous action or progressively (step 414) in continuous action.As shown in the embodiment of Figure 20, cis 100 can have lens driving module 165, and lens driving module 165 controls by control module 112 or for moving another module of imaging len 212, to change the focal length setting of cis 100.In this embodiment, photosystem has multiple discrete setting.For each discrete setting, lens 212 form the picture rich in detail of the object of the specified distance being positioned at range image reader 100 on the image sensor.In one embodiment, a ultimate value of the focusing range of optical system is corresponding to the focusing incident radiation from the object being positioned at infinity.If incident ray is the most parallel, then it is assumed that object is in infinity.In one embodiment, another ultimate value of the focusing range of optical system is the near point (near of optical system Point).The near point of optical system is the minimum distance relative to optical system that object can be placed, and herein, optical system still is able to produce the picture rich in detail of object.In another embodiment, the change in the focal length of optical system is not covered with the gamut of optical system.Such as, in this embodiment, the focal length of cis 100 is arranged between the focal length setting differing several millimeters and changes.In another embodiment, the focal length of cis 100 be arranged on difference centimetre focal length arrange between change.Reader 100 is set to include lens driving module 165, to allow scanning device to operate under exceeding extended depth-of-field.
With further reference to lens driving module 165, it is possible to implement various lens actuation techniques and method.Application No. 4,350, the entire contents of US patents of 418 is hereby expressly incorporated by reference, and it discloses the lens focus regulation system including adjustable range ring, is wherein realized the position adjustments of lens by the rotation of regulation ring.Application No. 4,793, the entire contents of US patents of 689 is also incorporated into this as reference, it discloses a kind of lens barrel, it includes having the hollow rotating ring that can rotate around optical axis, optical axis is arranged in the cavity of the hollow fixed cylinder with bearing, and optical axis is inserted in the movable cylinder of movement rotated in response to rotating ring and is inserted between fixed cylinder and rotating ring between diametric vibration wave motor.Application No. 5,541, the entire contents of US patents of 777 is also incorporated into this as reference, it discloses electromagnetic lens driver, including having interior yoke and the fixed component of outer yoke, Magnet that operating is inserted, for supporting the magnetic field position detector with generation position indicative signal of the Magnet movable part of powered main body, outside yoke and axial cincture the line style of interior yoke and detection operating inserted.
Process 400 also includes reading view data (step 420) from multiple exposure row.View data (step 424) is analyzed by the auto-focusing algorithm of such as comparison and detection method or method for detecting phases.Use row focal length images information, cis 100 is formulated the proper focal length of lens 212 and is arranged, such as by determining that suitable focal length is arranged based on the data gathered, then lens 212 move to that arrange, or by assessment current line view data to determine whether arranging when front focal length, cis can be focused on (step 428) with receiving.In various embodiments, image capture module 108, optical module, control module 112 or Special Automatic focus module (be such as exclusively used in and perform focal length calculating purpose ASIC or FPGA) analysis of view data is performed.Along with the position of lens 212 is correctly formulated, cis 100 enters global electronic shutter operator scheme (step 432).It can be seen that in certain situation according to process 400, cis 100 can stop roller shutter operation, and before reading view data from each pixel of image sensor array module 182, start the operation of global electronic shutter operator scheme.In global electronic shutter operator scheme, cis 100 gathers whole frame image data (step 436), and view data is stored in memory module 116 and is sent to decoder module 150 or automatic identification module 152 by control module 112 subsequently.According to this embodiment, wherein, within the time that reader imaging len 112 is run by control, row image information is read and is analyzed, in the range of frame data, it is possible to achieve cis automatically focuses on so that target imaging.In various embodiments, automatic focusing operation can be processed by Special Automatic focus module, or focus module can be integrated with other module of such as image capture module 108 and/or control module 112.
Referring still to the step of process 400, with reference to the flow chart of Figure 21, Figure 22 a and the rectangular histogram of Figure 22 b, further describe analysis row view data to determine the step 424 of focal length.In step 2102, cis 100 can be with the rectangular histogram of the pixel value of the current line of the view data of reading in constitution step 420.Figure 22 A is corresponding to the rectangular histogram of the row data pixel values of the bianry image (such as, in the bar code symbol on monochromatic base plate) focused on acceptably.Rectangular histogram 2108 represents high-contrast image, and is included in high-end many pixel values of gray scale, at many pixel values of gray scale low side, and a few pixels value in the middle part of tonal range.Figure 22 B is corresponding to focus on the rectangular histogram of the pixel value of the row data of poor bianry image.The view data that rectangular histogram 2110 represents is the low contrast pixel data of " flat ", it means that the ultimate value in gray scale has less pixel value, and has a large amount of pixel value at the center of gray scale.Thus, it will be seen that use image contrast information to be readily determined the focus level of image.
In step 2104, cis 100 determines the histogram data of collection.In step 2104, cis 100 may determine that the setting (appropriate of the suitable focal length alignment of lens 212 In-focus setting), or judge that the histogram data extracted from the current line of view data indicates whether to be focused on acceptably at setting or the position epigraph reader of current lens.When in step 2104, cis 100 judges when correctly arranging of lens 212 based on the histogram data gathered, and histogram data can come from current line, or based on current row data and the combination of preceding row data.On the other hand, when gathering row information, the record position of lens 212 or value is set, make often to go the associated lens position data of the position that the histogram information of the view data read comprises instruction lens 212.In step 2104, for determining that the transmission function that focal length alignment lens are arranged can use row contrast information as histogrammic expression, it is possible to use indicate the lens position data of lens 212 position relevant with often group row data.
The further step of reference process 400, in step 414, cis 100 can control lens 212 and move continuously or stepping is moved continuously.When controlling as moving continuously, the whole time that the continuous row pixel in image sensor array module 182 is exposed and reads, lens 212 continuous moving.When controlling to move continuously for stepping, within the whole time that the row pixel of sensor assembly 182 is exposed and is read, lens 212 repeatedly move and stop.In one embodiment of cis, lens 212 are controlled as step-by-step movement and move continuously, and cis 100 is continuous moving lens between two end points (that is, first farther out site (field position) and the second relatively near field point).In another embodiment of cis 100, lens 212 are controlled as step-by-step movement and move continuously, cis 100 continuous moving lens 212 between the two endpoints, and one or more position between endpoint location is stopped periodically lens 212.It is controlled as the lens 212 of step-by-step movement continuous moving, may be considered that there is motion phase (i.e. lens move period) and withholding period (i.e. during the lens of short duration free time).In one embodiment of the invention, the motion of lens 212 and the reading view data from multirow pixel are to coordinate.Such as, lens move the control with image sensor array module 182 and can be adjusted in the withholding period of lens 212, and a line or the multirow exposure period of image sensor array module 182 occur, so that at full line exposure period, lens 212 are idle.Further, in certain embodiments, when the motion stage at lens 212, when being effective corresponding to the process of pixel image data of exposure, cis 100 could be arranged to abandon the view data (during analytical procedure of such as, being expert at 424) corresponding to the pixel exposed in the motion phase of lens 212.
The specific embodiment of the process 400 that reference Figure 13 generally describes combines the flow chart of Figure 23 and Figure 24 and describes.In the embodiment of Figure 23, in step 424, cis 100 row view data based on the collection collecting that attempts determining that the lens that focal length is directed at are arranged.In step 428a, if cis 100 determines the enough information having acquired the focal length alignment position determining lens 212, cis 100 determines that the focal length alignment of lens 212 is arranged, and proceeds to step 428b, with the focal length alignment position moving to determine by lens 212.Without collecting enough information, cis 100 returns to step 432 to gather the information of other row.When in step 428b mobile lens 212 (such as the most correct in order to confirm the focal length alignment position determined), cis 100 can continue to read and process row view data.The focal length being moved into determining when lens 212 is directed at position, and cis 100 performs step 432, to enter the global electronic shutter operator scheme of operation.When cis 100 enters global shutter operator scheme when (step 432), image reader 100 can make lens 212 stop motion.Then cis performs step 436, to gather whole frame image data, then performs step 438, so that view data to be sent to one of them in data form decoder module 150 or automatic identification module 152.
In the embodiment describing process 400 with reference to Figure 24, cis 100 is assessed Current Datarow (the row data that most recent gathers) by step 424, to judge that Current Datarow indicates whether that present image reader 100 is when front focal length is directed at, and the focal length alignment setting up lens 212 is arranged.If cis 100 judges that cis 100 is directed at currently without focal length in step 428d, then cis 100 returns to step 420 to gather other row information.In step 420, if cis 100 judges that reading takes device and is currently directed at (in-focus) position at focal length, cis 100 proceeds to step 432 to enter global electronic shutter operator scheme.When cis 100 enters global shutter operator scheme, Graphic reader 100 can make lens 212 stop motion (step 432).Then cis 100 proceeds to step 436 to gather whole frame image data, then proceedes to step 438, and view data is sent to data form decoder module 150 or one of them in identification module 152 automatically.
Reference process 400 or process 800, can be regarded as in setting up " focal length alignment " position, expection or the current location of lens 212 can be appointed as " focal length alignment " by cis 100 based on the expection represented than the labelling at other more preferable focal length in focal length of lens position that can use or current lens position.Therefore, when lens focus position does not has high order focusing on ordinary meaning, if it represents that mark is more directed at focal length than other lens position, reader 100 still can specify position as " focal length alignment ".In a specific embodiment, moving continuously when lens 100 are controlled as stepping, it can switch between limited amount discrete location (such as two positions).In this embodiment, if lens position represent mark than other possible position more focal length alignment, then cis 100 can specify limited amount may discrete location one of them be " focal length alignment " position.Especially, when being set to lens 212 and switching between finite quantity discrete location, focal length can be ignored and judge step, and view data is directly transferred to decoder module 150 or automatic identification module 152.Especially, when there is limited amount alternately focal position, focal length alignment position can be readily distinguished based in the position being successfully decoded at result.Attempt identifying that average decoding time can be reduced in focal length alignment position by decoding.
In the deformation of the present invention, in step 420, cis 100 reads the row view data of scheduled volume, and in step 424, analyzes the row of scheduled volume.The row of scheduled volume can for example, 2 row of image sensor array 182,3 row, 10 row or all row (100+).In step 424, cis 100 can select optimum focusing (such as, the brightest contrast) OK from multirow, and to judge that the focal length of the record relevant with optimum focusing row is arranged be " focal length alignment " setting of cis 100.Alternatively, cis 100 can use the data image gathered from several row to calculate focal length alignment and arrange data.In any one of above-mentioned conversion embodiment, after determining that focal length is arranged, in step 432, cis 100 can initially enter global electronic shutter operator scheme, and the focal position then moving to lens 212 determine is arranged, or alternatively, in step 432, the lens that lens 212 move to determine can be arranged before entering global electronic shutter operator scheme by cis 100, or the two operation can be carried out simultaneously.
In another embodiment that automatic focal length operates, combined as described in Figure 25-Figure 30 B, global electronic shutter operator scheme can be used in focusing phase and data Harvest time.According to process 800 described herein, automatically focusing on the phase, arranging or each change of position from focal length, gather limited " window " frame image data.Such as, focal length determines that logical algorithm only reads and analyze the center of imageing sensor or the central. set (ten scan lines in the middle of such as) of scan line.According to this embodiment, and when substantially reducing the time of series of frames gathered in order to make cis focal length, limited frame data provide focal length to determine the enough information of logical algorithm.
In an alternate embodiment of the invention, the particular order of the step in process 400 or process 800 can change the concept herein included without departing from the present invention.In various other embodiments, the circuit performing roller shutter type operation can perform with the circuit performing global electronic shutter operation on identical CMOS chip, or can perform on one or two components on respective special chip.In a further embodiment, belt-type shutter function and global electronic shutter operation can be combined in the single module comprising hardware, software and/or firmware.
In another embodiment of the cis 100 operated with belt-type shutter or global electronic shutter pattern, cis 100 can between global electronic shutter operator scheme and rolling shutter operation pattern switching at runtime.In this embodiment, comparing given threshold value in short-term when the time of integration, cis 100 is switched to roller shutter type operator scheme from the global electronic shutter operator scheme of acquiescence.Many commercially available imagers are to use light shield or make electricity consumption conversion realize, and light shield allows a certain amount of light to be leaked in memory element, and memory element is kept apart by electricity conversion the most completely with light-sensitive element.So, after electric charge is sent to memory element, the incident ambient of image is illuminated having negative effect in memory element.The numerical example of this operation presented below.
Generally, the shutter efficiency of the cmos image sensor with global electronic shutter function specifies the scope that the memory block on imageing sensor can shield the view data of storage.Such as, if the efficiency of shutter is 99.9%, then longer 1000 times than the time of integration spent at non-shielded generation equal amount electric charge in the time of integration (also referred to as time of exposure) that blind zone generation electric charge is spent.Therefore, in image capture period, below equation provides the explanation from the light irradiance on the image of ambient light, after in image moves to memory block during the time limit, this light irradiance is relative to the light irradiance on the image of the object from use ambient light illumination, ambient light and light source 160 can be left in the basket, and less than desired degradation ratio during the time limit before image is moved to memory block.This formula can also represent at whole imaging cycle, the situation that incident illumination on image is identical.In two examples, it is to be appreciated that do not introduce maximum degeneration and minimum integration can be used.
(Amb.Irrad) * Tframe* (100%-%eff)=( Amb.Irrad+Light Source Irrad ) *Texposure)*(%deg)
In many instances, at exposure period and in the residue phase of frame, the light on image is constant.In this case, the light spoke intensity on image is constant, can calculate light and reveal the minimum integration time that can use when not unduly interfering with desired image.Computing formula in this case, it is allowed to calculate the calculating in minimum integration cycle for specific degeneration.Following normality irradiance numerical example is the maximum tolerance degradation ratio for the shutter efficiency of 99.9%, the frame frequency of 20ms and 5%.
20ms*(100%-99.9%)=( Texposure*5%)
Or calculate when not causing the degradation ratio more than 5%, it is possible to use the minimum exposure time:
Texposure=0.4ms
Therefore, if time of integration during picture catching is less than 0.4ms, then degenerate and reveal (optics and electronics) is introduced into 5% or more error.
Processing due in an embodiment of the image degradation of too strong ambient light introducing, becoming ratio when degradation ratio and the relevant predeterminated level of shutter efficiency can be allowed low with the frame frequency of cis, maximum when the time of integration, cis 100 is switched to roller shutter type operation.Figure 14 shows for the process 600 of switching operation modes in response to the short time of integration.In response to such as by operator's depressing or in response to the object provided in the visual field of cis 100 trigger 216, active module 124 can generate triggering signal so that process 600 starts.Process 600 includes the minimum integration time (step 604) that storage calculates.In one embodiment, threshold value is determined according to above-mentioned formula.These formula some input, such as, shutter efficiency, maximum can receive image degradation reveal and frame frequency, can as an initially set part for cis 100 or after a while the time arrange in cis 100.Process 600 also includes gathering view data (step 608).As a part for image data acquiring, the time of exposure for current environmental condition is formulated (step 612) by sensor array control module 186.In various embodiments, this time of exposure is determined by global electronic shutter control module 190, optical module 178 or another module suitably set up in cis 100.In order to determine whether that the operator scheme of cis 100 should be switched to belt-type shutter from global shutter, compare time of exposure and minimum integration time threshold (step 616) of formulation.If the time of integration formulated is shorter than the minimum integration time threshold calculated, then the operator scheme of cis 100 is switched to belt-type shutter (step 620) from global electronic shutter.If the time of integration formulated is more than or equal to the minimum integration time threshold calculated, then keep global electronic shutter operator scheme (step 628).
The further embodiment of the present invention is described with reference to Figure 15 A, flow process Figure 31 and Figure 32.As shown in fig. 15, cis 100 could be arranged to have user and can arrangement arrange.Such as, as shown in fig. 15, cis 100 provides graphical user interface (GUI), menu setecting display screen 3170 on display 504, and menu setecting display screen 3170 provides the optional config option of user of roller shutter type operator scheme and global shutter operator scheme for operator.GUI display screen can use the tool kit relevant with certain applicable operating system (such as WINDOWS CE) to configure, and operating system can be provided with on cis 100.When reader 100 is set to include browser or use analysis program suitable mutually and interpretive program to carry out other configuration, and GUI3170 can use various open standard language (such as HTML, JAVA, XML, JAVA) to generate.In the embodiment of Figure 15 A, GUI icon 3152 is Rolling shutter OptionButton, and GUI icon 3154 is global electronic shutter menu option.When selecting icon 3152, cis 100 is set to cis 100 and receives next triggering signal as described here, to start decoding trial, cis 100 uses roller shutter type operator scheme to gather view data, and does not use overall situation device operating mode.When selecting icon 3154, cis 100 is set to cis 100 and receives next and trigger signal and attempt to start decoding, and cis 100 uses overall situation device operating mode to gather view data, and does not use roller shutter type operator scheme.GUI3170 can be generated as allowing other the optional config option of user.In the embodiment of Figure 15 A, button 3156(can be text or pushbutton type) selection cis 100 is set to, receive trigger signal future time perform process 300..Cis 100 is set to by the selection of button 3158, performs process 400 receiving the future time triggering signal.Cis 100 is set to by the selection of button 3162, performs process 600, receives at future time and triggers signal.Cis 100 is set to by the selection of button 3164, cis 100 is in " picture catching " operator scheme, therefore, future time receives and triggers signal, cis gathers view data (the whole frame of 2D of such as view data), and export image (such as arriving display 504 or the device that is spaced apart), and the view data of collection is not sent to module 150 or module 152.In the application of carrier, be conducive to the object (such as, the vehicle of movement, the parcel on assembly line) in corresponding movement, under " picture catching " pattern, catch image.Thus, it will be seen that owing to using global shutter operator scheme to decrease image fault, therefore use the execution of the image capture mode of global shutter operator scheme to bring obvious benefit.Rotating or the order of software development kit (SDK) can also be used to generate with the relevant configuration of button 3156,3158,3160,3162 and 3164 between belt-type shutter configuration and global electronic shutter configuration.Generation system, the order making SDK can be selected to produce at the master terminal being spaced apart with cis is (such as, " belt-type shutter " and " global shutter " orders), and order is sent to one of them to reconfigure reader 100, during wherein this order makes cis 100 configure for belt-type shutter configuration and global electronic shutter of cis 100.
Referring again to the flow chart of Figure 31, in step 3102, operator selects between belt-type shutter configuration and global electronic shutter configuration.If operator selects Rolling shutter to configure, cis 100 proceeds to step 3104.In step 3104, by triggering the generation of signal (such as, by manual actuation or other method of trigger 216), cis 100 is driven to movable reading state from idle condition, then, automatically performs step 3106 and 3108.In step 3106, cis 100 uses Rolling shutter operator scheme to gather view data, then in step 3108, the view data gathered in step 3106 is sent to data form decoder module 152 or automatically identification module 152 with to image data decoding or carry out other operation.In step 3102, if selecting global electronic shutter pattern, then cis 100 performs step 3118.In step 3118, by triggering the generation of signal (such as, by manual actuation or other method of trigger 216), cis 100 is driven into movable reading state from idle condition, and the most automatically performs step 3118 and 3120.In step 3118, cis 100 uses global electronic shutter operator scheme to gather view data, then in step 3122, the view data gathered in step 3118 is sent to data form decoder module 152 or automatically identification module 152 with to image data decoding or carry out other operation.
With reference to the flow chart of Figure 32, another embodiment of the present invention is described.In the embodiment that the flow chart with reference to Figure 32 describes, cis 100 is set to gather view data, and uses Rolling shutter operator scheme and global shutter operator scheme, attempts decoding view data.In step 3202, generate as described here and trigger signal (such as, by manual actuation or other method of trigger 216), so that cis 100 is driven into movable reading state from idle condition, then, automatically perform step 3204 and 3206.In step 3204, cis 100 enters rolling shutter operation pattern.In step 3206, cis 100 uses the most whole frame image data of rolling shutter operation type collection or window frame view data.In step 3208, the view data gathered in step 3206 is sent to data form decoder module 150 and/or automatic identification module 152 by cis 100.Data form decoder module 150 or automatically identification module 152 can be decoded the view data gathered or other processes, and export result (such as, exporting the bar code information through decoding to display 504 and/or the device that is spaced apart).In step 3118, cis 100 enters global electronic shutter operator scheme.In step 3212, cis 100 uses global electronic shutter operator scheme to gather view data.In step 3212, view data 100 uses global electronic shutter operator scheme to gather view data.The view data gathered in step 3212 can be the view data of whole frame or window frame.In step 3214, the view data gathered in step 3212 is sent to data form decoder module 150 or automatic identification module 152 by cis 100.Data form decoder module 150 or automatically identification module 152 can be decoded the view data gathered or other processes, and export result (such as, exporting the bar code information through decoding to display and/or the device that is spaced apart).As controlled shown in ring arrow 3216, cis 100 can repeat step 3204,3206,3208,3210,3212 and 3214 automatically, until meeting stop condition.Stop condition can be the generation (can be to be generated by release trigger 216) or the bar code symbol successfully decoded of scheduled volume such as triggering and stopping signal.
In conjunction with the flow chart of Figure 25, another process according to the present invention is described.Similar to process 400, process 800 be included in lens 212 be controlled as motion during, the process to limited amount view data.In process 400 and process 800, quickly establish the focal length alignment position of lens 212.Simultaneously, process 400 includes the use to the image sensor array module 182 operated, time in the different phase of this process, the first roller shutter shutter operation pattern and perform successively second the overall situation device operating mode in, an execution process 800 in selectivity addressable image sensors array module can be used, roller shutter type operator scheme and the overall situation device operating mode under whole during, operate addressable image sensors array module described herein.
With further reference to process 800, in step 802, by triggering the generation (such as, in response to the detection of the object in the pressure of trigger 216, the cis visual field or receive the order of the device that is spaced apart) of signal, active module 124 starts process 800.In step 814, lens 212 are set to motion by cis 100.In step 814, it is during continuously motion or other stepping are moved continuously that cis 100 can control lens 212.
In step 820, cis 100 is from image sensor array module 182 readout window frame image data.Cmos image sensor can be made in window frame mode of operation.Under window frame operator scheme, only read the view data of the subset of all pixels of the optional addressing corresponding to image sensor array.Example with reference to the cis 100 that Figure 28 A, 28B and 28C are described under window frame operator scheme, wherein, use each square grid representative image sensor array of the block of pixels representing 10x10, and the pixel that wherein shadow region 2802,2804 and 2806 representative is addressed by selectivity and selectivity reads.In the embodiment of Figure 28 A, show window frame operator scheme, wherein, by optionally addressing and the pixel center row pattern of the one group of row pixel only reading the center being included in image sensor array module 182, and from image sensor array 182 readout window view data.Alternatively, under window frame operator scheme, cis 100 can optionally address and a single row of pixels from image sensor array module 182 selectively reads out view data.Further, under window frame operator scheme, cis 100 can optionally address, and selectively reads out view data from row 2802a and 2802b.In the embodiment of Figure 28 B, window frame operator scheme is shown, wherein, by optionally addressing and only read set of pixels neighbouring on the position at the center of image sensor array module 182 (i.e., the set of pixels being mutually adjacently), and from image sensor array module 182 readout window frame image data.In the embodiment of Figure 28 C, it is shown that window frame operator scheme, wherein, by selectively reading out the 10x10 block group being spaced apart of contiguous pixels on position, and from image sensor array module 182 readout window view data.In combining all of window frame operator scheme that Figure 28 A, 28B and 28C describe, optionally address, and read the view data corresponding to the half less than image sensor pixel.When making in window frame mode of operation, cis 100 can gather corresponding to the incident light images data on the one or more patterns as shown in Figure 28 a, 28b, 28c or the pixel in other pattern.This set of view data can include gray value collection, and is properly termed as window frame view data.
Storing whole frame image data with memory module 116, a part for the most whole frame image data is designated as comparing the optional operator scheme of the region of interest (sample area) through processing further, is described herein as window frame operator scheme.Under window frame operator scheme, in gathering the time slice needed for whole frame image data, can be with acquisition frame view data.
With further reference to process 800, in step 824, cis 100 analysis window frame image data, to judge the focal length of cis 100.With reference to the flow chart of Figure 29 and Figure 30 A and the rectangular histogram of Figure 30 B, further describe analysis window frame image data to judge the step of focal length.In step 4102, cis 100 may be made that step 820 reads current window frame image data the rectangular histogram of pixel value.Figure 30 A is according to by can the rectangular histogram of pixel value of row data of bianry image (such as, in the bar code symbol on monochromatic base plate) of collectiong focusing.Rectangular histogram 4108 represents high-contrast image, and is included in high-end many pixel values of gray scale, the many pixel values at gray scale low side and a few pixels value in gray scale center range.Figure 30 B is corresponding to focus on the rectangular histogram of the pixel value of the window frame view data of the bianry image of difference.The view data of rectangular histogram 4110 statistics is " flat ", and soft image means have less pixel value at two end points of gray value, and has a large amount of pixel value at the center of gray value.Thus, it will be seen that use image contrast information can be readily determined the focus level of image.
In step 4104, the histogram data that cis 100 assessment gathers.In step (original text is block) 4104, cis 100 may determine that the suitable focal length alignment of lens 212 is arranged, or determines that the histogram data extracted from the current line of view data indicates whether that cis 100 can be focused at current lens position with receiving.Cis 100 in step 4104 is based on the histogram data gathered, determine that lens 212 are suitably arranged, histogram data can come from current window frame image data, or the combination in front data of based on current window frame image data He previously acquired one or more window frame view data.On the other hand, recording the position of lens 212 or arrange value so that when window frame image data information is collected, the histogram information of the often row view data being read and analyzing has the associated lens position data of the position of instruction lens 212.In step 4104, for determining that the transmission function that focal length alignment lens are arranged can use window frame comparative information (as summarize in rectangular histogram), it is possible to use indicate the lens position data of lens 212 position relevant with the window frame view data of each collection.
The further step of reference process 800, in step 814, cis 100 can control lens 212 and move continuously for motion or stepping continuously.When controlling as moving continuously, the whole Time Continuous that lens 212 are exposed in the pixel in response to window frame view data and are read moves.When controlling to move continuously for step-by-step movement, lens 212 repeated to move and stop in the whole time that the pixel corresponding to window frame view data is exposed and reads.In an embodiment of cis 100, lens 212 control to move continuously for stepping, and cis 100 is continuous moving lens between two end points (that is, the first farther site and the second relatively near field point).In another embodiment of cis 100, lens 212 control to move continuously for step-by-step movement, and cis 100 intermittently makes lens 212 stop on mobile lens 212, and one or more position between endpoint location continuously between two endpoint locations.The lens 212 controlling to move continuously for stepping may be considered has motion phase (i.e. lens move period) and withholding period (corresponding to the time that lens are temporarily idle).In one embodiment of the invention, in the motion of lens 212 and multirow pixel, the reading of view data is to coordinate.Such as, the step motion of lens 212 and the control of image sensor array module 182 can be coordinated, and in exposing the exposure period corresponding to the pixel of window frame view data, the withholding period of the lens that stepping is moved continuously occurs, and before and after this exposure period, the period of motion occurs.Further, in a particular embodiment, when the process of the view data of the pixel corresponding to being exposed within the period of motion of lens 212 is effective, view data 100 can be configured so that, abandon the view data corresponding to the pixel being exposed in the moving period of lens 212, such as, in analytical procedure 824.
Flow chart with reference to Figure 26,27 describes the particular embodiment of the process 800 probably described with reference to Figure 25.In the embodiment of Figure 26, in step 824, cis 100 is attempted based on a determination that the focal length alignment collecting the window frame view data of that collection is arranged.If in step 828a, when cis 100 judges the enough information having acquired the focal length alignment position determining cis 100, then cis 100 proceeds to step 828b, and lens move to the focal length alignment position determined.Without collecting enough information, cis returns to step 820, to gather other window frame information.In step 828b, the such as focal length alignment position in order to judge to determine is the most correct and during mobile lens 212, cis 100 can continue read and process window frame view data.The focal length being moved into determining when lens 212 is directed at position, cis 100 performs step 836, gather whole frame image data (such as, according to process 300), then perform step 838, the view data of collection is sent to data form decoder module 150 or automatic identification module 152 one of them.
In the embodiment describing process 800 with reference to Figure 27, cis 100 is by window frame view data (the window frame data gathered recently) current in appraisal procedure 824 to judge whether current window frame view data indicates cis 100 to be currently that focal length is directed at, and the focal length alignment establishing lens 212 is arranged.In step 828c, if cis 100 judges that cis is not currently in focal length alignment, cis 100 returns to step 820, to gather other window frame information.In step 828, if cis 100 judges that reader is currently directed at position at focal length, cis 100 performs step 836, to gather whole frame image data (such as, according to process 300), then step 838 is performed, the view data of collection to be sent to one of them of data form decoder module 150 or automatic identification module 152.
In various embodiments of the present invention, in step 820, cis 100 can read the window frame view data of scheduled volume, and in step 824, cis 100 can analyze the window frame view data of scheduled volume.Window frame view data can have identical patterns (such as, be the pattern of Figure 28 A all the time) or can have change pattern (such as, be first the pattern of Figure 28 A, the pattern of followed by Figure 28 B, the pattern of followed by Figure 28 C).In the embodiment of a change, after collection, the window frame view data of each collection can be sent to data form decoder module 150 and/or automatic identification module 152 by cis 100.In step 824, arrange to determine that the focal length of cis 100 is directed at, the frame image data of the scheduled volume that cis 100 is analyzed.When determining that focal length alignment is arranged, cis 100 can select the focal length alignment relevant with the window frame view data of optimum focusing (high-contrast) to arrange, or, cis 100 can use the view data from the multiple window frame gathered, assessment focal length to arrange.Process 800 alternate embodiment any one in, in step 836, after the focal length of cis 100 is directed at and arranges and determine, before or after what lens 212 moved to determine arranged position is to establish focal length alignment and arrange, cis 100 can gather whole frame image data.
Reference process 400 and process 800, can be regarded as when establishing focal length alignment position, cis 828 is based on representing that target label is positioned at than on the predetermined of other more preferable focal length in available focal length of lens position or current location, it is possible to specify the predetermined or current location of lens 212 is focal length alignment.Therefore, when focal length of lens position not high order focusing on ordinary meaning, if sensor reader 100 represents that at least aiming symbol is directed at than other available lens position more focal length, then sensor reader 100 still can specify this position conduct " focal length alignment ".In a particular embodiment, when lens 212 control as being in during step-by-step movement is moved continuously, lens 212 can switch between limited amount discrete location (such as, two positions).In this embodiment, if lens position represents that aiming symbol is more directed at focal length than remaining possible position, then cis 100 can specify limited amount may one of them of discrete location for " focal length alignment " position.Especially in configuration, when lens 212 switch between limited amount discrete location, focal length can be ignored and determine step, and view data is transferred directly to decoder module 150 or automatic identification module 152.Especially, when having limited amount optional focal position, position based on positioning result in the way of being successfully decoded, focal length alignment position can be easily identified.Attempted by decoding, identify that average decoding time can be reduced in focal length alignment position.
Known, some usable image sensor arraies have setting or operator scheme, wherein, due to packaging relation (such as, edge pixel is covered by the packaging material of chip) or the configuration of specific aspect ratio, do not read limited amount edge columns and/or rows.When reading the view data from imageing sensor from all pixels or the most all of pixel of imageing sensor, and when not reading limited amount row and/or column border pixel, this collected image data set is considered whole frame image data collection herein.
Reference process 400 and process 800, it has been described that lens 212 can be controlled as one during motion or stepping are moved continuously continuously.It can be seen that when lens 212 control as moving continuously, the focal length of cis 100 arranges control for changing over.When lens 212 control to move continuously for step-by-step movement, therefore, the focal length of lens 212 arranges (being the most also the focal position of cis 100) and is also controlled by as step change over time.Further, according to process 400 or process 800, when lens 212 control to move continuously for step-by-step movement, in the motion phase, it is in variable condition that the focal length of lens 212 is arranged.When lens 212 control to move continuously for step-by-step movement, in withholding period, the focal length of cis 100 is arranged temporarily for idle condition.
Referring again to Figure 1A, following description provides the other details in the module of cis 100 described above.In various embodiments, control module 112 can include having quick accessible storage device on chip, for performing special IC (ASIC) and software, firmware and the CPU of digital decoding logic of specific operation.Memory module 116 can include any one or multiple read-only (ROM), random access and non-volatile programmable storage for data storage.Memorizer based on ROM may be used for accommodating secure data and the instruction of cis operating system and the code for other module.Memorizer based on RAM may be used for facilitating ephemeral data to store during cis operates.Non-volatile programmable storage can use various forms, typically, for EPROM (EPROM) and Electrically Erasable Read Only Memory (EEPROM).In certain embodiments, when the resting state that cis 100 is resting state or power saving, nonvolatile memory is for ensure that the reservation of data.
I/O module 120 is for setting up two-way communication potential between cis 100 and other electronic installation.The element with I/O module 12 part includes wireless or wired local network interface, dialing or cable modem interface, USB interface, pcmcia interface, RS232 interface, IBM Tailgate interface RS485 interface, PS/2 keyboard/mouse interface, special audio and/video interface, standard flash memory (CF) interface, PC card standard interface, safety criterion memorizer, secure digital input and output for input-output apparatus, and/or any other standard or personal device interface.CF interface is to be saved in website http://www.compactflash.org according to CF specification version 2 .0() CF standard and the interface that designs.The full content of CF specification version 2 .0 document is hereby expressly incorporated by reference.PC card standard interface is according to such as being safeguarded by PCMCIA (personal computer memory card international association) (PCMCIA), and the interface that can design from the PC card standard in PC card standard 8.0 versions-spring calendar year 2001 that http://www.pcmcia.org downloads.The full content of the specification version 2 .0 in PC card standard 8.0 versions-spring calendar year 2001 is hereby expressly incorporated by reference.
Active module 124 is for starting the operation of cis 100 each side, such as according to process 300 described herein, process 400, process 600 or the data acquisition and processing (DAP) of process 800.Process 300, process 400, process 600 and process 800 can perform automatically in response to the startup of the respective process of active module 124.Cis 100 could be arranged to automatically continue after process 300, process 400, process 600 and process 800 start, until meeting stop condition.Stop condition e.g. can stop the generation of signal (can be discharged generation by trigger 216) or the bar code symbol of scheduled volume is successfully decoded by trigger.In above-mentioned hand-held image reader 100a, active module includes trigger 216, when trigger 216 is depressed, generates the triggering signal that control module 112 receives, then, sends control signals to other proper modules of cis 100.In an embodiment of the hard-wired embodiment of cis 100, active module 124 includes object detection module, and in the presence of the object that will be imaged being detected, object sensing module generates the operation triggering signal to start image reading 100.When generating triggering signal, cis 100 is driven into active state from idle condition.Active module 124 can also corresponding to receive from locally or remotely isolating device order and generate triggering signal.
User feedback module 128 is for providing sensory feedback for operator.In various embodiments, feedback can include the sound sensation signal of honeycomb sound alarm, the visual display of such as LED flash of light instruction, the such as mechanical sense of vibration in cis 100, or can indicate other sensory feedback any of cis 100 mode of operation that such as image successfully catches to operator.
Display module 132 for providing the visual signal of the such as mode of operation of cis 100 to operator, such as, includes dump energy and/or memory space, operator scheme and/or other operation or function detail.In various embodiments, display module 132 can be provided by the display screen LCD panel with optional touch pad (touch-pad screen overlay), and operating touchpad contacts input for receiving the operator matched with display.
Subscriber Interface Module SIM 134 is for providing interface mechanism for the communication between operator and cis 100.In various embodiments, Subscriber Interface Module SIM includes keyboard, special function or programmable button, action bars or toggle switch etc..If display module 132 includes touch pad display screen as above (touch-pad screen overlay), display module can combine some the input functions optionally provided by element in Subscriber Interface Module SIM 134.
In certain embodiments, RFID module 136 is to meet RFID interrogator and the reader of ISO/IEC 14443, and RFID interrogator can inquire the non-contact device of RFID, and can recover the response that RFID label tag is launched.International Organization for Standardization and International Electrotechnical Commission (IEC) are the groups of the specialized system defining worldwide standard.In other embodiments, RFID module 136 operates according to ISO/IEC 10536 or ISO/IEC 15963.The all kinds that the non-contact card standard announced by ISO/IEC covers in embodiment, specially ISO/IEC 10536(close contact card), ISO/IEC 14443(is adjacent to formula card) and ISO/IEC 15693(proximity card).These be respectively used to operator and relevant coupling element the most closely, nearby or in more remote situation.In certain embodiments, RFID module 136 is set to reading and includes according to product electronic code (EPC), the label of the information automatically being identified the code format that center (Auto-ID Center at MIT) proposes by the Massachusetts Institute of Technology.In certain embodiments, RFID module 136 operates according to proprietary protocol.In certain embodiments, RFID module 136 communicates with at least some of of the information from the RFID label tag inquired to computer processor, and wherein computer processor goes access or give the data being stored on accessible services device for change by Web vector graphic information.In certain embodiments, information is RFID label tag serial number or the object relevant with RFID label tag.
In certain embodiments, smart card module 140 is the smart card reader meeting ISO/IEC 7816, and smart card reader uses electrical contact for setting up and design suitably contact chip communication based on smart card.Smart card module 140 can be read and write the data smart card to attachment in some cases.
In certain embodiments, magnetic stripe card module 144 is the magnetic strip reader of the object that can read the card such as delivering decoded information on one or more track (on the track such as, the credit card used) with magnetic form.In other embodiments, magnetic stripe card module 144 is magnetic character reading device, and it uses the character of magnetic ink print for reading, such as visible with the instruction routing number of American Bankers Association, account number, check sequence number and draft on banker's check.In some implementations, it is provided that the two types of magnetic reader device.
In some embodiments of cis 100, the functional packet of RFID module 136, smart card 140 and magnetic stripe card module 144 is contained in such as Panasonic's integrated smart card read module ZU-9A36CF4(by Matsushita Electrical Industrial Company, Ltd. supply) single tribrid reader module in, be in March, 2004, entitled " Manual on the date Insertion Type Integrated Smart Reader " described in more detail ZU-9A36CF4 in the Panasonic gauge MIS-DG60C194 of (" being manually inserted into type integrated smart card ") (version 1.00) .The full content of the document is hereby expressly incorporated by reference.
nullDecoder module 150 is for decoding the most one-dimensional or target data of two-dimensional bar,Such as,UPC/EAN、11 yards、39 yards、128 yards、Codabar、 Interleaved 2 of 5、 MSI、 PDF417、MicroPDF417、Code 16K、 Code 49、MaxiCode、Aztec、Aztec Mesa、Data matrix、Qcode、QR Code、(UCC is combined) UCC Composite、Snowflake、Vericode、Dataglyphs、RSS、BC 412、Code 93、Codablock、Postnet (US)、BPO4 State、 Canadian 4 State、Japanese Post、KIX (Dutch Post), Planet Code, OCR A, OCR B etc..In certain embodiments, decoder module also has automatic identification function, and automatic identification module can identify between multiple bar codes the most listed above automatically.The specific function of decoder 150, the such as measurement of decodable code tab character, at filing date on November 5th, 2004, Application No. 10/982,393, entitled " Device and System for Verifying Quality of Bar Codes " is described in the United States Patent (USP) of (for verifying device and the system of barcode quality).The entire disclosure of which is hereby expressly incorporated by reference.
Another example of cis 100 according to principle of the present invention structure is the portable data terminal 100b shown in the different perspective views in Figure 15 A, Figure 15 B and Figure 15 C.Figure 15 A shows that main perspective view, Figure 15 B show front perspective view, and Figure 15 C shows back side lens drawings.As shown in the figure, in one embodiment, portable data terminal 100b include interface element, interface element have display 504, keyboard 508, such as positioning light target interface button 512, trigger 216 and to have the stylus holder 520(of stylus holder 524 not shown).Portable data terminal 100b still further comprises lens 212 and light source 160b.In additional embodiment, portable data terminal can increase the multiple computer peripheral being attached and strengthen function.In various embodiments, computer peripheral can include the printer of the biometric reader of one or more magnetic strip reader, such as fingerprint scanner, such as receipt printer, RFID label tag or RF payment reader and smart card reader etc..In various embodiments, portable data terminal 100b can be Dolphin 7200,7300,7400,7900 or 9500 series mobile computer (Hand Held Products, Inc. supply, and general headquarters are positioned at 700Visions Drive, postcode 208, Skaneateles Falls, NY), and can be according to invention structure.Application No. 10/938,416, submit to day to be JIUYUE in 2004 10 days, entitled " Hand Held Computer Device " (" handheld computer device ") related U.S. patent in described in more detail the various details of handheld computer device, especially apparatus casing.The full content of the application is hereby expressly incorporated by reference.
Portable data terminal 100b also includes electromechanical interface 532, such as dialing or cable modem interface, USB interface, pcmcia interface, Ethernet interface, RS232 interface, IBM Tailgate interface RS485 interface, CF interface, PC card standard interface, the secure digital standard for memory interface, the secure digital input and output for input-output apparatus interface and/or other any appropriate criteria or privately owned equipment interface.In various embodiments, electromechanical interface 532 can serve as a part for attached computer interface.
Figure 16 shows the circuit block diagram of an embodiment of portable data terminal 100b.In the embodiment of figure 16, image capture module 108b includes the two-dimensional image sensor 536 that image engine, image engine include being arranged on image sensor chip 546 and the image forming optics 544 being correlated with.Relevant image forming optics 544 includes lens 212b (not shown).It is IT4000 or IT4200 image engine (Hand Held that image sensor chip 546 can be arranged on model constructed according to the invention Products, Inc supply, and general headquarters are positioned at Skaneateles Falls, NY) in, and can be to be suitable for all Kodak KAC-0311 or Micron described above The commercial chip of MT9V022 image sensor array.Portable data terminal 100b also includes that lighting module 104b, lighting module 104b include light source 106b and lighting control module 164b.These lighting modules are also parts for IT4000 and IT4200 image engine cited above.Portable data terminal 100b also includes processor integrated circuit (IC) chip 548, and this processor integrated circuit (IC) chip 548 can be by such as INTEL Strong ARM Risc processor or INTEL PXA255 processor provide.Processor IC chip 548 includes central processing unit (CPU) 552.In order to catch image, as it has been described above, suitable control and timing signal are sent to image sensor chip 546 by processor IC chip 548.Processor IC chip 548 also controls to be sent in RAM 576 view data that chip 546 generates.Processor IC chip 548 could be arranged to partially or wholly perform to combine the function of one or more module in the module 104,108,112,116,120,124,128,132,134,136,140,144,150,152,165 and 168 described in Figure 1A.
As it has been described above, portable data terminal 100b can include that the display 504 of such as liquid crystal display, keyboard 508, multiple communication or such as 802.11 radio communications connect the radio transceiver of device 556, connect global system radio receiver and/or the bluetooth radio adapter 564 of device 560 for mobile communication/GPRS (general packet radio service) (GSM/GPRS) radio communication.In additional embodiment, portable data terminal 100b can have by CDMA (CDMA), cellular digital packet (CDPD), Mobitex portable phone and data network and networking component, transmits the performance of the information of such as sound or data communication.In other embodiments, portable data terminal 100b can use DataTACTM network or wireless dial-up to connect and transmit information.
Portable data terminal 100b may further include infrared ray (IR) communication link 568.Keyboard 508 can be communicated with IC chip 548 by micro-chip processor 572.Portable data terminal 110b may further include RFID circuit 578 and smart card circuitry 586, RFID circuit 578 is previously discussed for data in reading and writing RFID label tag or mark, and smart card circuitry 586 includes the electrical contact 590 for setting up the smart card communications enabling the credit card with such as circuit.Portable data terminal 100b also includes that memorizer 574, memorizer 574 include volatile memory and nonvolatile memory.In one embodiment, volatile memory is partly by RAM 576 provide.Nonvolatile memory can partly be provided by flash rom 580.Processor IC chip 548 is communicated with RAM 576 and ROM 580 by system bus 584.Processor IC chip 548 and micro-chip processor 572 also include volatility and the nonvolatile memory of multi-region.In various embodiments, the above-mentioned module of at least some (element in such as control module 112) at least partly performs in software, and members can be stored in the nonvolatile memory of such as ROM 580.In one embodiment, processor IC chip 548 includes that itself uses CPU 552 and the control circuit of memorizer 574.The non-volatile district of memorizer 574 may be used for such as storing procedure operation instruction.
In various embodiments, processor IC chip 548 can include having several serial ports (such as, general, serial ports, bluetooth) and multiple I/O interfaces (not shown in Figure 16) of parallel interface (such as, PCMCIA, CF).
In one embodiment, processor IC chip 548 processes frame image data, such as, decode one-dimensional or two-dimensional bar or one group of OCR letter.Various bar codes and/or OCR decoding algorithm commercially can be used, such as, by the combination (Hand Held Products, Inc. supply) of IT4250 image engine with decoding deck.In one embodiment, decoding deck decodes such as symbolism, symbolism e.g. UPC/EAN, 11 codes, 39 codes, 128 codes, Codabar, Interleaved 2 of 5, MSI, PDF417, MicroPDF417, Code 16K, Code 49, MaxiCode, Aztec, Aztec Mesa, Data Matrix、 Qcode Code、UCC Composite,、Snowflake、 Vericode、Dataglyphs、 RSS、BC 412、Code 93、QR Codablock, Postnet (US)、BPO4 State、Canadian 4 State、Japanese Post、KIX (Dutch Post)、Planet Code, OCR A, OCR B etc..
In other operates, infrared transceiver 568 promotes the Data Infrared line of portable data terminal 100b from broadcast mode to the portable data terminal 100b under reception pattern and replicates.At data replicative phase, the use of infrared receiver 568 makes the data from single broadcasting equipment be received by several reception devices simultaneously, without any reception device and broadcasting equipment physical connection.
In other further embodiment, cis 100 may be embodied in such as processing terminal image Kiosk 8870(Hand Held Products Inc. supplies, and general headquarters are positioned at 700 Visions Drive, P.O. Box 208, Skaneateles Falls, NY), and in processing terminal constructed according to the invention.In a further embodiment, cis may be embodied in such as IMAGETEAM 3800E linear imaging engine or IMAGETEAM 4710(Hand Held Products, Inc. supplies, and general headquarters are positioned at 700 Visions Drive, P.O. Box 208, Skaneateles Falls, NY.) the fixed installation system of two-dimentional reader.
nullIn various embodiments,Above-mentioned module includes lighting module 104、Imaging acquisition module 108、Control module 112、Memory module 116、I/O module 120、Active module 124、User feedback module 128、Display module 132、Subscriber Interface Module SIM 134、RFID module 136、Smart card module 140、Magnetic stripe card module 144、Decoder module 150、Lighting control module 164、Power module 168、Interface module 172、Optical module 178、Sensor array module 182、Sensor array control module 186、Global electronic shutter control module 190、Ranks addressing and decoder module 194、And read module 198、Roller shutter type control module 202、And automatic focus module,These modules can be at different software、Firmware、And/or the various combination of hardware realizes.
The machinable medium that may be used for the present invention includes electronics, magnetic and/or optical storage medium, such as, magnetic floppy disc, hard disk, DVD drive, the CD driver of DVD disc can be used in some implementations, any CD-ROM disk is (i.e., read-only optical disc), CD-R dish is (i.e., write once read many optical disk), CD-RW CD is (i.e., CD-RW), and electricity storage medium (such as RAM, ROM, EPROM, CF card, pcmcia card, or optional SD or SDIO memorizer, and electronic unit, such as floppy disk, DVD drive, CD/CD-RW driver, or CF/PCMCIA/SD adapter), they accommodate and read from storage medium and/or be written to storage medium.Those skilled in the art of machinable medium understands, the new medium of constantly invention data storage and form, and in the future available any easily, commercially available storage medium and corresponding read/write device can be suitable for using, particularly, provided that any more preferable storage performance, faster access speed, less size and the lower cost of every bit storage information.Known old machine-readable medium the most also can be used, such as magnetic recording, the optics of printed character (such as OCR and Magnetic Solution code sign) or magnetic on punch tape tape or card, tape or line read and machine-readable character (the most one-dimensional or two-dimensional bar).
It will be appreciated by those skilled in the art that, can at hardware (such as, firmware hardwired logic), software (such as, logic decoding in the program operated on aageneral-purposeaprocessor) and firmware (such as, the logic in the nonvolatile memory of the operation calls on processor as required decoding) in realize many functions of electronics and electric device.The present invention considers to use a kind of enforcement implementing to replace using another identical function of different hardware, firmware and software using hardware, firmware and software.To a certain extent, execution can be by transmission function mathematical notation, i.e., it is to be applied to represent that the specific incentives of the black box input terminal of transmission function generates specific response at outlet terminal, contemplate any execution of transmission function, including the combination of hardware, firmware and software that the part or fragment transmitting function performs herein.
Although the present invention being explained by reference to structure disclosed herein, but, protection scope of the present invention is not limited to this details, present invention covers the various variations and alternatives in the scope and spirit of claims.

Claims (41)

1. making ambient-light images deteriorate the apparatus for reading of bar code being minimized, described apparatus for reading of bar code includes:
Integrated circuit including at least image sensor array;
Encapsulate the hand-held housing of described image sensor array;
Belt-type shutter control module, described belt-type shutter control module is configured to expose described imageing sensor successively Multirow pixel in array;
Global electronic shutter control module, described global electronic shutter control module is transmitted to image sensor array at exposure period Exposure control timing pulse, exposes the multirow pixel in described image sensor array, wherein during described exposure period simultaneously Described exposure period is to reset pixel and the time read between pixel value;
Bar code processing module, its existence being configured to identify the bar code symbol represented in the view data gathered;
Wherein, described apparatus for reading of bar code is configured to transmit Lighting control commutator pulse in the illumination phase, so that in institute The light sent by light source during stating the illumination phase is towards target;
Wherein, described Lighting control commutator pulse is shorter than described exposure control timing pulse;
Wherein, described apparatus for reading of bar code is programmed for running in one mode, and under described pattern, described bar code reads Device is in response to being applicable to the signal of light intensity judgement to select belt-type shutter control module and global electronic shutter to control mould In block one,
Wherein, described apparatus for reading of bar code can run automatically to identify between multiple bar code type.
Apparatus for reading of bar code the most according to claim 1, wherein, described in be applicable to light intensity judge signal include with The information that the intensity of light source of described apparatus for reading of bar code is relevant.
Apparatus for reading of bar code the most according to claim 1, wherein, described in be applicable to light intensity judge signal for really Determine whether the minimum integration time meets.
Apparatus for reading of bar code the most according to claim 1, wherein, described in be applicable to light intensity judge signal for really Whether determine the time of integration of current environmental condition less than the minimum integration time calculated.
Apparatus for reading of bar code the most according to claim 1, wherein, described belt-type shutter control module and the described overall situation Electronic shutter control module is integrated on the same integrated circuit, and described integrated circuit includes described image sensor array.
6. having an apparatus for reading of bar code for automatic focusing power, described apparatus for reading of bar code includes:
Integrated circuit, it comprises at least image sensor array, and described image sensor array has multirow pixel, described multirow Each pixel of pixel has a relevant pixel amplifier;
Encapsulate the hand-held housing of described image sensor array;
Imaging len, it is possible to will be directed on described image sensor array by the light of target reflection, described imaging len has Multiple focal lengths are arranged;
Belt-type shutter control module, described belt-type shutter control module is configured to expose described imageing sensor successively Multirow pixel in array is to gather the view data focused on;
Automatically focus module, described automatic focus module is configured to the view data analyzing described focusing to determine described mesh Target focal length alignment is arranged, and the focal length of described target alignment is arranged corresponding to described in being formed on described image sensor array The picture rich in detail of target;With
Bar code symbol processing module, described bar code symbol processing module is configured to identify in the view data gathered The existence of the expression of bar code symbol;
Wherein, at least some of phase of the time period of described multirow pixel is exposed successively in described belt-type shutter control module Between, the described focal length of described imaging len arranges and is controlled as carrying out continuously between the first focal length is arranged and the second focal length is arranged Changing, the object that described first focal length setting corresponds to described apparatus for reading of bar code the first distance is formed at described Picture rich in detail on image sensor array, described second focal length arranges and corresponds to described apparatus for reading of bar code second The object of distance is formed at the picture rich in detail on described image sensor array,
Wherein, described apparatus for reading of bar code can run automatically to identify between multiple bar code type.
7. having an apparatus for reading of bar code for automatic focusing power, described apparatus for reading of bar code includes:
Integrated circuit, it comprises at least image sensor array, and described image sensor array has multirow pixel, described multirow Each pixel of pixel has a relevant pixel amplifier;
Encapsulate the hand-held housing of described image sensor array;
Imaging len, it is possible to will be directed on described image sensor array by the light of target reflection, described imaging len has Multiple focal lengths are arranged;
Belt-type shutter control module, described belt-type shutter control module is configured to expose described imageing sensor successively Multirow pixel in array is to gather the view data focused on;
Automatically focus module, described automatic focus module is configured to the view data analyzing described focusing to determine described mesh Target focal length alignment is arranged, and the focal length of described target alignment is arranged corresponding to described in being formed on described image sensor array The picture rich in detail of target;With
Bar code symbol processing module, described bar code symbol processing module is configured to identify in the view data gathered The existence of the expression of bar code symbol;
Wherein, at least some of phase of the time period of described multirow pixel is exposed successively in described belt-type shutter control module Between, the described focal length of described imaging len arranges and is controlled as carrying out stepping between the first focal length is arranged and the second focal length is arranged Changing continuously, the object that described first focal length setting corresponds to described apparatus for reading of bar code the first distance is formed at Picture rich in detail on described image sensor array, described second focal length arranges and corresponds to described apparatus for reading of bar code Object at second distance is formed at the picture rich in detail on described image sensor array,
Wherein, described apparatus for reading of bar code can run automatically to identify between multiple bar code type.
8., according to the apparatus for reading of bar code described in claim 6 or 7, farther include global electronic shutter control module, institute State global electronic shutter control module to be configured to, once it is determined that the described focal length alignment of described target is arranged, expose the most simultaneously Described multirow pixel in image sensor array described in light is to gather image data frame.
Apparatus for reading of bar code the most according to claim 8, wherein, described apparatus for reading of bar code be configured to so that When described automatic focus module determines that described focal length alignment is arranged, described global electronic shutter control module is activated.
10. according to the apparatus for reading of bar code described in claim 6 or 7, wherein, described belt-type shutter control module can make The exposure period crossover of adjacent row pixel.
11. 1 kinds for from bar code symbol collection and the apparatus for reading of bar code of process bar code data, the reading of described bar code Fetching is put and is included:
Two-dimensional array, for receiving the light radiation reflected from described bar code symbol, described two-dimensional array includes the More than one pixel and more than second pixel, described apparatus for reading of bar code is configured to so that described apparatus for reading of bar code energy Enough it is controlled as selectivity addressing and reads the figure of more than first pixel from described array from described two-dimensional array As data, and unrelated with more than second pixel of described array, and each described pixel includes that photosensitive area and exhausted light shield data are deposited Storage area;
Hand-held housing, is used for encapsulating described two-dimensional array;
Optical module, for being directed to described two-dimensional array by the light radiation reflected from described bar code symbol;
Global electronic shutter, associates with described two-dimensional array, and described global electronic shutter can be in exposure period transmission exposure Control commutator pulse so that the pixel of the multiple row exposed during described exposure period in described two-dimensional array simultaneously, its Described in exposure period be to reset pixel and the time read between pixel value;
Lighting module, described lighting module is configured to transmit Lighting control commutator pulse in the illumination phase, so that described During the illumination phase, one or more light sources irradiate target;
Wherein, described Lighting control commutator pulse is shorter than described exposure control timing pulse;And
Bar code processing module, described bar code processing module and described two-dimensional array telecommunication, described bar code processes The expression of the bar code symbol that module is capable of identify that in the view data of collection;
Wherein, described apparatus for reading of bar code can be programmed or be set to catch the window frame of view data and make described figure As the window frame of data is decoded attempting,
Wherein, described apparatus for reading of bar code can run automatically to identify between multiple bar code type.
12. apparatus for reading of bar code according to claim 11, wherein, described two-dimensional array is complementary metal Thing quasiconductor (CMOS) imageing sensor.
13. apparatus for reading of bar code according to claim 11, wherein, to described image real time transfer to generate output number Automatically identify according to being included in multiple bar code type.
14. 1 kinds are used for the method operating hand-held apparatus for reading of bar code, and described method includes:
Determine at least one parameter relevant with ambient light intensity;
Analyze at least one parameter described;
In response to the analysis of at least one parameter described, to the image sensor array in described hand-held apparatus for reading of bar code from Global electronic shutter control module switches over control to belt-type shutter control module;
During exposure period, when described image sensor array is controlled by described belt-type shutter control module, gather image Data, wherein said exposure period is to reset pixel and the time read between pixel value;
Target is irradiated with one or more light sources during the illumination phase;
Wherein, the described illumination phase starts after the beginning of described exposure period, and the described illumination phase is at the knot of described exposure period Terminate before bundle;
Transmit the collected image collected when described image sensor array is controlled by described belt-type shutter control module Data are to bar code decoding module;With
Automatically identify between multiple bar code type.
15. methods according to claim 14, wherein, when at least one parameter described includes the exposure of current environmental condition Between.
16. methods according to claim 15, wherein, the analysis of at least one parameter described includes calculating current environment shape The time of exposure of condition and the ratio of scheduled exposure time.
17. 1 kinds of devices being used for reading bar code, described device includes:
Two-dimensional image sensor array, described two-dimensional image sensor array has column circuits and row circuit, wherein, described two dimension Image sensor array is CMOS structure, and wherein, described two-dimensional image sensor array comprises Pixel column;
First circuit board, it is provided with described two-dimensional image sensor array;
Second circuit board;
Imaging len, is used for focusing the light into described two-dimensional image sensor array;
Propping up support component, wherein, described support component includes the lens mount for supporting described imaging len, described support component quilt Being arranged on before described first circuit board, wherein said second circuit board is added by described support component with described first circuit board To be spaced and to be arranged on before described first circuit board;
Lighting source, its in response to Lighting control commutator pulse illumination phase projection illumination pattern, described lighting source by The light emitting diode being arranged on described second circuit board is constituted;
Focusing lighting source, it is used for projecting focusing patterns;And
Global electronic shutter control module, it transmits exposure control timing pulse at exposure period, to expose during exposure period simultaneously Multiple pixel columns in two-dimensional image sensor array described in light, wherein said exposure period is to reset pixel and reading pixel value Between time;
Wherein, described device is used for transmitting described Lighting control commutator pulse, to simultaneously drive described luminescence during the illumination phase The feature of the coordination between diode, and wherein said exposure period and described illumination phase is described exposure period and described illumination phase At least some of crossover in time;
Wherein, described Lighting control commutator pulse is shorter than described exposure control timing pulse;And
Wherein, described device also includes bar code processing module, and described bar code processing module is in the view data gathered The expression of middle identification bar code symbol;
Wherein, the described device for reading bar code can be programmed or be set to gather the window frame of view data and make The window frame of described view data is decoded attempting;
Wherein, the described device for reading bar code can be programmed or be set to automatically to know between multiple bar code type Not.
18. devices according to claim 17, wherein, described focusing lighting source is light emitting diode.
19. devices according to claim 17, wherein, described focusing lighting source includes infrared light-emitting diode.
20. devices according to claim 17, wherein, described lighting source includes infrared light-emitting diode.
21. devices according to claim 17, wherein, described lighting source includes blue LED, and wherein, Described focusing lighting source is configured to green light.
22. according to the device described in any one of claim 17 to 21, wherein, and the association between described exposure period and described illumination phase The feature adjusted is that described exposure period started to start afterwards in the described illumination phase.
23. according to the device described in any one of claim 17 to 21, wherein, and the association between described exposure period and described illumination phase The feature adjusted is that described exposure period started before the described illumination phase starts.
24. according to the device described in any one of claim 17 to 21, wherein, and the association between described exposure period and described illumination phase The feature adjusted is that described exposure period terminated before the described illumination phase terminates.
25. according to the device described in any one of claim 17 to 21, wherein, and the association between described exposure period and described illumination phase The feature adjusted is that described exposure period terminated to terminate afterwards in the described illumination phase.
26. devices according to claim 17, wherein, it is each that described device can run so that described light emitting diode The individual consumption electric current more than 80 milliamperes during the illumination phase.
27. devices according to claim 17, wherein, it is each that described device can run so that described light emitting diode The individual consumption electric current more than 120 milliamperes during the illumination phase.
28. devices according to claim 17, wherein, it is each that described device can run so that described light emitting diode The individual consumption electric current more than 160 milliamperes during the illumination phase.
29. devices according to claim 17, wherein, described device can run so that described light emitting diode each The individual consumption electric current more than 200 milliamperes during the illumination phase.
30. 1 kinds are read for gathering the bar code image based on complementary metal oxide semiconductors (CMOS) of view data from target Device, described bar code image reader includes:
Image sensor array based on complementary metal oxide semiconductors (CMOS), described figure based on complementary metal oxide semiconductors (CMOS) As sensor array includes multirow pixel, wherein, described image sensor array bag based on complementary metal oxide semiconductors (CMOS) The each pixel included includes photosensitive area and exhausted light shield district;
Time block, with described image sensor array telecommunication based on complementary metal oxide semiconductors (CMOS), described timing mould Block transmits exposure control timing pulse at exposure period, described based on CMOS (Complementary Metal Oxide Semiconductor) half with exposure simultaneously during exposure period The multirow pixel of the image sensor array of conductor, wherein said exposure period be reset pixel and read between pixel value time Between;
Lighting module, to one or more light sources transmission Lighting control commutator pulse to irradiate described target during the illumination phase, Described lighting module and described time block telecommunication;
Control module, itself and described time block and described lighting module telecommunication, described control module makes described exposure period Occurring during the described illumination phase at least partially, wherein, described Lighting control commutator pulse is than described spectrum assignment timing arteries and veins Rush short;And
Bar code processing module, the expression of its bar code symbol being capable of identify that in the view data of collection;
Wherein, described bar code image reader catches the window frame of view data and the window frame of described view data is entered Row decoding is attempted;
Wherein, described bar code image reader identifies between multiple bar code type automatically.
31. bar code image reader according to claim 30, wherein, described bar code image reader includes encapsulation The hand-held housing of described image sensor array.
32. according to the bar code image reader described in claim 30 or 31, and wherein, described lighting module includes by luminous two The light source that pole pipe provides.
33. according to the bar code image reader described in any one of claim 30 to 31, and wherein, described time block can be controlled The described image sensor array based on complementary metal oxide semiconductors (CMOS) of system is partly led based on CMOS (Complementary Metal Oxide Semiconductor) described in making The exposure of multiple different rows of the image sensor array of body starts simultaneously at.
34. bar code image reader according to claim 33, wherein, described lighting module overdrives described illumination mould The light source of block.
35. bar code image reader according to claim 32, wherein, described light source has maximum DC operation electric current and disappears Consumption rate, and wherein, described bar code image reader is configured to overdrive described light source, so that described light source is in institute Current drain during stating the illumination phase operates current drain rate more than described maximum DC.
36. bar code image reader according to claim 35, wherein, described bar code image reader is constructed use To overdrive described light source, so that the current drain that described light source is during the described illumination phase is more than described maximum DC operation electricity The 200% of stream consumption rate.
37. bar code image reader according to claim 32, wherein, described bar code image reader is constructed use So that described light source is by be strobed Lighting control pulsed drive during the described illumination phase, described in be strobed Lighting control arteries and veins Rush and produce pulse with gating rate.
38. according to the bar code image reader described in any one of claim 30 to 31, and the wherein said illumination phase is in described exposure Photophase starts front beginning.
39. according to the bar code image reader described in any one of claim 30 to 31, and the wherein said illumination phase is in described exposure Photophase starts after starting.
40. according to the bar code image reader described in any one of claim 30 to 31, and the wherein said illumination phase is in described exposure Photophase terminates front end.
41. according to the bar code image reader described in any one of claim 30 to 31, and the wherein said illumination phase is in described exposure Photophase terminates after terminating.
CN201110220832.0A 2005-03-11 2006-03-07 There is the apparatus for reading of bar code that global electronic shutter controls Active CN102324013B (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US11/077,975 US7568628B2 (en) 2005-03-11 2005-03-11 Bar code reading device with global electronic shutter control
US11/077,976 2005-03-11
US11/077,975 2005-03-11
US11/077,976 US7611060B2 (en) 2005-03-11 2005-03-11 System and method to automatically focus an image reader

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN2006800160235A Division CN101171597B (en) 2005-03-11 2006-03-07 Bar code reading device with global electronic shutter control

Publications (2)

Publication Number Publication Date
CN102324013A CN102324013A (en) 2012-01-18
CN102324013B true CN102324013B (en) 2016-12-14

Family

ID=

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5659167A (en) * 1994-04-05 1997-08-19 Metanetics Corporation Visually interactive decoding of dataforms
US6184534B1 (en) * 1998-08-04 2001-02-06 Eastman Kodak Company Method of pulsing light emitting diodes for reading fluorescent indicia, data reader, and system
CN1511412A (en) * 2002-01-24 2004-07-07 ����ŷ�������ʽ���� Auto-focusing device, electronic camera, and auto-focusing method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5659167A (en) * 1994-04-05 1997-08-19 Metanetics Corporation Visually interactive decoding of dataforms
US6184534B1 (en) * 1998-08-04 2001-02-06 Eastman Kodak Company Method of pulsing light emitting diodes for reading fluorescent indicia, data reader, and system
CN1511412A (en) * 2002-01-24 2004-07-07 ����ŷ�������ʽ���� Auto-focusing device, electronic camera, and auto-focusing method

Similar Documents

Publication Publication Date Title
CN101171597B (en) Bar code reading device with global electronic shutter control
JP6880288B2 (en) Image reader with global electronic shutter control
US7611060B2 (en) System and method to automatically focus an image reader
CN102324013B (en) There is the apparatus for reading of bar code that global electronic shutter controls
CN102324014B (en) Image read-out and the method for the hand-held apparatus for reading of bar code of auto-focusing

Legal Events

Date Code Title Description
PB01 Publication
SE01 Entry into force of request for substantive examination
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20210608

Address after: Building 1, Lane 555, huanke Road, Zhangjiang High Tech Park, Pudong New Area, Shanghai

Patentee after: HONEYWELL (CHINA) Co.,Ltd.

Address before: New York, USA

Patentee before: Hand Held Products, Inc.