WO2006026317A2 - Method and apparatus for controlling a lens, and camera module incorporating same - Google Patents

Method and apparatus for controlling a lens, and camera module incorporating same Download PDF

Info

Publication number
WO2006026317A2
WO2006026317A2 PCT/US2005/030159 US2005030159W WO2006026317A2 WO 2006026317 A2 WO2006026317 A2 WO 2006026317A2 US 2005030159 W US2005030159 W US 2005030159W WO 2006026317 A2 WO2006026317 A2 WO 2006026317A2
Authority
WO
WIPO (PCT)
Prior art keywords
lens
isp
lens module
recited
control signals
Prior art date
Application number
PCT/US2005/030159
Other languages
French (fr)
Other versions
WO2006026317A8 (en
WO2006026317A3 (en
Inventor
Terry Lee Zarnowski
Jeffrey J. Zarnowski
Iain A. Neil
Original Assignee
Panavision Imaging, Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panavision Imaging, Llc filed Critical Panavision Imaging, Llc
Priority to CN2005800332190A priority Critical patent/CN101103308B/en
Priority to EP05792724A priority patent/EP1789843A2/en
Priority to JP2007530099A priority patent/JP5027661B2/en
Publication of WO2006026317A2 publication Critical patent/WO2006026317A2/en
Publication of WO2006026317A3 publication Critical patent/WO2006026317A3/en
Publication of WO2006026317A8 publication Critical patent/WO2006026317A8/en

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00Optical objectives specially designed for the purposes specified below
    • G02B13/08Anamorphotic objectives
    • G02B13/12Anamorphotic objectives with variable magnification
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/64Imaging systems using optical elements for stabilisation of the lateral and angular position of the image
    • G02B27/646Imaging systems using optical elements for stabilisation of the lateral and angular position of the image compensating for small deviations, e.g. due to vibration or shake
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B3/00Simple or compound lenses
    • G02B3/12Fluid-filled or evacuated lenses
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/02Mountings, adjusting means, or light-tight connections, for optical elements for lenses
    • G02B7/028Mountings, adjusting means, or light-tight connections, for optical elements for lenses with means for compensating for changes in temperature or for controlling the temperature; thermal stabilisation
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/02Mountings, adjusting means, or light-tight connections, for optical elements for lenses
    • G02B7/04Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification
    • G02B7/10Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification by relative axial movement of several lenses, e.g. of varifocal objective lens
    • G02B7/102Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification by relative axial movement of several lenses, e.g. of varifocal objective lens controlled by a microcomputer
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B9/00Optical objectives characterised both by the number of the components and their arrangements according to their sign, i.e. + or -
    • G02B9/60Optical objectives characterised both by the number of the components and their arrangements according to their sign, i.e. + or - having five components only
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00Details of cameras or camera bodies; Accessories therefor
    • G03B17/02Bodies
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/54Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682Vibration or motion blur correction
    • H04N23/685Vibration or motion blur correction performed by mechanical compensation
    • H04N23/687Vibration or motion blur correction performed by mechanical compensation by shifting the lens or sensor position
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/74Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means

Definitions

  • the focus and zoom lens motor drives 122 convert electrical energy to mechanical motion to move the zoom lens group 104 and the focus lens group 102, and may also control other functions of the lens module 100.
  • a motor drive can provide force to alter the position, shape, or location of other components within the image capture system.
  • a motor drive can be used to change the shape and/or position of a liquid or pliable lens, change the physical position of a lens element, open or close a shutter (e.g. mechanically via an iris or optically via a transmission- variable Liquid Crystal Display (LCD)), or provide energy to an illumination source.
  • LCD Transmission- variable Liquid Crystal Display
  • Example embodiments include step motors, servo motors, screws, magnetic repulsion and attraction, piezoelectric, ultrasonic, flash, and the like.
  • a motor drive can also comprise a knob, lever, gear, wheel, or other mechanical device or a combination of mechanical devices that can be moved manually or moved in combination with other motor drives.
  • An example embodiment is a rotary knob that can alter the position of one or more lens elements to provide a focusing function.
  • Motor drives can be made of multiple components, some of which can accept control signals from an ISP or other device that in turn translates these signals into the appropriate energy needed to provide the force to alter a property of an element.
  • a simple example of a motor drive made of multiple components is a step motor driven screw.
  • lens groups are rotated, as described above, it may be desirable to rotate the captured image by rotating the chip containing the focal plane array 208, adding a prism within or between lens groups, or by processing the raw image data in ISP 210 to perform the rotation by manipulating data.

Abstract

An efficient image capture system is disclosed that integrates functions to control a lens including one or more of focus or object distance, zoom, temperature compensation, and stabilization within an image signal processor (ISP) with appropriate algorithms. In particular, the integrated ISP circuitry may control the motion of the focus and zoom optics of an optical assembly, control stabilization, control the flash, provide enhanced functions and features for controlling the zoom and focus lenses to enable enhanced image capture sequences and/or tracking lens data, provide a set of algorithms within the ISP to alter the aspect ratio (both height and width of an image) of the image, for example to compensate for the addition of an anamorphic lens, and integrate an anamorphic lens into the module to alter an image's projected aspect ratio onto the focal plane array.

Description

METHOD AND APPARATUS FOR CONTROLLING A LENS, AND CAMERA MODULE INCORPORATING SAME
Cross-Reference to Related Applications
[0001] This application claims the benefit under 35 U.S.C. §119(e) of U.S. Provisional Application No. 60/604,525, filed on August 25, 2004, the contents of which are incorporated by reference herein.
Field of the Invention
[0002] The present invention relates, generally, to an image capture system, and in particular embodiments, to an image capture system that integrates functions within a lens module, including some of all of the following: lens groups, lens motor drives, focal plane array, Image Signal Processor (ISP), control of focus or object distance, zoom, flash, shutter, temperature compensation, and/or stabilization.
Background of the Invention
[0003] Conventional imaging systems (e.g. digital cameras, camera phones, camcorders and other imaging devices and applications) typically incorporate a camera lens module as part of the system assembly. This lens module is comprised of a focal plane array, a mechanical housing, an optics assembly, and an electrical interface with connector.
[0004] FIG. 1 illustrates an exemplary conventional motor driven lens module 100 (module case represented by dashed line). The lens groups (focus lens group 102 and zoom lens group 104) within the lens module 100 are illustrative only, as it should be understood that many different configurations of lenses may be used within the lens module 100. For example, if the lens is a fixed or prime lens, then only one or more focus lens groups are present and move for focusing. If the lens is a zoom lens, then the lens groups act together to provide the zooming function, and one or more focus lens groups move for focusing. Additionally, one or more lens groups may be moved for temperature compensation, image stabilization, and anamorpliic distortion.
[0005] A lens group is comprised of one or more lens elements with a primary purpose of altering the path of electromagnetic radiation. Elements of a lens can be made from many differing types and compositions of materials, examples of which include glass of various compositions, crystals, plastics or resins, ceramics, liquids, or even a combination. Additionally, lens elements can be reflective, such as a mirror or prism. The elements of a lens can be made into different shapes, thicknesses, or other properties and can be made and/or combined with other elements to perform various tasks including focusing, magnification, reduction, reflection, refraction, correction or creation of regular distortion (including anamorphic distortion) and correction of lateral color. By altering the position, shape, transmittance, reflectance, magnetic attraction, or other properties of the elements, the functions described above may be performed. For example, moving an element along an axis perpendicular to the focal plane array 108 (along the primary or optical axis) is useful to provide focus and/or zoom capability. Similarly, changing the shape of a liquid or pliable element and/or in combination with moving it can do the same. Moving or changing the shape of an element relative to and along the primary axis is useful to provide image stabilization and temperature compensation. Sensors may be employed to sense some property of the lens elements such as position, shape, temperature, magnetic flux, displacement, humidity, and light. Some example embodiments of lens sensors include linear or rotary encoders, displacement sensors, thermistors, thermocouples, counters, motion detectors, and accelerometers.
[0006] The lens groups of FIG. 1 focus the visible electromagnetic spectrum or the infrared electromagnetic spectrum onto an image sensor (e.g. focal plane array) 108 within the lens module 100. A focal plane array is a device containing one or more elements that detect or sense electromagnetic radiation at various wavelengths or in ranges of wavelengths. These elements can be tuned through a variety of means to sense or detect, for example, the human visible light spectrum as would be used in digital photography and video. They can also be tuned to sense or detect infrared light, ultraviolet light, or other desired wavelengths or bands of wavelengths. Some example embodiments of focal plane arrays include charge coupled devices (CCDs), Complementary Metal Oxide Semiconductor (CMOS) active pixel sensors, CMOS active column sensors, quantum dot focal plane arrays, and gallium arsenide infrared arrays. Examples of focal plane arrays are found in U.S. Patent No. 6,084,229, U.S. Patent No. 5,471,515, and U.S. Patent No. 4,054,797, the contents of which are incorporated by reference herein.
[0007] In FIG. 1, raw image data 106 captured on the focal plane array 108 is transferred to an ISP 110. The ISP 110 is used to convert the raw image data 106 into usable still or video images that can be stored, printed, displayed, or further analyzed. The ISP 110 runs various algorithms for this purpose. As an example, the ISP 110 may run one or more algorithms to perform various image processing tasks including, but not limited to: automatic dark reference, color filter de-mosaicing, white balance, color correction, color space conversion, and compression. The ISP 110 can be implemented by algorithms running on a standalone processor such as a Digital Signal Processor (DSP), algorithms running in a programmable semiconductor.device such as Field Programmable Gate Array (FPGA), algorithms integrated directly into logic such as an Application Specific Integrated Circuit (ASIC)5 a combination of the aforementioned or other embodiments. Examples of ISPs are Faraday Technology Corporation's FTISPlOOS 2-Megal Pixel ISP, and Mtekvision's MV9313 ISP. [0008] Processed image data 112 from the ISP 110 is then transferred to a system processor 114. The system processor 114 accepts user input 116 to control the zoom lens group and focus lens group, shown symbolically as two switches for zoom control, although it should be understood that a number of different user inputs may be delivered to the system processor 114 using a number of different input mechanisms to control different functions. The system processor 114 then generates control signals 118, shown symbolically as a focus control signal and a zoom control signal, although it should be understood that a number of different control signals may be generated by the system processor 114. These control signals are then sent to lens drive electronics 120, which control focus and zoom lens motor drives 122 within the lens module 100. [0009] The focus and zoom lens motor drives 122 convert electrical energy to mechanical motion to move the zoom lens group 104 and the focus lens group 102, and may also control other functions of the lens module 100. For example, a motor drive can provide force to alter the position, shape, or location of other components within the image capture system. In another example, a motor drive can be used to change the shape and/or position of a liquid or pliable lens, change the physical position of a lens element, open or close a shutter (e.g. mechanically via an iris or optically via a transmission- variable Liquid Crystal Display (LCD)), or provide energy to an illumination source. Example embodiments include step motors, servo motors, screws, magnetic repulsion and attraction, piezoelectric, ultrasonic, flash, and the like. A motor drive can also comprise a knob, lever, gear, wheel, or other mechanical device or a combination of mechanical devices that can be moved manually or moved in combination with other motor drives. An example embodiment is a rotary knob that can alter the position of one or more lens elements to provide a focusing function. Motor drives can be made of multiple components, some of which can accept control signals from an ISP or other device that in turn translates these signals into the appropriate energy needed to provide the force to alter a property of an element. A simple example of a motor drive made of multiple components is a step motor driven screw. The screw drives a nut that is connected to the element of interest; when the screw turns, the position of the element changes. A motor such as a stepper is used to turn the screw. The motor requires energy to turn which is provided by a translator. The translator interprets control signals from the ISP or other source and converts these to electrical pulses of the correct relationsm'p to turn the stepper motor. Another example is a liquid lens drive. The liquid lens has magnetic properties such that when one or more external magnetic fields are applied, the lens can change shape and/or position. The drive in this case can be a permanent magnet and/or a coil of wire. When the magnet is moved or the coil of wire is energized in varying ways, the changing magnetic field changes the properties of the liquid lens. A translator converts controls signals from an ISP or other device and converts these signals into the appropriate energy. An example of a liquid lens element is found in U.S. Patent No. 6,369,954, the contents of which are incorporated by reference herein. [0010] Because recent advances in focal plane array technology have enabled focal plane arrays to contain more circuitry and perform more functions, some conventional lens modules now incorporate the ISP 110 on the same integrated circuit chip that contains a focal plane array 108 such as a CMOS active column sensor. More advanced conventional lens modules 100 may also incorporate the processing of focus control on the same integrated circuit chip that contains the focal plane array 108.
[0011] However, as FIG. 1 illustrates, the electrical control signals 118 that control the zoom lens drives, the flash, the shutter and other functions though the lens drive electronics 120 (which convert electrical energy to mechanical motion to move the lens and control other functions) have conventionally been derived outside of the lens module 100. For example, an auto-focus control signal from a position measurement sensor (e.g. an infrared or ultrasonic sensor) may be derived in a discrete ISP 110 and sent to a focus drive within the lens drive electronics 120. For image-based focus control, the image data 106 must be transferred from the lens module 100 to the system processor 114 where an edge-detection auto-focus algorithm is used to develop the focus control signal. Additionally, the user may wish to manually alter the object distance by controlling the focus lens group 102. Signals from buttons, switches or other input devices must be input to the system processor 114 which in turn sends the appropriate focus control signals to the lens drive electronics 120. Control signals for the zoom lens group, flash, shutter and other functions are similarly generated outside of the lens module 100, as described above. An example of a conventional system with control signals developed outside the lens module is Published U.K. Patent Application No. GB 2,141,260 A. [0012] Because conventional imaging systems utilize a lens module 100 separate from the devices that generate control signals, such as the lens drive electronics 120 illustrated in FIG. 1, additional manufacturing steps are required to assemble and connect the lens module together with these associated devices, increasing the time and expense of manufacture. In addition, these extra steps increase the chance of assembly errors. [0013] Having lens modules separate from devices that generate control signals, such as the lens drive electronics, can also create performance issues. The generation of the control signals outside the module wastes system power because of the extra processing steps performed by the devices outside the module. In addition, as described above, imaging systems that have integrated auto-focus lens control utilize an algorithm for controlling the focus lens that is located on the ISP separate from the focal plane array. The image processor must read the image data from the focal plane array, process the data, and then transmit control signals to the drive electronics of the focus lens, increasing the image acquisition time. [0014] Having lens modules separate from devices that generate control signals, such as the lens drive electronics, can also lead to undesirable product specifications and operational parameters. For example, the use of separate circuits (e.g. chips) for the lens drive electronics adds extra components, which can lead to increased imaging device size and weight. In addition, the use of separate circuits may require that each circuit be separately powered, with higher-powered output buffers used to drive signals between chips, resulting in increased power consumption.
[0015] In today's competitive consumer electronics environment in which the clear trends are increased features, decreased product size, and lower power consumption, manufacturers of imaging devices such as digital cameras and cell phones must utilize technologies which produce the most performance and capability in the smallest packaging possible, while at the same time minimizing assembly costs and the number of assembly errors.
[0016] With regard to capability, manufacturers would greatly benefit from a lens module with increased integrated functionality. An integrated modular approach would also allow imaging device manufacturers to make a standardized "platform" that can accommodate plug-in modules with different features to produce different product models.
[0017] With regard to performance, the size and power consumption improvements that can be realized using a lens module with increased integrated functionality would also be beneficial to imaging device manufacturers. Furthermore, compact compound zoom lens technology may be employed within these integrated modules, giving manufacturers a high-performance, wide-angle zoom lens not previously available in small imaging devices. Compact compound zoom lens technology is described in U.S. Patent Application No. 11/101,933, the contents of which are incorporated by reference herein.
[0018] With regard to minimizing assembly costs and assembly errors, manufacturers would greatly benefit from modularized multi-function components that enable devices to be assembled and connected with relatively few manufacturing steps, instead of having to assemble and connect multiple small devices. [0019] Therefore, there is a need to integrate functions within a lens module, including some or all of the following: lens groups, lens motor drives, focal plane array, ISP, control of focus or object distance, zoom, flash, shutter, temperature compensation, and/or stabilization.
Summary of the Invention
[0020] Embodiments of the present invention are directed to a modular image capture system that improves manufacturability (i.e. reduces manufacturing time, expense, and number of assembly errors) by integrating functions within a lens module, including some or all of the following: auto-focus and zoom lens groups, lens motor drives, focal plane array, ISP, control of zooming and focus or object distance, flash, shutter, temperature compensation, image stabilization, and a distance/focus measurement device (for non-image based focus control), including the appropriate algorithms. The integration of functions also improves image acquisition time and decreases imaging device size, weight, and power consumption.
[0021] One exemplary image capture system according to embodiments of the present invention may be formed with a focal plane array, a compound zoom lens, an ISP, an electrical and/or mechanical interface which are integrated into a single lens module assembly or chassis, and a housing that can provide a support structure for the assembly and other components in the image capture system. An electrical interface connected to the lens module chassis is used to communicate with a host device, and a mechanical interface is used to incorporate the assembly with the host device.
[0022] In particular, many of the functions and algorithms described above, such as the circuitry that generates the focus and zoom lens drive control signals, may be incorporated and executed on the same integrated circuit that performs the ISP function. This enhanced ISP can either be integrated directly on-chip with the focal plane array, or can be implemented in a discrete semiconductor integrated circuit mounted somewhere within the lens module.
[0023] An optional anamorphic lens, stabilization sensors and a stabilization drive may also be employed in the lens module. The stabilization sensors generate outputs which are fed back to and processed in the ISP, where the ISP can execute integrated image stabilization algorithms and send control signals back to the stabilization drive, all within the confines of the lens module, to stabilize the image being captured. Alternatively or in addition to the above, the ISP can move the image data to provide stabilization. Additionally, regardless of how the image is projected onto the focal plane array or otherwise captured by the system, an algorithm can be added to the ISP to alter the image aspect ratio as captured by the focal plane array, for example, to de-anamorphose the final image.
[0024] Flash or illumination control can also be integrated into the module, as well as the control of a shutter.
[0025] Alternative embodiments of the present invention of an image capture system according to embodiments of the present invention may include multiple ISPs, focal plane arrays, lenses and lens groups, and/or varying types of electrical and/or mechanical interfaces. Other alternative embodiments may include the addition of improved lenses or lens groups, one or more motor drives, one or more sensors, and/or one or more improved ISPs enhanced to control the motor drives and/or interface to the sensors.
[0026] The integrated approach provides certain benefits, as mentioned above.
For example, the shot-to-shot time can be decreased by integrating the ISP and the focus control algorithm together on the same chip. Integrating the drive electronics, feedback devices, control signals, and other relevant lens control electronics as well as the flash within the module assembly reduces the amount of electrical interconnects to the module from the system and can reduce overall system size and power consumption.
Brief Description of the Drawings
[0027] FIG. 1 illustrates an exemplary conventional motor driven lens module
(module case represented by dashed line).
[0028] FIG. 2 illustrates an exemplary motor driven lens module (module case represented by dashed line) with integrated functionality according to embodiments of the present invention.
Detailed Description of the Preferred Embodiment
[0029] In the following description of preferred embodiments, reference is made to the accompanying drawings which form a part hereof, and in which it is shown by way of illustration specific embodiments in which the invention may be practiced. It is to be understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the preferred embodiments of the present invention.
[0030] Embodiments of the present invention are directed to a modular image capture system that improves manufacturability (i.e. reduces manufacturing time, expense, and number of assembly errors) by integrating functions within a lens module, including some or all of the following: lens groups, lens motor drives, focal plane array, ISP, control of focus (including regular focus, close focus, or macro focus) or object distance, zoom, flash, shutter, temperature compensation, and/or stabilization, including the appropriate algorithms. The integration of functions also improves image acquisition time and decreases imaging device size, weight, and power consumption. In particular, many of the functions and algorithms described above may be incorporated and executed on the same integrated circuit that performs the ISP function. This enhanced ISP can then be integrated on the same substrate as the focal plane array or the ISP can be produced on a separate substrate. This separate substrate can also be integrated within the module.
[0031] One exemplary image capture system according to embodiments of the present invention may be formed with a focal plane array, a compound zoom lens, an ISP, an electrical and/or mechanical interface which are integrated into a single assembly, and a housing that can provide a support structure for the assembly. An electrical interface is used to communicate with a host device, and a mechanical interface is used to incorporate the assembly with the host device. The electrical interface may include one or more electrical connectors such as a plug or socket, and the mechanical interface may include guides, rails, bosses, and the like to accurately locate the module or assembly into the host device. The mechanical interface may also be integrated with the electrical interface to form a single electromechanical connector. Example host devices include, but are not limited to, a digital still camera, a video camera, a mobile phone, a personal data assistant, a security or surveillance camera, and an industrial camera.
[0032] FIG. 2 illustrates an exemplary motor driven lens module 200 (module case represented by dashed line) with integrated functionality according to embodiments of the present invention. The zoom, focus and thermal compensation lens groups 202 and 204 within the lens module 200 are illustrative only, as it should be understood that many different configurations of lenses may be used within the lens module 200. One or more of the lens groups may also be rotatable, as described in U.S. Patent Application No. 11/101,933. FIGs. 34 and 38 of that application illustrate an exemplary rotatable lens system including a liquid lens suitable for use in the lens module of the present invention. [0033] As mentioned above, U.S. Patent Application No. 11/101,933 describes a high-performance, compact compound zoom technology that may be used within the lens module 200 of the present invention. The compound zoom technology described in that application is a wide-range, ultra- wide angle optionally rotatable compound zoom lens system with a simplified zooming structure that reduces the number of independently moving lens groups to just two or three. Compound zoom technology allows for a very small diameter front element even with a large zoom range and extremely wide field of view. In order to allow the system to be used in a compact package, one or more fold prisms or mirrors can be included in the design. The reflective nature of these prisms or mirrors provides an additional benefit of preventing Electromagnetic Interference (EMI) from escaping the lens module. The optical design consists of a zooming kernel followed by a zooming relay, with a stationary P lens group in between. The zooming kernel has either an NP or NPP structure, and the zooming relay has either a P or PP structure. The kernel, as defined herein, includes all lens groups on the object space side of the stationary P lens group, while the zooming relay includes all zoom groups on the image space side of the stationary P lens group. There are just two or three independently moving groups altogether, one or two on each side of an intermediate image. The front group is stationary with respect to the image plane, as are the fold prisms. The zooming relay, comprising just one or two independently moving positive groups, has a notably simple structure that contributes significantly to the simplicity of the lens design. The compound zoom technology can also utilize the zooming groups as focusing groups and for temperature compensation, thus maintaining a relatively simple mechanical structure. The compactness and performance of compound zoom technology, not previously available, makes it ideally suited for inclusion in the integrated lens module 200 of FIG. 2. [0034] In FIG. 2, raw image data captured through the various lens groups is transferred from an image sensor (e.g. a focal plane array) 208 to an Image Signal Processor (ISP) 210 that may be located on the same chip or on a different chip as the image sensor, where the raw image data is processed. The focal plane array 208 may be sensitive to visible light having wavelengths of about 450-650 nanometers, ultraviolet light having wavelengths of less than about 450 nanometers, infrared light having wavelengths of greater than about 650 nanometers, or any combination of the above. The ISP 210 also accepts user input to control the zoom lens group and focus lens group, shown symbolically as two thumbwheels 216 on the lens module 200, although it should be understood that a number of different user inputs may be delivered to the ISP 210 using a number of different input mechanisms to control different functions. The ISP 210 then generates and sends control signals 218 to lens drive electronics 220, which may be located on-chip or off-chip but within the lens module 200. The lens drive electronics 220 then send further lens motor drive control signals to control focus and zoom lens motor drives and other functions within the lens module 200. Note that the focus and zoom lens groups may also be controlled manually, in addition to or instead of the lens drive electronics. In addition, the ISP 210 can derive an auto-focus control signal using focus or position measurement sensors (e.g. an infrared, ultrasonic, or additional image sensor) 244 which is sent to the lens drive electronics 220. The ISP 210 may also communicate with storage or other devices outside the module through a module connector to perform additional functions such as storing data into the storage or retrieving data from the storage. Note that in FIG. 2, unlike FIG. 1, the circuitry that generates the focus and zoom lens drive control signals 218 is integrated within the ISP 210 and located within the lens module 200. The ISP 210 can either be integrated directly on-chip with the focal plane array 208, or can be implemented in a discrete semiconductor die mounted somewhere within the lens module 200. The focus and zoom lens motor drives receive the control signals and convert electrical energy to mechanical motion to move the zoom, focus and thermal compensation lens groups 204 and 202 and control other features of the lens module 200.
[0035] Note that if one or more of the lens groups are rotated, as described above, it may be desirable to rotate the captured image by rotating the chip containing the focal plane array 208, adding a prism within or between lens groups, or by processing the raw image data in ISP 210 to perform the rotation by manipulating data.
[0036] Exemplary FIG. 2 shows an optional stabilization lens 246 and radialy movable lens mount 226 located on the image side of the zoom, focus and thermal compensation lens group 204, although it should be understood that the stabilization lens and lens mount may be located elsewhere in the lens module 200. Stabilization sensors 228 are shown in FIG. 2 as being located near the focal plane array 208, although it should be understood that the stabilization sensors may be located elsewhere in the lens module 200. The stabilization sensors 228 (e.g. feedback devices such as accelerometers or gyroscopes) generate stabilization data outputs 230 which are fed back to and processed in the ISP 210, where the ISP can execute integrated image stabilization algorithms and send control signals 218 back to the drive electronics 220 to control the lens mount 226 and stabilize the image being captured. An example of a lens system with image stabilization is found in U.S. Published Application No. US 2004/0021953 Al, the contents of which are incorporated herein by reference.
[0037] Focal plane arrays and optics for modules are typically designed around the standard imaging format aspect ratios such as 4:3 or 16:9. This can limit performance, viewing angle, zoom factor, cost and other parameters. The use of anamorphic lenses can eliminate the restrictions imposed by these standards. Exemplary FIG. 2 shows an optional anamorphic lens 224. The anamorphic lens 224 may be added within the lens module 200 to alter the projected image aspect ratio. Although the example of FIG. 2 shows the anamorphic lens 224 between the stabilizaiton lens group 246 and a shutter 234, the anamorphic lens 224 can be added anywhere within the optical path. Additionally, regardless of how the image is projected onto the focal plane array or otherwise captured by the system, an algorithm can be added to the ISP 210 to alter the image aspect ratio as captured by the focal plane array 208. This introduction of an anamorphic lens 224 with or without the aspect ratio image processing algorithm enables optimization of different parameters for the system. For example, smaller diameter lenses may be used to lower costs, and/or a square aspect image sensor can be used to capture 4:3 or 16:9 aspect ratio images. An example of a cost and performance enhancement is to use an anamorphic lens to squeeze an image horizontally so that it can be completely captured by a square format focal plane array. This enables the use of less expensive and smaller diameter optics, and a smaller and therefore cheaper focal plane array. Use of an anamorphic lens 224 also enables the use of non-square pixels.
[0038] Flash or illumination control 238 for illuminating a scene can also be integrated into the module under the control of flash control signals from the drive electronics 220 and the ISP 210. In the case of LED or similar type illumination, the function of a 'flashlight' can be added as well as the normal "strobe" for digital photography or constant or pulsed illumination for video capture. [0039] Also shown in exemplary FIG. 2 is a shutter 234, which may be opened and closed under the control of shutter control signals from the drive electronics 220 and the ISP 210.
[0040] Alternative embodiments of the present invention of an image capture system according to embodiments of the present invention may include multiple ISPs, focal plane arrays, lenses and lens groups, and/or varying types of electrical and/or mechanical interfaces. Other alternative embodiments may include the addition of improved lenses or lens groups, one or more motor drives, one or more sensors, and/or one or more improved ISPs enhanced to control the motor drives and/or interface to the sensors.
[0041] The integrated functions described above and their algorithms can respond to user input via pushbuttons, switches, or other input devices, from feedback devices such as position, acceleration, gyroscopes, and/or other sensors, and can also react to data sent to it by the system or the connector for the lens module 200. Electrical control signal outputs may be generated that interface directly to a lens drive within the lens module and/or send data out the data interface to the image capture system.
[0042] The integrated approach illustrated in FIG. 2 provides certain benefits.
For example, the shot-to-shot time can be decreased by integrating the ISP 210 and the focus control algorithm together on the same chip. In the case where the focus changes as the lens is zoomed, focus following (maintaining focus as the zoom changes) can be enabled when the user alters the zoom ratio. The user can alter the zoom ratio mechanically or by activating a button, switch or other input device 216, with such activation or mechanical motion providing a signal which can be input directly via an electrical signal to the ISP algorithms or through the data interface. Integrating the drive electronics 220, feedback devices, control signals, and other relevant lens control electronics as well as the flash within the module assembly reduces the amount of electrical interconnects to the module from the system and can reduce overall system size and power consumption while at the same time improving performance. [0043] The addition of this integrated control capability to either or both control of the zoom and focus lens groups enables other features such as the tracking and recording of lens position data with respect to the captured image, and/or enables user programmed sequences to be entered and executed such as "set zoom to X zoom" and "set object distance (focus) to Y," where X and Y are programmable variables. Even more complex zoom and focus control can be implemented with the addition of multiple settings with timed or event driven intervals (e.g. memorize and repeat a sequence). For example, a simple sequence that could be stored is (1) zoom to 3x magnification, (2) set focus to 3.0 feet, (3) capture image, (4) zoom to 2x magnification, (5) adjust focus to 12 feet, and (6) capture image.
[0044] Temperature measurement and optical as well as image compensation may also be included within the lens module 200. Temperature or thermal compensation may include a temperature sensor 240, which generates temperature data that is sent to the ISP 210 for processing. Changes in temperature can cause de- focusing which can be compensated within the optics by using focus control and moving one or more of lens groups 202 and 204. Additionally, the image data can be temperature compensated in the ISP 210 to improve image quality.
[0045] Zoom lens controls may also be integrated into the lens module 200 and may be placed in a location accessible to a user (see representative thumbwheels 216 in FIG. 2), even after the lens module is installed in the image capture system. Zoom lens controls are typically either a mechanical device or electrical switches or buttons. For the mechanical devices, a rotary knob or collar, lever, cam, gears or other device (or a combination of all or some of the aforementioned) is moved by the operator, and this motion is transmitted to the zoom lens to move it. For electrical switches or buttons, the duration of motion for the zoom lens is typically proportional to the length of time the switch or button is actuated. When the switch or button is pushed, electrical signals are typically sent to the imaging system controller, which then sends corresponding electrical signals to the zoom lens electric drive system. The drive system is typically a motor which takes the electrical signal and converts it back to mechanical motion either directly or through a mechanical device to move the zoom lens. [0046] Note that when the zoom lens is moved, the image may go out of focus during zooming, requiring the image to be re-focused. Focus lens controls may also be integrated into the module in a location accessible to a user, to enable the user to perform this re-focusing. Additionally, the focus group can be changed by the user to alter the object distance or the focus lens group(s) may be controlled by the ISP to maintain the focus automatically.
[0047] Although the present invention has been fully described in connection with embodiments thereof with reference to the accompanying drawings, it is to be noted that various changes and modifications will become apparent to those skilled in the art. Such changes and modifications are to be understood as being included within the scope of the present invention as defined by the appended claims.

Claims

WHAT IS CLAIMED IS:
1. A lens module with integrated functionality, comprising: a plurality of lens groups for receiving an image and providing a zooming capability; a focal plane array aligned with the lens groups for capturing the image through the lens groups and generating raw image data; an Image Signal Processor (ISP) communicatively coupled to the focal plane array for receiving and processing the raw image data and generating control signals, the control signals including a zoom control signal; drive electronics communicatively coupled to the ISP for receiving the control signals and generating lens motor drive signals; one or more lens motor drives communicatively coupled to the drive electronics for receiving the lens motor drive signals, and coupled to the lens groups for moving the lens groups in accordance with the lens motor drive signals; and a lens module chassis for supporting the lens groups, the focal plane array, the ISP, the drive electronics, and the one or more lens motor drives, the lens module chassis for enabling the lens module to be assembled into an imaging system as a single component.
2. The lens module as recited in claim 1, the lens groups comprising a compound zoom lens system.
3. The lens module as recited in claim 1, wherein at least one of the lens groups is a focus lens group, the ISP is for further generating focus control signals, and the one or more lens motor drives includes a focus lens motor drive.
4. The lens module as recited in claim 3, further including a focus sensor communicatively coupled to the ISP for assisting the ISP in generating the focus control signals.
5. The lens module as recited in claim 1, wherein the focal plane array and the ISP are co-located on a single integrated circuit.
6. The lens module as recited in claim 1, further comprising: one or more stabilization sensors communicatively coupled to the ISP for generating and sending stabilization data to the ISP; and a stabilization drive coupled to one or more of the lens groups and to the ISP for receiving stabilization control signals generated by the ISP and for performing image stabilization; wherein the ISP is configured for processing the stabilization data and generating the stabilization control signals.
7. The lens module as recited in claim 1, further comprising: one or more temperature sensors communicatively coupled to the ISP for generating and sending temperature data to the ISP; wherein the ISP is configured for processing the temperature data and generating focus control signals for temperature compensation.
8. The lens module as recited in claim 1, further comprising: a flash driver communicatively coupled to the drive electronics and the ISP for controlling a flash; wherein the ISP is configured for generating flash control signals for the flash driver.
9. The lens module as recited in claim 1, further comprising: a shutter communicatively coupled to the drive electronics and the ISP for controlling the image captured on the focal plane array; wherein the ISP is configured for generating shutter control signals for the shutter.
10. The lens module as recited in claim 1 , wherein the focal plane array is a Charge Coupled Device (CCD).
11. The lens module as recited in claim 1 , wherein the focal plane array is a Complementary Metal Oxide Semiconductor (CMOS) active pixel sensor.
12. The lens module as recited in claim 1, wherein the focal plane array is a Complementary Metal Oxide Semiconductor (CMOS) active column sensor.
13. The lens module as recited in claim 1, wherein the focal plane array is a quantum dot focal plane array.
14. The lens module as recited in claim 1, wherein the focal plane array is sensitive to a visible spectrum of wavelengths of about 450-650 nanometers.
15. The lens module as recited in claim 1, wherein the focal plane array is sensitive to an infrared spectrum of wavelengths of greater than about 650 nanometers.
16. The lens module as recited in claim 1 , wherein the focal plane array is sensitive to an ultraviolet spectrum of wavelengths of less than about 450 nanometers.
17. The lens module as recited in claim 1, wherein the focal plane array is sensitive to one or more of a visible spectrum of wavelengths of about 450-650
, nanometers, an infrared spectrum of wavelengths of greater than about 650 nanometers, and an ultraviolet spectrum of wavelengths of less than about 450 nanometers.
18. The lens module as recited in claim 1, wherein the at least one of the lens groups comprises a liquid lens.
19. The lens module as recited in claim 1, the ISP for communicating with external storage to store or retrieve image or image-related data.
20. The lens module as recited in claim 1 , the ISP for storing lens position data with respect to a captured image.
21. The lens module as recited in claim 1, the ISP for storing sequences of lens position data for subsequent execution.
22. The lens module as recited in claim 1, further comprising: one or more connectors to connect the lens module to a host device, the one or more connectors including one or more of an electrical interface for transferring data to and from the lens module, and a mechanical interface for accurately locating the lens module into the host device.
23. The lens module as recited in claim 22, wherein the mechanical interface is integrated with the electrical interface to form a single electro-mechanical connector.
24. A lens module with integrated functionality, comprising: a plurality of lens groups for receiving an image and providing a zooming capability, the lens groups comprising a compound zoom lens system; a focal plane array aligned with the lens groups for capturing the image through the lens groups and generating raw image data; an Image Signal Processor (ISP) communicatively coupled to the focal plane array for receiving and processing the raw image data and generating control signals, the control signals including a focus control signal and a zoom control signal; drive electronics communicatively coupled to the ISP for receiving the control signals and generating lens motor drive signals; one or more lens motor drives communicatively coupled to the drive electronics for receiving the lens motor drive signals, and coupled to the lens groups for moving the lens groups in accordance with the lens motor drive signals; and a lens module chassis for supporting the lens groups, the focal plane array, the ISP, the drive electronics, and the one or more lens motor drives, the lens module chassis for enabling the lens module to be assembled into an imaging system as a single component.
25. The lens module as recited in claim 24, wherein at least one of the lens groups is a focus lens group, the ISP is for further generating focus control signals, and the one or more lens motor drives includes a focus lens motor drive.
26. The lens module as recited in claim 25, further including a focus sensor communicatively coupled to the ISP for assisting the ISP in generating focus control signals.
27. The lens module as recited in claim 24, wherein the focal plane array and the ISP are co-located on a single integrated circuit.
28. The lens module as recited in claim 27, wherein the ISP is configured for processing stabilization data and generating stabilization control signals, temperature data and generating focus control signals for temperature compensation, flash control signals for a flash driver, or shutter control signals for a shutter.
29. The lens module as recited in claim 24, further comprising: one or more connectors to connect the lens module to a host device, the one or more connectors including one or more of an electrical interface for transferring data to and from the lens module, and a mechanical interface for accurately locating the lens module into the host device.
30. The lens module as recited in claim 29, wherein the mechanical interface is integrated with the electrical interface to form a single electro-mechanical connector.
31. A method for integrating lens module functionality, comprising: receiving an image through a compound zoom lens system; capturing the received image and generating raw image data; receiving and processing the raw image data and generating control signals, the control signals including a focus control signal and a zoom control signal; receiving the control signals and generating lens motor drive signals; receiving the lens motor drive signals and moving lens groups in the compound zoom lens system in accordance with the lens motor drive signals; and performing the preceding steps within a lens module chassis for enabling the lens module chassis to be assembled into an imaging system as a single component.
32. The method as recited in claim 31 , further comprising performing the steps of (1) capturing the received image and generating raw image data and (2) receiving and processing the raw image data and generating control signals, the control signals including a focus control signal and a zoom control signal, within a single integrated circuit.
33. The method as recited in claim 32, further comprising processing stabilization data and generating stabilization control signals, processing temperature data and generating focus control signals for temperature compensation, processing flash control signals for a flash driver, or processing shutter control signals for a shutter within the single integrated circuit.
34. The method as recited in claim 31, further comprising: providing one or more of an electrical interface for transferring data to and from the lens module, and a mechanical interface for accurately locating the lens module into the host device.
35. The method as recited in claim 34, further comprising integrating the mechanical interface with the electrical interface to form a single electro-mechanical connector.
PCT/US2005/030159 2004-08-25 2005-08-22 Method and apparatus for controlling a lens, and camera module incorporating same WO2006026317A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN2005800332190A CN101103308B (en) 2004-08-25 2005-08-22 Method and apparatus for controlling a lens, and camera module incorporating same
EP05792724A EP1789843A2 (en) 2004-08-25 2005-08-22 Method and apparatus for controlling a lens, and camera module incorporating same
JP2007530099A JP5027661B2 (en) 2004-08-25 2005-08-22 Lens control method and apparatus, and camera module incorporating the same

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US60452504P 2004-08-25 2004-08-25
US60/604,525 2004-08-25

Publications (3)

Publication Number Publication Date
WO2006026317A2 true WO2006026317A2 (en) 2006-03-09
WO2006026317A3 WO2006026317A3 (en) 2006-12-21
WO2006026317A8 WO2006026317A8 (en) 2007-04-19

Family

ID=36000564

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2005/030159 WO2006026317A2 (en) 2004-08-25 2005-08-22 Method and apparatus for controlling a lens, and camera module incorporating same

Country Status (6)

Country Link
US (1) US7616877B2 (en)
EP (1) EP1789843A2 (en)
JP (1) JP5027661B2 (en)
KR (1) KR100924179B1 (en)
CN (1) CN101103308B (en)
WO (1) WO2006026317A2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7616877B2 (en) 2004-08-25 2009-11-10 Panavision Imaging, Llc Method and apparatus for controlling a lens, and camera module incorporating same
GB2479931A (en) * 2010-04-30 2011-11-02 Sony Corp A Camera Device, Arrangement and System
US11575845B2 (en) 2020-10-26 2023-02-07 Samsung Electro-Mechanics Co., Ltd. Infrared image sensor and infrared camera module
US11927731B2 (en) 2020-12-28 2024-03-12 Samsung Electro-Mechanics Co., Ltd. Lens and optical imaging system

Families Citing this family (58)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9900478B2 (en) 2003-09-04 2018-02-20 Flir Systems, Inc. Device attachment with infrared imaging sensor
WO2014105241A1 (en) * 2012-12-26 2014-07-03 Flir Systems, Inc. Device attachment with infrared imaging sensor
JP5017989B2 (en) * 2006-09-27 2012-09-05 ソニー株式会社 Imaging apparatus and imaging method
US7544919B2 (en) 2006-11-20 2009-06-09 Red.Com, Inc. Focus assist system and method
US9690168B2 (en) 2006-11-20 2017-06-27 Red.Com, Inc. Focus assist system and method
JP2008170874A (en) * 2007-01-15 2008-07-24 Sony Corp Zoom lens and imaging device
KR101505699B1 (en) * 2007-10-08 2015-03-24 블랙아이 옵틱스, 엘엘씨 Liquid optics zoom lens system and imaging apparatus
EP2217960B1 (en) 2007-12-04 2017-06-07 Blackeye Optics, LLC Image-stabilization system comprising two liquid lenses
CA2703246C (en) 2007-12-04 2017-07-11 Blackeye Optics, Llc Zoom lens of the telephoto type having a liquid lens in a fixed group
JP5178186B2 (en) * 2007-12-28 2013-04-10 キヤノン株式会社 Lens position control device and control method thereof
US9756264B2 (en) 2009-03-02 2017-09-05 Flir Systems, Inc. Anomalous pixel detection
US9948872B2 (en) 2009-03-02 2018-04-17 Flir Systems, Inc. Monitor and control systems and methods for occupant safety and energy efficiency of structures
US10757308B2 (en) 2009-03-02 2020-08-25 Flir Systems, Inc. Techniques for device attachment with dual band imaging sensor
US9986175B2 (en) 2009-03-02 2018-05-29 Flir Systems, Inc. Device attachment with infrared imaging sensor
US9843742B2 (en) * 2009-03-02 2017-12-12 Flir Systems, Inc. Thermal image frame capture using de-aligned sensor array
JP4402163B1 (en) 2009-04-06 2010-01-20 株式会社オプトエレクトロニクス Liquid lens optical body and optical information reader
CA2758206C (en) * 2009-04-10 2019-03-19 Blackeye Optics Llc Variable power optical system
CA2758207C (en) * 2009-04-10 2018-05-22 Blackeye Optics, Llc Variable power optical system
US10091439B2 (en) * 2009-06-03 2018-10-02 Flir Systems, Inc. Imager with array of multiple infrared imaging modules
US9843743B2 (en) 2009-06-03 2017-12-12 Flir Systems, Inc. Infant monitoring systems and methods using thermal imaging
US9716843B2 (en) 2009-06-03 2017-07-25 Flir Systems, Inc. Measurement device for electrical installations and related methods
US8432467B2 (en) * 2009-07-24 2013-04-30 Raytheon Company Integrated detection and display imaging system and method
US8190012B2 (en) * 2009-09-10 2012-05-29 Raytheon Company Optical system with adjustable shims
US8902944B2 (en) * 2009-10-08 2014-12-02 Kaiam Corp. High power multi-wavelength laser source
CN102055886A (en) * 2009-11-10 2011-05-11 台湾东电化股份有限公司 Integrated module including image sensor, focusing drive device and drive circuit
US9706138B2 (en) 2010-04-23 2017-07-11 Flir Systems, Inc. Hybrid infrared sensor array having heterogeneous infrared sensors
US9948878B2 (en) 2010-04-23 2018-04-17 Flir Systems, Inc. Abnormal clock rate detection in imaging sensor arrays
TWI474068B (en) * 2010-05-05 2015-02-21 Hon Hai Prec Ind Co Ltd Displacement measuring device
US9058653B1 (en) 2011-06-10 2015-06-16 Flir Systems, Inc. Alignment of visible light sources based on thermal images
US9143703B2 (en) 2011-06-10 2015-09-22 Flir Systems, Inc. Infrared camera calibration techniques
US10389953B2 (en) 2011-06-10 2019-08-20 Flir Systems, Inc. Infrared imaging device having a shutter
US9235023B2 (en) 2011-06-10 2016-01-12 Flir Systems, Inc. Variable lens sleeve spacer
US10051210B2 (en) 2011-06-10 2018-08-14 Flir Systems, Inc. Infrared detector array with selectable pixel binning systems and methods
US9706137B2 (en) 2011-06-10 2017-07-11 Flir Systems, Inc. Electrical cabinet infrared monitor
US10841508B2 (en) 2011-06-10 2020-11-17 Flir Systems, Inc. Electrical cabinet infrared monitor systems and methods
US9961277B2 (en) 2011-06-10 2018-05-01 Flir Systems, Inc. Infrared focal plane array heat spreaders
US9509924B2 (en) * 2011-06-10 2016-11-29 Flir Systems, Inc. Wearable apparatus with integrated infrared imaging module
US10169666B2 (en) 2011-06-10 2019-01-01 Flir Systems, Inc. Image-assisted remote control vehicle systems and methods
US9900526B2 (en) 2011-06-10 2018-02-20 Flir Systems, Inc. Techniques to compensate for calibration drifts in infrared imaging devices
DE102011086325A1 (en) * 2011-11-15 2013-05-16 Karl Storz Gmbh & Co. Kg Illumination optics, observation device and method for generating an illumination light beam
CN103297665A (en) * 2012-02-22 2013-09-11 庄佑华 Image acquisition system
US10996542B2 (en) 2012-12-31 2021-05-04 Flir Systems, Inc. Infrared imaging system shutter assembly with integrated thermister
CN103389559B (en) * 2013-08-01 2015-12-02 山东神戎电子股份有限公司 Based on infrared lens and the compensation method of temperature change compensation
US9973692B2 (en) 2013-10-03 2018-05-15 Flir Systems, Inc. Situational awareness by compressed display of panoramic views
CN103595906B (en) * 2013-11-30 2016-06-08 中南林业科技大学 There is the integrated camera lens of two-part and the image acquisition system of single offset sensor fuselage
CN103607531A (en) * 2013-11-30 2014-02-26 中南林业科技大学 Integrated type camera lens
US11297264B2 (en) 2014-01-05 2022-04-05 Teledyne Fur, Llc Device attachment with dual band imaging sensor
KR102559545B1 (en) * 2015-08-06 2023-07-25 엘지이노텍 주식회사 A lens moving unit
KR102372087B1 (en) * 2015-10-28 2022-03-08 삼성전자주식회사 Method and apparatus for generating depth image
US9936123B2 (en) * 2016-08-04 2018-04-03 Omnivision Technologies, Inc. Camera and method with widescreen image on nearly-square aspect ratio photosensor array
US11194221B2 (en) * 2017-01-24 2021-12-07 Lg Innotek Co., Ltd. Liquid lens, liquid lens module including the lens, camera module including the same, and method for controlling the lens
KR102489148B1 (en) * 2018-01-31 2023-01-16 엘지이노텍 주식회사 Camera module
CN108646384B (en) * 2018-04-13 2020-09-01 维沃移动通信有限公司 Focusing method and device and mobile terminal
DE102019210508A1 (en) * 2019-07-16 2021-01-21 Conti Temic Microelectronic Gmbh Optical sensor module and method
CN111443557A (en) * 2020-05-13 2020-07-24 浙江宝妈创客品牌管理有限公司 Multimedia projection automatic correction device based on light sensation control
CN113885605B (en) * 2021-09-30 2022-10-04 深圳市火乐科技发展有限公司 Temperature control method, related device and storage medium
CN114326857B (en) * 2021-12-30 2022-11-29 中国商用飞机有限责任公司 Digital image processing error active temperature compensation device and method under low temperature condition
CN115657265B (en) * 2022-12-20 2023-06-09 宜昌华鑫智能光学有限公司 Zoom control method and system for lens

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4407567A (en) * 1978-05-05 1983-10-04 Quantel S.A. Objective having a variable focal length
US4816860A (en) * 1986-07-07 1989-03-28 Minolta Camera Kabushiki Kaisha Camera
US4972267A (en) * 1988-06-14 1990-11-20 Fuji Photo Film Co., Ltd. Still-video camera for eliminating dark current differences
US5282042A (en) * 1990-09-28 1994-01-25 Fuji Photo Film Co., Ltd. Strobe control method and apparatus for use in pseudo-frame photography
US5895129A (en) * 1997-01-23 1999-04-20 Canon Kabushiki Kaisha Optical apparatus
US6009340A (en) * 1998-03-16 1999-12-28 Northrop Grumman Corporation Multimode, multispectral imaging system
US6084229A (en) * 1998-03-16 2000-07-04 Photon Vision Systems, Llc Complimentary metal oxide semiconductor imaging device
US6169853B1 (en) * 1998-01-05 2001-01-02 Asahi Kogaku Kogyo Kabushiki Kaisha Zooming optical system
US20020003576A1 (en) * 2000-06-07 2002-01-10 Kazuo Konishi Video camera apparatus
US6407439B1 (en) * 1999-08-19 2002-06-18 Epitaxial Technologies, Llc Programmable multi-wavelength detector array
US6642955B1 (en) * 2000-01-10 2003-11-04 Extreme Cctv Inc. Surveillance camera system with infrared and visible light bandpass control circuit
US20030223010A1 (en) * 2002-06-04 2003-12-04 Michael Kaplinsky Method and apparatus for automatic gain and exposure control for maintaining target image brightness in video imager systems

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH04326264A (en) 1991-04-25 1992-11-16 Kyocera Corp Output system for video camera
JP3278206B2 (en) * 1992-08-31 2002-04-30 キヤノン株式会社 Imaging device and method thereof
US6630949B1 (en) * 1992-12-01 2003-10-07 Canon Kabushiki Kaisha Image processing system and information processing apparatus
JP2771085B2 (en) 1992-12-03 1998-07-02 キヤノン株式会社 Image processing system and information processing device
JPH09166493A (en) 1995-12-15 1997-06-24 Nikon Corp Image pick-up device and method therefor and light reception device
JPH10213743A (en) * 1997-01-28 1998-08-11 Fuitsuto:Kk Optical system for converting aspect ratio and image processor capable of converting aspect ratio
JPH10326906A (en) * 1997-05-26 1998-12-08 Hamamatsu Photonics Kk Photodetection element and image-pickup element
US6341902B1 (en) * 1997-12-05 2002-01-29 Asahi Kogaku Kogyo Kabushiki Kaisha Photographic lens recognition system for a camera body
JP2996642B2 (en) 1998-04-27 2000-01-11 行政院國家科學委員會 Active pixel image sensor
JPH11355624A (en) * 1998-06-05 1999-12-24 Fuji Photo Film Co Ltd Photographing device
JP2001230954A (en) * 2000-02-15 2001-08-24 Fuji Photo Film Co Ltd Image pickup device
JP2003107310A (en) * 2001-09-26 2003-04-09 Olympus Optical Co Ltd Zoom lens barrel
JP2003134364A (en) 2001-10-25 2003-05-09 Olympus Optical Co Ltd Camera
JP2003262907A (en) 2002-03-11 2003-09-19 Kyocera Corp Pop-up photographic lens system for digital camera or the like
JP2003315650A (en) * 2002-04-26 2003-11-06 Olympus Optical Co Ltd Optical device
US6710950B2 (en) * 2002-06-05 2004-03-23 Nokia Mobile Phones Limited Piezoelectric actuator for digital camera optical system
DE60308191T2 (en) 2002-07-22 2007-08-23 Panavision Inc., Woodland Hills ZOOM WITH ULTRA-HIGH MAGNIFICATION RATIO
JP3688677B2 (en) * 2002-11-19 2005-08-31 株式会社東芝 Camera mounting method and portable electronic device with camera
US6980828B2 (en) * 2002-12-03 2005-12-27 Nokia Corporation Multi-media mobile communication device and related construction method
US6762888B1 (en) * 2003-02-18 2004-07-13 Arc Design, Inc. Control system of zoom lens for digital still cameras
JP2005064887A (en) * 2003-08-13 2005-03-10 Sankyo Seiki Mfg Co Ltd Camera and portable machine therewith
US7329856B2 (en) * 2004-08-24 2008-02-12 Micron Technology, Inc. Image sensor having integrated infrared-filtering optical device and related method
JP5027661B2 (en) 2004-08-25 2012-09-19 パナビジョン イメージング リミテッド ライアビリティ カンパニー Lens control method and apparatus, and camera module incorporating the same

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4407567A (en) * 1978-05-05 1983-10-04 Quantel S.A. Objective having a variable focal length
US4816860A (en) * 1986-07-07 1989-03-28 Minolta Camera Kabushiki Kaisha Camera
US4972267A (en) * 1988-06-14 1990-11-20 Fuji Photo Film Co., Ltd. Still-video camera for eliminating dark current differences
US5282042A (en) * 1990-09-28 1994-01-25 Fuji Photo Film Co., Ltd. Strobe control method and apparatus for use in pseudo-frame photography
US5895129A (en) * 1997-01-23 1999-04-20 Canon Kabushiki Kaisha Optical apparatus
US6169853B1 (en) * 1998-01-05 2001-01-02 Asahi Kogaku Kogyo Kabushiki Kaisha Zooming optical system
US6009340A (en) * 1998-03-16 1999-12-28 Northrop Grumman Corporation Multimode, multispectral imaging system
US6084229A (en) * 1998-03-16 2000-07-04 Photon Vision Systems, Llc Complimentary metal oxide semiconductor imaging device
US6407439B1 (en) * 1999-08-19 2002-06-18 Epitaxial Technologies, Llc Programmable multi-wavelength detector array
US6642955B1 (en) * 2000-01-10 2003-11-04 Extreme Cctv Inc. Surveillance camera system with infrared and visible light bandpass control circuit
US20020003576A1 (en) * 2000-06-07 2002-01-10 Kazuo Konishi Video camera apparatus
US20030223010A1 (en) * 2002-06-04 2003-12-04 Michael Kaplinsky Method and apparatus for automatic gain and exposure control for maintaining target image brightness in video imager systems

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7616877B2 (en) 2004-08-25 2009-11-10 Panavision Imaging, Llc Method and apparatus for controlling a lens, and camera module incorporating same
GB2479931A (en) * 2010-04-30 2011-11-02 Sony Corp A Camera Device, Arrangement and System
US11575845B2 (en) 2020-10-26 2023-02-07 Samsung Electro-Mechanics Co., Ltd. Infrared image sensor and infrared camera module
US11927731B2 (en) 2020-12-28 2024-03-12 Samsung Electro-Mechanics Co., Ltd. Lens and optical imaging system

Also Published As

Publication number Publication date
EP1789843A2 (en) 2007-05-30
CN101103308B (en) 2011-05-18
KR20070083593A (en) 2007-08-24
WO2006026317A8 (en) 2007-04-19
US7616877B2 (en) 2009-11-10
CN101103308A (en) 2008-01-09
WO2006026317A3 (en) 2006-12-21
JP5027661B2 (en) 2012-09-19
JP2008511042A (en) 2008-04-10
KR100924179B1 (en) 2009-10-28
US20060045504A1 (en) 2006-03-02

Similar Documents

Publication Publication Date Title
US7616877B2 (en) Method and apparatus for controlling a lens, and camera module incorporating same
KR101278239B1 (en) Dual lens optical system and Dual lens camera comprising the same
US20120194728A1 (en) Image sensor module and camera module including the same
US7604421B2 (en) Imaging device module
US8861104B2 (en) Lens barrel and imaging device
CN111246070A (en) Camera module and electronic equipment
CN212115447U (en) Periscopic camera module and electronic equipment
KR20200041062A (en) Camera Actuator and Camera module including the same
US20100086291A1 (en) Camera module and driving method thereof
JP2007072067A (en) Lens barrel and imaging apparatus
CN210807351U (en) Mobile terminal
CN101122662B (en) Minitype actuator and automatic focusing lens module group
JP4910454B2 (en) Lens barrel and imaging device
JPWO2006035580A1 (en) Lens barrel, and imaging apparatus, camera, and portable device including the lens barrel
KR20100071537A (en) Camera device
US9148558B2 (en) Camera module having first and second imaging optical system controlled in relation to imaging modes and imaging method
JP2007133214A (en) Lens barrel and imaging apparatus
JP2006133366A (en) Lens barrel, camera equipped with lens barrel and method for assembling lens barrel
JP2007121494A (en) Lens barrel and imaging apparatus
JP2020188348A (en) Imaging device, image monitoring system, and control method of imaging device
JP2010210691A (en) Stereoscopic imaging apparatus
JP2005148197A (en) Imaging apparatus and portable terminal equipped with the same
CN211791692U (en) Camera module and electronic equipment
JP4474791B2 (en) Electronic camera
JP2005121950A (en) Imaging apparatus and portable terminal equipped with same

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2007530099

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2005792724

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 1020077006885

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 200580033219.0

Country of ref document: CN

WWP Wipo information: published in national office

Ref document number: 2005792724

Country of ref document: EP