US20120026366A1 - Continuous electronic zoom for an imaging system with multiple imaging devices having different fixed fov - Google Patents

Continuous electronic zoom for an imaging system with multiple imaging devices having different fixed fov Download PDF

Info

Publication number
US20120026366A1
US20120026366A1 US13/262,842 US201013262842A US2012026366A1 US 20120026366 A1 US20120026366 A1 US 20120026366A1 US 201013262842 A US201013262842 A US 201013262842A US 2012026366 A1 US2012026366 A1 US 2012026366A1
Authority
US
United States
Prior art keywords
image sensor
image
sensor array
zoom
fov
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/262,842
Inventor
Chen Golan
Boris Kipnis
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEXTVISION STABILIZED SYSTEMS Ltd
Original Assignee
NEXTVISION STABILIZED SYSTEMS Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEXTVISION STABILIZED SYSTEMS Ltd filed Critical NEXTVISION STABILIZED SYSTEMS Ltd
Priority to US13/262,842 priority Critical patent/US20120026366A1/en
Publication of US20120026366A1 publication Critical patent/US20120026366A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/681—Motion detection
    • H04N23/6812—Motion detection based on additional sensors, e.g. acceleration sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682—Vibration or motion blur correction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682—Vibration or motion blur correction
    • H04N23/683—Vibration or motion blur correction performed by a processor, e.g. controlling the readout of an image memory
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682—Vibration or motion blur correction
    • H04N23/685—Vibration or motion blur correction performed by mechanical compensation
    • H04N23/687—Vibration or motion blur correction performed by mechanical compensation by shifting the lens or sensor position
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10T—TECHNICAL SUBJECTS COVERED BY FORMER US CLASSIFICATION
    • Y10T29/00—Metal working
    • Y10T29/49—Method of mechanical manufacture
    • Y10T29/49826—Assembling or joining

Definitions

  • the present invention relates to an electronic zoom for imaging systems, and more particularly, the present invention relates to a continuous electronic zoom for an image acquisition system, the system including multiple imaging devices having different fixed FOV.
  • Digital zoom is a method of narrowing the apparent angle of view of a digital still or video image.
  • Electronic zoom is accomplished by cropping an image down to a centered area of the image with the same aspect ratio as the original, and usually also interpolating the result back up to the pixel dimensions of the original. It is accomplished electronically, without any adjustment of the camera's optics, and no optical resolution is gained in the process. Typically some information is lost in the process.
  • the image resolution is known, and by using image sensors having substantially higher resolution, one can perform lossless electronic zoom.
  • the ratio between the image sensor resolution and the output resolution dictates the lossless electronic zoom range. For example, having a 5 Megapixel, 2592 ⁇ 1944, image sensor array and an output resolution frame of 400 ⁇ 300 yields maximal lossless electronic zoom of 6.48:
  • a camera with a large dynamic zoom range requires heavy and expensive lenses, as well as complex design.
  • Electronic zoom does not need moving mechanical elements, as does optical zoom.
  • the present invention describes a continuous electronic zoom for an image acquisition system, having multiple imaging devices each with a different fixed field of view (FOV).
  • FOV field of view
  • Using two (or more) image sensors, having different fixed FOV facilitates a light weight electronic zoom with a large lossless zooming range.
  • This lossless electronic zoom is also referred to herein, as the optimal zoom:
  • Optimal_Zoom (Wide_FOV/Narrow_FOV) 2 .
  • a method for continuous electronic zoom in a computerized image acquisition system the system having multiple optical image acquisition devices each with a FOV.
  • the method includes providing a first image acquisition device having a first image sensor array coupled with a first lens having a first FOV, typically a wide FOV , and a first electronic zoom.
  • the method further includes providing a second image acquisition device having a second image sensor array coupled with a second lens having a second FOV, typically a narrow FOV, and a second electronic zoom.
  • the angle of view of the first FOV is wider than the angle of view of the second FOV.
  • the method further includes computing the alignment between the first image sensor array and the second image sensor array, whereby determining an X-coordinate offset, a Y-coordinate offset and optionally, a Z-rotation offset of the correlation between the first image sensor array and the second image sensor array.
  • the method further includes the steps of providing a user of the image acquisition device with a zoom selecting control, thereby obtaining a requested zoom, selecting one of the image acquisition devices based on the requested zoom, acquiring an image frame with the selected image acquisition device, thereby obtaining an acquired image frame, and performing digitally zoom on the acquired image frame, thereby obtaining an acquired image frame with the requested zoom.
  • the calibration of the alignment, between the first image sensor array and the second image sensor array facilitates continuous electronic zoom with uninterrupted imaging, when switching back and forth between the first image sensor array and the second image sensor array.
  • the electronic calibration is performed with sub-pixel accuracy.
  • the computerized image acquisition system is configured to provide zooming functions selected from the group consisting of a bin function and a skip function.
  • the selecting of the image acquisition device includes selecting the parameters of the bin and/or skip functions, wherein the method further includes the step of applying the selected bin/skip functions to the acquired image frame, before the performing of the digital zoom step.
  • the image sensor arrays are focused to the infinite.
  • the first lens is a focus adjustable lens.
  • the second lens is a focus adjustable lens.
  • the second lens is a zoom lens.
  • the electronic calibration step is performed on each pair of adjacently disposed image sensor arrays.
  • the first image acquisition device and the second image acquisition device are coupled with a mutual front lens and a beam splitter, wherein one portion of the light reaching the beam splitter is directed towards the first image sensor array and the remainder portion of the light reaching the beam splitter is directed towards the second image sensor array.
  • the first image sensor array is a color sensor and the second image sensor array is a monochrome sensor, wherein a colored image frame is acquired by the first image sensor array, a monochrome image frame is acquired by the second image sensor array, wherein the colored image frame and the monochrome image frame are fused to form a high resolution colored image frame.
  • the angle of view of the first FOV is wider than the angle of view of the second FOV.
  • the angle of view of the first FOV is substantially equal to the angle of view of the second FOV.
  • the fusion of the colored image frame and the monochrome image frame includes the step of computing color values for the high resolution pixels of the monochrome image frame from the respective low resolution pixels of the colored image frame.
  • the computing of color values is performed in sub pixel accuracy.
  • FIG. 1 is a block diagram illustration of another zoom control sub-system for an image acquisition system, according to variations of the present invention
  • FIG. 2 is a schematic flow diagram chart that outlines the successive steps of the continuous zoom process, according to embodiments of the present invention
  • FIG. 3 is a block diagram illustration of a zoom control sub-system for an image acquisition system, according to variations of the present invention
  • FIG. 4 is a schematic flow diagram chart that outlines the successive steps of the continuous zoom process, according to variations of the present invention, include using bin/skip functions;
  • FIGS. 5 a and 5 b illustrate examples of beam splitter configurations for image acquisition systems, according to embodiments of the present invention
  • FIG. 6 is a block diagram illustration of a camera system, according to embodiments of the present invention, including a color image sensor having wide FOV and a color image sensor having narrow FOV; and
  • FIG. 7 is a block diagram illustration of another zoom control sub-system for a color image acquisition system, according to variations of the present invention.
  • the present invention is described, with no limitations, in terms of an image acquisition system having two image acquisition devices. But the present invention is not limited to two image acquisition devices, and in variations of the present invention, the image acquisition system can be similarly embodied with three image acquisition devices and more.
  • FIG. 1 is a block diagram illustration of a zoom control sub-system 100 for an image acquisition system, according to preferred embodiments of the present invention.
  • Zoom control sub-system 100 includes multiple image sensors, each with a fixed and preferably different FOV, configured to provide continuous electronic zoom capabilities with uninterrupted, when switching back and forth between the image sensors.
  • Zoom control sub-system 100 includes a tele image sensor 110 coupled with a narrow lens 120 having a predesigned FOV 140 , a wide image sensor 112 coupled with a wide lens 122 having a predesigned FOV 142 , a zoom control module 130 and an image sensor selector 150 .
  • An object 20 is viewed from both tele image sensor 110 and wide image sensor 112 , whereas the object is magnified in tele image sensor 110 with respect to wide image sensor 112 , by a predesigned factor.
  • the FOV of wide image sensor 112 can be calculated by multiplying the FOV of tele image sensor 110 by the optimal zoom of image sensors 110 and 112 .
  • Tele image sensor 110 and wide image sensor 112 are adjacently disposed, such that at least a portion of the environment viewed from within the narrow FOV of tele image acquisition device 110 overlaps the environment viewed from within the wide FOV of wide image acquisition device 112 .
  • an electronically calibrating is performed to determine the alignment offsets between wide image sensor array 110 and tele image sensor array 112 .
  • the electronic calibration step is performed one time, after the manufacturing of the image acquisition system and before the first use.
  • the electronic calibration yields an X-coordinate offset, a Y-coordinate offset and optionally, a Z-coordinate rotational offset of the correlation between wide image sensor array 110 and tele image sensor array 112 .
  • all three aforementioned offset values are computed in sub-pixel accuracy. It should be noted that for image acquisition systems with more than two image sensors, the electronic calibration step is performed on each pair of adjacently disposed image sensor arrays.
  • Zoom control circuit 130 receives a required zoom from an operator of the image acquisition system, and selects the relevant image sensor ( 110 and 112 ) by activating image sensor selector 150 position.
  • the relevant camera zoom factor is calculated by zoom control unit 130 .
  • An aspect of the present invention is to provide methods facilitating continuous electronic zoom capabilities with uninterrupted imaging, performed by an image acquisition system having multiple image sensors, each with a fixed and preferably different FOV.
  • the continuous electronic zoom with uninterrupted imaging is also maintained when switching back and forth between adjacently disposed image sensors.
  • FIG. 2 is a schematic flow diagram chart that outlines the successive steps of an example continuous zoom process 200 , according to embodiments of the present invention, performed on image acquisition system, having a zoom control sub-system such as zoom control sub-system 100 .
  • Process 200 includes the flowing steps:
  • Step 210 providing a wide image acquisition device and a tele image acquisition device.
  • FIGS. 5 a and 5 b illustrates examples of beam splitter configurations for image acquisition systems, according to embodiments of the present invention.
  • wide image acquisition device 112 and tele image acquisition device 110 are coupled with a mutual front lens 570 and a beam splitter 580 , wherein one portion of the light reaching beam splitter 580 is directed towards wide image sensor array 112 and the remainder portion of the light reaching beam splitter 580 is directed towards tele image sensor array 110 .
  • the beam splitter configuration includes a wide angle lens 572 , to provide image sensor 510 a wider FOV with respect to image sensor 512 .
  • the beam splitter configuration includes wide angle lens 572 , to provide image sensor 510 a wide FOV, and a narrow angle lens 574 , to provide image sensor 512 a narrow FOV, relative to the FOV of image sensor 512 .
  • FIG. 3 is a block diagram illustration of zoom control sub-system 300 for an image acquisition system, according to some embodiments of the present invention.
  • Zoom control sub-system 300 includes an image sensor 310 having a lens module 320 with a fixed focal length lens or a zoom lens, a zoom control module 330 and a digital-zoom module 340 .
  • An object 20 is captured by image sensor 310 through lens module 320 .
  • Zoom control unit 330 calculates the most optimal values for image sensor 310 , binning/skip factors and continuous digital-zoom values that are provided to digital-zoom unit 340 . Setting the binning/skip factor and windowing of image sensor 310 allows to keep a suitable frame refresh rate, while digital-zoom unit 340 provides continuous zoom.
  • a binning function which function is optionally provided by the sensor array provider, is a zoom out function that merges 2 ⁇ 2, or 4 ⁇ 4, or 8 ⁇ 8 pixels pixel array, or any other square array of pixels, into a single pixel, whereby reducing the image frame dimensions.
  • the binning function may be refined by using algorithms such as “bi-linear” interpolation, “bi-cubic” interpolation and other commonly used digital zoom algorithms.
  • a skip function, which function is optionally provided by the sensor array provider, is a zoom out function that allows skipping pixels while reading frame out, whereby reducing the image frame dimensions and decrease the image acquisition time.
  • zoom control sub-system 100 of a image acquisition system includes the binning/skip function capabilities as in zoom control sub-system 300 .
  • FIG. 4 is a schematic flow diagram chart that outlines the successive steps of an example continuous zoom process 400 , according to embodiments of the present invention, performed on image acquisition system, having a zoom control sub-system such as zoom control sub-system 100 .
  • Process 400 includes the flowing steps:
  • Step 410 providing a wide image acquisition device and a tele image acquisition device.
  • FIG. 6 is a block diagram illustration of a camera system 600 , according to embodiments of the present invention, including a color image sensor 612 having wide FOV 642 and a monochrome image sensor 610 having narrow FOV 640 .
  • the angle of view of wide FOV 142 is typically wider than the angle of view of narrow FOV 140 .
  • the angle of view of wide FOV 142 is substantially equal to the angle of view of narrow FOV 140 .
  • a principal intention of the present invention includes providing a camera system 600 and a method of use thereof, wherein the output image frame 650 has the resolution of image sensor 610 , having narrow FOV 640 , and the color of image sensor 612 , having wide FOV 642 .
  • FIG. 7 is a block diagram illustration of another zoom control sub-system 700 for a color image acquisition system, according to variations of the present invention.
  • a colored image frame 632 is acquired by wide image sensor array 612
  • a monochrome image frame 630 is acquired by narrow image sensor array 610 .
  • image sensor selector 750 closes contact 752
  • monochrome image sensor 610 is bypassed and only color image sensor 612 having is in operation.
  • Fusion module 660 extracts the color information from color image frame 632 and fuses the extracted color information with monochrome image frame 630 to form a high resolution, colored image frame 650 .
  • the fusion includes computing color values for the high resolution pixels of monochrome image frame 630 from the respective low resolution color image frame 632 .
  • the computation and alignment of the color values is performed in sub pixel accuracy.
  • the output colored image frame 650 is provided with RGB information.
  • fusion module 760 transmits the Y information, obtained from monochrome image sensor 610 covered with color (Cr, Cb) information obtained from color image sensor 612 . The color information obtained from color image sensor 612 via a color space. Then, fusion module 760 merges the Y information, obtained from monochrome image sensor 610 , and the color (Cr, Cb) information. Then, color space conversion module 770 converts the image back to an RGB color space, creating colored output image frame 650 .
  • the (Y, Cr, Cb) image information is transmitted in separate channels to an image receiving unit, bypassing color space conversion module 770 .

Abstract

A method for continuous electronic zoom in a computerized image acquisition system, the system having a wide image acquisition device and a tele image acquisition device having a tele image sensor array coupled with a tele lens having a narrow FOV, and a tele electronic zoom. The method includes providing a user of the image acquisition device with a zoom selecting control, thereby obtaining a requested zoom, selecting one of the image acquisition devices based on the requested zoom and acquiring an image frame, thereby obtaining an acquired image frame, and performing digitally zoom on the acquired image frame, thereby obtaining an acquired image frame with the requested zoom. The alignment between the wide image sensor array and the tele image sensor array is computed, to facilitate continuous electronic zoom with uninterrupted imaging, when switching back and forth between the wide image sensor array and the tele image sensor array.

Description

    RELATED APPLICATION
  • The present application claims the benefit of U.S. provisional application 61/167,226 filed on Apr. 7, 2009, the disclosure of which is incorporated herein by reference.
    • FIELD OF THE INVENTION
  • The present invention relates to an electronic zoom for imaging systems, and more particularly, the present invention relates to a continuous electronic zoom for an image acquisition system, the system including multiple imaging devices having different fixed FOV.
    • BACKGROUND OF THE INVENTION AND PRIOR ART
  • Digital zoom is a method of narrowing the apparent angle of view of a digital still or video image. Electronic zoom is accomplished by cropping an image down to a centered area of the image with the same aspect ratio as the original, and usually also interpolating the result back up to the pixel dimensions of the original. It is accomplished electronically, without any adjustment of the camera's optics, and no optical resolution is gained in the process. Typically some information is lost in the process.
  • In video streams (such as PAL, NTSC, SECAM, 656, etc.) the image resolution is known, and by using image sensors having substantially higher resolution, one can perform lossless electronic zoom. The ratio between the image sensor resolution and the output resolution dictates the lossless electronic zoom range. For example, having a 5 Megapixel, 2592×1944, image sensor array and an output resolution frame of 400×300 yields maximal lossless electronic zoom of 6.48:
      • 2592/400=6.48,
      • 1944/300=6.48.
  • Typically, a camera with a large dynamic zoom range requires heavy and expensive lenses, as well as complex design. Electronic zoom does not need moving mechanical elements, as does optical zoom.
  • There is a need for and it would be advantageous to have image sensors, having static, light weight electronic zoom and a large lossless zooming range.
    • SUMMARY OF THE INVENTION
  • The present invention describes a continuous electronic zoom for an image acquisition system, having multiple imaging devices each with a different fixed field of view (FOV). Using two (or more) image sensors, having different fixed FOV, facilitates a light weight electronic zoom with a large lossless zooming range. For example, a first image sensor has a 60° angle of view and a second image sensor has a 60° angle of view. Therefore, Wide_FOV=Narrow_FOV*6. Hence, switching between the image sensors provide a lossless electronic zoom of 62=36. This lossless electronic zoom is also referred to herein, as the optimal zoom:

  • Optimal_Zoom=(Wide_FOV/Narrow_FOV)2.
  • It should be noted that to obtain similar zoom (×36) by optical means, for an output resolution frame of 400×300, the needed image sensor array is:
  • 36*400=14400,
  • 36*300=10800.
  • 14400*10800=155,520,000.
  • Hence, to obtain a zoom of ×36 by optical means, for an output resolution frame of 400×300, one needs a 155 Megapixel, 14400×10800, image sensor array.
  • According to teachings of the present invention, there is provided a method for continuous electronic zoom in a computerized image acquisition system, the system having multiple optical image acquisition devices each with a FOV. The method includes providing a first image acquisition device having a first image sensor array coupled with a first lens having a first FOV, typically a wide FOV , and a first electronic zoom. The method further includes providing a second image acquisition device having a second image sensor array coupled with a second lens having a second FOV, typically a narrow FOV, and a second electronic zoom. Typically, the angle of view of the first FOV is wider than the angle of view of the second FOV. At least a portion of the environment, viewed from within the second FOV of the second image acquisition device, overlaps the environment viewed from within the first FOV of the first image acquisition device. The method further includes computing the alignment between the first image sensor array and the second image sensor array, whereby determining an X-coordinate offset, a Y-coordinate offset and optionally, a Z-rotation offset of the correlation between the first image sensor array and the second image sensor array.
  • The method further includes the steps of providing a user of the image acquisition device with a zoom selecting control, thereby obtaining a requested zoom, selecting one of the image acquisition devices based on the requested zoom, acquiring an image frame with the selected image acquisition device, thereby obtaining an acquired image frame, and performing digitally zoom on the acquired image frame, thereby obtaining an acquired image frame with the requested zoom. The calibration of the alignment, between the first image sensor array and the second image sensor array, facilitates continuous electronic zoom with uninterrupted imaging, when switching back and forth between the first image sensor array and the second image sensor array. Preferably the electronic calibration is performed with sub-pixel accuracy.
  • Optionally, the computerized image acquisition system is configured to provide zooming functions selected from the group consisting of a bin function and a skip function. The selecting of the image acquisition device includes selecting the parameters of the bin and/or skip functions, wherein the method further includes the step of applying the selected bin/skip functions to the acquired image frame, before the performing of the digital zoom step.
  • In variations of the present invention, the image sensor arrays are focused to the infinite.
  • Optionally, the first lens is a focus adjustable lens.
  • Optionally, the second lens is a focus adjustable lens.
  • Optionally, the second lens is a zoom lens.
  • In image acquisition systems having more than two imaging devices, the electronic calibration step is performed on each pair of adjacently disposed image sensor arrays.
  • In variations of the present invention, the first image acquisition device and the second image acquisition device are coupled with a mutual front lens and a beam splitter, wherein one portion of the light reaching the beam splitter is directed towards the first image sensor array and the remainder portion of the light reaching the beam splitter is directed towards the second image sensor array.
  • In embodiments of the present invention, the first image sensor array is a color sensor and the second image sensor array is a monochrome sensor, wherein a colored image frame is acquired by the first image sensor array, a monochrome image frame is acquired by the second image sensor array, wherein the colored image frame and the monochrome image frame are fused to form a high resolution colored image frame. In preferred embodiments of the present invention, the angle of view of the first FOV is wider than the angle of view of the second FOV. However, in variation of the present invention, the angle of view of the first FOV is substantially equal to the angle of view of the second FOV.
  • Optionally, the fusion of the colored image frame and the monochrome image frame includes the step of computing color values for the high resolution pixels of the monochrome image frame from the respective low resolution pixels of the colored image frame. Optionally, the computing of color values is performed in sub pixel accuracy.
    • BRIEF DESCRIPTION OF THE DRAWINGS
  • The present invention will become fully understood from the detailed description given herein below and the accompanying drawings, which are given by way of illustration and example only and thus not limitative of the present invention, and wherein:
  • FIG. 1 is a block diagram illustration of another zoom control sub-system for an image acquisition system, according to variations of the present invention;
  • FIG. 2 is a schematic flow diagram chart that outlines the successive steps of the continuous zoom process, according to embodiments of the present invention;
  • FIG. 3 is a block diagram illustration of a zoom control sub-system for an image acquisition system, according to variations of the present invention;
  • FIG. 4 is a schematic flow diagram chart that outlines the successive steps of the continuous zoom process, according to variations of the present invention, include using bin/skip functions;
  • FIGS. 5 a and 5 b illustrate examples of beam splitter configurations for image acquisition systems, according to embodiments of the present invention;
  • FIG. 6 is a block diagram illustration of a camera system, according to embodiments of the present invention, including a color image sensor having wide FOV and a color image sensor having narrow FOV; and
  • FIG. 7 is a block diagram illustration of another zoom control sub-system for a color image acquisition system, according to variations of the present invention.
    •  DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • Before explaining embodiments of the invention in detail, it is to be understood that the invention is not limited in its application to the details of construction and the arrangement of the components set forth in the host description or illustrated in the drawings.
  • Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art of the invention belongs. The methods and examples provided herein are illustrative only and not intended to be limiting.
  • It should be noted that in general, the present invention is described, with no limitations, in terms of an image acquisition system having two image acquisition devices. But the present invention is not limited to two image acquisition devices, and in variations of the present invention, the image acquisition system can be similarly embodied with three image acquisition devices and more.
  • Reference is made to FIG. 1, which is a block diagram illustration of a zoom control sub-system 100 for an image acquisition system, according to preferred embodiments of the present invention. Zoom control sub-system 100 includes multiple image sensors, each with a fixed and preferably different FOV, configured to provide continuous electronic zoom capabilities with uninterrupted, when switching back and forth between the image sensors.
  • Zoom control sub-system 100 includes a tele image sensor 110 coupled with a narrow lens 120 having a predesigned FOV 140, a wide image sensor 112 coupled with a wide lens 122 having a predesigned FOV 142, a zoom control module 130 and an image sensor selector 150. An object 20 is viewed from both tele image sensor 110 and wide image sensor 112, whereas the object is magnified in tele image sensor 110 with respect to wide image sensor 112, by a predesigned factor. In the optimal configuration, the FOV of wide image sensor 112 can be calculated by multiplying the FOV of tele image sensor 110 by the optimal zoom of image sensors 110 and 112. Tele image sensor 110 and wide image sensor 112 are adjacently disposed, such that at least a portion of the environment viewed from within the narrow FOV of tele image acquisition device 110 overlaps the environment viewed from within the wide FOV of wide image acquisition device 112.
  • Before using zoom control sub-system 100, an electronically calibrating is performed to determine the alignment offsets between wide image sensor array 110 and tele image sensor array 112. Typically, since the spatial offsets between wide image sensor array 110 and tele image sensor array 112 are fixed, the electronic calibration step is performed one time, after the manufacturing of the image acquisition system and before the first use. The electronic calibration yields an X-coordinate offset, a Y-coordinate offset and optionally, a Z-coordinate rotational offset of the correlation between wide image sensor array 110 and tele image sensor array 112. Preferably, all three aforementioned offset values are computed in sub-pixel accuracy. It should be noted that for image acquisition systems with more than two image sensors, the electronic calibration step is performed on each pair of adjacently disposed image sensor arrays.
  • Zoom control circuit 130 receives a required zoom from an operator of the image acquisition system, and selects the relevant image sensor (110 and 112) by activating image sensor selector 150 position. The relevant camera zoom factor is calculated by zoom control unit 130.
  • An aspect of the present invention is to provide methods facilitating continuous electronic zoom capabilities with uninterrupted imaging, performed by an image acquisition system having multiple image sensors, each with a fixed and preferably different FOV. The continuous electronic zoom with uninterrupted imaging is also maintained when switching back and forth between adjacently disposed image sensors.
  • Reference is also made to FIG. 2, which is a schematic flow diagram chart that outlines the successive steps of an example continuous zoom process 200, according to embodiments of the present invention, performed on image acquisition system, having a zoom control sub-system such as zoom control sub-system 100. Process 200 includes the flowing steps:
  • Step 210: providing a wide image acquisition device and a tele image acquisition device.
      • Multiple optical image acquisition devices can be used, but for description clarity, with no limitation, the method will be described in terms of two image acquisition devices: wide image acquisition device and a tele image acquisition device.
      • Both image acquisition devices (110 and 112) include an image sensor array coupled with a lens (120 and 122, respectively), providing a fixed FOV (tele FOV 140 and wide FOV 142, respectively). Preferably, wide FOV 142 is substantially wider than narrow FOV 140.
      • The image acquisition devices are adjacently disposed, such that at least a portion of the environment, viewed from within narrow FOV 140 of the tele image acquisition device 110, overlaps the environment viewed from within the wide FOV 142 of wide image acquisition device 112.
        Step 220: determining alignment offsets.
      • Before using zoom control sub-system 100, an electronically calibrating is performed to determine the alignment offsets between wide image sensor array 110 and tele image sensor array 112. Typically, since the spatial offsets between wide image sensor array 110 and tele image sensor array 112 are fixed, the electronic calibration step is performed one time, after the manufacturing of the image acquisition system and before the first use. The electronic calibration yields an X-coordinate offset and a Y-coordinate offset of the correlation between wide image sensor array 110 and tele image sensor array 112. Preferably, the X-coordinate offset and the Y-coordinate offset are computed in sub-pixel accuracy. It should be noted that for image acquisition systems with more than two image sensors, the electronic calibration step is performed on each pair of adjacently disposed image sensor arrays.
        Step 230: zoom selection.
      • A user of the image acquisition selects the required zoom.
        Step 240: selecting an image acquisition device.
      • The zoom control 130 selects an image acquisition device with the having a zoom more proximal to the requested zoom.
        Step 250: acquiring an image frame.
      • An image frame is acquired by the selected image acquisition device.
        Step 260: resampling the acquired image frame to the requested zoom.
      • The zoom control 130 computes the zoom factor between the fixed zoom of the selected image acquisition device and the requested zoom. Based on the computed factor, zoom control 130 performs electronic zoom on the acquired image frame to meet the requested zoom.
  • Reference is made back to FIG. 1 and referring also to FIGS. 5 a and 5 b, which illustrates examples of beam splitter configurations for image acquisition systems, according to embodiments of the present invention. In variations of the present invention, wide image acquisition device 112 and tele image acquisition device 110 are coupled with a mutual front lens 570 and a beam splitter 580, wherein one portion of the light reaching beam splitter 580 is directed towards wide image sensor array 112 and the remainder portion of the light reaching beam splitter 580 is directed towards tele image sensor array 110. In FIG. 5 a, the beam splitter configuration includes a wide angle lens 572, to provide image sensor 510 a wider FOV with respect to image sensor 512. In FIG. 5 b, the beam splitter configuration includes wide angle lens 572, to provide image sensor 510 a wide FOV, and a narrow angle lens 574, to provide image sensor 512 a narrow FOV, relative to the FOV of image sensor 512.
  • Reference is now made to FIG. 3, which is a block diagram illustration of zoom control sub-system 300 for an image acquisition system, according to some embodiments of the present invention. Zoom control sub-system 300 includes an image sensor 310 having a lens module 320 with a fixed focal length lens or a zoom lens, a zoom control module 330 and a digital-zoom module 340. An object 20 is captured by image sensor 310 through lens module 320. Zoom control unit 330 calculates the most optimal values for image sensor 310, binning/skip factors and continuous digital-zoom values that are provided to digital-zoom unit 340. Setting the binning/skip factor and windowing of image sensor 310 allows to keep a suitable frame refresh rate, while digital-zoom unit 340 provides continuous zoom.
  • A binning function, which function is optionally provided by the sensor array provider, is a zoom out function that merges 2×2, or 4×4, or 8×8 pixels pixel array, or any other square array of pixels, into a single pixel, whereby reducing the image frame dimensions. The binning function may be refined by using algorithms such as “bi-linear” interpolation, “bi-cubic” interpolation and other commonly used digital zoom algorithms. A skip function, which function is optionally provided by the sensor array provider, is a zoom out function that allows skipping pixels while reading frame out, whereby reducing the image frame dimensions and decrease the image acquisition time.
  • In variations of the present invention, zoom control sub-system 100 of a image acquisition system includes the binning/skip function capabilities as in zoom control sub-system 300.
  • Reference is also made to FIG. 4, which is a schematic flow diagram chart that outlines the successive steps of an example continuous zoom process 400, according to embodiments of the present invention, performed on image acquisition system, having a zoom control sub-system such as zoom control sub-system 100. Process 400 includes the flowing steps:
  • Step 410: providing a wide image acquisition device and a tele image acquisition device.
      • Multiple optical image acquisition devices can be used, but for description clarity, with no limitation, the method will be described in terms of two image acquisition devices: wide image acquisition device and a tele image acquisition device.
      • Both image acquisition devices (110 and 112) include an image sensor array coupled with a lens (120 and 122, respectively), providing a fixed FOV (tele FOV 140 and wide FOV 142, respectively). Preferably, wide FOV 142 is substantially wider than narrow FOV 140.
      • The image acquisition devices are adjacently disposed, such that at least a portion of the environment, viewed from within narrow FOV 140 of the tele image acquisition device 110, overlaps the environment viewed from within the wide FOV 142 of wide image acquisition device 112.
        Step 420: determining alignment offsets.
      • Before using zoom control sub-system 100, an electronically calibrating is performed to determine the alignment offsets between wide image sensor array 110 and tele image sensor array 112. Typically, since the spatial offsets between wide image sensor array 110 and tele image sensor array 112 are fixed, the electronic calibration step is performed one time, after the manufacturing of the image acquisition system and before the first use. The electronic calibration yields an X-coordinate offset, a Y-coordinate offset and optionally, a Z-coordinate rotational offset of the correlation between wide image sensor array 110 and tele image sensor array 112. Preferably, all three aforementioned coordinate offset values are computed in sub-pixel accuracy. It should be noted that for image acquisition systems with more than two image sensors, the electronic calibration step is performed on each pair of adjacently disposed image sensor arrays.
        Step 430: zoom selection.
      • A user of the image acquisition selects the required zoom.
        Step 435: bin/skip function selection.
      • The zoom control 130 selects the bin/skip function, typically provided by the image sensor provider, bringing the combination of the optical zoom and the binning/skip magnification selection, to a zoom value most proximal to the requested zoom.
        Step 440: selecting an image acquisition device.
      • The zoom control 130 selects an image acquisition device, bringing the combination of the optical zoom and the binning/skip magnification selection, to a zoom value most proximal to the requested zoom.
        Step 450: acquiring an image frame.
      • An image frame is acquired by the selected image acquisition device.
        Step 460: performing electronic zoom on the acquired image frame to meet the requested zoom.
      • The zoom control 130 computes the zoom factor between the fixed zoom of the selected image acquisition device, combined with the selected by bin/skip factor, and the requested zoom. Based on the computed factor, zoom control 130 performs electronic zoom on the acquired image frame to meet the requested zoom.
  • Reference is now made to FIG. 6, which is a block diagram illustration of a camera system 600, according to embodiments of the present invention, including a color image sensor 612 having wide FOV 642 and a monochrome image sensor 610 having narrow FOV 640. The angle of view of wide FOV 142 is typically wider than the angle of view of narrow FOV 140. In some variations of the present invention, the angle of view of wide FOV 142 is substantially equal to the angle of view of narrow FOV 140.
  • A principal intention of the present invention includes providing a camera system 600 and a method of use thereof, wherein the output image frame 650 has the resolution of image sensor 610, having narrow FOV 640, and the color of image sensor 612, having wide FOV 642.
  • Reference is now made to FIG. 7, which is a block diagram illustration of another zoom control sub-system 700 for a color image acquisition system, according to variations of the present invention. A colored image frame 632 is acquired by wide image sensor array 612, and a monochrome image frame 630 is acquired by narrow image sensor array 610. When image sensor selector 750 closes contact 752, monochrome image sensor 610 is bypassed and only color image sensor 612 having is in operation.
  • When image sensor selector 750 closes contact 754, both monochrome image sensor 610 and color image sensor 612 are in operation, whereas image frames are acquired by monochrome image sensor 610 and color of image sensor 612, synchronously. Fusion module 660 extracts the color information from color image frame 632 and fuses the extracted color information with monochrome image frame 630 to form a high resolution, colored image frame 650. The fusion includes computing color values for the high resolution pixels of monochrome image frame 630 from the respective low resolution color image frame 632. Preferably, the computation and alignment of the color values is performed in sub pixel accuracy.
  • In some variations of the present invention, the output colored image frame 650 is provided with RGB information. In other variations of the present invention, fusion module 760 transmits the Y information, obtained from monochrome image sensor 610 covered with color (Cr, Cb) information obtained from color image sensor 612. The color information obtained from color image sensor 612 via a color space. Then, fusion module 760 merges the Y information, obtained from monochrome image sensor 610, and the color (Cr, Cb) information. Then, color space conversion module 770 converts the image back to an RGB color space, creating colored output image frame 650. Optionally, the (Y, Cr, Cb) image information is transmitted in separate channels to an image receiving unit, bypassing color space conversion module 770.
  • The invention being thus described in terms of embodiments and examples, it will be obvious that the same may be varied in many ways. Such variations are not to be regarded as a departure from the spirit and scope of the invention, and all such modifications as would be obvious to one skilled in the art are intended to be included within the scope of the claims.

Claims (19)

1. In a computerized image acquisition system, having multiple optical image acquisition devices each with a fixed field of view (FOV), a method for continuous electronic zoom comprising the steps of:
a) providing a first image acquisition device including:
i) a first image sensor array coupled with a first lens having a first FOV; and
ii) a first electronic zoom;
b) providing a second image acquisition device including:
i) a second image sensor array coupled with a second lens having a second FOV; and
ii) a second electronic zoom;
wherein at least a portion of the environment, viewed from within said second FOV of said second image acquisition device, overlaps the environment viewed from within said first FOV of said first image acquisition device;
c) electronically calibrating the alignment between said first image sensor array and said second image sensor array, whereby determining an X-coordinate offset and a Y-coordinate offset of the correlation between said first image sensor array and said second image sensor array;
d) providing a user of the image acquisition device with a zoom selecting control, thereby obtaining a requested zoom;
e) selecting one of said image acquisition devices based on said requested zoom;
f) acquiring an image frame with said selected image acquisition device, thereby obtaining an acquired image frame; and
g) performing digitally zoom on said acquired image frame, thereby obtaining an acquired image frame with said requested zoom,
wherein said calibrating of said alignment between said first image sensor array and said second image sensor array, facilitates continuous electronic zoom with uninterrupted imaging, when switching back and forth between said first image sensor array and said second image sensor array.
2. The method as in claim 1, wherein the computerized image acquisition system is configured to provide zooming functions selected from the group consisting of a bin function and a skip function; wherein said selecting of said image acquisition device includes selecting the parameters of said bin and/or skip functions; and wherein said method further includes the step of applying said selected bin/skip functions, with said selected parameters, to said acquired image frame, before said performing of said digital zoom step.
3. The method as in claim 1, wherein said image sensor arrays are focused to the infinite.
4. The method as in claim 1, wherein a lens, selected from the group consisting of said first lens and said second lens, is a focus adjustable lens.
5. The method as in claim 1, wherein a lens, selected from the group consisting of said first lens and said second lens, is a focus adjustable lens.
6. The method as in claim 1 wherein said second lens is a zoom lens.
7. The method as in claim 1, where said electronic calibration of said alignment between said first image sensor array and said second image sensor array, further determines a Z-coordinate rotational offset of the correlation between said first image sensor array and said second image sensor array.
8. The method as in claim 1, wherein said electronic calibration is performed with sub-pixel accuracy.
9. The method as in claim 1, wherein said electronic calibration step is performed on each pair of adjacently disposed image sensor arrays.
10. The method as in claim 1, wherein said first image acquisition device and said second image acquisition device are coupled with a mutual front lens and a beam splitter, wherein one portion of the light reaching said beam splitter is directed towards said first image sensor array and the remainder portion of the light reaching said beam splitter is directed towards said second image sensor array.
11. The method as in claim 1, wherein the angle of view of said first FOV is wider than the angle of view of said second FOV.
12. The method as in claim 1, wherein said first image sensor array is a color sensor and said second image sensor array is a monochrome sensor,
wherein a colored image frame is acquired by said first image sensor array;
wherein a monochrome image frame is acquired by said second image sensor array; and
wherein said colored image frame and said monochrome image frame are fused to form a high resolution colored image frame.
13. The method as in claim 12, wherein said fusion of said colored image frame and said monochrome image frame includes the step of computing color values for the pixels of said monochrome image frame from the respective pixels of said colored image frame.
14. The method as in claim 12, wherein the angle of view of said first FOV is wider than the angle of view of said second FOV.
15. The method as in claim 12, wherein the angle of view of said first FOV is substantially equal to the angle of view of said second FOV.
16. The method as in claim 13, wherein said computing of color values is performed in sub pixel accuracy.
17. The method as in claim 2, wherein said image sensor arrays are focused to the infinite.
18. The method as in claim 2, wherein said second lens is a zoom lens.
19. The method as in claim 7, wherein said electronic calibration is performed with sub-pixel accuracy.
US13/262,842 2009-04-07 2010-04-06 Continuous electronic zoom for an imaging system with multiple imaging devices having different fixed fov Abandoned US20120026366A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/262,842 US20120026366A1 (en) 2009-04-07 2010-04-06 Continuous electronic zoom for an imaging system with multiple imaging devices having different fixed fov

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US16722609P 2009-04-07 2009-04-07
US13/262,842 US20120026366A1 (en) 2009-04-07 2010-04-06 Continuous electronic zoom for an imaging system with multiple imaging devices having different fixed fov
PCT/IL2010/000281 WO2010116367A1 (en) 2009-04-07 2010-04-06 Continuous electronic zoom for an imaging system with multiple imaging devices having different fixed fov

Publications (1)

Publication Number Publication Date
US20120026366A1 true US20120026366A1 (en) 2012-02-02

Family

ID=42935704

Family Applications (3)

Application Number Title Priority Date Filing Date
US13/263,024 Abandoned US20120113266A1 (en) 2009-04-07 2010-04-06 Methods of manufacturing a camera system having multiple image sensors
US13/259,250 Active 2031-11-13 US8896697B2 (en) 2009-04-07 2010-04-06 Video motion compensation and stabilization gimbaled imaging system
US13/262,842 Abandoned US20120026366A1 (en) 2009-04-07 2010-04-06 Continuous electronic zoom for an imaging system with multiple imaging devices having different fixed fov

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US13/263,024 Abandoned US20120113266A1 (en) 2009-04-07 2010-04-06 Methods of manufacturing a camera system having multiple image sensors
US13/259,250 Active 2031-11-13 US8896697B2 (en) 2009-04-07 2010-04-06 Video motion compensation and stabilization gimbaled imaging system

Country Status (3)

Country Link
US (3) US20120113266A1 (en)
EP (1) EP2417560B1 (en)
WO (5) WO2010116370A1 (en)

Cited By (114)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120035233A1 (en) * 2009-04-13 2012-02-09 Apex Laboratories Private Limited Medicinal cream made using miconazole nitrate and chitosan and a process to make the same
US20150146030A1 (en) * 2013-11-26 2015-05-28 Pelican Imaging Corporation Array Camera Configurations Incorporating Constituent Array Cameras and Constituent Cameras
US20150244942A1 (en) * 2013-07-04 2015-08-27 Corephotonics Ltd. Thin dual-aperture zoom digital camera
US9185291B1 (en) * 2013-06-13 2015-11-10 Corephotonics Ltd. Dual aperture zoom digital camera
US9319585B1 (en) 2014-12-18 2016-04-19 Omnivision Technologies, Inc. High resolution array camera
US9438888B2 (en) 2013-03-15 2016-09-06 Pelican Imaging Corporation Systems and methods for stereo imaging with camera arrays
US20170111589A1 (en) * 2014-04-23 2017-04-20 Samsung Electronics Co., Ltd. Image pickup apparatus including lens elements having different diameters
WO2017068456A1 (en) * 2015-10-19 2017-04-27 Corephotonics Ltd. Dual-aperture zoom digital camera user interface
WO2017115179A1 (en) * 2015-12-29 2017-07-06 Corephotonics Ltd. Dual-aperture zoom digital camera with automatic adjustable tele field of view
US9706132B2 (en) 2012-05-01 2017-07-11 Fotonation Cayman Limited Camera modules patterned with pi filter groups
US9712759B2 (en) 2008-05-20 2017-07-18 Fotonation Cayman Limited Systems and methods for generating depth maps using a camera arrays incorporating monochrome and color cameras
US9733486B2 (en) 2013-03-13 2017-08-15 Fotonation Cayman Limited Systems and methods for controlling aliasing in images captured by an array camera for use in super-resolution processing
US9743051B2 (en) 2013-02-24 2017-08-22 Fotonation Cayman Limited Thin form factor computational array cameras and modular array cameras
US9749547B2 (en) 2008-05-20 2017-08-29 Fotonation Cayman Limited Capturing and processing of images using camera array incorperating Bayer cameras having different fields of view
US9749568B2 (en) 2012-11-13 2017-08-29 Fotonation Cayman Limited Systems and methods for array camera focal plane control
US9754422B2 (en) 2012-02-21 2017-09-05 Fotonation Cayman Limited Systems and method for performing depth based image editing
US9774789B2 (en) 2013-03-08 2017-09-26 Fotonation Cayman Limited Systems and methods for high dynamic range imaging using array cameras
EP3226055A1 (en) * 2016-03-31 2017-10-04 Sony Corporation Optical system, electronic device, camera, method and computer program
US9794476B2 (en) 2011-09-19 2017-10-17 Fotonation Cayman Limited Systems and methods for controlling aliasing in images captured by an array camera for use in super resolution processing using pixel apertures
US9800856B2 (en) 2013-03-13 2017-10-24 Fotonation Cayman Limited Systems and methods for synthesizing images from image data captured by an array camera using restricted depth of field depth maps in which depth estimation precision varies
US9807382B2 (en) 2012-06-28 2017-10-31 Fotonation Cayman Limited Systems and methods for detecting defective camera arrays and optic arrays
US9813616B2 (en) 2012-08-23 2017-11-07 Fotonation Cayman Limited Feature based high resolution motion estimation from low resolution images captured using an array source
US9811753B2 (en) 2011-09-28 2017-11-07 Fotonation Cayman Limited Systems and methods for encoding light field image files
US9858673B2 (en) 2012-08-21 2018-01-02 Fotonation Cayman Limited Systems and methods for estimating depth and visibility from a reference viewpoint for pixels in a set of images captured from different viewpoints
US9888194B2 (en) 2013-03-13 2018-02-06 Fotonation Cayman Limited Array camera architecture implementing quantum film image sensors
US9898856B2 (en) 2013-09-27 2018-02-20 Fotonation Cayman Limited Systems and methods for depth-assisted perspective distortion correction
US9924092B2 (en) 2013-11-07 2018-03-20 Fotonation Cayman Limited Array cameras incorporating independently aligned lens stacks
US9942474B2 (en) 2015-04-17 2018-04-10 Fotonation Cayman Limited Systems and methods for performing high speed video capture and depth estimation using array cameras
US9955070B2 (en) 2013-03-15 2018-04-24 Fotonation Cayman Limited Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information
US9986224B2 (en) 2013-03-10 2018-05-29 Fotonation Cayman Limited System and methods for calibration of an array camera
US20180160040A1 (en) * 2012-11-28 2018-06-07 Corephotonics Ltd. High resolution thin multi-aperture imaging systems
US10009538B2 (en) 2013-02-21 2018-06-26 Fotonation Cayman Limited Systems and methods for generating compressed light field representation data using captured light fields, array geometry, and parallax information
US10063783B2 (en) * 2015-09-30 2018-08-28 Apple Inc. Mobile zoom using multiple optical image stabilization cameras
US10089740B2 (en) 2014-03-07 2018-10-02 Fotonation Limited System and methods for depth regularization and semiautomatic interactive matting using RGB-D images
US10091405B2 (en) 2013-03-14 2018-10-02 Fotonation Cayman Limited Systems and methods for reducing motion blur in images or video in ultra low light with array cameras
CN108718376A (en) * 2013-08-01 2018-10-30 核心光电有限公司 With the slim multiple aperture imaging system focused automatically and its application method
US10119808B2 (en) 2013-11-18 2018-11-06 Fotonation Limited Systems and methods for estimating depth from projected texture using camera arrays
US10122993B2 (en) 2013-03-15 2018-11-06 Fotonation Limited Autofocus system for a conventional camera that uses depth information from an array camera
US10127682B2 (en) 2013-03-13 2018-11-13 Fotonation Limited System and methods for calibration of an array camera
US10156706B2 (en) 2014-08-10 2018-12-18 Corephotonics Ltd. Zoom dual-aperture camera with folded lens
US10182216B2 (en) 2013-03-15 2019-01-15 Fotonation Limited Extended color processing on pelican array cameras
US10194089B2 (en) 2016-02-08 2019-01-29 Qualcomm Incorporated Systems and methods for implementing seamless zoom function using multiple cameras
US10218889B2 (en) 2011-05-11 2019-02-26 Fotonation Limited Systems and methods for transmitting and receiving array camera image data
US20190068881A1 (en) * 2017-08-24 2019-02-28 Samsung Electronics Co., Ltd. Mobile device including multiple cameras
US10230898B2 (en) 2015-08-13 2019-03-12 Corephotonics Ltd. Dual aperture zoom camera with video support and switching / non-switching dynamic control
US10250871B2 (en) 2014-09-29 2019-04-02 Fotonation Limited Systems and methods for dynamic calibration of array cameras
US10261219B2 (en) 2012-06-30 2019-04-16 Fotonation Limited Systems and methods for manufacturing camera modules using active alignment of lens stack arrays and sensors
CN109644258A (en) * 2016-08-31 2019-04-16 华为技术有限公司 Multicamera system for zoom shot
US10284780B2 (en) 2015-09-06 2019-05-07 Corephotonics Ltd. Auto focus and optical image stabilization with roll compensation in a compact folded camera
US10288840B2 (en) 2015-01-03 2019-05-14 Corephotonics Ltd Miniature telephoto lens module and a camera utilizing such a lens module
US10288897B2 (en) 2015-04-02 2019-05-14 Corephotonics Ltd. Dual voice coil motor structure in a dual-optical module camera
US10290111B2 (en) 2016-07-26 2019-05-14 Qualcomm Incorporated Systems and methods for compositing images
US10297034B2 (en) 2016-09-30 2019-05-21 Qualcomm Incorporated Systems and methods for fusing images
US10306120B2 (en) 2009-11-20 2019-05-28 Fotonation Limited Capturing and processing of images captured by camera arrays incorporating cameras with telephoto and conventional lenses to generate depth maps
US10341543B2 (en) 2016-04-28 2019-07-02 Qualcomm Incorporated Parallax mask fusion of color and mono images for macrophotography
WO2019138342A1 (en) 2018-01-09 2019-07-18 6115187 Canada, Inc. d/b/a Immervision, Inc. Constant resolution continuous hybrid zoom system
US10366472B2 (en) 2010-12-14 2019-07-30 Fotonation Limited Systems and methods for synthesizing high resolution images using images captured by an array of independently controllable imagers
US10371928B2 (en) 2015-04-16 2019-08-06 Corephotonics Ltd Auto focus and optical image stabilization in a compact folded camera
US10382698B2 (en) 2015-09-30 2019-08-13 Apple Inc. Mobile zoom using multiple optical image stabilization cameras
US10379371B2 (en) 2015-05-28 2019-08-13 Corephotonics Ltd Bi-directional stiffness for optical image stabilization in a dual-aperture digital camera
US20190253593A1 (en) * 2016-10-28 2019-08-15 Huawei Technologies Co., Ltd. Photographing Method for Terminal and Terminal
US10390005B2 (en) 2012-09-28 2019-08-20 Fotonation Limited Generating images from light fields utilizing virtual viewpoints
WO2019160237A1 (en) * 2018-02-14 2019-08-22 Samsung Electronics Co., Ltd. Electronic device and method for controlling display of images
US10412314B2 (en) 2013-03-14 2019-09-10 Fotonation Limited Systems and methods for photometric normalization in array cameras
US10455168B2 (en) 2010-05-12 2019-10-22 Fotonation Limited Imager array interfaces
US10482618B2 (en) 2017-08-21 2019-11-19 Fotonation Limited Systems and methods for hybrid depth regularization
US10488631B2 (en) 2016-05-30 2019-11-26 Corephotonics Ltd. Rotational ball-guided voice coil motor
US10516826B2 (en) 2015-02-13 2019-12-24 Apple Inc. Dual camera magnet arrangement
US20200007777A1 (en) * 2018-06-28 2020-01-02 Aver Information Inc. Image-capturing device and method for operating image-capturing system
US10534153B2 (en) 2017-02-23 2020-01-14 Corephotonics Ltd. Folded camera lens designs
US10616484B2 (en) 2016-06-19 2020-04-07 Corephotonics Ltd. Frame syncrhonization in a dual-aperture camera system
US20200137380A1 (en) * 2018-10-31 2020-04-30 Intel Corporation Multi-plane display image synthesis mechanism
US10645286B2 (en) 2017-03-15 2020-05-05 Corephotonics Ltd. Camera with panoramic scanning range
US10642271B1 (en) * 2016-08-26 2020-05-05 Amazon Technologies, Inc. Vehicle guidance camera with zoom lens
US20200145579A1 (en) * 2018-11-01 2020-05-07 Korea Advanced Institute Of Science And Technology Image processing apparatus and method using video signal of planar coordinate system and spherical coordinate system
US10694168B2 (en) 2018-04-22 2020-06-23 Corephotonics Ltd. System and method for mitigating or preventing eye damage from structured light IR/NIR projector systems
US10706518B2 (en) 2016-07-07 2020-07-07 Corephotonics Ltd. Dual camera system with improved video smooth transition by image blending
US10845565B2 (en) 2016-07-07 2020-11-24 Corephotonics Ltd. Linear ball guided voice coil motor for folded optic
US10884321B2 (en) 2017-01-12 2021-01-05 Corephotonics Ltd. Compact folded camera
US10904512B2 (en) 2017-09-06 2021-01-26 Corephotonics Ltd. Combined stereoscopic and phase detection depth mapping in a dual aperture camera
US10951834B2 (en) 2017-10-03 2021-03-16 Corephotonics Ltd. Synthetically enlarged camera aperture
US10976567B2 (en) 2018-02-05 2021-04-13 Corephotonics Ltd. Reduced height penalty for folded camera
US11048915B2 (en) * 2016-06-29 2021-06-29 Safran Identity & Security Method and a device for detecting fraud by examination using two different focal lengths during automatic face recognition
US20210377428A1 (en) * 2020-05-29 2021-12-02 Maruzen Intec Co., Ltd. Monitor camera
WO2022007840A1 (en) * 2020-07-08 2022-01-13 杭州萤石软件有限公司 Image fusion method and device
US11268830B2 (en) 2018-04-23 2022-03-08 Corephotonics Ltd Optical-path folding-element with an extended two degree of freedom rotation range
US11270110B2 (en) 2019-09-17 2022-03-08 Boston Polarimetrics, Inc. Systems and methods for surface modeling using polarization cues
US11287081B2 (en) 2019-01-07 2022-03-29 Corephotonics Ltd. Rotation mechanism with sliding joint
US11290658B1 (en) 2021-04-15 2022-03-29 Boston Polarimetrics, Inc. Systems and methods for camera exposure control
US11302012B2 (en) 2019-11-30 2022-04-12 Boston Polarimetrics, Inc. Systems and methods for transparent object segmentation using polarization cues
US11315276B2 (en) 2019-03-09 2022-04-26 Corephotonics Ltd. System and method for dynamic stereoscopic calibration
US11333955B2 (en) 2017-11-23 2022-05-17 Corephotonics Ltd. Compact folded camera structure
US11363180B2 (en) 2018-08-04 2022-06-14 Corephotonics Ltd. Switchable continuous display information system above camera
US11368631B1 (en) 2019-07-31 2022-06-21 Corephotonics Ltd. System and method for creating background blur in camera panning or motion
US11381747B2 (en) 2015-02-13 2022-07-05 Apple Inc. Dual camera magnet arrangement
US11509837B2 (en) 2020-05-12 2022-11-22 Qualcomm Incorporated Camera transition blending
US11525906B2 (en) 2019-10-07 2022-12-13 Intrinsic Innovation Llc Systems and methods for augmentation of sensor systems and imaging systems with polarization
US11531209B2 (en) 2016-12-28 2022-12-20 Corephotonics Ltd. Folded camera structure with an extended light-folding-element scanning range
US11580667B2 (en) 2020-01-29 2023-02-14 Intrinsic Innovation Llc Systems and methods for characterizing object pose detection and measurement systems
US11637977B2 (en) 2020-07-15 2023-04-25 Corephotonics Ltd. Image sensors and sensing methods to obtain time-of-flight and phase detection information
US11635596B2 (en) 2018-08-22 2023-04-25 Corephotonics Ltd. Two-state zoom folded camera
US11640047B2 (en) 2018-02-12 2023-05-02 Corephotonics Ltd. Folded camera with optical image stabilization
US11659135B2 (en) 2019-10-30 2023-05-23 Corephotonics Ltd. Slow or fast motion video using depth information
US11689813B2 (en) 2021-07-01 2023-06-27 Intrinsic Innovation Llc Systems and methods for high dynamic range imaging using crossed polarizers
US11693064B2 (en) 2020-04-26 2023-07-04 Corephotonics Ltd. Temperature control for Hall bar sensor correction
US11770609B2 (en) 2020-05-30 2023-09-26 Corephotonics Ltd. Systems and methods for obtaining a super macro image
US11770618B2 (en) 2019-12-09 2023-09-26 Corephotonics Ltd. Systems and methods for obtaining a smart panoramic image
US11792538B2 (en) 2008-05-20 2023-10-17 Adeia Imaging Llc Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
US11797863B2 (en) 2020-01-30 2023-10-24 Intrinsic Innovation Llc Systems and methods for synthesizing data for training statistical models on different imaging modalities including polarized images
US11832018B2 (en) 2020-05-17 2023-11-28 Corephotonics Ltd. Image stitching in the presence of a full field of view reference image
US11910089B2 (en) 2020-07-15 2024-02-20 Corephotonics Lid. Point of view aberrations correction in a scanning folded camera
US11946775B2 (en) 2020-07-31 2024-04-02 Corephotonics Ltd. Hall sensor—magnet geometry for large stroke linear position sensing
US11949976B2 (en) 2019-12-09 2024-04-02 Corephotonics Ltd. Systems and methods for obtaining a smart panoramic image
US11953700B2 (en) 2021-05-27 2024-04-09 Intrinsic Innovation Llc Multi-aperture polarization optical systems using beam splitters

Families Citing this family (51)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9294755B2 (en) * 2010-10-20 2016-03-22 Raytheon Company Correcting frame-to-frame image changes due to motion for three dimensional (3-D) persistent observations
GB2492529B (en) * 2011-05-31 2018-01-10 Skype Video stabilisation
US8823813B2 (en) 2011-06-06 2014-09-02 Apple Inc. Correcting rolling shutter using image stabilization
US8648919B2 (en) 2011-06-06 2014-02-11 Apple Inc. Methods and systems for image stabilization
WO2013025552A1 (en) * 2011-08-12 2013-02-21 Aerovironment, Inc. Bi-stable, sub-commutated, direct-drive, sinusoidal motor controller for precision position control
US9933935B2 (en) * 2011-08-26 2018-04-03 Apple Inc. Device, method, and graphical user interface for editing videos
WO2013033954A1 (en) 2011-09-09 2013-03-14 深圳市大疆创新科技有限公司 Gyroscopic dynamic auto-balancing ball head
GB201116566D0 (en) 2011-09-26 2011-11-09 Skype Ltd Video stabilisation
GB2497507B (en) 2011-10-14 2014-10-22 Skype Received video stabilisation
IL219639A (en) 2012-05-08 2016-04-21 Israel Aerospace Ind Ltd Remote tracking of objects
JP2014007653A (en) * 2012-06-26 2014-01-16 Jvc Kenwood Corp Imaging device, imaging method, imaging system, and program
WO2014058511A2 (en) * 2012-08-01 2014-04-17 Bye Uas, Inc. Small uas with high definition video
CN103679108B (en) 2012-09-10 2018-12-11 霍尼韦尔国际公司 Optical markings reading device with multiple images sensor
US9148571B2 (en) * 2012-09-14 2015-09-29 Apple Inc. Image distortion correction in scaling circuit
US10212396B2 (en) 2013-01-15 2019-02-19 Israel Aerospace Industries Ltd Remote tracking of objects
IL224273B (en) * 2013-01-17 2018-05-31 Cohen Yossi Delay compensation while controlling a remote sensor
CN103198462B (en) * 2013-04-08 2017-12-22 南华大学 Intense radiation resistant visual sensing device based on information fusion
US8903568B1 (en) 2013-07-31 2014-12-02 SZ DJI Technology Co., Ltd Remote control method and terminal
CN103426282A (en) * 2013-07-31 2013-12-04 深圳市大疆创新科技有限公司 Remote control method and terminal
JP6160357B2 (en) * 2013-08-15 2017-07-12 株式会社リコー Image processing apparatus, image processing method, and image communication system
JP2016541026A (en) 2013-10-08 2016-12-28 エスゼット ディージェイアイ テクノロジー カンパニー リミテッドＳｚ Ｄｊｉ Ｔｅｃｈｎｏｌｏｇｙ Ｃｏ．，Ｌｔｄ Apparatus and method for stabilization and vibration reduction
US9348197B2 (en) 2013-12-24 2016-05-24 Pv Labs Inc. Platform stabilization system
US20150187390A1 (en) * 2013-12-30 2015-07-02 Lyve Minds, Inc. Video metadata
WO2015157058A1 (en) * 2014-04-07 2015-10-15 Bae Systems Information & Electronic Systems Integration Inc. Contrast based image fusion
WO2015192056A1 (en) * 2014-06-13 2015-12-17 Urthecast Corp. Systems and methods for processing and providing terrestrial and/or space-based earth observation video
IL233684B (en) 2014-07-17 2018-01-31 Shamir Hanan Stabilization and display of remote images
CA2980920C (en) 2015-03-25 2023-09-26 King Abdulaziz City Of Science And Technology Apparatus and methods for synthetic aperture radar with digital beamforming
US10615513B2 (en) 2015-06-16 2020-04-07 Urthecast Corp Efficient planar phased array antenna assembly
DE102016206493A1 (en) * 2015-06-23 2016-12-29 Robert Bosch Gmbh Method and camera system for determining the distance of objects to a vehicle
EP3380864A4 (en) 2015-11-25 2019-07-03 Urthecast Corp. Synthetic aperture radar imaging apparatus and methods
US10097765B2 (en) * 2016-04-20 2018-10-09 Samsung Electronics Co., Ltd. Methodology and apparatus for generating high fidelity zoom for mobile video
US10341565B2 (en) 2016-05-10 2019-07-02 Raytheon Company Self correcting adaptive low light optical payload
CN109477607A (en) 2016-06-06 2019-03-15 深圳市大疆灵眸科技有限公司 Image procossing for tracking
EP3465085B1 (en) 2016-06-06 2021-12-29 SZ DJI Osmo Technology Co., Ltd. Carrier-assisted tracking
KR102502090B1 (en) * 2016-06-14 2023-02-20 로무 가부시키가이샤 Unmanned aerial vehicle equipped with camera
WO2018027340A1 (en) * 2016-08-06 2018-02-15 SZ DJI Technology Co., Ltd. Systems and methods for mobile platform imaging
FR3055078B1 (en) * 2016-08-11 2019-05-31 Parrot Drones IMAGE CAPTURE METHOD (S), COMPUTER PROGRAM, AND ELECTRONIC CAPTURE SYSTEM OF ASSOCIATED VIDEO
US9794483B1 (en) * 2016-08-22 2017-10-17 Raytheon Company Video geolocation
US20190174063A1 (en) * 2016-09-23 2019-06-06 Qualcomm Incorporated Adaptive Image Processing in an Unmanned Autonomous Vehicle
WO2018053786A1 (en) 2016-09-23 2018-03-29 Qualcomm Incorporated Adaptive motion filtering in an unmanned autonomous vehicle
CN110235441B (en) * 2017-03-24 2021-01-15 华为技术有限公司 Multi-camera system for low illumination
CA3064586A1 (en) 2017-05-23 2018-11-29 King Abdullah City Of Science And Technology Synthetic aperture radar imaging apparatus and methods for moving targets
CA3064735C (en) 2017-05-23 2022-06-21 Urthecast Corp. Synthetic aperture radar imaging apparatus and methods
CA3083033A1 (en) 2017-11-22 2019-11-28 Urthecast Corp. Synthetic aperture radar apparatus and methods
CN109922260B (en) * 2019-03-04 2020-08-21 中国科学院上海微系统与信息技术研究所 Data synchronization method and synchronization device for image sensor and inertial sensor
US11265469B1 (en) 2020-04-10 2022-03-01 Amazon Technologies, Inc. System to mitigate image jitter by an actuator driven camera
CN114390188B (en) * 2020-10-22 2023-05-12 华为技术有限公司 Image processing method and electronic equipment
CN112788293B (en) * 2020-12-29 2023-08-25 深圳市朗驰欣创科技股份有限公司 Information acquisition method and device, terminal equipment and storage medium
US11438514B1 (en) * 2021-05-24 2022-09-06 Getac Technology Corporation Performing image collection adjustment within a body-mounted camera
WO2023123371A1 (en) * 2021-12-31 2023-07-06 Qualcomm Incorporated Image correction based on activity detection
WO2024018347A1 (en) * 2022-07-20 2024-01-25 Gentex Corporation Image processing for pixel correction

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020163582A1 (en) * 2001-05-04 2002-11-07 Gruber Michael A. Self-calibrating, digital, large format camera with single or mulitiple detector arrays and single or multiple optical systems
US20050219659A1 (en) * 2004-03-31 2005-10-06 Shuxue Quan Reproduction of alternative forms of light from an object using digital imaging system
US20060139475A1 (en) * 2004-12-23 2006-06-29 Esch John W Multiple field of view camera arrays
US20060275025A1 (en) * 2005-02-18 2006-12-07 Peter Labaziewicz Digital camera using multiple lenses and image sensors to provide an extended zoom range
US20080030611A1 (en) * 2006-08-01 2008-02-07 Jenkins Michael V Dual Sensor Video Camera

Family Cites Families (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4524390A (en) * 1983-03-07 1985-06-18 Eastman Kodak Company Imaging apparatus
US5325449A (en) * 1992-05-15 1994-06-28 David Sarnoff Research Center, Inc. Method for fusing images and apparatus therefor
US5754229A (en) * 1995-11-14 1998-05-19 Lockheed Martin Corporation Electronic image sensor with multiple, sequential or staggered exposure capability for color snap shot cameras and other high speed applications
US7023913B1 (en) * 2000-06-14 2006-04-04 Monroe David A Digital security multimedia sensor
US6611289B1 (en) * 1999-01-15 2003-08-26 Yanbin Yu Digital cameras using multiple sensors with multiple lenses
US6995794B2 (en) * 1999-06-30 2006-02-07 Logitech Europe S.A. Video camera with major functions implemented in host software
US7068854B1 (en) * 1999-12-29 2006-06-27 Ge Medical Systems Global Technology Company, Llc Correction of defective pixels in a detector
US20020015536A1 (en) * 2000-04-24 2002-02-07 Warren Penny G. Apparatus and method for color image fusion
US7663695B2 (en) * 2000-05-05 2010-02-16 Stmicroelectronics S.R.L. Method and system for de-interlacing digital images, and computer program product therefor
US6724945B1 (en) * 2000-05-24 2004-04-20 Hewlett-Packard Development Company, L.P. Correcting defect pixels in a digital image
US7365783B2 (en) * 2001-03-16 2008-04-29 Olympus Corporation Image pickup apparatus which stores initial defect data concerning image pickup device and data on later developed defects
US20030053658A1 (en) * 2001-06-29 2003-03-20 Honeywell International Inc. Surveillance system and methods regarding same
US7027089B2 (en) * 2001-07-06 2006-04-11 Hynix Semiconductor, Inc. Image sensor with defective pixel address storage
US7940299B2 (en) * 2001-08-09 2011-05-10 Technest Holdings, Inc. Method and apparatus for an omni-directional video surveillance system
DE10210831A1 (en) * 2002-03-12 2003-11-06 Zeiss Carl Optical image acquisition and evaluation system
US7408572B2 (en) * 2002-07-06 2008-08-05 Nova Research, Inc. Method and apparatus for an on-chip variable acuity imager array incorporating roll, pitch and yaw angle rates measurement
US7176963B2 (en) * 2003-01-03 2007-02-13 Litton Systems, Inc. Method and system for real-time image fusion
US7876359B2 (en) * 2003-01-17 2011-01-25 Insitu, Inc. Cooperative nesting of mechanical and electronic stabilization for an airborne camera system
US7619626B2 (en) * 2003-03-01 2009-11-17 The Boeing Company Mapping images from one or more sources into an image for display
US7315630B2 (en) * 2003-06-26 2008-01-01 Fotonation Vision Limited Perfecting of digital image rendering parameters within rendering devices using face detection
US7495694B2 (en) * 2004-07-28 2009-02-24 Microsoft Corp. Omni-directional camera with calibration and up look angle improvements
US7358498B2 (en) * 2003-08-04 2008-04-15 Technest Holdings, Inc. System and a method for a smart surveillance system
US7796169B2 (en) * 2004-04-20 2010-09-14 Canon Kabushiki Kaisha Image processing apparatus for correcting captured image
US7466343B2 (en) * 2004-07-20 2008-12-16 Nahum Gat General line of sight stabilization system
US7602438B2 (en) * 2004-10-19 2009-10-13 Eastman Kodak Company Method and apparatus for capturing high quality long exposure images with a digital camera
US7639888B2 (en) * 2004-11-10 2009-12-29 Fotonation Ireland Ltd. Method and apparatus for initiating subsequent exposures based on determination of motion blurring artifacts
IL165190A (en) * 2004-11-14 2012-05-31 Elbit Systems Ltd System and method for stabilizing an image
US20060203090A1 (en) * 2004-12-04 2006-09-14 Proximex, Corporation Video surveillance using stationary-dynamic camera assemblies for wide-area video surveillance and allow for selective focus-of-attention
US7688364B2 (en) * 2004-12-10 2010-03-30 Ambarella, Inc. Decimating and cropping based zoom factor for a digital camera
US7561191B2 (en) * 2005-02-18 2009-07-14 Eastman Kodak Company Camera phone using multiple lenses and image sensors to provide an extended zoom range
US20070102622A1 (en) * 2005-07-01 2007-05-10 Olsen Richard I Apparatus for multiple camera devices and method of operating same
US7557832B2 (en) * 2005-08-12 2009-07-07 Volker Lindenstruth Method and apparatus for electronically stabilizing digital images
US7964835B2 (en) * 2005-08-25 2011-06-21 Protarius Filo Ag, L.L.C. Digital cameras with direct luminance and chrominance detection
US7676084B2 (en) * 2006-06-19 2010-03-09 Mtekvision Co., Ltd. Apparatus for processing dead pixel
JP2008072565A (en) * 2006-09-15 2008-03-27 Ricoh Co Ltd Imaging device and defective pixel correction method
US7649555B2 (en) * 2006-10-02 2010-01-19 Mtekvision Co., Ltd. Apparatus for processing dead pixel
JP2008160300A (en) * 2006-12-21 2008-07-10 Canon Inc Image processor, and imaging apparatus
US7643063B2 (en) * 2006-12-29 2010-01-05 The Boeing Company Dual loop stabilization of video camera images
JP2008203636A (en) * 2007-02-21 2008-09-04 Toshiba Matsushita Display Technology Co Ltd Manufacturing method of array substrate, manufacturing method of display device, and array substrate and display device
US8587659B1 (en) * 2007-05-07 2013-11-19 Equinox Corporation Method and apparatus for dynamic image registration
EP2015562A1 (en) * 2007-07-10 2009-01-14 Thomson Licensing S.A. Processing device for correcting defect pixel values of an image sensor unit, image sensor unit with the processing device and method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020163582A1 (en) * 2001-05-04 2002-11-07 Gruber Michael A. Self-calibrating, digital, large format camera with single or mulitiple detector arrays and single or multiple optical systems
US20050219659A1 (en) * 2004-03-31 2005-10-06 Shuxue Quan Reproduction of alternative forms of light from an object using digital imaging system
US20060139475A1 (en) * 2004-12-23 2006-06-29 Esch John W Multiple field of view camera arrays
US20060275025A1 (en) * 2005-02-18 2006-12-07 Peter Labaziewicz Digital camera using multiple lenses and image sensors to provide an extended zoom range
US20080030611A1 (en) * 2006-08-01 2008-02-07 Jenkins Michael V Dual Sensor Video Camera

Cited By (274)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11792538B2 (en) 2008-05-20 2023-10-17 Adeia Imaging Llc Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
US11412158B2 (en) 2008-05-20 2022-08-09 Fotonation Limited Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
US10142560B2 (en) 2008-05-20 2018-11-27 Fotonation Limited Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
US9712759B2 (en) 2008-05-20 2017-07-18 Fotonation Cayman Limited Systems and methods for generating depth maps using a camera arrays incorporating monochrome and color cameras
US10027901B2 (en) 2008-05-20 2018-07-17 Fotonation Cayman Limited Systems and methods for generating depth maps using a camera arrays incorporating monochrome and color cameras
US9749547B2 (en) 2008-05-20 2017-08-29 Fotonation Cayman Limited Capturing and processing of images using camera array incorperating Bayer cameras having different fields of view
US20120035233A1 (en) * 2009-04-13 2012-02-09 Apex Laboratories Private Limited Medicinal cream made using miconazole nitrate and chitosan and a process to make the same
US10306120B2 (en) 2009-11-20 2019-05-28 Fotonation Limited Capturing and processing of images captured by camera arrays incorporating cameras with telephoto and conventional lenses to generate depth maps
US10455168B2 (en) 2010-05-12 2019-10-22 Fotonation Limited Imager array interfaces
US11423513B2 (en) 2010-12-14 2022-08-23 Fotonation Limited Systems and methods for synthesizing high resolution images using images captured by an array of independently controllable imagers
US10366472B2 (en) 2010-12-14 2019-07-30 Fotonation Limited Systems and methods for synthesizing high resolution images using images captured by an array of independently controllable imagers
US11875475B2 (en) 2010-12-14 2024-01-16 Adeia Imaging Llc Systems and methods for synthesizing high resolution images using images captured by an array of independently controllable imagers
US10218889B2 (en) 2011-05-11 2019-02-26 Fotonation Limited Systems and methods for transmitting and receiving array camera image data
US10742861B2 (en) 2011-05-11 2020-08-11 Fotonation Limited Systems and methods for transmitting and receiving array camera image data
US10375302B2 (en) 2011-09-19 2019-08-06 Fotonation Limited Systems and methods for controlling aliasing in images captured by an array camera for use in super resolution processing using pixel apertures
US9794476B2 (en) 2011-09-19 2017-10-17 Fotonation Cayman Limited Systems and methods for controlling aliasing in images captured by an array camera for use in super resolution processing using pixel apertures
US10019816B2 (en) 2011-09-28 2018-07-10 Fotonation Cayman Limited Systems and methods for decoding image files containing depth maps stored as metadata
US10984276B2 (en) 2011-09-28 2021-04-20 Fotonation Limited Systems and methods for encoding image files containing depth maps stored as metadata
US9811753B2 (en) 2011-09-28 2017-11-07 Fotonation Cayman Limited Systems and methods for encoding light field image files
US10430682B2 (en) 2011-09-28 2019-10-01 Fotonation Limited Systems and methods for decoding image files containing depth maps stored as metadata
US11729365B2 (en) 2011-09-28 2023-08-15 Adela Imaging LLC Systems and methods for encoding image files containing depth maps stored as metadata
US20180197035A1 (en) 2011-09-28 2018-07-12 Fotonation Cayman Limited Systems and Methods for Encoding Image Files Containing Depth Maps Stored as Metadata
US10275676B2 (en) 2011-09-28 2019-04-30 Fotonation Limited Systems and methods for encoding image files containing depth maps stored as metadata
US9754422B2 (en) 2012-02-21 2017-09-05 Fotonation Cayman Limited Systems and method for performing depth based image editing
US10311649B2 (en) 2012-02-21 2019-06-04 Fotonation Limited Systems and method for performing depth based image editing
US9706132B2 (en) 2012-05-01 2017-07-11 Fotonation Cayman Limited Camera modules patterned with pi filter groups
US9807382B2 (en) 2012-06-28 2017-10-31 Fotonation Cayman Limited Systems and methods for detecting defective camera arrays and optic arrays
US10334241B2 (en) 2012-06-28 2019-06-25 Fotonation Limited Systems and methods for detecting defective camera arrays and optic arrays
US11022725B2 (en) 2012-06-30 2021-06-01 Fotonation Limited Systems and methods for manufacturing camera modules using active alignment of lens stack arrays and sensors
US10261219B2 (en) 2012-06-30 2019-04-16 Fotonation Limited Systems and methods for manufacturing camera modules using active alignment of lens stack arrays and sensors
US10380752B2 (en) 2012-08-21 2019-08-13 Fotonation Limited Systems and methods for estimating depth and visibility from a reference viewpoint for pixels in a set of images captured from different viewpoints
US9858673B2 (en) 2012-08-21 2018-01-02 Fotonation Cayman Limited Systems and methods for estimating depth and visibility from a reference viewpoint for pixels in a set of images captured from different viewpoints
US10462362B2 (en) 2012-08-23 2019-10-29 Fotonation Limited Feature based high resolution motion estimation from low resolution images captured using an array source
US9813616B2 (en) 2012-08-23 2017-11-07 Fotonation Cayman Limited Feature based high resolution motion estimation from low resolution images captured using an array source
US10390005B2 (en) 2012-09-28 2019-08-20 Fotonation Limited Generating images from light fields utilizing virtual viewpoints
US9749568B2 (en) 2012-11-13 2017-08-29 Fotonation Cayman Limited Systems and methods for array camera focal plane control
USRE49256E1 (en) 2012-11-28 2022-10-18 Corephotonics Ltd. High resolution thin multi-aperture imaging systems
US20180160040A1 (en) * 2012-11-28 2018-06-07 Corephotonics Ltd. High resolution thin multi-aperture imaging systems
USRE48444E1 (en) 2012-11-28 2021-02-16 Corephotonics Ltd. High resolution thin multi-aperture imaging systems
USRE48477E1 (en) 2012-11-28 2021-03-16 Corephotonics Ltd High resolution thin multi-aperture imaging systems
USRE48697E1 (en) 2012-11-28 2021-08-17 Corephotonics Ltd. High resolution thin multi-aperture imaging systems
USRE48945E1 (en) 2012-11-28 2022-02-22 Corephotonics Ltd. High resolution thin multi-aperture imaging systems
US10009538B2 (en) 2013-02-21 2018-06-26 Fotonation Cayman Limited Systems and methods for generating compressed light field representation data using captured light fields, array geometry, and parallax information
US9743051B2 (en) 2013-02-24 2017-08-22 Fotonation Cayman Limited Thin form factor computational array cameras and modular array cameras
US9774831B2 (en) 2013-02-24 2017-09-26 Fotonation Cayman Limited Thin form factor computational array cameras and modular array cameras
US9774789B2 (en) 2013-03-08 2017-09-26 Fotonation Cayman Limited Systems and methods for high dynamic range imaging using array cameras
US9917998B2 (en) 2013-03-08 2018-03-13 Fotonation Cayman Limited Systems and methods for measuring scene information while capturing images using array cameras
US9986224B2 (en) 2013-03-10 2018-05-29 Fotonation Cayman Limited System and methods for calibration of an array camera
US10958892B2 (en) 2013-03-10 2021-03-23 Fotonation Limited System and methods for calibration of an array camera
US11570423B2 (en) 2013-03-10 2023-01-31 Adeia Imaging Llc System and methods for calibration of an array camera
US10225543B2 (en) 2013-03-10 2019-03-05 Fotonation Limited System and methods for calibration of an array camera
US11272161B2 (en) 2013-03-10 2022-03-08 Fotonation Limited System and methods for calibration of an array camera
US10127682B2 (en) 2013-03-13 2018-11-13 Fotonation Limited System and methods for calibration of an array camera
US9800856B2 (en) 2013-03-13 2017-10-24 Fotonation Cayman Limited Systems and methods for synthesizing images from image data captured by an array camera using restricted depth of field depth maps in which depth estimation precision varies
US9888194B2 (en) 2013-03-13 2018-02-06 Fotonation Cayman Limited Array camera architecture implementing quantum film image sensors
US9733486B2 (en) 2013-03-13 2017-08-15 Fotonation Cayman Limited Systems and methods for controlling aliasing in images captured by an array camera for use in super-resolution processing
US10412314B2 (en) 2013-03-14 2019-09-10 Fotonation Limited Systems and methods for photometric normalization in array cameras
US10091405B2 (en) 2013-03-14 2018-10-02 Fotonation Cayman Limited Systems and methods for reducing motion blur in images or video in ultra low light with array cameras
US10547772B2 (en) 2013-03-14 2020-01-28 Fotonation Limited Systems and methods for reducing motion blur in images or video in ultra low light with array cameras
US9602805B2 (en) 2013-03-15 2017-03-21 Fotonation Cayman Limited Systems and methods for estimating depth using ad hoc stereo array cameras
US10674138B2 (en) 2013-03-15 2020-06-02 Fotonation Limited Autofocus system for a conventional camera that uses depth information from an array camera
US10542208B2 (en) 2013-03-15 2020-01-21 Fotonation Limited Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information
US9438888B2 (en) 2013-03-15 2016-09-06 Pelican Imaging Corporation Systems and methods for stereo imaging with camera arrays
US9800859B2 (en) 2013-03-15 2017-10-24 Fotonation Cayman Limited Systems and methods for estimating depth using stereo array cameras
US10182216B2 (en) 2013-03-15 2019-01-15 Fotonation Limited Extended color processing on pelican array cameras
US9955070B2 (en) 2013-03-15 2018-04-24 Fotonation Cayman Limited Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information
US10638099B2 (en) 2013-03-15 2020-04-28 Fotonation Limited Extended color processing on pelican array cameras
US10122993B2 (en) 2013-03-15 2018-11-06 Fotonation Limited Autofocus system for a conventional camera that uses depth information from an array camera
US10455218B2 (en) 2013-03-15 2019-10-22 Fotonation Limited Systems and methods for estimating depth using stereo array cameras
US20160050374A1 (en) * 2013-06-13 2016-02-18 Corephotonics Ltd. Dual aperture zoom digital camera
US10326942B2 (en) * 2013-06-13 2019-06-18 Corephotonics Ltd. Dual aperture zoom digital camera
US10225479B2 (en) * 2013-06-13 2019-03-05 Corephotonics Ltd. Dual aperture zoom digital camera
US10904444B2 (en) * 2013-06-13 2021-01-26 Corephotonics Ltd. Dual aperture zoom digital camera
US20180152640A1 (en) * 2013-06-13 2018-05-31 Corephotonics Ltd. Dual aperture zoom digital camera
US20230008641A1 (en) * 2013-06-13 2023-01-12 Corephotonics Ltd. Dual aperture zoom digital camera
US10841500B2 (en) * 2013-06-13 2020-11-17 Corephotonics Ltd. Dual aperture zoom digital camera
US9661233B2 (en) * 2013-06-13 2017-05-23 Corephotonics Ltd. Dual aperture zoom digital camera
US11838635B2 (en) * 2013-06-13 2023-12-05 Corephotonics Ltd. Dual aperture zoom digital camera
US20190230291A1 (en) * 2013-06-13 2019-07-25 Corephotonics Ltd. Dual aperture zoom digital camera
CN105308947A (en) * 2013-06-13 2016-02-03 核心光电有限公司 Dual aperture zoom digital camera
US11470257B2 (en) * 2013-06-13 2022-10-11 Corephotonics Ltd. Dual aperture zoom digital camera
US9185291B1 (en) * 2013-06-13 2015-11-10 Corephotonics Ltd. Dual aperture zoom digital camera
US11287668B2 (en) 2013-07-04 2022-03-29 Corephotonics Ltd. Thin dual-aperture zoom digital camera
US10288896B2 (en) 2013-07-04 2019-05-14 Corephotonics Ltd. Thin dual-aperture zoom digital camera
US9599796B2 (en) 2013-07-04 2017-03-21 Corephotonics Ltd. Thin dual-aperture zoom digital camera
US10620450B2 (en) 2013-07-04 2020-04-14 Corephotonics Ltd Thin dual-aperture zoom digital camera
US9413972B2 (en) * 2013-07-04 2016-08-09 Corephotonics Ltd. Thin dual-aperture zoom digital camera
US20150244942A1 (en) * 2013-07-04 2015-08-27 Corephotonics Ltd. Thin dual-aperture zoom digital camera
US11614635B2 (en) 2013-07-04 2023-03-28 Corephotonics Ltd. Thin dual-aperture zoom digital camera
US11852845B2 (en) 2013-07-04 2023-12-26 Corephotonics Ltd. Thin dual-aperture zoom digital camera
US11856291B2 (en) 2013-08-01 2023-12-26 Corephotonics Ltd. Thin multi-aperture imaging system with auto-focus and methods for using same
CN108989648A (en) * 2013-08-01 2018-12-11 核心光电有限公司 With the slim multiple aperture imaging system focused automatically and its application method
US10694094B2 (en) 2013-08-01 2020-06-23 Corephotonics Ltd. Thin multi-aperture imaging system with auto-focus and methods for using same
US10469735B2 (en) * 2013-08-01 2019-11-05 Corephotonics Ltd. Thin multi-aperture imaging system with auto-focus and methods for using same
US11470235B2 (en) 2013-08-01 2022-10-11 Corephotonics Ltd. Thin multi-aperture imaging system with autofocus and methods for using same
US11716535B2 (en) 2013-08-01 2023-08-01 Corephotonics Ltd. Thin multi-aperture imaging system with auto-focus and methods for using same
CN108718376A (en) * 2013-08-01 2018-10-30 核心光电有限公司 With the slim multiple aperture imaging system focused automatically and its application method
US10250797B2 (en) * 2013-08-01 2019-04-02 Corephotonics Ltd. Thin multi-aperture imaging system with auto-focus and methods for using same
CN108989649A (en) * 2013-08-01 2018-12-11 核心光电有限公司 With the slim multiple aperture imaging system focused automatically and its application method
US20190149721A1 (en) * 2013-08-01 2019-05-16 Corephotonics Ltd. Thin multi-aperture imaging system with auto-focus and methods for using same
US9898856B2 (en) 2013-09-27 2018-02-20 Fotonation Cayman Limited Systems and methods for depth-assisted perspective distortion correction
US10540806B2 (en) 2013-09-27 2020-01-21 Fotonation Limited Systems and methods for depth-assisted perspective distortion correction
US9924092B2 (en) 2013-11-07 2018-03-20 Fotonation Cayman Limited Array cameras incorporating independently aligned lens stacks
US10119808B2 (en) 2013-11-18 2018-11-06 Fotonation Limited Systems and methods for estimating depth from projected texture using camera arrays
US11486698B2 (en) 2013-11-18 2022-11-01 Fotonation Limited Systems and methods for estimating depth from projected texture using camera arrays
US10767981B2 (en) 2013-11-18 2020-09-08 Fotonation Limited Systems and methods for estimating depth from projected texture using camera arrays
US10708492B2 (en) 2013-11-26 2020-07-07 Fotonation Limited Array camera configurations incorporating constituent array cameras and constituent cameras
US9426361B2 (en) 2013-11-26 2016-08-23 Pelican Imaging Corporation Array camera configurations incorporating multiple constituent array cameras
US9456134B2 (en) * 2013-11-26 2016-09-27 Pelican Imaging Corporation Array camera configurations incorporating constituent array cameras and constituent cameras
US20180139382A1 (en) * 2013-11-26 2018-05-17 Fotonation Cayman Limited Array Camera Configurations Incorporating Constituent Array Cameras and Constituent Cameras
US20150146030A1 (en) * 2013-11-26 2015-05-28 Pelican Imaging Corporation Array Camera Configurations Incorporating Constituent Array Cameras and Constituent Cameras
US9813617B2 (en) 2013-11-26 2017-11-07 Fotonation Cayman Limited Array camera configurations incorporating constituent array cameras and constituent cameras
US10574905B2 (en) 2014-03-07 2020-02-25 Fotonation Limited System and methods for depth regularization and semiautomatic interactive matting using RGB-D images
US10089740B2 (en) 2014-03-07 2018-10-02 Fotonation Limited System and methods for depth regularization and semiautomatic interactive matting using RGB-D images
US20170111589A1 (en) * 2014-04-23 2017-04-20 Samsung Electronics Co., Ltd. Image pickup apparatus including lens elements having different diameters
US10122932B2 (en) * 2014-04-23 2018-11-06 Samsung Electronics Co., Ltd. Image pickup apparatus including lens elements having different diameters
US10939043B2 (en) 2014-04-23 2021-03-02 Samsung Electronics Co., Ltd. Image pickup apparatus including lens elements having different diameters
US10571665B2 (en) 2014-08-10 2020-02-25 Corephotonics Ltd. Zoom dual-aperture camera with folded lens
US10509209B2 (en) 2014-08-10 2019-12-17 Corephotonics Ltd. Zoom dual-aperture camera with folded lens
US11543633B2 (en) 2014-08-10 2023-01-03 Corephotonics Ltd. Zoom dual-aperture camera with folded lens
US10976527B2 (en) 2014-08-10 2021-04-13 Corephotonics Ltd. Zoom dual-aperture camera with folded lens
US11703668B2 (en) 2014-08-10 2023-07-18 Corephotonics Ltd. Zoom dual-aperture camera with folded lens
US11002947B2 (en) 2014-08-10 2021-05-11 Corephotonics Ltd. Zoom dual-aperture camera with folded lens
US10156706B2 (en) 2014-08-10 2018-12-18 Corephotonics Ltd. Zoom dual-aperture camera with folded lens
US11262559B2 (en) 2014-08-10 2022-03-01 Corephotonics Ltd Zoom dual-aperture camera with folded lens
US11042011B2 (en) 2014-08-10 2021-06-22 Corephotonics Ltd. Zoom dual-aperture camera with folded lens
US10250871B2 (en) 2014-09-29 2019-04-02 Fotonation Limited Systems and methods for dynamic calibration of array cameras
US11546576B2 (en) 2014-09-29 2023-01-03 Adeia Imaging Llc Systems and methods for dynamic calibration of array cameras
US9319585B1 (en) 2014-12-18 2016-04-19 Omnivision Technologies, Inc. High resolution array camera
CN105721841A (en) * 2014-12-18 2016-06-29 全视科技有限公司 High resolution array camera
US11125975B2 (en) 2015-01-03 2021-09-21 Corephotonics Ltd. Miniature telephoto lens module and a camera utilizing such a lens module
US10288840B2 (en) 2015-01-03 2019-05-14 Corephotonics Ltd Miniature telephoto lens module and a camera utilizing such a lens module
US10931877B2 (en) 2015-02-13 2021-02-23 Apple Inc. Dual camera magnet arrangement
US10516826B2 (en) 2015-02-13 2019-12-24 Apple Inc. Dual camera magnet arrangement
US11381747B2 (en) 2015-02-13 2022-07-05 Apple Inc. Dual camera magnet arrangement
US10288897B2 (en) 2015-04-02 2019-05-14 Corephotonics Ltd. Dual voice coil motor structure in a dual-optical module camera
US10558058B2 (en) 2015-04-02 2020-02-11 Corephontonics Ltd. Dual voice coil motor structure in a dual-optical module camera
US10656396B1 (en) 2015-04-16 2020-05-19 Corephotonics Ltd. Auto focus and optical image stabilization in a compact folded camera
US10459205B2 (en) 2015-04-16 2019-10-29 Corephotonics Ltd Auto focus and optical image stabilization in a compact folded camera
US10613303B2 (en) 2015-04-16 2020-04-07 Corephotonics Ltd. Auto focus and optical image stabilization in a compact folded camera
US10962746B2 (en) 2015-04-16 2021-03-30 Corephotonics Ltd. Auto focus and optical image stabilization in a compact folded camera
US11808925B2 (en) 2015-04-16 2023-11-07 Corephotonics Ltd. Auto focus and optical image stabilization in a compact folded camera
US10571666B2 (en) 2015-04-16 2020-02-25 Corephotonics Ltd. Auto focus and optical image stabilization in a compact folded camera
US10371928B2 (en) 2015-04-16 2019-08-06 Corephotonics Ltd Auto focus and optical image stabilization in a compact folded camera
US9942474B2 (en) 2015-04-17 2018-04-10 Fotonation Cayman Limited Systems and methods for performing high speed video capture and depth estimation using array cameras
US10670879B2 (en) 2015-05-28 2020-06-02 Corephotonics Ltd. Bi-directional stiffness for optical image stabilization in a dual-aperture digital camera
US10379371B2 (en) 2015-05-28 2019-08-13 Corephotonics Ltd Bi-directional stiffness for optical image stabilization in a dual-aperture digital camera
US10567666B2 (en) 2015-08-13 2020-02-18 Corephotonics Ltd. Dual aperture zoom camera with video support and switching / non-switching dynamic control
US11770616B2 (en) 2015-08-13 2023-09-26 Corephotonics Ltd. Dual aperture zoom camera with video support and switching / non-switching dynamic control
US10917576B2 (en) 2015-08-13 2021-02-09 Corephotonics Ltd. Dual aperture zoom camera with video support and switching / non-switching dynamic control
US11350038B2 (en) 2015-08-13 2022-05-31 Corephotonics Ltd. Dual aperture zoom camera with video support and switching / non-switching dynamic control
US10230898B2 (en) 2015-08-13 2019-03-12 Corephotonics Ltd. Dual aperture zoom camera with video support and switching / non-switching dynamic control
US11546518B2 (en) 2015-08-13 2023-01-03 Corephotonics Ltd. Dual aperture zoom camera with video support and switching / non-switching dynamic control
US10356332B2 (en) 2015-08-13 2019-07-16 Corephotonics Ltd. Dual aperture zoom camera with video support and switching / non-switching dynamic control
US10498961B2 (en) 2015-09-06 2019-12-03 Corephotonics Ltd. Auto focus and optical image stabilization with roll compensation in a compact folded camera
US10284780B2 (en) 2015-09-06 2019-05-07 Corephotonics Ltd. Auto focus and optical image stabilization with roll compensation in a compact folded camera
US10750096B2 (en) 2015-09-30 2020-08-18 Apple Inc. Mobile zoom using multiple optical image stabilization cameras
US11722774B2 (en) 2015-09-30 2023-08-08 Apple Inc. Mobile zoom using multiple optical image stabilization cameras
US10382698B2 (en) 2015-09-30 2019-08-13 Apple Inc. Mobile zoom using multiple optical image stabilization cameras
US11102416B2 (en) 2015-09-30 2021-08-24 Apple Inc. Mobile zoom using multiple optical image stabilization cameras
US10063783B2 (en) * 2015-09-30 2018-08-28 Apple Inc. Mobile zoom using multiple optical image stabilization cameras
WO2017068456A1 (en) * 2015-10-19 2017-04-27 Corephotonics Ltd. Dual-aperture zoom digital camera user interface
CN108353118A (en) * 2015-12-29 2018-07-31 核心光电有限公司 Based on Dual-Aperture zoom digital camera with automatic adjustable focal length visual field
US10578948B2 (en) 2015-12-29 2020-03-03 Corephotonics Ltd. Dual-aperture zoom digital camera with automatic adjustable tele field of view
US10935870B2 (en) 2015-12-29 2021-03-02 Corephotonics Ltd. Dual-aperture zoom digital camera with automatic adjustable tele field of view
US11314146B2 (en) 2015-12-29 2022-04-26 Corephotonics Ltd. Dual-aperture zoom digital camera with automatic adjustable tele field of view
US11392009B2 (en) 2015-12-29 2022-07-19 Corephotonics Ltd. Dual-aperture zoom digital camera with automatic adjustable tele field of view
US11726388B2 (en) 2015-12-29 2023-08-15 Corephotonics Ltd. Dual-aperture zoom digital camera with automatic adjustable tele field of view
WO2017115179A1 (en) * 2015-12-29 2017-07-06 Corephotonics Ltd. Dual-aperture zoom digital camera with automatic adjustable tele field of view
US11599007B2 (en) 2015-12-29 2023-03-07 Corephotonics Ltd. Dual-aperture zoom digital camera with automatic adjustable tele field of view
US10194089B2 (en) 2016-02-08 2019-01-29 Qualcomm Incorporated Systems and methods for implementing seamless zoom function using multiple cameras
US10539763B2 (en) 2016-03-31 2020-01-21 Sony Corporation Optical system, electronic device, camera, method and computer program
CN107272149A (en) * 2016-03-31 2017-10-20 索尼公司 Optical system, electronic equipment, camera, method and computer program
EP3226055A1 (en) * 2016-03-31 2017-10-04 Sony Corporation Optical system, electronic device, camera, method and computer program
US10341543B2 (en) 2016-04-28 2019-07-02 Qualcomm Incorporated Parallax mask fusion of color and mono images for macrophotography
US10362205B2 (en) 2016-04-28 2019-07-23 Qualcomm Incorporated Performing intensity equalization with respect to mono and color images
US11650400B2 (en) 2016-05-30 2023-05-16 Corephotonics Ltd. Rotational ball-guided voice coil motor
US10488631B2 (en) 2016-05-30 2019-11-26 Corephotonics Ltd. Rotational ball-guided voice coil motor
US10616484B2 (en) 2016-06-19 2020-04-07 Corephotonics Ltd. Frame syncrhonization in a dual-aperture camera system
US11689803B2 (en) 2016-06-19 2023-06-27 Corephotonics Ltd. Frame synchronization in a dual-aperture camera system
US11172127B2 (en) 2016-06-19 2021-11-09 Corephotonics Ltd. Frame synchronization in a dual-aperture camera system
US11048915B2 (en) * 2016-06-29 2021-06-29 Safran Identity & Security Method and a device for detecting fraud by examination using two different focal lengths during automatic face recognition
US10845565B2 (en) 2016-07-07 2020-11-24 Corephotonics Ltd. Linear ball guided voice coil motor for folded optic
US10706518B2 (en) 2016-07-07 2020-07-07 Corephotonics Ltd. Dual camera system with improved video smooth transition by image blending
US11048060B2 (en) 2016-07-07 2021-06-29 Corephotonics Ltd. Linear ball guided voice coil motor for folded optic
US11550119B2 (en) 2016-07-07 2023-01-10 Corephotonics Ltd. Linear ball guided voice coil motor for folded optic
US10290111B2 (en) 2016-07-26 2019-05-14 Qualcomm Incorporated Systems and methods for compositing images
US10642271B1 (en) * 2016-08-26 2020-05-05 Amazon Technologies, Inc. Vehicle guidance camera with zoom lens
CN109644258A (en) * 2016-08-31 2019-04-16 华为技术有限公司 Multicamera system for zoom shot
US10616493B2 (en) * 2016-08-31 2020-04-07 Huawei Technologies Co., Ltd. Multi camera system for zoom
US11790481B2 (en) 2016-09-30 2023-10-17 Qualcomm Incorporated Systems and methods for fusing images
US10297034B2 (en) 2016-09-30 2019-05-21 Qualcomm Incorporated Systems and methods for fusing images
US10827107B2 (en) * 2016-10-28 2020-11-03 Huawei Technologies Co., Ltd. Photographing method for terminal and terminal
US20190253593A1 (en) * 2016-10-28 2019-08-15 Huawei Technologies Co., Ltd. Photographing Method for Terminal and Terminal
US11531209B2 (en) 2016-12-28 2022-12-20 Corephotonics Ltd. Folded camera structure with an extended light-folding-element scanning range
US11693297B2 (en) 2017-01-12 2023-07-04 Corephotonics Ltd. Compact folded camera
US10884321B2 (en) 2017-01-12 2021-01-05 Corephotonics Ltd. Compact folded camera
US11809065B2 (en) 2017-01-12 2023-11-07 Corephotonics Ltd. Compact folded camera
US11815790B2 (en) 2017-01-12 2023-11-14 Corephotonics Ltd. Compact folded camera
US10670827B2 (en) 2017-02-23 2020-06-02 Corephotonics Ltd. Folded camera lens designs
US10571644B2 (en) 2017-02-23 2020-02-25 Corephotonics Ltd. Folded camera lens designs
US10534153B2 (en) 2017-02-23 2020-01-14 Corephotonics Ltd. Folded camera lens designs
US11671711B2 (en) 2017-03-15 2023-06-06 Corephotonics Ltd. Imaging system with panoramic scanning range
US10645286B2 (en) 2017-03-15 2020-05-05 Corephotonics Ltd. Camera with panoramic scanning range
US10818026B2 (en) 2017-08-21 2020-10-27 Fotonation Limited Systems and methods for hybrid depth regularization
US10482618B2 (en) 2017-08-21 2019-11-19 Fotonation Limited Systems and methods for hybrid depth regularization
US11562498B2 (en) 2017-08-21 2023-01-24 Adela Imaging LLC Systems and methods for hybrid depth regularization
US20190068881A1 (en) * 2017-08-24 2019-02-28 Samsung Electronics Co., Ltd. Mobile device including multiple cameras
US10681273B2 (en) * 2017-08-24 2020-06-09 Samsung Electronics Co., Ltd. Mobile device including multiple cameras
US10951822B2 (en) 2017-08-24 2021-03-16 Samsung Electronics Co., Ltd. Mobile device including multiple cameras
US10904512B2 (en) 2017-09-06 2021-01-26 Corephotonics Ltd. Combined stereoscopic and phase detection depth mapping in a dual aperture camera
US10951834B2 (en) 2017-10-03 2021-03-16 Corephotonics Ltd. Synthetically enlarged camera aperture
US11695896B2 (en) 2017-10-03 2023-07-04 Corephotonics Ltd. Synthetically enlarged camera aperture
US11619864B2 (en) 2017-11-23 2023-04-04 Corephotonics Ltd. Compact folded camera structure
US11333955B2 (en) 2017-11-23 2022-05-17 Corephotonics Ltd. Compact folded camera structure
US11809066B2 (en) 2017-11-23 2023-11-07 Corephotonics Ltd. Compact folded camera structure
US10607315B2 (en) 2018-01-09 2020-03-31 Immervision, Inc. Constant resolution continuous hybrid zoom system
EP3738096A4 (en) * 2018-01-09 2020-12-16 Immervision Inc. Constant resolution continuous hybrid zoom system
KR20200140791A (en) * 2018-01-09 2020-12-16 임머비젼, 인코퍼레이티드 Constant resolution continuous hybrid zoom system
US11734793B2 (en) 2018-01-09 2023-08-22 Immervision, Inc. Constant resolution continuous hybrid zoom system
WO2019138342A1 (en) 2018-01-09 2019-07-18 6115187 Canada, Inc. d/b/a Immervision, Inc. Constant resolution continuous hybrid zoom system
KR102376679B1 (en) 2018-01-09 2022-03-21 임머비젼, 인코퍼레이티드 Continuous hybrid zoom system with constant resolution
US11189011B2 (en) 2018-01-09 2021-11-30 Immervision, Inc. Constant resolution continuous hybrid zoom system
JP2021509800A (en) * 2018-01-09 2021-04-01 イマーヴィジョン インコーポレイテッドＩｍｍｅｒｖｉｓｉｏｎ Ｉｎｃ． Continuous hybrid zoom system with constant resolution
US10976567B2 (en) 2018-02-05 2021-04-13 Corephotonics Ltd. Reduced height penalty for folded camera
US11686952B2 (en) 2018-02-05 2023-06-27 Corephotonics Ltd. Reduced height penalty for folded camera
US11640047B2 (en) 2018-02-12 2023-05-02 Corephotonics Ltd. Folded camera with optical image stabilization
WO2019160237A1 (en) * 2018-02-14 2019-08-22 Samsung Electronics Co., Ltd. Electronic device and method for controlling display of images
US10911687B2 (en) 2018-02-14 2021-02-02 Samsung Electronics Co., Ltd. Electronic device and method for controlling display of images
US10911740B2 (en) 2018-04-22 2021-02-02 Corephotonics Ltd. System and method for mitigating or preventing eye damage from structured light IR/NIR projector systems
US10694168B2 (en) 2018-04-22 2020-06-23 Corephotonics Ltd. System and method for mitigating or preventing eye damage from structured light IR/NIR projector systems
US11359937B2 (en) 2018-04-23 2022-06-14 Corephotonics Ltd. Optical-path folding-element with an extended two degree of freedom rotation range
US11268830B2 (en) 2018-04-23 2022-03-08 Corephotonics Ltd Optical-path folding-element with an extended two degree of freedom rotation range
US11867535B2 (en) 2018-04-23 2024-01-09 Corephotonics Ltd. Optical-path folding-element with an extended two degree of freedom rotation range
US11733064B1 (en) 2018-04-23 2023-08-22 Corephotonics Ltd. Optical-path folding-element with an extended two degree of freedom rotation range
US11268829B2 (en) 2018-04-23 2022-03-08 Corephotonics Ltd Optical-path folding-element with an extended two degree of freedom rotation range
US11140327B2 (en) * 2018-06-28 2021-10-05 Aver Information Inc. Image-capturing device and method for operating image-capturing system of two cameras
US20200007777A1 (en) * 2018-06-28 2020-01-02 Aver Information Inc. Image-capturing device and method for operating image-capturing system
US11363180B2 (en) 2018-08-04 2022-06-14 Corephotonics Ltd. Switchable continuous display information system above camera
US11635596B2 (en) 2018-08-22 2023-04-25 Corephotonics Ltd. Two-state zoom folded camera
US11852790B2 (en) 2018-08-22 2023-12-26 Corephotonics Ltd. Two-state zoom folded camera
US20200137380A1 (en) * 2018-10-31 2020-04-30 Intel Corporation Multi-plane display image synthesis mechanism
US20200145579A1 (en) * 2018-11-01 2020-05-07 Korea Advanced Institute Of Science And Technology Image processing apparatus and method using video signal of planar coordinate system and spherical coordinate system
US10805534B2 (en) * 2018-11-01 2020-10-13 Korea Advanced Institute Of Science And Technology Image processing apparatus and method using video signal of planar coordinate system and spherical coordinate system
US11287081B2 (en) 2019-01-07 2022-03-29 Corephotonics Ltd. Rotation mechanism with sliding joint
US11527006B2 (en) 2019-03-09 2022-12-13 Corephotonics Ltd. System and method for dynamic stereoscopic calibration
US11315276B2 (en) 2019-03-09 2022-04-26 Corephotonics Ltd. System and method for dynamic stereoscopic calibration
US11368631B1 (en) 2019-07-31 2022-06-21 Corephotonics Ltd. System and method for creating background blur in camera panning or motion
US11699273B2 (en) 2019-09-17 2023-07-11 Intrinsic Innovation Llc Systems and methods for surface modeling using polarization cues
US11270110B2 (en) 2019-09-17 2022-03-08 Boston Polarimetrics, Inc. Systems and methods for surface modeling using polarization cues
US11525906B2 (en) 2019-10-07 2022-12-13 Intrinsic Innovation Llc Systems and methods for augmentation of sensor systems and imaging systems with polarization
US11659135B2 (en) 2019-10-30 2023-05-23 Corephotonics Ltd. Slow or fast motion video using depth information
US11302012B2 (en) 2019-11-30 2022-04-12 Boston Polarimetrics, Inc. Systems and methods for transparent object segmentation using polarization cues
US11842495B2 (en) 2019-11-30 2023-12-12 Intrinsic Innovation Llc Systems and methods for transparent object segmentation using polarization cues
US11770618B2 (en) 2019-12-09 2023-09-26 Corephotonics Ltd. Systems and methods for obtaining a smart panoramic image
US11949976B2 (en) 2019-12-09 2024-04-02 Corephotonics Ltd. Systems and methods for obtaining a smart panoramic image
US11580667B2 (en) 2020-01-29 2023-02-14 Intrinsic Innovation Llc Systems and methods for characterizing object pose detection and measurement systems
US11797863B2 (en) 2020-01-30 2023-10-24 Intrinsic Innovation Llc Systems and methods for synthesizing data for training statistical models on different imaging modalities including polarized images
US11693064B2 (en) 2020-04-26 2023-07-04 Corephotonics Ltd. Temperature control for Hall bar sensor correction
US11509837B2 (en) 2020-05-12 2022-11-22 Qualcomm Incorporated Camera transition blending
US11832018B2 (en) 2020-05-17 2023-11-28 Corephotonics Ltd. Image stitching in the presence of a full field of view reference image
US20210377428A1 (en) * 2020-05-29 2021-12-02 Maruzen Intec Co., Ltd. Monitor camera
US11770609B2 (en) 2020-05-30 2023-09-26 Corephotonics Ltd. Systems and methods for obtaining a super macro image
WO2022007840A1 (en) * 2020-07-08 2022-01-13 杭州萤石软件有限公司 Image fusion method and device
US11637977B2 (en) 2020-07-15 2023-04-25 Corephotonics Ltd. Image sensors and sensing methods to obtain time-of-flight and phase detection information
US11832008B2 (en) 2020-07-15 2023-11-28 Corephotonics Ltd. Image sensors and sensing methods to obtain time-of-flight and phase detection information
US11910089B2 (en) 2020-07-15 2024-02-20 Corephotonics Lid. Point of view aberrations correction in a scanning folded camera
US11946775B2 (en) 2020-07-31 2024-04-02 Corephotonics Ltd. Hall sensor—magnet geometry for large stroke linear position sensing
US11290658B1 (en) 2021-04-15 2022-03-29 Boston Polarimetrics, Inc. Systems and methods for camera exposure control
US11683594B2 (en) 2021-04-15 2023-06-20 Intrinsic Innovation Llc Systems and methods for camera exposure control
US11954886B2 (en) 2021-04-15 2024-04-09 Intrinsic Innovation Llc Systems and methods for six-degree of freedom pose estimation of deformable objects
US11953700B2 (en) 2021-05-27 2024-04-09 Intrinsic Innovation Llc Multi-aperture polarization optical systems using beam splitters
US11689813B2 (en) 2021-07-01 2023-06-27 Intrinsic Innovation Llc Systems and methods for high dynamic range imaging using crossed polarizers
US11962901B2 (en) 2023-07-02 2024-04-16 Corephotonics Ltd. Systems and methods for obtaining a super macro image

Also Published As

Publication number Publication date
WO2010116368A1 (en) 2010-10-14
WO2010116370A1 (en) 2010-10-14
US8896697B2 (en) 2014-11-25
WO2010116366A1 (en) 2010-10-14
EP2417560A4 (en) 2016-05-18
WO2010116369A1 (en) 2010-10-14
US20120113266A1 (en) 2012-05-10
EP2417560B1 (en) 2017-11-29
US20120019660A1 (en) 2012-01-26
EP2417560A1 (en) 2012-02-15
WO2010116367A1 (en) 2010-10-14

Similar Documents

Publication Publication Date Title
US20120026366A1 (en) Continuous electronic zoom for an imaging system with multiple imaging devices having different fixed fov
KR101634516B1 (en) Dual aperture zoom digital camera
JP5705270B2 (en) IMAGING DEVICE, IMAGING SYSTEM, IMAGING DEVICE CONTROL METHOD, PROGRAM, AND STORAGE MEDIUM
EP2382792B1 (en) Imaging apparatus, image correction method, and computer-readable recording medium
US7453510B2 (en) Imaging device
KR20180013979A (en) Dual-aperture zoom camera with video support and switching / non-switching dynamic control
JP6436783B2 (en) Image processing apparatus, imaging apparatus, image processing method, program, and storage medium
US9258545B2 (en) Stereoscopic imaging apparatus
US20110234767A1 (en) Stereoscopic imaging apparatus
JP6047025B2 (en) Imaging apparatus and control method thereof
US11457152B2 (en) Device for imaging partial fields of view, multi-aperture imaging device and method of providing same
US20120050580A1 (en) Imaging apparatus, imaging method, and program
US9407813B2 (en) Image capturing apparatus, control method of image capturing apparatus, and image capturing system
JP2012124555A (en) Imaging apparatus
JP2014039096A (en) Multi-eye camera photographing system and control method of the same
JP2020088403A (en) Image processing apparatus, control method therefor and program
JP4908350B2 (en) Image processing method and imaging apparatus using the image processing method
JP2016057546A (en) Imaging device and control method for the same
JP2014215436A (en) Image-capturing device, and control method and control program therefor
US20100103276A1 (en) Split aperture capture of rangemap for 3d imaging
EP3497928B1 (en) Multi camera system for zoom
JP6370004B2 (en) Imaging apparatus and imaging method
JP2004191651A (en) Imaging apparatus
JP6282240B2 (en) IMAGING DEVICE, IMAGING SYSTEM, IMAGING DEVICE CONTROL METHOD, PROGRAM, AND STORAGE MEDIUM
JP2024002631A (en) Image processing device, imaging device, image processing method, computer program and recording medium

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION