[go: up one dir, main page]

WO2018124267A1 - Appareil de traitement d'images, système de capture d'images, procédé de traitement d'images, et support d'enregistrement - Google Patents

Appareil de traitement d'images, système de capture d'images, procédé de traitement d'images, et support d'enregistrement Download PDF

Info

Publication number
WO2018124267A1
WO2018124267A1 PCT/JP2017/047191 JP2017047191W WO2018124267A1 WO 2018124267 A1 WO2018124267 A1 WO 2018124267A1 JP 2017047191 W JP2017047191 W JP 2017047191W WO 2018124267 A1 WO2018124267 A1 WO 2018124267A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
superimposed
projection
area
capturing device
Prior art date
Application number
PCT/JP2017/047191
Other languages
English (en)
Inventor
Keiichi Kawaguchi
Takahiro Asai
Hiroshi SUITOH
Kazuhiro Yoshida
Original Assignee
Ricoh Company, Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2017245506A external-priority patent/JP2019057903A/ja
Application filed by Ricoh Company, Ltd. filed Critical Ricoh Company, Ltd.
Priority to CN201780080785.XA priority Critical patent/CN110114797A/zh
Priority to US16/474,443 priority patent/US11393070B2/en
Priority to EP17840542.9A priority patent/EP3563336A1/fr
Publication of WO2018124267A1 publication Critical patent/WO2018124267A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/90—Dynamic range modification of images or parts thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging

Definitions

  • FIG. 13 is a schematic block diagram illustrating a hardware configuration of a smart phone, according to the first embodiment.
  • FIG. 14 is a functional block diagram of the image capturing system according to the first embodiment.
  • FIGs. 15A and 15B are conceptual diagrams respectively illustrating a linked image capturing device management table, and a linked image capturing device configuration screen, according to the first embodiment.
  • FIG. 16 is a block diagram illustrating a functional configuration of an image and audio processing unit according to the first embodiment.
  • FIG. 17 is an illustration of a data structure of superimposed display metadata according to the first embodiment.
  • FIGs. 18A and 18B are conceptual diagrams respectively illustrating a plurality of grid areas in a second area, and a plurality of grid areas in a third area, according to the first embodiment.
  • FIGS. 29A and 29B are conceptual diagrams illustrating a two-dimensional view of the spherical image superimposed with the planar image, using the location parameter, in the first embodiment.
  • FIGs. 30A, 30B, 30C, and 30D are illustrations of a wide-angle image without superimposed display, a telephoto image without superimposed display, a wide-angle image with superimposed display, and a telephoto image with superimposed display, according to the first embodiment.
  • FIG. 31 is a schematic view illustrating an image capturing system according to a second embodiment.
  • FIG. 32 is a schematic diagram illustrating a hardware configuration of an image processing server according to the second embodiment.
  • FIG. 33 is a schematic block diagram illustrating a functional configuration of the image capturing system of FIG. 31 according to the second embodiment.
  • FIG. 34 is a block diagram illustrating a functional configuration of an image and audio processing unit according to the second embodiment.
  • FIG. 35 is a data sequence diagram illustrating operation of capturing the image, performed by the image
  • the predetermined-area image Q which is an image of the predetermined area T illustrated in FIG. 6A, is displayed on a display as an image of an imaging area of the virtual camera IC, as illustrated in FIG. 6B.
  • FIG. 6B illustrates the predetermined-area image Q represented by the predetermined-area information that is set by default. The following explains the position of the virtual camera IC, using an imaging direction (ea, aa) and an angle of view ⁇ of the virtual camera IC.
  • FIG. 7 is a view illustrating a relation between the predetermined-area information and the image of the predetermined area T.
  • ea denotes an elevation angle
  • aa denotes an azimuth angle
  • ⁇ denotes an angle of view, respectively, of the virtual camera IC.
  • the position of the virtual camera IC is adjusted, such that the point of gaze of the virtual camera IC, indicated by the imaging direction (ea, aa), matches the central point CP of the predetermined area T as the imaging area of the virtual camera IC.
  • the predetermined-area image Q is an image of the predetermined area T, in the spherical image CE.
  • f denotes a distance from the virtual camera IC to the central point CP of the predetermined area T.
  • L denotes a distance between the central point CP and a given vertex of the predetermined area T (2L is a diagonal line).
  • FIG. 8 is a schematic diagram illustrating a configuration of the image capturing system according to the embodiment.
  • the smart phone 5 may communicate with the special image capturing device 1 and the generic image capturing device 3, without using the near-distance wireless communication, but using wired communication such as a cable.
  • the smart phone 5 is an example of an image processing apparatus capable of processing images being captured. Other examples of the image processing apparatus include, but not limited to, a tablet personal computer (PC), a note PC, and a desktop PC.
  • the smart phone 5 may operate as a communication terminal described below.
  • the microphone 108 converts sounds to audio data (signal).
  • the audio processor 109 acquires the audio data output from the microphone 108 via an I/F bus and performs predetermined processing on the audio data.
  • the network I/F 116 collectively refers to an interface circuit such as a USB I/F that allows the special image capturing device 1 to communicate data with an external medium such as an SD card or an external personal computer.
  • the network I/F 116 supports at least one of wired and wireless communications.
  • the data of the equirectangular projection image, which is stored in the DRAM 114, is stored in the external medium via the network I/F 116 or transmitted to the external device such as the smart phone 5 via the network I/F 116, at any desired time.
  • the communication circuit 117 communicates data with the external device such as the smart phone 5 via the antenna 117a of the special image capturing device 1 by near-distance wireless communication such as Wi-Fi, NFC, and Bluetooth.
  • the communication circuit 117 is also capable of transmitting the data of equirectangular projection image to the external device such as the smart phone 5.
  • the determiner 37 which is implemented by instructions of the CPU 311, performs various determinations. For example, the determiner 37 determines whether the shutter button 315a has been pressed by the user.
  • the storing and reading unit 39 which is implemented by instructions of the CPU 311 illustrated in FIG. 12, stores various data or information in the memory 3000 or reads out various data or information from the memory 3000.
  • the image generator 586 superimposes (maps) the planar image P (or the corrected image C of the planar image P), on the partial sphere PS to generate an image to be superimposed on the spherical image CE, which is referred to as a superimposed image S for simplicity.
  • the image generator 586 generates mask data M, based on a surface area of the partial sphere PS.
  • the image generator 586 covers (attaches) the equirectangular projection image EC, over the sphere CS, to generate the spherical image CE.
  • the near-distance communication unit 38 of the generic image capturing device 3 transmits planar image data, obtained at S15, to the smart phone 5 (S19). With the planar image data, the image identifier for identifying the planar image data, and attribute data, are transmitted. The image identifier and attribute data of the planar image, are a part of planar image information illustrated in FIG. 17.
  • the near-distance communication unit 58 of the smart phone 5 receives the planar image data, the image identifier, and the attribute data.
  • FIG. 32 is a schematic block diagram illustrating a hardware configuration of the image processing server 7, according to the embodiment.
  • the image processing server 7, which is implemented by the general-purpose computer, includes a CPU 701, a ROM 702, a RAM 703, a HD 704, a HDD 705, a medium I/F 707, a display 708, a network I/F 709, a keyboard 711, a mouse 712, a CD-RW drive 714, and a bus line 710. Since the image processing server 7 operates as a server, an input device such as the keyboard 711 and the mouse 712, or an output device such as the display 708 does not have to be provided.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

Appareil de traitement d'images : obtenant une première image dans une première projection, une seconde image dans une seconde projection, et des informations d'emplacement indiquant des emplacements d'une pluralité de points dans la première image qui sont respectivement associés à une pluralité de points dans la seconde image; générant, en tant qu'image à superposer sur la première image, une image superposée sur la base de la seconde image, l'image superposée ayant la pluralité de points dans la seconde image à des emplacements respectifs comme indiqué par les informations d'emplacement; et superposant l'image superposée sur la première image.
PCT/JP2017/047191 2016-12-28 2017-12-28 Appareil de traitement d'images, système de capture d'images, procédé de traitement d'images, et support d'enregistrement WO2018124267A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN201780080785.XA CN110114797A (zh) 2016-12-28 2017-12-28 图像处理设备，图像捕获系统，图像处理方法和记录介质
US16/474,443 US11393070B2 (en) 2016-12-28 2017-12-28 Image processing apparatus, image capturing system, image processing method, and recording medium
EP17840542.9A EP3563336A1 (fr) 2016-12-28 2017-12-28 Appareil de traitement d'images, système de capture d'images, procédé de traitement d'images, et support d'enregistrement

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
JP2016256583 2016-12-28
JP2016-256583 2016-12-28
JP2017191385 2017-09-29
JP2017-191385 2017-09-29
JP2017245506A JP2019057903A (ja) 2016-12-28 2017-12-21 画像処理装置、撮影システム、画像処理方法、及びプログラム
JP2017-245506 2017-12-21

Publications (1)

Publication Number Publication Date
WO2018124267A1 true WO2018124267A1 (fr) 2018-07-05

Family

ID=61189498

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/047191 WO2018124267A1 (fr) 2016-12-28 2017-12-28 Appareil de traitement d'images, système de capture d'images, procédé de traitement d'images, et support d'enregistrement

Country Status (1)

Country Link
WO (1) WO2018124267A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110111265A (zh) * 2019-04-04 2019-08-09 深圳市华星光电技术有限公司 叠加图形的校正方法及叠加图形的校正装置
EP3712839A1 (fr) * 2019-03-20 2020-09-23 Ricoh Company, Ltd. Dispositif de capture d'image, système de capture d'image, procédé de traitement d'image et moyens de support
JP2020162118A (ja) * 2019-03-20 2020-10-01 株式会社リコー 撮影装置、撮影システム、画像処理方法、及びプログラム
CN113055601A (zh) * 2021-03-30 2021-06-29 Oppo广东移动通信有限公司 双目拍摄矫正方法、双目拍摄矫正装置和电子设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130271499A1 (en) * 2012-04-15 2013-10-17 Trimble Navigation Limited Identifying a point of interest from different stations
JP2016096487A (ja) 2014-11-17 2016-05-26 株式会社クワンズ 撮影システム
US20160234438A1 (en) * 2015-02-06 2016-08-11 Tetsuya Satoh Image processing system, image generation apparatus, and image generation method
JP2017178135A (ja) 2016-03-31 2017-10-05 豊田合成株式会社 ステアリングホイール及びステアリングホイールの製造方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130271499A1 (en) * 2012-04-15 2013-10-17 Trimble Navigation Limited Identifying a point of interest from different stations
JP2016096487A (ja) 2014-11-17 2016-05-26 株式会社クワンズ 撮影システム
US20160234438A1 (en) * 2015-02-06 2016-08-11 Tetsuya Satoh Image processing system, image generation apparatus, and image generation method
JP2017178135A (ja) 2016-03-31 2017-10-05 豊田合成株式会社 ステアリングホイール及びステアリングホイールの製造方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"ECCV 2002 conference", vol. 2353, 2002, SPRINGER INTERNATIONAL PUBLISHING, Cham, ISBN: 978-3-642-33485-6, ISSN: 0302-9743, article FADI DORNAIKA ET AL: "Image Registration for Foveated Omnidirectional Sensing", pages: 606 - 620, XP055456994, 032548, DOI: 10.1007/3-540-47979-1_41 *

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3712839A1 (fr) * 2019-03-20 2020-09-23 Ricoh Company, Ltd. Dispositif de capture d'image, système de capture d'image, procédé de traitement d'image et moyens de support
CN111726520A (zh) * 2019-03-20 2020-09-29 株式会社理光 摄影装置、摄影系统、图像处理方法
JP2020162118A (ja) * 2019-03-20 2020-10-01 株式会社リコー 撮影装置、撮影システム、画像処理方法、及びプログラム
US10939068B2 (en) 2019-03-20 2021-03-02 Ricoh Company, Ltd. Image capturing device, image capturing system, image processing method, and recording medium
US11310459B2 (en) 2019-03-20 2022-04-19 Ricoh Company, Ltd. Image capturing device, image capturing system, image processing method, and recording medium
JP7484237B2 (ja) 2019-03-20 2024-05-16 株式会社リコー 撮影装置、撮影システム、画像処理方法、及びプログラム
CN110111265A (zh) * 2019-04-04 2019-08-09 深圳市华星光电技术有限公司 叠加图形的校正方法及叠加图形的校正装置
CN110111265B (zh) * 2019-04-04 2021-08-06 Tcl华星光电技术有限公司 叠加图形的校正方法及叠加图形的校正装置
CN113055601A (zh) * 2021-03-30 2021-06-29 Oppo广东移动通信有限公司 双目拍摄矫正方法、双目拍摄矫正装置和电子设备

Similar Documents

Publication Publication Date Title
US11393070B2 (en) Image processing apparatus, image capturing system, image processing method, and recording medium
US10593014B2 (en) Image processing apparatus, image processing system, image capturing system, image processing method
US10789671B2 (en) Apparatus, system, and method of controlling display, and recording medium
US10681271B2 (en) Image processing apparatus, image capturing system, image processing method, and recording medium
US20190340737A1 (en) Image processing apparatus, image processing system, image capturing system, image processing method, and recording medium
US10937134B2 (en) Image processing apparatus, image capturing system, image processing method, and recording medium
US10855916B2 (en) Image processing apparatus, image capturing system, image processing method, and recording medium
US10638039B2 (en) Apparatus, system, and method of controlling image capturing, and recording medium
US20200236277A1 (en) Image processing apparatus, image capturing system, image processing method, and recording medium
US20190306420A1 (en) Image processing apparatus, image capturing system, image processing method, and recording medium
US20190289206A1 (en) Image processing apparatus, image capturing system, image processing method, and recording medium
US20190391778A1 (en) Apparatus, system, and method for controlling display, and recording medium
US10939068B2 (en) Image capturing device, image capturing system, image processing method, and recording medium
JP2019164782A (ja) 画像処理装置、撮影システム、画像処理方法、及びプログラム
WO2018124267A1 (fr) Appareil de traitement d'images, système de capture d'images, procédé de traitement d'images, et support d'enregistrement
JP2019185757A (ja) 画像処理装置、撮影システム、画像処理方法、及びプログラム
JP2018110384A (ja) 画像処理装置、撮影システム、画像処理方法、及びプログラム
US11250540B2 (en) Image processing apparatus, image capturing system, image processing method, and recording medium
JP2018157538A (ja) プログラム、撮像システム、情報処理装置
WO2018124266A1 (fr) Appareil de traitement d'images, système de capture d'images, procédé de traitement d'images, et support d'enregistrement
JP2019164783A (ja) 画像処理装置、撮影システム、画像処理方法、及びプログラム
JP2018109971A (ja) 画像処理装置、画像処理システム、撮影システム、画像処理方法、及びプログラム
JP2019087984A (ja) 情報処理装置、撮像システム、プログラム
WO2018124268A1 (fr) Appareil de traitement d'images, système de traitement d'images, système de capture d'images, procédé de traitement d'images et support d'enregistrement
JP2018110385A (ja) 通信端末、撮影システム、画像処理方法、及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17840542

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2017840542

Country of ref document: EP

Effective date: 20190729