JP2014003574A - Image pick-up device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To simultaneously confirm a relative positional relationship between imaging ranges before and after zooming in and a state of a subject after zooming in.
An imaging apparatus adjusts a shooting magnification of a zoom lens according to an imaging unit that captures an image of a subject via a zoom lens, an operation unit that receives a user operation, and a zoom operation that zooms the zoom lens. A zoom control unit, a detection unit that detects a change in the imaging range of the imaging unit, and a display control unit that outputs an image to be displayed on the display device. The imaging unit acquires the first image at the start of zooming in, and acquires the second image after zooming in. In addition, the display control unit generates a guide image in which a display indicating the imaging range after zooming in is superimposed on the first image. Then, the display control unit causes the display device to display the third image in which the guide image is superimposed on a partial region of the second image.
[Selection] Figure 1

Description

  The present invention relates to an imaging apparatus.

  2. Description of the Related Art Conventionally, techniques for displaying various compositions on one screen have been proposed for imaging devices such as electronic cameras.

JP 2007-180664 A

  By the way, when zooming in on a subject with an imaging device, the angle of view gradually becomes narrower, so it is relatively difficult to fit the main subject in a frame on the telephoto side. In addition, for example, when shooting while confirming the position of the main subject by repeating zoom-out and zoom-in, there is a high possibility of missing a photo opportunity.

  An imaging apparatus that is an example of the present invention includes an imaging unit that captures an image of a subject via a zoom lens, an operation unit that receives a user operation, and a zoom magnification of the zoom lens according to a zoom operation that zooms the zoom lens. A zoom control unit that adjusts the image, a detection unit that detects a change in the imaging range of the imaging unit, and a display control unit that outputs an image to be displayed on the display device. The imaging unit acquires the first image at the start of zooming in, and acquires the second image after zooming in. In addition, the display control unit generates a guide image in which a display indicating the imaging range after zooming in is superimposed on the first image. Then, the display control unit causes the display device to display the third image in which the guide image is superimposed on a partial region of the second image.

  According to the present invention, the relative positional relationship between the imaging ranges before and after zooming in and the state of the subject after zooming in can be confirmed simultaneously.

The figure which shows the structural example of the electronic camera in one Embodiment. The figure which shows the example of arrangement | positioning of a 1st zoom switch, a 2nd zoom switch, and a release switch. 6 is a flowchart illustrating an operation example of an electronic camera according to an embodiment. (A)-(f): The figure which shows the example of the change of the through image and guide image by zoom and panning (A): A diagram showing a display example of a guide image before the display switching operation, (b): A diagram showing a display example of the guide image after the display switching operation.

  FIG. 1 is a diagram illustrating a configuration example of an electronic camera according to an embodiment that is an example of an imaging apparatus. The electronic camera of one embodiment has a guide function for displaying a guide image indicating the current imaging range when zooming in. In one embodiment, a configuration example of a lens-integrated electronic camera (compact electronic camera) including a high-power zoom lens will be described.

  The electronic camera 100 includes a zoom lens 101, a lens driver 102, an imaging unit 103, a camera microcomputer 104, an attitude sensor 105, a memory 106, a media I / F 107, a monitor 108, and an operation unit 109. doing. Here, the lens driver 102, the imaging unit 103, the attitude sensor 105, the memory 106, the media I / F 107, the monitor 108, and the operation unit 109 are connected to the camera microcomputer 104, respectively.

  The zoom lens 101 is a lens for adjusting the photographing magnification. The lens position (zoom position) of the zoom lens 101 is adjusted by the lens driver 102 in the optical axis direction. The lens driver 102 includes an encoder 102a that detects a zoom position as an example of a detection unit.

  The imaging unit 103 is a module that captures (captures) an image of a subject formed through the zoom lens 101. For example, the imaging unit 103 includes an imaging element that performs photoelectric conversion, and a signal processing circuit that performs analog signal processing, A / D conversion processing, and the like on the output of the imaging element.

  Further, in the shooting mode of the electronic camera, the imaging unit 103 captures a recording still image accompanied by recording in the nonvolatile storage medium (115) in response to an imaging instruction by a release switch (123) described later. The imaging unit 103 continuously captures images for observation (through images) at predetermined time intervals in the shooting mode. The through-image data acquired in time series is used for moving image display (live view display) on the monitor 108 and various arithmetic processes by the camera microcomputer 104.

  The camera microcomputer 104 is a processor that comprehensively controls the operation of the electronic camera 100. For example, the camera microcomputer 104 performs image processing such as color interpolation, white balance correction, gradation conversion, and color space conversion on input image data for one frame.

  The camera microcomputer 104 includes a zoom control unit 111, a display control unit 112, an image analysis unit 113, and a recording processing unit 114. The functional blocks of each unit included in the camera microcomputer 104 can be realized by an arbitrary processor, memory, or other LSI in terms of hardware, and can be realized by a program loaded in the memory in terms of software.

  The zoom control unit 111 controls the lens driver 102 according to an input of a zoom switch described later, and adjusts the shooting magnification of the zoom lens 101.

  The display control unit 112 controls image display on the monitor 108. For example, the display control unit 112 displays a through image on the monitor 108 in the shooting mode. The display control unit 112 generates a guide image indicating the imaging range after zooming in when the guide function is on, and causes the monitor 108 to display the guide image together with the through image when zooming in.

  The image analysis unit 113 compares two images captured at different times, and detects an area in the image where the subject has changed.

  The recording processing unit 114 generates an image file by associating additional information such as shooting conditions with the still image data for recording.

  The attitude sensor 105 is an example of a detection unit, and is a sensor that detects a change in the inclination of the optical axis of the zoom lens 101 in the pitching direction (vertical direction) or the yaw direction (horizontal direction). For example, the posture sensor 105 is a known three-axis acceleration sensor that supports measurement of gravitational acceleration (static acceleration).

  The memory 106 temporarily stores image data in the pre-process and post-process of image processing. For example, the memory 106 is an SDRAM that is a volatile storage medium.

  The media I / F 107 has a connector for connecting a nonvolatile storage medium 115. The media I / F 107 executes writing / reading of the image file data with respect to the storage medium 115 connected to the connector. The storage medium 115 is, for example, a hard disk or a memory card incorporating a semiconductor memory. In FIG. 1, a memory card is illustrated as an example of the storage medium 115.

  The monitor 108 is a display device that performs live view display of a through image, reproduction display of a still image, and the like.

  The operation unit 109 receives various operations from the user. For example, the operation unit 109 includes a first zoom switch (first zoom SW) 121, a second zoom switch (second zoom SW) 122, a release switch (release SW) 123, and a guide switch (guide SW) 124.

  The first zoom switch 121 and the second zoom switch 122 are operation members that receive an operation (zoom out) for changing the photographing magnification of the zoom lens 101 to the wide angle side (zoom out) or an operation (zoom in) for changing to the telephoto side. Note that the zoom control unit 111 may move the zoom lens 101 at a different speed when the second zoom switch 122 is operated than when the first zoom switch 121 is operated.

  The release switch 123 is an operation member that receives an instruction to capture a still image for recording. The guide switch 124 is an operation member that switches on / off of the guide function (display of a guide image).

  FIG. 2 is a diagram illustrating an arrangement example of the first zoom switch 121, the second zoom switch 122, and the release switch 123. The first zoom switch 121 and the release switch 123 are disposed on the upper surface of the casing of the electronic camera 100. On the other hand, the second zoom switch 122 is disposed in the lens barrel portion of the electronic camera 100.

  Hereinafter, an operation example of the shooting mode in the electronic camera of one embodiment will be described.

  When the shooting mode of the electronic camera 100 is activated, the camera microcomputer 104 drives the imaging unit 103 to start capturing a through image. Thereafter, the through images are sequentially generated at predetermined intervals. In addition, the camera microcomputer 104 displays the through image as a moving image on the display unit. Therefore, at the time of shooting standby in the shooting mode, the user can perform framing for determining the shooting composition by referring to the through image on the display unit. When framing is performed, the user can freely change the shooting magnification by operating the zoom switch.

  When the guide function is on (when the guide switch 124 is turned on), the camera microcomputer 104 starts the guide function processing shown in the flowchart of FIG. Note that the camera microcomputer 104 may determine that the guide function is on only while the guide switch 124 is being pressed (on operation).

  Step # 101: The camera microcomputer 104 determines whether or not a zoom-in operation has been accepted. If the above requirement is satisfied (YES side), the process proceeds to # 103. On the other hand, if the above requirement is not satisfied (NO side), the process proceeds to # 102.

  Step # 102: The camera microcomputer 104 determines whether or not a guide function OFF operation (off operation of the guide switch 124 or release of pressing of the guide switch 124) has been received. If the above requirement is satisfied (YES side), the camera microcomputer 104 ends the processing of the flowchart of FIG. On the other hand, if the above requirement is not satisfied (NO side), the process returns to # 101 and the camera microcomputer 104 repeats the above processing.

  Step # 103: The camera microcomputer 104 holds the through image captured by the imaging unit 103 at the start of zoom-in (during zoom-in operation) in the memory 106 as a first image.

  Step # 104: The camera microcomputer 104 acquires information on the imaging range corresponding to the first image. Information on the imaging range corresponding to the first image is used by the camera microcomputer 104 when obtaining a change in the imaging range due to zooming, panning, or the like.

  For example, the camera microcomputer 104 in # 104 acquires information on the zoom position at the start of zoom-in from the lens driver 102. In step # 104, the camera microcomputer 104 acquires information about the tilt of the lens optical axis at the start of zoom-in from the attitude sensor 105. Note that information of the imaging range corresponding to the first image is held in the memory 106.

  Step # 105: The zoom control unit 111 increases the photographing magnification by moving the lens position of the zoom lens 101 to the telephoto side by the amount of operation of the zoom switch. A through image captured after zooming in has a smaller imaging range than before zooming in. In the case of looping in the flowchart of FIG. 3, zooming out may be performed in the second and subsequent processes of # 105.

  Step # 106: The display control unit 112 displays a guide image on the monitor 108 together with a through image (second image) newly acquired after zooming. In step # 106, the display control unit 112 causes the monitor 108 to display a guide image having a size smaller than that of the second image on a part of the second image.

  Here, the guide image is generated by the following processes (1) to (3).

  (1) First, the camera microcomputer 104 acquires information on the current imaging range. The camera microcomputer 104 acquires information on the current zoom position from the lens driver 102, and acquires information on the current tilt of the optical axis of the lens from the attitude sensor 105.

  (2) The camera microcomputer 104 compares the information on the imaging range corresponding to the first image held in the memory 106 with the information on the current imaging range (obtained in (1) above), and compares the first image. And the relative positional relationship between the current imaging range. For example, the camera microcomputer 104 can obtain the reduction ratio of the current imaging range for the first image based on the amount of change in the zoom position. In addition, the camera microcomputer 104 can determine the positional deviation of the current imaging range with respect to the first image based on the amount of change in the tilt of the lens optical axis.

  (3) The display control unit 112 generates a guide image by superimposing a display (for example, a rectangular frame) indicating the current imaging range on the first image. When the current imaging range is not within the range of the first image, the display control unit 112 displays a display (for example, an arrow) indicating in which direction the current imaging range is in the guide image instead of the rectangular frame. .

  Here, FIGS. 4A to 4F show examples of changes in the through image and the guide image due to zooming and panning.

  FIG. 4A shows a through image (first image) before zooming in. 4B to 4F show through images on which guide images are superimposed. 4B corresponds to the state zoomed in from FIG. 4A, and FIG. 4C corresponds to the state zoomed in from FIG. 4B. 4D to 4F correspond to the state of panning sequentially without zooming from FIG. 4C.

  When zooming in is started, the display control unit 112 displays a guide image together with the through image on the monitor 108 (FIGS. 4B to 4F). Thereby, the user can confirm the state of the subject after zooming in with the through image while confirming the relative positional relationship of the imaging range before and after zooming in with the guide image.

  In each guide image, a rectangular frame (indicated by a broken line in the figure) indicating the current imaging range is superimposed on the reduced first image. When zooming in, the angle of view becomes narrow, so the size of the rectangular frame on the guide image becomes small (FIGS. 4B and 4C). When panning is performed, the position of the rectangular frame on the guide image shifts (FIGS. 4D and 4E). Note that when panning is further performed in the right direction from the state of FIG. 4E, the current imaging range deviates from the first image, so that an arrow is displayed on the guide image (FIG. 4F). ).

  Step # 107: The camera microcomputer 104 determines whether or not an instruction to capture a still image (for example, full pressing operation of the release switch 123) has been received. If the above requirement is satisfied (YES side), the process proceeds to # 108. On the other hand, if the above requirement is not satisfied (NO side), the process proceeds to # 109.

  Step # 108: The camera microcomputer 104 executes a still image capturing process for recording. The imaging unit 103 captures a recording still image in accordance with an instruction from the camera microcomputer 104. Then, the recording processing unit 114 generates an image file by associating additional information such as shooting conditions with the recording still image data, and records the image file on the storage medium 115 via the media I / F 107. Thereafter, the camera microcomputer 104 ends the process of the flowchart of FIG.

  Here, when a recording still image is captured after zooming in, the recording processing unit 114 adds information related to the guide image (through image (first image) before zooming in and first image) to the supplementary information of the image file. Coordinate information indicating the range of still images for recording).

  The following items can be considered as uses of the information on the guide image. For example, by using the first image as a thumbnail, it is possible to improve the searchability of the image by presenting the situation of the entire scene. In addition, when creating a search screen that links a plurality of still images captured by zooming at different locations of the same first image and links to each still image by designating the corresponding location of the first image, Can be used as search screen material.

  Step # 109: The camera microcomputer 104 determines whether or not the change up to the current imaging range with the first image as a reference exceeds a threshold value. If the above requirement is satisfied (YES side), the process proceeds to # 112. On the other hand, if the above requirement is not satisfied (NO side), the process proceeds to # 110.

  For example, when the zoom position is moved to the telephoto side more than a certain level from the time of acquisition of the first image, and the change in photographing magnification exceeds the threshold value from the start of zooming in, the camera microcomputer 104 in # 109 satisfies the above requirements (YES side) Is determined. This case corresponds to a case where the size of the current imaging range is remarkably reduced on the guide image.

  For example, when the inclination of the lens optical axis changes more than a certain value and exceeds the threshold value from the time of acquisition of the first image, the camera microcomputer 104 in # 109 determines that the above requirement is satisfied (YES side). This case corresponds to a case where the range of the first image and the current imaging range do not match at all due to a change in the orientation of the electronic camera 100.

  Step # 110: The camera microcomputer 104 determines whether or not the zoom operation has been stopped for a certain period. If the above requirement is satisfied (YES side), the process proceeds to # 112. Note that the case of the YES side of # 110 corresponds to a case where, for example, zooming is not performed for a long time, and there is little need to monitor the field of view before zooming. On the other hand, if the above requirement is not satisfied (NO side), the process proceeds to # 111.

  Step # 111: The image analysis unit 113 compares the current through image (second image) with the corresponding area of the first image, and detects an area where the subject has changed. For example, the image analysis unit 113 detects a region where the luminance and color difference between the two images is different as a region where the subject has changed.

  Then, the image analysis unit 113 determines whether or not the ratio of the area where the subject has changed exceeds the threshold value. If the above requirement is satisfied (YES side), the process proceeds to # 112. The case of # 111 on the YES side corresponds to, for example, a case where the current composition has changed significantly compared to when the first image is captured. On the other hand, if the above requirement is not satisfied (NO side), the process proceeds to # 113.

  Step # 112: In these cases, the display control unit 112 stops the superimposed display of the guide image. Thereafter, returning to # 101, the camera microcomputer 104 repeats the above processing.

  Step # 113: The camera microcomputer 104 determines whether or not a guide function off operation (off operation of the guide switch 124 or release of the guide switch 124) has been received.

  When the above requirement is satisfied (YES side), after the display control unit 112 stops the superimposed display of the guide image, the camera microcomputer 104 ends the process of the flowchart of FIG. On the other hand, if the above requirement is not satisfied (NO side), the process proceeds to # 114.

  Step # 114: The camera microcomputer 104 determines whether a display switching operation for changing the sizes of the through image and the guide image has been received from the operation unit 109. If the above requirement is satisfied (YES side), the process proceeds to # 115. On the other hand, if the above requirement is not satisfied (NO side), the process proceeds to # 116.

  Step # 115: The display control unit 112 switches the display areas of the guide image and the through image and causes the monitor 108 to display them. A small through image is superimposed on a part of the guide image and displayed on the monitor 108. This makes it easier for the user to visually recognize the guide image. FIG. 5A is a guide image display example before the display switching operation, and FIG. 5B is a guide image display example after the display switching operation.

  Thereafter, returning to # 105, the camera microcomputer 104 repeats the above operation. Note that the display control unit 112 in one embodiment may restore the guide image and the through image display area after a predetermined time has elapsed from the display switching operation until the display switching operation is performed again. May be maintained.

  Step # 116: The camera microcomputer 104 determines whether or not a guide image update operation has been accepted. If the above requirement is satisfied (YES side), the process proceeds to # 117. On the other hand, if the above requirement is not satisfied (NO side), the process returns to # 105 and the camera microcomputer 104 repeats the above operation.

  Step # 117: The camera microcomputer 104 holds the through image captured by the imaging unit 103 during the guide image update operation in the memory 106 as a new first image. In addition, the camera microcomputer 104 acquires information on the imaging range corresponding to the new first image. By the process of # 117, the guide image is generated based on the imaging range at the time of the guide image update operation.

  Thereafter, returning to # 105, the camera microcomputer 104 repeats the above operation. Above, description of the flowchart of FIG. 3 is complete | finished.

  The electronic camera of one embodiment acquires a first image at the start of zoom-in (# 103), and generates a guide image in which a display indicating an imaging range after zoom-in is superimposed on the first image (# 106). . Then, after zooming in, the electronic camera superimposes the guide image on a partial area of the through image and displays it on the monitor 108 (# 106). Therefore, in one embodiment, the state of the subject after zooming in can be confirmed with a through image while confirming the relative positional relationship of the imaging range before and after zooming in with the guide image.

<Supplementary items of the embodiment>
(Supplement 1): In the above embodiment, the configuration example of the lens-integrated electronic camera has been described. However, the imaging device of the present invention may be an interchangeable lens electronic camera. The imaging apparatus of the present invention can also be applied to a camera module incorporated in a mobile electronic device (for example, a smartphone, a mobile phone, etc.) on the assumption that it has a function of optical zoom control by a zoom lens.

  (Supplement 2): In the above embodiment, the example in which the guide function is turned on / off according to the operation of the guide switch 124 has been described. However, in the imaging apparatus of the present invention, the guide function may be turned on according to, for example, a zoom-in operation of the zoom switch.

  (Supplement 3): In the image pickup apparatus of the present invention, when a zoom operation is performed with one zoom switch (for example, the second zoom switch 122), a guide image is displayed on the monitor 108, and the other zoom switch (for example, the first zoom switch (for example, the first zoom switch 122)). The guide image may not be displayed on the monitor 108 when the zoom operation is performed by the zoom switch 121).

  (Supplement 4): In the above-described embodiment, the example in which the display of the guide image is stopped when the zoom operation is stopped for a certain period has been described (# 110, # 112). However, the image pickup apparatus of the present invention may update the first image and the information of the image pickup range when the zoom operation is stopped for a certain period, similarly to # 117 in the above embodiment.

  (Supplement 5): In the processing of # 108 in the above embodiment, the recording processing unit 114 may record the guide image itself as supplementary information of the image file.

  From the above detailed description, features and advantages of the embodiments will become apparent. It is intended that the scope of the claims extend to the features and advantages of the embodiments as described above without departing from the spirit and scope of the right. Further, any person having ordinary knowledge in the technical field should be able to easily come up with any improvements and modifications, and there is no intention to limit the scope of the embodiments having the invention to those described above. It is also possible to use appropriate improvements and equivalents within the scope disclosed in.

DESCRIPTION OF SYMBOLS 100 ... Electronic camera, 101 ... Zoom lens, 102 ... Lens driver, 102a ... Encoder, 103 ... Imaging part, 104 ... Camera microcomputer, 105 ... Attitude sensor, 106 ... Memory, 107 ... Media I / F, 108 ... Monitor, 109 DESCRIPTION OF SYMBOLS ... Operation part 111 ... Zoom control part 112 ... Display control part 113 ... Image analysis part 114 ... Recording processing part 115 ... Storage medium 121 ... 1st zoom switch 122 ... 2nd zoom switch 123 ... Release Switch, 124 ... Guide switch

Claims (11)

An imaging unit that captures an image of a subject via a zoom lens;
An operation unit for receiving user operations;
A zoom control unit for adjusting a shooting magnification of the zoom lens according to a zoom operation for zooming the zoom lens;
A detection unit for detecting a change in an imaging range of the imaging unit;
A display control unit that outputs an image to be displayed on the display device,
The imaging unit acquires a first image at the start of zooming in, acquires a second image after zooming in,
The display control unit generates a guide image in which a display indicating the imaging range after zooming in is superimposed on the first image, and displays the third image in which the guide image is superimposed on a partial region of the second image. An image pickup apparatus that is displayed on a device. The imaging device according to claim 1,
A guide switch for switching on / off the display of the guide image;
The display control unit displays the third image on the display device when the guide switch is turned on. The imaging device according to claim 2,
The display device is configured to display the third image on the display device while the on operation of the guide switch is continued. In the imaging device according to claim 1,
The display control unit stops the display of the third image when the change in the photographing magnification exceeds a threshold value from the start of zooming in. In the imaging device according to any one of claims 1 to 4,
The detection unit detects the movement of the optical axis of the zoom lens,
The display control unit stops the display of the third image when the movement of the optical axis of the zoom lens exceeds a threshold value. In the imaging device according to any one of claims 1 to 5,
The image pickup apparatus, wherein the display control unit stops displaying the third image when the zoom operation is stopped for a certain period. The imaging apparatus according to any one of claims 1 to 6,
An image analysis unit for detecting an area where the subject has changed between the second image and the corresponding area of the first image;
The display device is configured to stop displaying the third image when a ratio of a region where the subject has changed exceeds a threshold value. In the imaging device according to any one of claims 1 to 7,
When the display switching operation is performed, the display control unit causes the display device to display a fourth image in which the second image is superimposed on a partial region of the guide image. In the imaging device according to any one of claims 1 to 8,
The imaging unit updates the first image when the zoom operation is stopped for a certain period or when the guide image is updated,
The imaging apparatus, wherein the display control unit generates the guide image using the updated first image. The imaging apparatus according to any one of claims 1 to 9,
The operation unit includes two types of zoom switches each accepting the zoom operation,
The display control unit displays the third image on the display device when the zoom operation is performed with one zoom switch, and displays the third image on the display device when the zoom operation is performed with the other zoom switch. An image pickup apparatus characterized by not displaying. The imaging apparatus according to any one of claims 1 to 10,
A recording processing unit that records the first image and coordinate information indicating the range of the still image for recording in association with the still image for recording when a still image for recording is captured after zooming in An image pickup apparatus further comprising: