JP2013090154A - Photography device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a photography device making it easy to grasp what a user intends to photograph in photography.SOLUTION: The photography device comprises: an imaging section capable of photographing an image including a plurality of subjects; a main-image generation section for generating a main image on the basis of the image obtained by the imaging section; a sub-image generation section for generating a sub image by performing processing to zoom a desired subject selected from the plurality of subjects on the image obtained by the imaging section; a superposition processing section for generating a superposition image by performing processing to superpose the sub image generated by the sub-image generation section on the main image generated by the main-image generation section; and a picture quality adjustment section for adjusting the picture quality of an area corresponding to the main image of the superposition image and the picture quality of an area corresponding to the sub image of the superposition image individually.

Description

  The present invention relates to a photographing apparatus, and more particularly to a photographing apparatus capable of simultaneously photographing a plurality of image data.

  2. Description of the Related Art Conventionally, there has been known a technique capable of acquiring a plurality of pieces of image data having different fields of view in a single shooting operation and recording the acquired pieces of image data individually in a photographing apparatus such as a digital camera.

  Specifically, for example, Patent Document 1 discloses a part of the first area based on image data corresponding to the first area in an image sensor that captures a subject image from a photographing optical system using photoelectric conversion. Is determined as a second area, image data corresponding to the first area and image data corresponding to the second area are alternately read from the image sensor, and the image data corresponding to the first area and the There is disclosed a digital camera having a configuration in which image data corresponding to a second area is recorded individually (as a separate image file).

Japanese Unexamined Patent Publication No. 2004-187124

  However, according to the configuration disclosed in Patent Document 1, for example, among the image data corresponding to the first area and the image data having two different fields of view that are individually recorded as image data corresponding to the second area. However, there is a problem that it may be difficult to grasp the user's intention of shooting at the time of shooting just by reproducing and viewing the image data of one field of view.

  The present invention has been made in view of the above-described circumstances, and an object of the present invention is to provide an imaging apparatus capable of easily grasping a user's intention of shooting at the time of shooting.

  An imaging device according to an aspect of the present invention includes an imaging unit that can capture an image including a plurality of subjects, a main image generation unit that generates a main image based on the image obtained by the imaging unit, and the imaging unit A sub-image generation unit that generates a sub-image by performing a process of zooming a desired subject selected from the plurality of subjects, and the main image generation unit A superimposition processing unit that generates a superimposed image by performing a process of superimposing the sub image generated by the sub image generation unit on the main image, and an image quality of an area corresponding to the main image of the superimposed image And an image quality adjustment unit for individually adjusting the image quality of a region corresponding to the sub-image of the superimposed image.

  According to the photographing apparatus of the present invention, it is possible to easily grasp the user's intention of photographing at the time of photographing.

1 is a block diagram illustrating a configuration of a main part of a photographing apparatus according to an embodiment of the present invention. 6 is a flowchart illustrating an example of processing performed in the imaging apparatus according to the present embodiment. Explanatory drawing for demonstrating the process which concerns on the setting of a superimposition area | region. The figure which shows an example of the display mode of a superimposition frame. Explanatory drawing for demonstrating the process which concerns on the production | generation of a tracking frame. The figure which shows an example of the display mode of a tracking frame. 6 is a flowchart illustrating an example of processing related to generation of superimposed image data. The figure which shows an example of the gain map applied to main image data. The figure which shows an example of the gain map applied to sub image data. The figure which shows an example of the superimposition image data produced | generated by the process of FIG. The figure which shows an example of the display mode of GUI used for the image quality adjustment of superimposition image data. The figure which shows an example of the superimposition image data recorded when image | photographing using the imaging device which concerns on a present Example. 3 is a flowchart showing an example different from that shown in FIG. Explanatory drawing for demonstrating the process which concerns on the reset of a superimposition area | region. The figure which shows an example of the overlapping area | region reset.

  Embodiments of the present invention will be described below with reference to the drawings.

  1 to 15 relate to an embodiment of the present invention.

  FIG. 1 is a block diagram illustrating a configuration of a main part of a photographing apparatus according to an embodiment of the present invention.

  The photographing apparatus 1 is configured as a digital camera, for example, and includes an imaging unit 11, an image processing unit 12, a tracking unit 13, a superimposition processing unit 14, a superimposition area setting unit 15, a touch panel unit 16, and a recording unit. 17 and a display unit 18.

  The imaging unit 11 includes, for example, an imaging system including a lens, a diaphragm mechanism, a shutter mechanism, a focus adjustment mechanism, and an imaging element. The imaging unit 11 is configured to capture one or more subjects located within the field of view of the lens in the imaging system described above and obtain image data.

  The image processing unit 12 includes a main image generation unit 12a and a sub image generation unit 12b.

  The main image generation unit 12a generates main image data by performing image processing such as white balance and dynamic range adjustment on the image data obtained by the imaging unit 11.

  The sub image generation unit 12b performs image processing such as white balance and dynamic range adjustment on the image data obtained by the imaging unit 11. Further, the sub image generation unit 12b becomes a tracking target of the tracking unit 13 from the image data subjected to the above-described image processing when the operation mode of the imaging apparatus 1 is set to a superimposition imaging mode described later. An area within the tracking frame including the subject is extracted. Then, the sub-image generation unit 12b calculates a zoom magnification so that the image data of the region within the tracking frame extracted as described above matches the superimposition region set by the superimposition region setting unit 15, and the zoom magnification Sub-image data is generated by digitally zooming the image data subjected to the above-described image processing.

  The tracking unit 13 has a function capable of tracking a desired subject included in the image data obtained by the imaging unit 11. In addition, the tracking unit 13 selects from among the subjects displayed on the display unit 18 based on an instruction output from the touch panel unit 16 when the operation mode of the imaging device 1 is set to a superimposition shooting mode described later. One subject corresponding to the instruction is selected as a subject to be tracked, and a process for generating a tracking frame indicating the selected subject to be tracked is further performed. A specific example of the processing of the tracking unit 13 will be described later.

  When the operation mode of the photographing apparatus 1 is set to a superposition photographing mode described later, the superimposing processing unit 14 generates main image data generated by the main image generating unit 12a and a sub image generated by the sub image generating unit 12b. Based on the data and the superimposition region set by the superimposition region setting unit 15, superimposition image data is generated by performing processing described later, and further, processing related to image quality adjustment of the generated superimposition image data is performed. . A specific example of the processing of the superimposition processing unit 14 will be described later.

  The superimposition region setting unit 15 is a superimposition region corresponding to the coordinate position of the touch panel unit 16 detected based on an instruction output from the touch panel unit 16 when the operation mode of the photographing apparatus 1 is set to a superimposition photographing mode described later. Is set, and a process of causing the display unit 18 to display a superimposition frame corresponding to the set superimposition area is performed. A specific example of the processing of the superimposition area setting unit 15 will be described later.

  The touch panel unit 16 is configured to be able to give instructions to the tracking unit 13 and the overlapping region setting unit 15 when the user performs an operation by touching a finger or the like.

  The recording unit 17 includes, for example, a nonvolatile memory provided in the imaging device 1 or a memory card that can be attached to and detached from the imaging device 1, and various images such as superimposed image data generated by the superimposition processing unit 14. The data can be recorded (saved).

  The display unit 18 includes, for example, an LCD (liquid crystal display), a display driving circuit, and the like, and is configured to display the superimposed image data generated by the superimposition processing unit 14.

  In addition to the components illustrated in FIG. 1, for example, the photographing apparatus 1 of the present embodiment includes a mode changeover switch that can issue an instruction relating to switching of operation mode settings of the photographing apparatus 1, and the photographing apparatus 1. A power switch that can instruct to turn on / off the camera, a release button that can issue a release instruction to record still image data, and controls related to basic operations of each part of the photographing apparatus 1. It is assumed that various devices (not shown) such as a CPU that performs the above are provided.

  Here, the process performed in the photographing apparatus 1 of the present embodiment will be described by taking as an example a case where superimposed image data is generated using still image data acquired when a release instruction is issued. FIG. 2 is a flowchart illustrating an example of processing performed in the photographing apparatus according to the present embodiment.

  First, as the photographing apparatus 1 is turned on, image data acquisition by the imaging unit 11 is started, and the image data is displayed in live view on the display unit 18 (step S1 in FIG. 2).

  In the live view display in step S1 of FIG. 2, the processing in each part of the sub image generation unit 12b, the tracking unit 13, and the superimposition region setting unit 15 is not performed, and the superimposition processing unit 14 further performs the main image display. The main image data generated by the generation unit 12a is output through. That is, the image data displayed in the live view on the display unit 18 in step S1 of FIG. 2 is subjected to image processing such as white balance and dynamic range adjustment by the main image generation unit 12a on the image data acquired by the imaging unit 11. Approximate to what has been applied.

  On the other hand, the CPU of the photographing apparatus 1 determines whether or not the operation mode of the photographing apparatus 1 is set to the superimposing photographing mode by operating the mode switch during the live view display in step S1 of FIG. 2 (FIG. 2). 2 step S2).

  In step S2 of FIG. 2, when the operation mode of the photographing apparatus 1 is not set to the superimposed photographing mode, the operation mode of the photographing apparatus 1 is set to the normal photographing mode.

  Note that the above-described normal shooting mode is realized by using, for example, a known process for performing shooting and recording of the image data displayed in live view on the display unit 18 in step S1 of FIG. This is an operation mode in which Therefore, in the following, for the sake of simplicity, description regarding the above-described normal shooting mode is omitted.

  2, when the operation mode of the photographing apparatus 1 is set to the superimposition shooting mode, the superimposition area setting unit 15 performs processing related to the setting of the superimposition area and the display of the superposition frame (in FIG. 2). Step S3).

  FIG. 3 is an explanatory diagram for explaining a process related to the setting of the overlapping region. FIG. 4 is a diagram illustrating an example of a display mode of the overlapping frame.

  Specifically, when the operation mode of the photographing apparatus 1 is set to the superimposing photographing mode, the superimposing region setting unit 15 sets the coordinate position of the upper left corner as the origin (0, 0) as the origin (0, 0) and the XY coordinate system (X-axis direction and Y The coordinate position A (Xa, Ya) corresponding to the touch start position of the touch input operation on the touch panel unit 16 and the touch of the touch input operation on the touch panel unit 16 based on an instruction output from the touch panel unit 16 defining the axial direction) A coordinate position B (Xb, Yb) corresponding to the end position is detected (see FIG. 3). In the present embodiment, the description will be made assuming that the magnitude relationship of Xb> Xa and Yb> Ya holds.

  The overlapping region setting unit 15 sets a rectangular region having a diagonal line connecting the coordinate position A (Xa, Ya) and the coordinate position B (Xb, Yb) on the touch panel unit 16 as the overlapping region (see FIG. 3).

  The superimposition area setting unit 15 performs a process of converting the coordinate position of the touch panel unit 16 into the position of the display unit 18, and the like, and a superimposition frame indicating a region corresponding to the superimposition area set as described above, and a live view display The displayed image data is also displayed on the display unit 18 (see FIG. 4).

  The superimposition area setting unit 15 outputs information related to the superimposition area obtained by the process of step S3 in FIG. 2 to the sub-image generation unit 12b, the tracking unit 13, and the superimposition processing unit 14. Specifically, the overlapping area setting unit 15 includes, for example, the coordinate position A (Xa, Ya), the coordinate position B (Xb, Yb), and the size (area) of the rectangle of the overlapping area in the touch panel unit 16; Is output to the sub-image generation unit 12b, the tracking unit 13, and the superimposition processing unit 14.

  On the other hand, the tracking unit 13 performs processing related to selection of a subject to be tracked and generation of a tracking frame based on the information related to the superimposed region output from the superimposed region setting unit 15 (step S4 in FIG. 2).

  Specifically, the tracking unit 13 detects a position in the screen of the display unit 18 corresponding to the coordinate position of the touch panel unit 16 specified by the instruction based on the instruction output from the touch panel unit 16, and One subject displayed at the detected position of the display unit 18 is selected as a subject to be tracked.

  Furthermore, the tracking unit 13 performs a process of generating a rectangular tracking frame for indicating one subject selected as the subject to be tracked.

  Here, the process related to the generation of the tracking frame described above will be described by taking as an example the case where the subject to be tracked is a (one) person. According to the present embodiment, the tracking target may be a subject other than a person. FIG. 5 is an explanatory diagram for explaining processing related to generation of a tracking frame. FIG. 6 is a diagram illustrating an example of a display mode of the tracking frame.

  First, the tracking unit 13 detects the positions of the eyes and mouth of the person selected as the tracking target subject by performing processing such as face organ detection.

  Next, the tracking unit 13 determines the length of the vertical side of the tracking frame based on the detection result of the positions of the eyes and mouth of the person selected as the subject to be tracked (the length of the portion above the eye position). ): (Length of the part from the position of the eye to the position of the mouth): (length of the part from the position of the mouth to the lower part) is set as a length LV so as to have a ratio of 1: 1: 3 ( (See FIG. 5).

  Further, the tracking unit 13 applies the coordinate values of the coordinate position A (Xa, Ya) and the coordinate position B (Xb, Yb) of the superimposed region output from the superimposed region setting unit 15 to the following formula (1). Thus, the value of the aspect ratio AR is calculated.

AR = (Yb−Ya + 1) / (Xb−Xa + 1) (1)

The tracking unit 13 multiplies the aspect ratio AR calculated using the above formula (1) by the length LV of the vertical side set as described above, thereby obtaining the horizontal direction of the tracking frame. The side length HV is calculated.

  In the present embodiment, the lengths of the sides in the vertical and horizontal directions of the tracking frame may be set by another method different from the method described above.

  Thereafter, the tracking unit 13 generates a rectangular tracking frame having the length LV in the vertical direction and the length HV in the horizontal direction calculated by the above procedure, and further, as shown in FIG. The coordinate position C (Xc, Yc) of the upper left corner and the coordinate position D (Xd, Yd) of the lower right corner of the rectangular tracking frame in the touch panel unit 16 in which the XY coordinate system is defined (see FIG. 5). ). In the present embodiment, the description will be made assuming that the magnitude relations of Xd> Xc and Yd> Yc are established.

  Then, the tracking unit 13 performs processing such as converting the coordinate position of the touch panel unit 16 to the position of the display unit 18, thereby combining the above-described overlapping frame and tracking frame with the image data displayed in the live view. Are displayed on the screen of the display unit 18 (see FIG. 6).

  Further, the tracking unit 13 outputs information related to the tracking frame generated by the process of step S4 in FIG. 2 to the sub-image generation unit 12b. Specifically, the tracking unit 13 includes, for example, a coordinate position C (Xc, Yc), a coordinate position D (Xd, Yd), and a rectangular size (area) of the tracking frame in the touch panel unit 16. The information is output to the sub image generation unit 12b.

  On the other hand, the CPU of the photographing apparatus 1 shifts to a state waiting for the operation of the release button while continuing the processing related to the display of the superimposition frame and the tracking frame (step S5 in FIG. 2).

  Thereafter, when the CPU of the photographing apparatus 1 detects that a release instruction has been performed by operating the release button (step S5 in FIG. 2), the still image data corresponding to the detection timing of the release instruction is photographed and the main image is captured. Control for outputting to the generation unit 12a and the sub-image generation unit 12b is performed.

  Then, the main image generation unit 12a, the sub image generation unit 12b, and the superimposition processing unit 14 perform various processes on the still image data output from the imaging unit 11 according to the release instruction, thereby superimposing image data. Is generated (step S6 in FIG. 2).

  Here, a specific example of the processing performed in step S6 of FIG. 2 will be described mainly with reference to the flowchart of FIG. FIG. 7 is a flowchart illustrating an example of processing related to generation of superimposed image data.

  The main image generation unit 12a generates main image data by performing image processing such as white balance and dynamic range adjustment on the still image data output from the imaging unit 11 in response to the release instruction in step S5 of FIG. Then, the generated main image data is output to the superimposition processing unit 14 (step S21 in FIG. 7).

  On the other hand, the sub-image generating unit 12b performs image processing such as white balance and dynamic range adjustment on the still image data output from the imaging unit 11 in response to the release instruction in step S5 in FIG. Sub-image data is generated using the applied image data, and the generated sub-image data is output to the superimposition processing unit 14 (step S22 in FIG. 7).

  Here, a specific example of the process performed in step S22 of FIG. 7 will be described.

  Based on the information output from the tracking unit 13, the sub-image generation unit 12 b selects a subject to be tracked by the tracking unit 13 from among still image data subjected to image processing such as white balance and dynamic range adjustment. Extract the area within the tracking frame.

  Further, the sub-image generation unit 12b outputs information on the coordinate position A (Xa, Ya) and the coordinate position B (Xb, Yb) output from the superimposition region setting unit 15 and the coordinate position C ( The zoom magnification ZR is calculated by performing an operation using the following formula (2) based on the information of Xc, Yc) and the coordinate position D (Xd, Yd).

ZR = (Yb−Ya + 1) / (Yd−Yc + 1) (2)

Then, the sub-image generation unit 12b generates sub-image data by digitally zooming the still image data subjected to the above-described image processing with the zoom magnification ZR obtained as the calculation result of the formula (2). The sub image data is output to the superimposition processing unit 14.

  Note that the sub-image generation unit 12b is not limited to performing the above-described processing in step S22 in FIG. 7. For example, pixel interpolation processing corresponding to the zoom magnification ZR is performed on image data digitally zoomed at the zoom magnification ZR. The image subjected to the processing may be output to the superimposition processing unit 14 as sub image data.

  On the other hand, the superimposition processing unit 14 is generated based on the information output from the superimposition region setting unit 15 and applied to the main image data generated in step S21 in FIG. 7 and in step S22 in FIG. A gain map to be applied to the sub image data is generated (step S23 in FIG. 7).

  FIG. 8 is a diagram illustrating an example of a gain map applied to main image data. FIG. 9 is a diagram illustrating an example of a gain map applied to the sub image data.

  Specifically, as shown in FIG. 8, for example, as shown in FIG. 8, the superimposition processing unit 14 uses pixels in regions other than the superimposition region as gain maps applied to the main image data. A gain map is generated in which the gain is set to 1 and the gain gradually changes from 1 to 0 as it goes from the pixel at the end of the overlap region to the pixel at the center.

  In addition, the superimposition processing unit 14 sets, as a gain map to be applied to the sub image data, for example, as illustrated in FIG. 9, the gains of pixels in regions other than the superimposition region are set to 0 in the vertical direction and horizontal direction of the sub image data frame. In addition, a gain map is generated such that the gain gradually changes from 0 to 1 as it goes from the pixel at the end of the overlapping region to the pixel at the center.

  The gain map applied to the main image data and the sub image data is, for example, as long as the gain value of each pixel in the entire frame is generated to be 1 when both gain maps are added. 8 and FIG. 9 may be different.

    The superimposition processing unit 14 applies the gain map generated in step S23 of FIG. 7 to the main image data and the sub image data, respectively, and further performs addition processing on the main image data and the sub image data to which the gain map is applied. For example, as shown in FIG. 10, superimposed image data including a superimposed frame is generated (step S24 in FIG. 7). FIG. 10 is a diagram illustrating an example of superimposed image data generated by the processing of FIG.

  Then, as the process of step S24 of FIG. 7 is completed, the process of step S7 of FIG. 2 is continuously performed.

  The superimposition processing unit 14 having a function as an image quality adjustment unit performs processing related to image quality adjustment of the superimposed image data generated in step S6 in FIG. 2 (step S7 in FIG. 2). FIG. 11 is a diagram illustrating an example of a display mode of a GUI used for image quality adjustment of superimposed image data.

  Specifically, as shown in FIG. 11, for example, the superimposition processing unit 14 can adjust the superimposition image data generated by the process of step S6 in FIG. 2 and the image quality of the area corresponding to the main image data. An image quality adjustment slider 101 as a GUI and an image quality adjustment slider 102 as a GUI capable of adjusting the image quality of the area corresponding to the sub image data are displayed together on the display unit 18. Then, the superimposition processing unit 14 individually performs image quality adjustment according to the operation of the image quality adjustment sliders 101 and 102 on the superimposed image data generated by the process of step S6 of FIG.

  The image quality adjustment slider 101 is a parameter that is alternatively selected from parameters related to image quality adjustment of the main image data such as saturation level, brightness level, contrast strength, and the like. It is configured as a GUI that can be changed. Further, the image quality adjustment slider 101 moves in accordance with the operation of the touch panel unit 16 (for example, along the vertical direction of the display unit 18), and is selectively selected from parameters related to image quality adjustment of the main image data. It is configured to include a knob portion 101a as a GUI capable of giving instructions related to the increase / decrease of the parameter. Then, according to the configuration in which the image quality adjustment slider 101 is displayed on the display unit 18, the superimposition processing unit 14 is based on the instruction output from the touch panel unit 16 and the color tone according to the current position of the knob unit 101 a. Alternatively, parameters related to the image quality of the region corresponding to the main image data in the superimposed image data are adjusted (changed) so as to have contrast.

  The image quality adjustment slider 102 is a parameter that is alternatively selected from parameters related to the image quality adjustment of the sub image data, such as the saturation level, the brightness level, or the contrast level. It is configured as a GUI that can be changed. Further, the image quality adjustment slider 102 moves according to the operation of the touch panel unit 16 (for example, along the vertical direction of the display unit 18), and is selectively selected from parameters related to image quality adjustment of the main image data. It is configured to include a knob portion 102a as a GUI capable of giving an instruction related to the increase / decrease of the parameter. Then, according to the configuration in which such an image quality adjustment slider 102 is displayed on the display unit 18, the superimposition processing unit 14 is based on an instruction output from the touch panel unit 16 and has a color tone corresponding to the current position of the knob unit 102 a. Alternatively, the parameter relating to the image quality of the region corresponding to the sub image data in the superimposed image data is adjusted (changed) so as to have contrast.

  On the other hand, when the CPU of the photographing apparatus 1 detects that the image quality adjustment in step S7 in FIG. 2 has been completed, the superimposed frame, the image quality adjustment slider 101, and the image quality adjustment from the superimposed image data illustrated in FIG. Control is performed so that the superimposed image data as shown in FIG. 12 with the recording slider 102 deleted is displayed on the display unit 18 as a rec view and recorded in the recording unit 17 (steps S8 and S9 in FIG. 2). ). FIG. 12 is a diagram illustrating an example of superimposed image data recorded when shooting is performed using the shooting apparatus according to the present embodiment.

  Subsequently, the processing performed in the photographing apparatus 1 of the present embodiment will be described by taking as an example a case where superimposed image data is generated using moving image data acquired before a release instruction is issued. FIG. 13 is a flowchart illustrating an example different from FIG. 2, such as processing performed in the imaging apparatus according to the present embodiment. In the following, for the sake of simplicity, description will be made while omitting portions to which processing similar to that already described can be applied as appropriate.

  First, as the photographing apparatus 1 is turned on, acquisition of image data by the imaging unit 11 is started, and the image data is displayed in live view on the display unit 18 (step S31 in FIG. 13).

  In the live view display in step S31 of FIG. 13, the processes in the sub image generation unit 12b, the tracking unit 13, and the superimposition area setting unit 15 are not performed, and the superimposition processing unit 14 further performs the main image display. The main image data generated by the generation unit 12a is output through. That is, the image data displayed in the live view on the display unit 18 in step S31 of FIG. 13 is subjected to image processing such as white balance and dynamic range adjustment by the main image generation unit 12a on the image data acquired by the imaging unit 11. Approximate to what has been applied.

  On the other hand, the CPU of the photographing apparatus 1 determines whether or not the operation mode of the photographing apparatus 1 is set to the superimposed photographing mode by operating the mode change switch during the live view display in step S31 of FIG. 13 (FIG. 13). 13 step S32).

  In step S32 of FIG. 13, when the operation mode of the photographing apparatus 1 is not set to the superimposed photographing mode, the operation mode of the photographing apparatus 1 is set to the normal photographing mode.

  Further, when the operation mode of the photographing apparatus 1 is set to the superimposition shooting mode in step S32 of FIG. 13, the superimposition area setting unit 15 performs the process related to the setting of the superimposition area and the display of the superposition frame in step of FIG. Processing similar to that described in the description of S3 is performed (step S33 in FIG. 13). 13 is performed in the superimposition region setting unit 15, the superimposition frame indicating the region corresponding to the superimposition region and the image data displayed in the live view are combined on the display unit 18. Is displayed (see FIG. 4).

  The superimposition area setting unit 15 outputs information related to the superimposition area obtained by the process of step S33 of FIG. 13 to the sub-image generation unit 12b, the tracking unit 13, and the superimposition processing unit 14. Specifically, the overlapping area setting unit 15 includes, for example, the coordinate position A (Xa, Ya), the coordinate position B (Xb, Yb), and the size (area) of the rectangle of the overlapping area in the touch panel unit 16; Is output to the sub-image generation unit 12b, the tracking unit 13, and the superimposition processing unit 14.

  On the other hand, the tracking unit 13 is described in the description of step S4 in FIG. 2 as the process related to the selection of the tracking target subject and the generation of the tracking frame based on the information related to the overlapping region output from the overlapping region setting unit 15. Processing similar to that of the above is performed (step S34 in FIG. 13). Then, the tracking unit 13 performs the process of step S34 in FIG. 13 so that the above-described superimposition frame and tracking frame and the image data displayed in live view are displayed together on the screen of the display unit 18. (See FIG. 6).

  In addition, the tracking unit 13 outputs information related to the tracking frame generated by the process of step S34 in FIG. 13 to the sub image generation unit 12b. Specifically, the tracking unit 13 includes, for example, a coordinate position C (Xc, Yc), a coordinate position D (Xd, Yd), and a rectangular size (area) of the tracking frame in the touch panel unit 16. The information is output to the sub image generation unit 12b.

  Then, the main image generation unit 12a, the sub image generation unit 12b, and the superimposition processing unit 14 perform processing substantially similar to the above-described series of processing in FIG. 7 (processing in step S6 in FIG. 2). The superimposed image data including the superimposed frame as illustrated in FIG. 10 is generated for each frame of the moving image data output from the imaging unit 11 (step S35 in FIG. 13).

  Furthermore, the superimposition processing unit 14 performs the same process as that described in the description of step S7 in FIG. 2 as a process related to the image quality adjustment of the superimposed image data generated in step S35 in FIG. 13 (step in FIG. 13). S36).

  That is, for the image quality adjustment as a GUI capable of adjusting the image quality of the overlapping frame and the area corresponding to the main image data as illustrated in FIG. 11 by performing the processing of step S35 and step S36 of FIG. The superimposed image data including the slider 101 and the image quality adjustment slider 102 as a GUI capable of adjusting the image quality of the area corresponding to the sub image data is displayed in live view on the display unit 18. Then, according to the configuration in which such superimposed image data is displayed in live view on the display unit 18, the superimposition processing unit 14 is based on an instruction output from the touch panel unit 16 and has a color tone corresponding to the current position of the knob unit 101 a. Alternatively, the parameter relating to the image quality of the area corresponding to the main image data is adjusted (changed) in substantially real time so as to have contrast, and further, the color tone or contrast corresponding to the current position of the knob unit 102a is provided. A parameter related to the image quality of the area corresponding to the sub image data is adjusted (changed) in substantially real time.

  On the other hand, the superimposed region setting unit 15 determines whether or not an instruction related to adjustment of the superimposed region is given on the touch panel unit 16 when the superimposed image data that has undergone the process of step S36 in FIG. Is determined (step S37 in FIG. 13).

  Specifically, the superimposed region setting unit 15 configures, for example, a rectangular superimposed region (superimposed frame) when the superimposed image data that has undergone the process of step S36 in FIG. It is determined whether or not an instruction related to the adjustment of the superimposition region is made based on whether or not a touch input operation that straddles any one of the four sides is performed on the touch panel unit 16.

  When the superimposition area setting unit 15 obtains a determination result that the instruction for adjustment of the superimposition area has not been made in step S37 of FIG. 13, the superimposition area setting unit 15 continues the process of step S39 of FIG. Do.

  In addition, in step S37 of FIG. 13, when the determination result that the instruction related to the adjustment of the superimposition area has been given is obtained, the superimposition area setting unit 15 performs the process related to the resetting of the superimposition area and the display of the superposition frame. This is performed (step S38 in FIG. 13).

  Here, with respect to the processing performed in step S38 in FIG. 13, a rectangular overlapping region as shown in FIG. 14 having a diagonal line connecting the coordinate position A (Xa, Ya) and the coordinate position B (Xb, Yb) described above. A case where is set as the current overlapping region will be described as an example. FIG. 14 is an explanatory diagram for explaining a process related to the resetting of the overlapping area.

  A touch input operation is performed so as to straddle any one of the four sides constituting the rectangular overlapping region having a diagonal line connecting the coordinate position A (Xa, Ya) and the coordinate position B (Xb, Yb). When this is detected, the superimposition area setting unit 15 responds to an instruction output from the touch panel unit 16 that defines the XY coordinate system (X-axis direction and Y-axis direction) with the coordinate position of the upper left corner as the origin (0, 0). Based on the coordinate position E (Xe, Ye) corresponding to the touch start position of the touch input operation on the touch panel unit 16, the coordinate position F (Xf, Yf) corresponding to the touch end position of the touch input operation on the touch panel unit 16, Is detected (see FIG. 14). In the present embodiment, the description will be made assuming that the magnitude relation of Xf> Xe and Ye> Yf is established.

  Thereafter, the superimposing area setting unit 15 selects one of the four sides constituting the rectangular superimposing area (superimposing frame) at the position closest to the coordinate position E (Xe, Ye) corresponding to the touch start position. Set the edge as the edge to be adjusted.

  That is, when the coordinate position E (Xe, Ye) as shown in FIG. 14 is detected, the right side that forms the rectangular overlapping region (superimposing frame) is set as the adjustment target side.

  On the other hand, the superposition area setting unit 15 subtracts the coordinate value Xe from the coordinate value Xf when the right side or the left side is set as the adjustment target side among the four sides constituting the rectangular superposition area (superimposition frame). The obtained value is set as the movement amount of the side to be adjusted.

  In addition, the superposition region setting unit 15 subtracts the coordinate value Yf from the coordinate value Ye when the upper side or the lower side is set as the adjustment target side among the four sides constituting the rectangular superposition region (superimposition frame). The obtained value is set as the movement amount of the side to be adjusted.

  Then, the superposition region setting unit 15 moves with respect to one coordinate value corresponding to the side to be adjusted among the coordinate values included in the coordinate position A (Xa, Ya) and the coordinate position B (Xb, Yb). The coordinate position of the movement destination is acquired by adding the value of the amount.

  Specifically, when the left side of the rectangular overlapping area (superimposing frame) is set as the adjustment target side, the overlapping area setting unit 15 sets the coordinate position of the movement destination corresponding to the coordinate position A (Xa, Ya). G (Xa + (Xf−Xe), Ya) is acquired.

  When the upper side of the rectangular superposition region (superposition frame) is set as the adjustment target side, the superposition region setting unit 15 sets the coordinate position H (Xa, Ya +) of the movement destination corresponding to the coordinate position A (Xa, Ya). (Ye-Yf)) is acquired.

  When the right side of the rectangular superposition region (superimposition frame) is set as the adjustment target side, the superposition region setting unit 15 sets the coordinate position I (Xb + (Xf) of the movement destination corresponding to the coordinate position B (Xb, Yb). -Xe) and Yb) are acquired.

  When the lower side of the rectangular superposition region (superimposition frame) is set as the adjustment target side, the superimposition region setting unit 15 moves to the coordinate position J (Xb, Yb +) of the movement destination corresponding to the coordinate position B (Xb, Yb). (Ye-Yf)) is acquired.

  That is, when the coordinate position E (Xe, Ye) as shown in FIG. 14 is detected and the right side constituting the rectangular overlapping region (superimposing frame) is set as the adjustment target side, the coordinate position The coordinate position I (Xb + (Xf−Xe), Yb) of the movement destination corresponding to B (Xb, Yb) is acquired.

  Then, the superimposition area setting unit 15 displays a diagonal line connecting the coordinate position A (Xa, Ya) and the coordinate position I (Xb + (Xf−Xe), Yb) as shown in FIG. Re-set as a rectangular overlapped area as shown in FIG. FIG. 15 is a diagram illustrating an example of the reset overlapping area.

  The superimposition area setting unit 15 performs a process of converting the coordinate position of the touch panel unit 16 into the position of the display unit 18, and the like, and a superimposition frame indicating an area corresponding to the superimposition area reset as described above, and a live view The displayed image data is also displayed on the display unit 18 together.

  In addition, the superimposition region setting unit 15 uses the sub-image generation unit 12b, the tracking unit 13, and the superimposition processing unit 14 as information on the superimposition region reset by the processing in step S38 in FIG. 13 as described above. Output to. Specifically, the overlapping area setting unit 15, for example, the coordinate position A (Xa, Ya), the coordinate position I (Xb + (Xf−Xe), Yb), and the rectangular size of the overlapping area in the touch panel unit 16. (Area) is output to the sub-image generation unit 12b, the tracking unit 13, and the superimposition processing unit 14.

  Then, the tracking frame and the superimposed image data are respectively updated by performing processing based on the information relating to the superposed region reset by the processing in step S38 in FIG. 13 in steps S34 and S35 in FIG. That is, as the overlapping area is reset by the process of step S38 in FIG. 13, the size of the rectangle of the overlapping frame and the tracking frame is changed, and the size of the overlapping frame and the tracking frame is changed. A new zoom magnification ZR is calculated, and sub-image data digitally zoomed with the calculated new zoom magnification ZR is generated.

  In the present embodiment, the process when the overlapping area is reset by the process of step S38 in FIG. 13 is not limited to the process described above. Specifically, for example, as the overlapping area is reset by the process of step S38 in FIG. 13, the size of the rectangle of the overlapping frame and the tracking frame is changed, and further, before the overlapping area is reset. While maintaining the zoom magnification ZR, sub image data corresponding to the size of the changed overlapping frame and tracking frame may be generated.

  On the other hand, the CPU of the photographing apparatus 1 determines whether or not a release instruction has been given by operating the release button (step S39 in FIG. 13).

  Then, when the CPU of the photographing apparatus 1 obtains a determination result that the release instruction has not been given in step S39 of FIG. 13, it performs the process of step S35 of FIG. 13 again.

  When the CPU of the photographing apparatus 1 obtains the determination result that the release instruction has been issued in step S39 in FIG. 13, the CPU 1 of the imaging apparatus 1 uses the superimposed frame as the superimposed image data of the frame corresponding to the detection timing of the release instruction. Then, control is performed so that the superimposed image data from which the image quality adjustment slider 101 and the image quality adjustment slider 102 have been deleted is recorded on the display unit 18 and recorded in the recording unit 17 (step S40 in FIG. 13). And step S41).

  According to the embodiment described above, the superimposed image that emphasizes the relevance between the main subject to be photographed by the user and the subordinate subject selected by the user as the subject related to the main subject. Data is generated, and the generated superimposed image data can be recorded in the recording unit 17. That is, according to the present embodiment described above, for example, by reproducing and browsing the superimposed image data recorded in the recording unit 17, it is possible to easily grasp the user's shooting intention at the time of shooting.

  Note that according to the present embodiment described above, the main image data and the sub image data used for generating the superimposed image data are not limited to those generated based on one image data photographed under the same photographing conditions. Alternatively, it may be generated based on two pieces of image data photographed under mutually different photographing conditions. Specifically, for example, two types of shooting conditions that combine various parameters such as exposure correction, aperture, shutter speed, and sensitivity are set in advance, and one of the two types of shooting conditions is shot. Main image data generated based on the first image data and sub-image data generated based on the second image data photographed under the other of the two types of photographing conditions. It may be used for generation.

  Further, according to the present embodiment described above, the main image data is not limited to the one that generates the superimposed image data through the process as shown in FIG. Is generated, sub-image data subjected to processing for extracting (cutting out) only the area within the tracking frame that has been digitally zoomed with the zoom magnification ZR is generated, and the sub-image data is synthesized (inserted) into the superimposed area of the main image data. Thus, the superimposed image data may be generated.

  It should be noted that the present invention is not limited to the above-described embodiments, and it is needless to say that various changes and applications can be made without departing from the spirit of the invention.

DESCRIPTION OF SYMBOLS 1 Imaging device 11 Imaging part 12 Image processing part 12a Main image generation part 12b Sub image generation part 13 Tracking part 14 Superimposition processing part 15 Superimposition area setting part 16 Touch panel part 17 Recording part 18 Display part

Claims (4)

An imaging unit capable of capturing an image including a plurality of subjects;
A main image generation unit that generates a main image based on the image obtained by the imaging unit;
A sub-image generating unit that generates a sub-image by performing a process of zooming a desired subject selected from the plurality of subjects on the image obtained by the imaging unit;
A superimposition processing unit that generates a superimposed image by performing a process of superimposing the sub image generated by the sub image generation unit on the main image generated by the main image generation unit;
An image quality adjustment unit for individually adjusting the image quality of the region corresponding to the main image of the superimposed image and the image quality of the region corresponding to the sub-image of the superimposed image;
A photographing apparatus comprising: A superimposition area setting unit capable of setting a superimposition area where the sub-image is superimposed on a desired area in the main image;
The sub-image generation unit calculates a zoom magnification according to the superimposing region set by the superimposing region setting unit, and performs a process of zooming the desired subject with the calculated zoom magnification, thereby subtracting the sub-image. The imaging device according to claim 1, wherein the imaging device is generated.   The superimposing processing unit generates the superimposed image by superimposing the sub-image obtained by zooming the desired subject at the zoom magnification on the superimposing region set in the main image. The imaging device according to claim 2.   At least one of a display unit capable of displaying the superimposed image subjected to image quality adjustment by the image quality adjustment unit and a recording unit capable of recording the superimposed image subjected to image quality adjustment performed by the image quality adjustment unit. The imaging apparatus according to claim 1, further comprising:

Images