JP2013062761A - Image processor, image processing method, and program - Google Patents

Abstract

An image processing apparatus, an image processing method, and a program for appropriately determining a region of interest in an image based on shooting information.
An attention area determination unit that determines an attention area in the input image according to a technique according to photographing information obtained at the time of photographing an input image among a plurality of techniques, and a peripheral area not included in the attention area And an image processing unit that performs a blurring process on the image processing apparatus.
[Selection] Figure 8

Description

  The present disclosure relates to an image processing device, an image processing method, and a program.

  Recently, various photographing modes tend to be implemented in photographing apparatuses. For example, according to the miniature mode, an image at the time of shooting or an image after shooting can be changed to an image like a miniature with a shallow depth of field.

  Regarding such a miniature mode, for example, Patent Document 1 discloses a photographing apparatus that performs a blurring process on a background region that does not include a main subject to a degree corresponding to the focal length of a lens. Here, in Patent Document 1, an example in which a region corresponding to a focus position in an image is determined as a main subject region, or when a plurality of face regions are extracted as subjects, a face region having the largest size, Alternatively, an example is described in which the main subject area is determined based on the face area closest to the center.

JP 2008-118348 A

  However, in the case where the region of interest that is not subjected to the blurring process is determined based on one in-focus position from the image in which a plurality of in-focus positions exist, The results obtained are different. Therefore, if the attention area is uniformly determined with reference to one in-focus position, the user may not obtain the expected result.

  Therefore, the present disclosure proposes a new and improved image processing apparatus, image processing method, and program capable of appropriately determining a region of interest in an image based on shooting information.

  According to the present disclosure, an attention area determination unit that determines an attention area in the input image according to a technique according to photographing information obtained when photographing the input image among a plurality of techniques, and is not included in the attention area An image processing apparatus is provided that includes an image processing unit that performs a blurring process on a peripheral region.

  In addition, according to the present disclosure, among a plurality of methods, determining a region of interest in the input image according to a method according to photographing information obtained at the time of photographing the input image, and surroundings not included in the region of interest An image processing method is provided that includes performing a blurring process on a region.

  In addition, according to the present disclosure, the computer includes a region-of-interest determination unit that determines a region of interest in the input image according to a method according to shooting information obtained at the time of shooting of the input image among a plurality of methods, and the attention A program is provided for functioning as an image processing unit that performs a blurring process on a peripheral region that is not included in the region.

  As described above, according to the present disclosure, it is possible to appropriately determine a region of interest in an image based on shooting information.

It is explanatory drawing which showed the structure of the image processing system 1 by embodiment of this indication. It is explanatory drawing which showed the example of arrangement | positioning of a focus point. It is explanatory drawing which showed the miniature process. It is explanatory drawing which showed the miniature process. It is explanatory drawing which showed the miniature process. It is explanatory drawing which showed the specific example of the image in which several focus positions exist. It is explanatory drawing which showed the specific example of the image in which several focus positions exist. It is explanatory drawing which showed the structure of the image processing apparatus 20 by this embodiment. 3 is a flowchart illustrating a first operation example of the image processing apparatus 20. It is the flowchart which showed the determination method of the attention area | region which considered the several focus position. It is explanatory drawing which showed the calculation method of dispersion degree. It is explanatory drawing which showed the calculation method of dispersion degree. It is the flowchart which showed the 2nd operation example of the image processing apparatus. It is the block diagram which showed the hardware constitutions of the image processing apparatus.

  Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

  In the present specification and drawings, a plurality of components having substantially the same functional configuration may be distinguished by adding different alphabets after the same reference numeral. However, when it is not necessary to particularly distinguish each of a plurality of constituent elements having substantially the same functional configuration, only the same reference numerals are given.

Moreover, this indication is demonstrated according to the item order shown below.
1. 1. Basic configuration of image processing system 2. Configuration of image processing apparatus Operation of image processing apparatus 3-1. First operation example 3-2. Second operation example 4. Hardware configuration Conclusion

<1. Basic Configuration of Image Processing System>
The technology according to the present disclosure may be implemented in a form described in detail in “2. Configuration of Image Processing Device” to “3. Operation of Image Processing Device” as an example. An image processing apparatus (20) according to an embodiment of the present disclosure includes:
A. Of a plurality of methods, a region of interest determination unit that determines a region of interest in the input image according to a method according to shooting information obtained at the time of shooting of the input image;
B. An image processing unit that performs a blurring process on a peripheral area not included in the attention area.

  In the following, first, a basic configuration of an image processing system including such an image processing apparatus will be described.

  FIG. 1 is an explanatory diagram illustrating a configuration of an image processing system 1 according to an embodiment of the present disclosure. As illustrated in FIG. 1, the image processing system 1 according to an embodiment of the present disclosure includes a photographing device 10 and an image processing device 20.

(Photographing device 10)
The photographing apparatus 10 obtains an image by photographing a subject. Specifically, the photographing apparatus 10 includes a photographing optical system such as a photographing lens and a zoom lens, and an image pickup device such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The photographing optical system collects light emitted from the subject and forms a subject image on the imaging surface of the photographing element. The imaging element converts the subject image formed by the imaging optical system into an electrical image signal.

  In addition, the imaging apparatus 10 according to the present embodiment has focus points at a plurality of locations on the imaging surface, and can detect a focused state for each focus point. For example, as shown in FIG. 2, focus points P1 to P35 are arranged at 35 locations on the imaging surface 14, and the photographing apparatus 10 can detect the degree of focus at each focus point.

  Such a photographing device 10 acquires photographing information at the time of photographing an image, and supplies an image file including the image and photographing information to the image processing device 20 as shown in FIG. Note that the shooting information includes, for example, focal length information indicating a focal length at the time of image shooting, and focus information. The focus information may include information indicating the degree of focusing at each focus point, and information indicating the state of the optical system such as the lens position at the time of shooting.

(Image processing apparatus 20)
The image processing device 20 has a function of performing various image processing on the image supplied from the imaging device 10. For example, the image processing apparatus 20 can perform miniature processing on an image supplied from the imaging apparatus 10 using imaging information of the image. Miniature processing is processing that blurs the region around the region of interest without blurring the region of interest in the image, and this makes it possible to obtain a miniature-like image with a shallow depth of field. Hereinafter, the miniature processing will be briefly described with reference to FIGS.

  3-5 is explanatory drawing which showed the miniature process. Note that in FIGS. 3 to 5, the intensity of image blur due to miniature processing is expressed by color shading. That is, in FIG. 3 to FIG. 5, the region where the blur is strong is given a lighter color.

  As shown in FIG. 3, when the focus point P <b> 20 near the center of the image is the only in-focus position in the image (that is, the position where the degree of focus exceeds the threshold value), the region including the focus point P <b> 20. Is determined as a region of interest. As shown in FIG. 4, when the focus point P30 at the bottom of the image is the only in-focus position in the image, the area including the focus point P30 is determined as the attention area. Similarly, as shown in FIG. 5, when the focus point P5 at the top of the image is the only in-focus position in the image, the area including the focus point P5 is determined as the attention area.

  Then, the image processing apparatus 20 performs a blurring process on the peripheral area of the attention area around the attention area. Specifically, as shown in FIGS. 3 to 5, the image processing apparatus 20 performs a stronger blurring process as the distance from the attention area increases. Thereby, an image like a miniature with a shallow depth of field is obtained. Alternatively, the image processing apparatus 20 may perform a blurring process on the peripheral area around the in-focus position with the in-focus position as the center.

  In the present specification, an example in which the above-described miniature processing is performed in the image processing apparatus 20 will be described. However, by providing the imaging apparatus 10 with a configuration for performing miniature processing, the miniature processing is performed in the imaging apparatus 10. It is also possible to do this. In this case, the imaging device 10 may perform miniature processing after capturing an image, or may perform miniature processing when capturing an image.

  Also, although a PC (Personal Computer) is shown as an example of the image processing apparatus 20, the image processing apparatus 20 is not limited to a PC. For example, the image processing device 20 may be an information processing device such as a home video processing device (DVD recorder, VCR, etc.), a PDA (Personal Digital Assistants), a home game device, or a home appliance. Further, the image processing device 20 may be an information processing device such as a mobile phone, a PHS (Personal Handyphone System), a portable video processing device, or a portable game device.

(background)
As described above, when there is one in-focus position in the image, the attention area can be determined so as to include the in-focus position. However, in practice, there may be a plurality of in-focus positions in the image. Hereinafter, a specific example of an image having a plurality of in-focus positions will be described.

  6 and 7 are explanatory diagrams showing specific examples of an image having a plurality of in-focus positions. In the example shown in FIG. 6, the image is in focus at the focus points P11, P12, P18, and P19 corresponding to the human face area. In particular, the degree of focus at the focus point P12 is the highest.

  In the example shown in FIG. 7, the image is in focus at the focus points P2, P6, P9, P13, P15, P21, P22 and P28 corresponding to the tree area beside the road. In particular, the degree of focus at the focus point P28 is the highest.

  As a method for determining a region of interest from an image in which a plurality of in-focus positions exist, a method for determining a region including the most in-focus position as a region of interest, or a plurality of in consideration of a plurality of in-focus positions, for example, a plurality And a method of determining an area including the center of gravity position of the in-focus position as an attention area.

  However, the attention area determined by the method used may differ. For example, when the in-focus positions are concentrated at one place as shown in FIG. 6, there is no great difference in the attention area determined by each method. On the other hand, when the in-focus positions are dispersed as shown in FIG. 7, different attention areas are determined for each method. When the attention area is different as described above, an image finally obtained by the miniature processing is also different. Therefore, when the attention area is not appropriate, it is difficult to obtain a result expected by the user.

  Thus, the image processing apparatus 20 according to the present embodiment has been created by focusing on the above circumstances. The image processing apparatus 20 according to the present embodiment can appropriately determine a region of interest in an image based on shooting information. Hereinafter, the image processing apparatus 20 according to the present embodiment will be described in detail.

<2. Configuration of Image Processing Device>
FIG. 8 is an explanatory diagram showing the configuration of the image processing apparatus 20 according to the present embodiment. As illustrated in FIG. 8, the image processing apparatus 20 according to the present embodiment includes a storage unit 216, a region of interest determination unit 220, and a blur processing unit 230.

  The storage unit 216 stores an image file made up of images and shooting information supplied from the shooting device 10. The storage unit 216 may be a storage medium such as a nonvolatile memory, a magnetic disk, an optical disk, and an MO (Magneto Optical) disk.

  The attention area determination unit 220 selects a method for determining the attention area of the image stored in the storage unit 216 based on shooting information of the image, and determines the attention area of the image by the selected method. . As a method for determining the region of interest, a method including determining a region including the most in-focus position as the region of interest, or considering a plurality of in-focus positions, for example, a region including the center of gravity positions of a plurality of in-focus positions. There is a method for determining the area.

  Here, when the depth of field is shallow, it is difficult to focus the subject. Therefore, the most focused position with the highest degree of focus in the image with the shallow depth of field is likely to be the subject intended by the user. On the other hand, since many subjects are focused when the depth of field is deep, the most in-focus position of an image with a deep depth of field may not be the only subject intended by the user. Therefore, as will be described in detail in “3. Operation of the image processing apparatus”, the attention area determination unit 220 selects a method for determining the attention area based on the depth of field at the time of image capturing. .

  3 to 5, etc., the example in which the attention area is an area along the horizontal direction of the image has been described, but the form of the attention area is not limited to such an example. For example, the attention area may be an area along the vertical direction of the image, a circular area, or a rectangular area that constitutes a part of the horizontal direction and the vertical direction.

  The blurring processing unit 230 is an image processing unit that performs a blurring process on a peripheral region of the attention area determined by the attention area determination unit 220. For example, the blurring processing unit 230 may perform stronger blurring processing on an area away from the attention area by using different low-pass filters depending on the distance from the attention area.

<3. Operation of image processing apparatus>
The configuration of the image processing apparatus 20 according to the present embodiment has been described above. Subsequently, an operation example of the image processing apparatus 20 according to the present embodiment will be described.

(First operation example)
FIG. 9 is a flowchart showing a first operation example of the image processing apparatus 20. As shown in FIG. 9, first, the attention area determination unit 220 of the image processing apparatus 20 acquires an image to be processed and shooting information of the image (S308).

  Then, the attention area determination unit 220 determines whether there are a plurality of in-focus positions in the image based on the focus information included in the shooting information (S308). Here, when a plurality of in-focus positions do not exist in the image, the attention area determination unit 220 determines an area including the most in-focus position in the image as the attention area (S316). Note that whether or not there are a plurality of in-focus positions in the image can be determined by analyzing the image even when there is no focus information. Similarly, the most in-focus position and the in-focus position can be detected by image analysis.

  On the other hand, when there are a plurality of in-focus positions in the image, the attention area determination unit 220 selects the attention area determination method based on the focal length indicated by the focal length information included in the photographing information (S312).

  Specifically, since the depth of field is shallower as the focal length is longer, and the depth of field is deeper as the focal length is shorter, the attention area determination unit 220 is most focused when the focal length is equal to or greater than the threshold. A region including the position is determined as a region of interest (S316).

  In addition, when the focal length is less than the threshold, the attention area determination unit 220 determines the attention area in consideration of a plurality of in-focus positions (S320). As an example, when the focal length is less than the threshold value, the attention area determination unit 220 may uniformly determine an area including, for example, the centroid positions of the plurality of focus positions as the attention area. In addition, when the focal length is less than the threshold, the attention area determination unit 220 may determine the attention area in consideration of the dispersion of a plurality of in-focus positions as described with reference to FIG.

  FIG. 10 is a flowchart showing a method of determining a region of interest in consideration of the dispersion of a plurality of in-focus positions. As shown in FIG. 10, the attention area determination unit 220 first calculates the degree of dispersion of a plurality of in-focus positions (S322). A method for calculating the degree of dispersion will be described later.

  Then, when the degree of dispersion is greater than or equal to the threshold (S324), the attention area determination unit 220 determines an area including the most in-focus position as the attention area (S326). On the other hand, when the degree of dispersion is less than the threshold (S324), the attention area determination unit 220 determines, for example, an area including the centroid positions of the plurality of focusing positions as the attention area based on the plurality of focusing positions (S328). .

  Accordingly, for example, when the focal length of the images shown in FIGS. 6 and 7 is less than the threshold value, the image shown in FIG. An area including the position of the center of gravity is determined as the attention area. On the other hand, for the image shown in FIG. 7 in which the dispersion degree of the focus position is equal to or greater than the threshold value, the area including the most in-focus position P28 is determined as the attention area.

  When the attention area is determined in S316 or S320 as described above, the blurring processing unit 230 performs a blurring process on the peripheral area of the attention area as shown in FIG. 9 (S330).

  As described above, according to the first operation example of the image processing apparatus 20, it is possible to appropriately determine the attention area according to the focal length at the time of image capturing. Further, according to the first operation example of the image processing device 20, when there are a plurality of in-focus positions, the attention area can be more appropriately determined by calculating the degree of dispersion of the in-focus positions. Is possible.

(Supplement)
Here, with reference to FIG. 11 and FIG. 12, a method for the attention area determination unit 220 to calculate the degree of dispersion of the in-focus position in S322 will be supplemented.

-First Calculation Method First, the attention area determination unit 220 calculates the distance ΔX of the in-focus position farthest in the horizontal direction (X direction) according to the following formula (1), and according to the following formula (2). The distance ΔY of the in-focus position farthest in the vertical direction (Y direction) is calculated.
ΔX = Xmax−Xmin (Formula 1)
ΔY = Ymax−Ymin (Formula 2)

  As shown in FIG. 11, when the focus points P10, P12, P27, and P30 are in-focus positions, ΔX expressed by Equation 1 corresponds to the horizontal distance between the focus points P30 and P27. Further, ΔY expressed by the following mathematical formula 2 corresponds to the vertical distance between P10 and P12 and P30.

Then, the attention area determination unit 220 calculates the degree of dispersion according to the following Equation 3 using the distance ΔX and the distance ΔY.
Dispersion = ΔX · ΔY
(Formula 3)

  The degree of dispersion of a plurality of in-focus positions in an image can be evaluated based on the degree of dispersion obtained by Equation 3 above. In addition, although the above formula 3 shows an example of multiplying the distance ΔX and the distance ΔY, the calculation for calculating the degree of dispersion is not limited to such an example. For example, even if the distance ΔX and the distance ΔY are added, Good. With this configuration, it is possible to avoid a case where the degree of dispersion is calculated as “0” when the distance ΔX or the distance ΔY is “0”.

-Second Calculation Method In the first calculation method, the method for calculating the degree of dispersion of the in-focus position in the horizontal direction and the vertical direction has been described. Only the degree of dispersion at the in-focus position in the upper or vertical direction may be calculated.

  For example, as shown in FIGS. 3 to 5, when the attention area is an area along the horizontal direction, the focus position is included even if the focus positions are dispersed in the horizontal direction at the same vertical position. The attention area and the attention area including the centroid positions of the plurality of in-focus positions coincide with each other. For this reason, when the attention area is an area along the horizontal direction, it is considered that the significance of calculating the degree of dispersion of the in-focus position in the horizontal direction is small.

  Therefore, the attention area determination unit 220 may calculate only the degree of dispersion of the in-focus positions in a direction (for example, the vertical direction) that intersects the direction along the attention area (for example, the horizontal direction). With this configuration, the processing of the image processing device 20 can be simplified.

-3rd calculation method Moreover, the attention area determination part 220 may calculate the area of the area containing a some focus position as dispersion degree. For example, as shown in FIG. 11, when the focus points P10, P12, P27 and P30 are in-focus positions, the attention area determination unit 220 distributes the area of the area including the focus points P10, P12, P27 and P30. It may be calculated as a degree.

(3-2. Second operation example)
FIG. 13 is a flowchart illustrating a second operation example of the image processing apparatus 20. As illustrated in FIG. 13, first, the attention area determination unit 220 of the image processing device 20 acquires an image to be processed and shooting information of the image (S308).

  Then, the attention area determination unit 220 determines whether there are a plurality of in-focus positions in the image based on the focus information included in the shooting information (S308). Here, when a plurality of in-focus positions do not exist in the image, the attention area determination unit 220 determines an area including the most in-focus position in the image as the attention area (S316).

  On the other hand, when there are a plurality of in-focus positions in the image, the attention area determination unit 220 determines whether the subject distance at the most in-focus position obtained from the focus information included in the shooting information is less than a threshold value. A method for determining a region of interest is selected (S334).

  Specifically, the closer the subject distance is, the shallower the depth of field is, and the farther the subject distance is, the deeper the depth of field is. Therefore, the attention area determination unit 220 determines that the subject distance at the most in-focus position is less than the threshold value. In step S316, the region including the most in-focus position is determined as the attention region. On the other hand, when the subject distance at the most in-focus position is equal to or greater than the threshold, the attention area determination unit 220 determines the attention area in consideration of a plurality of in-focus positions (S320). For example, as described in the first operation example, the attention area determination unit 220 may determine, as the attention area, an area including, for example, the center of gravity position among the plurality of focusing positions, or the dispersion of the plurality of focusing positions. The attention area may be determined in consideration of

<4. Hardware configuration>
The image processing by the image processing apparatus 20 described above is realized in cooperation with hardware included in the image processing apparatus 20 described below with reference to FIG.

  FIG. 14 is a block diagram illustrating a hardware configuration of the image processing apparatus 20. The image processing apparatus 20 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, and a host bus 204. The image processing apparatus 20 includes a bridge 205, an external bus 206, an interface 207, an input device 208, an output device 210, a storage device (HDD) 211, a drive 212, and a communication device 215.

  The CPU 201 functions as an arithmetic processing device and a control device, and controls the overall operation in the image processing device 20 according to various programs. Further, the CPU 201 may be a microprocessor. The ROM 202 stores programs used by the CPU 201, calculation parameters, and the like. The RAM 203 temporarily stores programs used in the execution of the CPU 201, parameters that change as appropriate during the execution, and the like. These are connected to each other by a host bus 204 including a CPU bus.

  The host bus 204 is connected to an external bus 206 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 205. Note that the host bus 204, the bridge 205, and the external bus 206 are not necessarily configured separately, and these functions may be mounted on one bus.

  The input device 208 includes input means for a user to input information, such as a mouse, keyboard, touch panel, button, microphone, switch, and lever, and an input control circuit that generates an input signal based on the input by the user and outputs the input signal to the CPU 201. Etc. The user of the image processing device 20 can input various data and instruct processing operations to the image processing device 20 by operating the input device 208.

  The output device 210 includes display devices such as a CRT (Cathode Ray Tube) display device, a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Diode) device, and a lamp. Furthermore, the output device 210 includes an audio output device such as a speaker and headphones. The output device 210 outputs reproduced content, for example. Specifically, the display device displays various information such as reproduced video data as text or images. On the other hand, the audio output device converts reproduced audio data or the like into audio and outputs it.

  The storage device 211 is a data storage device configured as an example of a storage unit of the image processing device 20 according to the present embodiment. The storage device 211 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, a deletion device that deletes data recorded on the storage medium, and the like. The storage device 211 is composed of, for example, an HDD (Hard Disk Drive). The storage device 211 drives a hard disk and stores programs executed by the CPU 201 and various data.

  The drive 212 is a storage medium reader / writer, and is built in or externally attached to the image processing apparatus 20. The drive 212 reads information recorded on a removable storage medium 24 such as a mounted magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and outputs it to the RAM 203. The drive 212 can also write information to the removable storage medium 24.

  The communication device 215 is a communication interface configured with, for example, a communication device for connecting to the communication network 12. The communication device 215 may be a wireless LAN (Local Area Network) compatible communication device, an LTE (Long Term Evolution) compatible communication device, or a wire communication device that performs wired communication.

<5. Conclusion>
As described above, according to the image processing apparatus 20 of the present embodiment, the attention area can be determined based on the information related to the depth of field in the shooting information, so that a miniature effect suitable for the image can be obtained. Is possible. Further, according to the image processing apparatus 20 of the present embodiment, it is possible to more appropriately determine a region of interest by calculating the degree of dispersion of a plurality of focus positions when there are a plurality of focus positions. Become.

  In addition, although preferred embodiment of this indication was described in detail, referring an accompanying drawing, the technical scope of this indication is not limited to this example. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that it belongs to the technical scope of the present disclosure.

  For example, each step in the processing of the image processing apparatus 20 of the present specification does not necessarily have to be processed in time series in the order described as a flowchart. For example, each step in the processing of the image processing apparatus 20 may be processed in an order different from the order described as the flowchart, or may be processed in parallel.

  In addition, it is possible to create a computer program for causing hardware such as the CPU 201, the ROM 202, and the RAM 203 built in the image processing apparatus 20 to perform the same functions as the components of the image processing apparatus 20 described above. A storage medium storing the computer program is also provided.

The following configurations also belong to the technical scope of the present disclosure.
(1)
Of a plurality of methods, a region of interest determination unit that determines a region of interest in the input image according to a method according to shooting information obtained at the time of shooting of the input image;
An image processing unit that performs a blurring process on a peripheral area not included in the attention area;
An image processing apparatus comprising:
(2)
The image processing device according to (1), wherein the attention area determination unit determines the attention area according to a method according to a depth of field at the time of shooting the input image based on the shooting information.
(3)
The shooting information includes focus information indicating a focus state of each position in the input image,
The attention area determination unit determines an area including the most in-focus position as the attention area when a plurality of focusing positions do not exist in the input image, and the plurality of focusing positions exist in the input image. In this case, the image processing device according to (2), wherein the region of interest is determined by a method according to information related to the other depth of field included in the shooting information.
(4)
The shooting information includes focal length information indicating a focal length,
The attention area determination unit determines an area including the most in-focus position as the attention area when the focal distance is higher than a first threshold, and a plurality of areas when the focal distance is equal to or less than the first threshold. The image processing apparatus according to (3), wherein the region of interest is determined from the in-focus position.
(5)
The attention area determination unit calculates a degree of dispersion of the plurality of in-focus positions when the focal length is less than or equal to the first threshold, and when the degree of dispersion is higher than a second threshold, The image processing apparatus according to (4), wherein an area including a position is determined as the attention area, and the attention area is determined from the plurality of in-focus positions when the degree of dispersion is equal to or less than the second threshold. .
(6)
The shooting information includes information that can specify the subject distance,
The attention area determination unit determines an area including the most in-focus position as the attention area when the subject distance is equal to or smaller than the third threshold, and a plurality of areas when the subject distance is higher than the third threshold. The image processing apparatus according to (3), wherein the region of interest is determined from the in-focus position.
(7)
The attention area determination unit calculates a degree of dispersion of the plurality of in-focus positions when the subject distance is higher than the third threshold, and when the degree of dispersion is higher than a second threshold, the focus is determined. The image processing apparatus according to (6), wherein an area including a position is determined as the attention area, and the attention area is determined from the plurality of focus positions when the degree of dispersion is equal to or less than the second threshold. .
(8)
The region of interest is a region along a first direction in the input image;
The image processing device according to (5) or (7), wherein the attention area determination unit calculates a degree of dispersion in a second direction intersecting the first direction at the plurality of focus positions. .
(9)
Determining a region of interest in the input image according to a method according to shooting information obtained when shooting the input image among a plurality of methods;
Blurring a peripheral area not included in the attention area;
Including an image processing method.
(10)
Computer
Of a plurality of methods, a region of interest determination unit that determines a region of interest in the input image according to a method according to shooting information obtained at the time of shooting of the input image;
An image processing unit that performs a blurring process on a peripheral area not included in the attention area;
Program to function as

DESCRIPTION OF SYMBOLS 10 Image | photographing apparatus 20 Image processing apparatus 216 Storage part 220 Attention area determination part 230 Blur processing part

Claims (10)

Of a plurality of methods, a region of interest determination unit that determines a region of interest in the input image according to a method according to shooting information obtained at the time of shooting of the input image;
An image processing unit that performs a blurring process on a peripheral area not included in the attention area;
An image processing apparatus comprising:   The image processing apparatus according to claim 1, wherein the attention area determination unit determines the attention area according to a method according to a depth of field at the time of shooting the input image based on the shooting information. The shooting information includes focus information indicating a focus state of each position in the input image,
The attention area determination unit determines an area including the most in-focus position as the attention area when a plurality of focusing positions do not exist in the input image, and the plurality of focusing positions exist in the input image. The image processing apparatus according to claim 2, wherein the region of interest is determined by a method according to information related to the other depth of field included in the shooting information. The shooting information includes focal length information indicating a focal length,
The attention area determination unit determines an area including the most in-focus position as the attention area when the focal distance is higher than a first threshold, and a plurality of areas when the focal distance is equal to or less than the first threshold. The image processing apparatus according to claim 3, wherein the region of interest is determined from an in-focus position.   The attention area determination unit calculates a degree of dispersion of the plurality of in-focus positions when the focal length is less than or equal to the first threshold, and when the degree of dispersion is higher than a second threshold, The image processing apparatus according to claim 4, wherein an area including a position is determined as the attention area, and the attention area is determined from the plurality of in-focus positions when the degree of dispersion is equal to or less than the second threshold. The shooting information includes information that can specify the subject distance,
The attention area determination unit determines an area including the most in-focus position as the attention area when the subject distance is equal to or smaller than the third threshold, and a plurality of areas when the subject distance is higher than the third threshold. The image processing apparatus according to claim 3, wherein the region of interest is determined from an in-focus position.   The attention area determination unit calculates a degree of dispersion of the plurality of in-focus positions when the subject distance is higher than the third threshold, and when the degree of dispersion is higher than a second threshold, the focus is determined. The image processing apparatus according to claim 6, wherein an area including a position is determined as the attention area, and the attention area is determined from the plurality of in-focus positions when the degree of dispersion is equal to or less than the second threshold value. The region of interest is a region along a first direction in the input image;
The image processing apparatus according to claim 5, wherein the attention area determination unit calculates a degree of dispersion of the plurality of in-focus positions in a second direction intersecting the first direction. Determining a region of interest in the input image according to a method according to shooting information obtained when shooting the input image among a plurality of methods;
Blurring a peripheral area not included in the attention area;
Including an image processing method. Computer
Of a plurality of methods, a region of interest determination unit that determines a region of interest in the input image according to a method according to shooting information obtained at the time of shooting of the input image;
An image processing unit that performs a blurring process on a peripheral area not included in the attention area;
Program to function as

Images