KR101298210B1 - Method of controlling digital image processing apparatus wherein face area is searched - Google Patents

Abstract

The present invention relates to a control method of a digital image processing apparatus in which a photographing mode and a reproduction mode are performed. Here, when at least one face region is found in the entire image data obtained in the photographing mode, the index image of the face region is displayed together with the entire image in the reproduction mode.

Description

Method of controlling digital image processing apparatus wherein face area is searched}

1 is a perspective view showing the front and top appearance of a digital camera as a digital image processing apparatus to which the control method according to the present invention is applied.

FIG. 2 is a rear view showing a rear outer shape of the digital camera of FIG. 1;

FIG. 3 is a diagram showing the overall configuration of the digital camera of FIG. 1. FIG.

4 is a flow chart showing the main algorithm of the digital camera processor of FIG.

FIG. 5 is a flowchart illustrating an algorithm of the photographing mode performing step of FIG. 4 when the person photographing mode is set in the performing of the setting mode of FIG. 4.

FIG. 6 is a diagram illustrating a structure of an image file formed on a memory card by performing the algorithm of FIG. 5.

7 is a flowchart illustrating a playback algorithm when the video file of FIG. 6 is selected in the playback mode.

8 is a diagram illustrating an example of an entire image obtained by the image capturing step of FIG. 5.

9 is a diagram illustrating a screen displayed by performing step S701 of FIG. 7.

10 and 11 illustrate screens displayed by performing steps S705, S707, and S709 of FIG. 7.

 <Explanation of symbols for the main parts of the drawings>

1 ... digital camera, 11 ... self-timer lamp,

12 ... flash, 13 ... shutter release button,

15 ... function buttons, 16 ... ASR mode button,

17 ... power button, 19 ... flash-light sensor, 20 ... lens, 22 ... camera-status lamp,

23 ... special-effect button, 24 ... camera strap hook,

25 ... earphone connection, MIC ... microphone,

SP ... speaker, 35 ... display panel,

36 ... + / - button, 39 ... Zoom / 9 split / volume button,

42 ... play / printer button, 43 ... mode button,

OPS ... Optical system, OEC ... Photoelectric conversion unit, M _Z ... Zoom motor, M _F ... Focus motor,

M _A ... aperture motor, 501 ... analog-to-digital converter,

502 ... timing circuit, 503 ... real time clock,

504 ... DRAM, 505 ... EEPROM, 506 ... memory card interface, 507 ... digital camera processor, 508 ... RS232C interface, 509 ... video filter, 21a ... USB connection, 21b ... RS232C connection, 21c ... video output, 510 ... lens driver, 511 ... flash controller, 512 ... microcontroller, INP ... user input, LAMP ... light emitter, 513 ... audio processor, 514 ... LCD driver, 62 ... flash memory, 91 ... screen image,

921, 922 face image, 102, 112 index image,

101, 111 ... Enlarged face image by full image data.

The present invention relates to a control method of a digital image processing apparatus, and more particularly, to a control method of a digital image processing apparatus in which a photographing mode and a reproduction mode are performed.

As a typical digital image processing apparatus, for example, a digital camera of U.S. Patent No. 6,097,431 (entitled "Method and system for reviewing and navigating among images on an image capture unit") is exemplified.

In the conventional digital image processing apparatus as described above, the photographing mode and the reproduction mode are performed. When people are photographed in the photographing mode, the user needs to enlarge the face area of any one person in the reproduction mode in order to see in detail the face state of at least one person.

However, in order to enlarge the face area of a person in the entire image obtained by photographing, there is a problem that the user must continuously operate the direction buttons and the zoom buttons for a considerable time. That is, the face area of any person in the entire image may not be quickly enlarged by simple manipulation of the user.

SUMMARY OF THE INVENTION An object of the present invention is to provide a control method of a digital image processing apparatus that enables a user to quickly enlarge a face area of a person in a whole image obtained by photographing by a simple operation of a user.

The present invention for achieving the above object relates to a control method of a digital image processing apparatus in which the photographing mode and the reproduction mode are performed. Here, when at least one face region is found in the entire image data obtained in the photographing mode, the index image of the face region is displayed together with the entire image in the reproduction mode.

According to the control method of the digital image processing apparatus of the present invention, the image of the face region may be enlarged and displayed as the user simply selects the index image of the face region. That is, the face region of any one of the entire images obtained by the photographing may be quickly enlarged and displayed by a simple manipulation of the user.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

Timer lamp 11, flash 12, shutter release button 13, and ASR (Advanced Shake) 13 are provided on the front and the top of the digital camera 1 as a digital image processing apparatus according to the present invention, Reduction button 16, a power button 17, a lens unit 20, a microphone MIC, and a speaker SP.

The self-timer lamp 11 operates during the set time from when the shutter release button 13 is depressed to when it starts capturing an image in the self-timer mode. In addition, the self-timer lamp 11 generates auxiliary light according to the user's selection.

The ASR mode button 16 is used to compensate for camera shake. The ASR mode button 16 is also used as a lock button. For example, when the ASR mode button 16 is pressed for less than one second, the image stabilization function is performed. When the ASR mode button 16 is pressed for more than one second, the lock function in the playback mode is performed.

The shutter release button 13 has a two-stage structure. That is, when the user operates the wide angle-zoom button 39 _W and the tele-zoom button 39 _T and then presses the shutter release button 13 by one step, the SH1 signal from the shutter release button 13 is turned on ), And the SH2 signal from the shutter release button 13 is turned on when the second stage is pressed. In the still image shooting mode and the moving image shooting mode, an image is captured after the SH2 signal is turned on. In continuous-shooting mode, images are captured continuously while the SH1 signal is on.

2, a digital camera 1 according to the present invention includes function buttons 15, a camera-state lamp 22, a special-effect button 23, a camera strap hook 24, There are a connection section 25, a display panel 35, a +/- button 36, a zoom / 9 division / volume button 39, a reproduction / printer button 42 and a mode button 43.

The function buttons 15 are used by the user to perform specific functions of the digital camera 1 and are used as direction-movement buttons of the active cursor in the menu screen of the display panel 35, And is used to switch between the file and the recording medium.

The camera-state lamp 22 is used to show various operational states of the camera. The special-effect button 23 is used to set special effects on the image to be photographed. The +/- button 36 is used to adjust the shutter speed for night view shooting and the like.

The zoom / 9split / volume button 39 is used to perform a zooming operation in shooting or playback mode, to display nine pictures in a single playback mode, or to adjust the volume of audio. Used for

The reproduction / printer button 42 is used for switching between the reproduction mode and the preview mode or for direct output to the printer.

The mode button 43 is used to select a PMP (Portable Media Player) mode or various shooting modes.

Fig. 3 shows the overall configuration of the digital camera 1 of Fig. Referring to Figs. 1 to 3, the overall configuration and operation of the digital camera 1 of Fig. 1 will be described as follows.

An optical system (OPS) including a lens unit and a filter unit optically processes light from a subject. The lens portion of the optical system OPS includes a zoom lens, a focus lens, and a compensation lens. When the user presses the zoom / 9 division / volume button 39 included in the user input unit INP in the preview mode or the moving image shooting mode, a corresponding signal is input to the micro controller 512. Accordingly, as the micro controller 512 controls the lens driving unit 510, the zoom motor M _Z is driven to move the zoom lens.

Meanwhile, in the automatic focusing mode, the main controller built in the digital camera processor 507 controls the driving unit 510 through the micro controller 512 to drive the focus motor M _F. Thus, the focus lens is moved. In this process, the number of drive steps of the focus motor M _F , for example, the position of the focus lens where the high frequency component of the image signal is the largest, is set. Reference symbol M _A denotes a motor for driving an aperture (not shown).

A photoelectric conversion unit OEC of a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide-Semiconductor) converts light from the optical system OPS into an electrical analog signal. Here, the digital camera processor 507 controls the timing circuit 502 to control the operations of the photoelectric conversion unit (OEC) and the analog-digital conversion unit 501. A CDS-ADC (Correlation Double Sampler and Analog-to-Digital Converter) element 501 as an analog-to-digital conversion section processes an analog signal from the photoelectric conversion section OEC to remove high frequency noise, And then converted into a digital signal.

The real-time clock 503 provides time information to the digital camera processor 507. The digital camera processor 507 processes digital signals from the CDS-ADC device 501 to generate digital image signals classified into luminance and chrominance signals.

The light-emitting section (LAMP) driven by the microcontroller 512 according to the control signals from the digital camera processor 507 incorporating the main controller includes a self-timer lamp 11 and a camera-state lamp 22 .

The user input unit INP includes a shutter release button 13, function buttons 15, an ASR mode button 16, a power button 17, a special-effect button 23, a +/- button 36, A zoom / nine division / volume button 39, a playback / printer button 42, a mode button 43, and the like.

A digital image signal from the digital camera processor 507 is temporarily stored in a dynamic random access memory (DRAM) 504. An algorithm necessary for the operation of the digital camera processor 507 is stored in an EEPROM (Electrically Erasable and Programmable Read Only Memory) 505. In the memory card interface (MCI) 506, the user's memory card is detached. In the flash memory (FM), setting data necessary for the operation of the digital camera processor 507 is stored. In the memory card interface 506, a plurality of memory cards are detached and removed as user's recording media.

The digital video signal from the digital camera processor 507 is input to the LCD driver 514, whereby an image is displayed on the display panel 35.

The digital video signal from the digital camera processor 507 is transmitted through the USB (Universal Serial Bus) connection unit 21a or the RS232C interface 508 and the connection unit 21b through the serial communication in the interface unit 21 And can be transmitted as a video signal through the video filter 509 and the video output unit 21c.

The audio processor 513 outputs the audio signal from the microphone MIC to the digital camera processor 507 or the speaker SP and outputs the audio signal from the digital camera processor 507 to the speaker SP.

On the other hand, the micro controller 512 controls the operation of the flash controller 511 in accordance with the signal from the flash-light amount sensor 19 to drive the flash 12. [

FIG. 4 shows a main algorithm of the digital camera processor 507 of FIG. A main algorithm of the digital camera processor 507 of FIG. 3 will be described with reference to FIGS. 1 to 4 as follows.

When operation power is applied to the digital camera 1, the digital camera processor 507 executes initialization (step S1). When this initialization step S1 is executed, the digital camera processor 507 performs a preview mode (step S2). In this preview mode, the input image is displayed on the display panel 35.

Next, when the SH1 signal as the first stage signal from the shutter release button 13 is in the On state (step S3), the digital camera processor 507 performs the shooting mode (step S4).

Next, when signals corresponding to the setting mode are input from the input signals from the user input unit INP (step S5), a setting mode for setting the operating conditions according to the input signals from the user input unit INP is performed (Step S6).

On the other hand, if no termination signal is generated (step S7), the digital camera processor 507 determines whether a conversion signal to another arbitrary mode has been generated (step S8).

If no conversion signal to another mode is generated in step S8, the digital camera processor 507 repeats step S2 and the following steps. If a conversion signal to any other mode, for example, a playback mode, is generated in step S8, the digital camera processor 507 repeatedly performs the step S2 and subsequent steps after performing the mode (step S9). do.

FIG. 5 shows an algorithm of performing a shooting mode of FIG. 4 when the person photographing mode is set in the performing of the setting mode of FIG. 4. 3 and 5, the algorithm of FIG. 5 will be described.

First, the digital camera processor 507 obtains current contour information from the preview image data of the user-face detection unit 48 (step S601). That is, the current outline information is obtained from the preview image data from the auxiliary CDS-ADC element 47.

Next, the digital camera processor 507 determines whether the SH2 signal, which is a two-stage signal from the shutter release button 13 in FIG. 1, is on (step S501).

If the SH2 signal is not On in step S501, the digital camera processor 507 determines whether the SH1 signal, which is the first stage signal from the shutter release button 13, is on (step S503). ).

If the SH1 signal, which is the first-stage signal from the shutter release button 13, is in the on state in step S503, the user intends to take a picture, and thus, the step S501 is performed again. If the SH1 signal, which is the first-stage signal from the shutter release button 13 in the step S503, is in the off state, since the user's intention to capture has disappeared, the digital camera processor 507 terminates the execution of this algorithm.

If the SH2 signal is On in step S501, since the user presses the shutter release button 13 completely, the digital camera processor 507 continues the following steps.

The digital camera processor 507 generates an image file in the memory card (step S505).

Next, the digital camera processor 507 captures an image (step S507). More specifically, the digital camera processor 507 processes digital image data from the CDS-ADC element 501 to generate digital image data classified into luminance and chroma signals, and generates the generated digital image data in the DRAM 504. Save it temporarily).

Next, the digital camera processor 507 obtains face contour information from the entire image data temporarily stored in the DRAM 504 (step S509). Here, the well-known contour recognition algorithm is used. In summary, whether to contour is determined according to the gray level difference between adjacent pixels.

Next, the digital camera processor 507 obtains position information of the face area according to the outline information of the face (step S511).

Next, the digital camera processor 507 adjusts the face image data as the data of the index image for the face region, the index image data as the data of the index image for the entire image, and the resolution of the color LCD panel 35 as the display panel. As a result, screen image data obtained by lowering the resolution of the entire image data is obtained (step S513).

Of course, the face image data as data of the index image for the face region is obtained from the total data of the face region by the positional information of the face region obtained in step S511.

Next, the digital camera processor 507 compresses the entire image data (step S515).

Next, the digital camera processor 507 stores the image data in the image file (step S517). Here, the face image data, index image data, screen image data, and compressed all image data are stored in an image file. Of course, the position information of the face area obtained in step S511 is also stored in the image file. Related contents are described with reference to FIG. 6.

FIG. 6 shows the structure of an image file formed on a memory card as a recording medium by the algorithm of FIG. 5 being performed. The structure of the image file of FIG. 6 uses the format of an EXIF (EXchangeable Image File) in accordance with the recommended image format of the digital camera of No. 12,234-1 of ISO (International Standardization Organization).

5 and 6, in each of the conventional image files formed in the memory card of FIG. 2, the data area M1, the first application area M2, and the second application area indicating the start of the video file. (APP2), compression table regions M11 to M15, all image data (JPEG compressed data) region M16, screen image data region M17, index image data region M18, first face image data region M19 ), A second face image data area M20, and an area M21 of data indicating the end of the image file are formed in this order. Here, since there are two face regions in the entire image, the first face image data region M19 and the second face image data region M20 exist.

Tag information data, which is referred to as basic information of an image file, is stored in the first application area M2. This tag information data includes the position information of the face regions obtained in step S511.

The content list data M3 and the stream data M4 to M10 are stored in the second application area APP2.

The JPEG table areas M11 to M15 in which the information of the compression process are stored are defined as a fine-quantization-tables (DQT) area (M11), a fine-Huffman-Tables (DHT) area (M12), and a fine-restart-interval (DRI) area. (M13), a discrete cosine transform frame (SOF) region M14, and a start-of-scan region M15.

The compressed data area M16 stores data of a result of compressing the entire image data according to the information of the compression process.

The screen image data obtained in the step S513 is stored in the screen image data area M17. As described above, the screen image data refers to image data in which the resolution of the entire image data is lowered according to the resolution of the color LCD panel 35 as the display panel.

The index image data area M18 stores the index image data obtained in step S513. As described above, the index image data refers to the data of the index image for the entire image.

The face image data obtained in step S513 is stored in the first face image data region M19 and the second face image data region M20. As described above, the face image data means data of an index image of a face region.

FIG. 7 shows a playback algorithm when the video file of FIG. 6 is selected in the playback mode. FIG. 8 shows an example of the entire image obtained by the image capturing step S507 of FIG. 5. FIG. 9 shows a screen displayed by performing step S701 of FIG. 7. 10 and 11 show screens displayed by performing steps S705, S707, and S709 of FIG. 7.

In FIGS. 9 to 11, reference numeral 91 denotes a screen image, 921 and 922 denote face images, 102 and 112 index images, and 101 and 111 denote enlarged face images by full image data.

6 to 11, a playback algorithm when the video file of FIG. 6 is selected in the playback mode will be described.

First, the digital camera processor 507 displays the screen image (91 in FIG. 9) and the face images 921 and 922 (step S701). More specifically, the digital camera processor 507 displays the screen image (91 in FIG. 9) using the screen image data stored in the screen image data area M17. In addition, the digital camera processor 507 displays the first face image 921 using the first face image data stored in the first face image data region M19. The digital camera processor 507 displays the second face image 922 using the second face image data stored in the second face image data region M19.

Next, the digital camera processor 507 determines whether the first face image 921 or the second face image 922 is selected by the user (step S703). This step S703 and subsequent steps S705 to S709 are repeatedly performed until the end signal is generated (step S711). If any face image is selected in step S703, steps S705 to S709 are performed.

In operation S705, the digital camera processor 507 obtains original image data of the face region from the entire image data M16 according to position information of the face region corresponding to the selected face image.

Next, the digital camera processor 507 enlarges and displays the image of the face area using the obtained original image data of the face area (see steps S707 and 101 and 111 of FIGS. 10 and 11).

On the other hand, the digital camera processor 507 displays the index image (102 or 112 of FIG. 10 or 11), and marks the enlarged displayed face area on the index image 102 or 112. Accordingly, the user can immediately detect the location of the image that is currently enlarged.

As described above, according to the control method of the digital image processing apparatus according to the present invention, an image of the face region may be enlarged and displayed as the user simply selects an index image of the face region. That is, the face region of any person among the entire images obtained by photographing may be rapidly enlarged and displayed by a simple manipulation of the user.

The present invention is not limited to the above embodiments, but may be modified and improved by those skilled in the art within the spirit and scope of the invention as defined in the claims.

Claims (8)

A control method of a digital image processing apparatus in which a shooting mode and a playback mode are performed, And when at least one face region is found in the entire image data obtained in the photographing mode, displaying the index image of the face region together with the entire image in the reproduction mode. The method of claim 1, wherein in the playback mode, And displaying an enlarged image of the face region when the index image of the face region is selected. The method of claim 2, wherein in the playback mode, And the entire image data is used to enlarge an image of the face region. The method of claim 2, wherein in the photographing mode, when photographing is performed by a user, (a) generating an image file on a recording medium; (b) if the entire image data is obtained by capturing the image, retrieving the location information of the face region by searching the entire image data; (c) when the position information of the face region is obtained, obtaining face image data as data of an index image of the face region from all data of the face region; And and (d) storing the entire image data and the face image data in the image file. The method of claim 4, wherein in the playback mode, And a face image data is used to display an index image of the face region. The method of claim 4, wherein step (b) (b1) performing the image capture, (b2) obtaining contour information of a face from the entire image data, and and (b3) obtaining position information of the face region according to the outline information of the face. The method of claim 4, wherein in step (d), And index image data as data of the index image for the entire image are stored in the image file together with the entire image data and the face image data. The method of claim 7, wherein in step (d), The screen image data of which the resolution of the entire image data is lowered according to the resolution of a display panel is stored in the image file together with the entire image data and the face image data.

Images