JP2010045619A - Image reproducing device, imaging apparatus, image reproduction method, image reproduction program - Google Patents

Abstract

When a moving image is paused and a still image is viewed, a preferable still image is displayed.
A control circuit of an electronic camera reads a reference image and an interpolated image, which are a plurality of still images arranged in chronological order (step S202), and uses a moving image as a monitor based on the read plurality of still images. It is displayed (steps S206 and S215). When the operation member detects a pause instruction operation input from the user during the display of the moving image, it is determined that there is an instruction to display a still image (steps S207 and S216) and is read instead of the moving image. The pause display composite image obtained by combining at least two still images among the plurality of still images is displayed on the monitor (steps S210 and S219).
[Selection] Figure 6

Description

  The present invention relates to a technique for reproducing an image based on a still image.

  2. Description of the Related Art Conventionally, imaging devices that can perform still image shooting during moving image shooting are known. For example, Patent Document 1 discloses an imaging apparatus that interpolates a moving image frame that is missing in still image shooting.

JP 2001-111934 A

  By the way, a preferable image is different between the case of viewing a normal still image and the case of viewing a still image paused during moving image reproduction. In other words, a clear image with no image flow is preferred for viewing a normal still image, but when viewing a still image by pausing during moving image playback, an image with an image flow flows more in motion. May be preferable. Therefore, it is desired to display a preferable still image when pausing and viewing a still image during moving image reproduction.

An image reproduction apparatus according to the present invention includes an image reading unit that reads a plurality of still images arranged in time series, and a moving image display that displays a moving image on a display monitor based on the plurality of still images read by the image reading unit. A control means; an operation detection means for detecting a pause instruction operation input by a user during the display of a moving image; and when a pause instruction operation is detected by the operation detection means, a plurality of still images are substituted for the moving image. Pause display control means for displaying on a display monitor a pause display composite image obtained by synthesizing at least two still images of the images.
An imaging device according to the present invention includes an image generation device and an imaging unit that images a subject and generates a plurality of still images.
An image reproduction method according to the present invention reads a plurality of still images arranged in chronological order, displays a moving image on a display monitor based on the plurality of still images, and pauses input by a user during the display of the moving image When an instruction operation is detected and a pause instruction operation is detected, a pause display composite image obtained by synthesizing at least two or more still images among a plurality of still images is displayed on the display monitor instead of the moving image.
An image reproduction program according to the present invention is executed in a computer to which a display monitor and an operation member are connected, and an image reading step for causing a computer to read a plurality of still images arranged in time series, and an image reading step for the computer. A moving image display control step for displaying a moving image on a display monitor based on a plurality of still images read in step 1, and a pause instruction operation input from the user to the operation member while the moving image is displayed is detected by the computer When a pause instruction operation is detected in the operation detection step and the operation detection step, a pause display for synthesizing at least two or more still images out of a plurality of still images to a computer instead of a moving image A pause display control step for displaying the composite image on the display monitor.

  ADVANTAGE OF THE INVENTION According to this invention, when pausing and viewing a still image during moving image reproduction, a preferable still image can be displayed.

<Description of First Embodiment>
FIG. 1 is a block diagram showing the configuration of the electronic camera of the first embodiment. The electronic camera includes an imaging optical system 11, a lens driving unit 12, an imaging element 13, an imaging element driving circuit 14, a signal processing circuit 15, a data processing circuit 16, a first memory 17, and a display control circuit 18. And a monitor 19, a compression / expansion circuit 20, a recording I / F (interface) 21, a communication I / F (interface) 22, an operation member 23, a release button 24, a vibration sensor 25, and a second memory. 26, a control circuit 27 and a bus 28.

  Here, the data processing circuit 16, the first memory 17, the compression / expansion circuit 20, the second memory 26 and the control circuit 27 are connected to each other via a bus 28. The lens driving unit 12, the image sensor driving circuit 14, the signal processing circuit 15, the display control circuit 18, the recording I / F 21, the communication I / F 22, the operation member 23, the release button 24, and the vibration sensor 25 are each a control circuit 27. (In FIG. 1, signal lines connecting the signal processing circuit 15, the display control circuit 18, and the control circuit 27 are omitted for simplicity).

  The imaging optical system 11 includes a plurality of lens groups including a zoom lens and a focusing lens, and serves to form a subject image on the imaging surface of the imaging element 13. For simplicity, the imaging optical system 11 is illustrated as a single lens in FIG.

  Each lens position of the imaging optical system 11 is adjusted in the optical axis direction by the lens driving unit 12. The lens driving unit 12 includes a lens driving mechanism and adjusts the lens position in accordance with a lens driving command from the control circuit 27. For example, the focus adjustment of the imaging optical system 11 is performed by the lens driving unit 12 driving the focus lens back and forth in the optical axis direction. Further, zoom adjustment of the imaging optical system 11 is performed by the lens driving unit 12 driving the zoom lens to advance and retreat in the optical axis direction.

  The image sensor 13 photoelectrically converts a subject image by a light beam that has passed through the imaging optical system 11 to generate an analog image signal. The image sensor 13 in the present embodiment is capable of single-shot imaging of still images, continuous shooting imaging of still images, and imaging of moving images. The output of the image sensor 13 is connected to the signal processing circuit 15. The image sensor 13 is configured by a CCD image sensor or a CMOS image sensor.

  The image sensor drive circuit 14 generates a drive signal at a predetermined timing in accordance with a command from the control circuit 27 and supplies the drive signal to the image sensor 13. Then, the image sensor driving circuit 14 controls charge accumulation (imaging) and reading of the accumulated charges of the image sensor 13 by the drive signal.

  The signal processing circuit 15 is an ASIC that performs various types of signal processing on the output of the image sensor 13. Specifically, the signal processing circuit 15 performs correlated double sampling, gain adjustment, DC regeneration, A / D conversion, and the like. Parameters such as gain adjustment in the signal processing circuit 15 are determined in accordance with a command from the control circuit 27. The signal processing circuit 15 is connected to the data processing circuit 16, and the data after the signal processing is output to the data processing circuit 16.

  The data processing circuit 16 is a circuit that performs digital signal processing on the image data output from the signal processing circuit 15. In the data processing circuit 16, for example, image processing such as color interpolation processing, gradation conversion processing, contour enhancement processing, and white balance adjustment is executed. The data processing circuit 16 is connected to the display control circuit 18 and the compression / decompression circuit 20, respectively. Then, the data processing circuit 16 outputs the recorded image data after the image processing to the compression / decompression circuit 20 in accordance with a command from the control circuit 27.

  Further, the data processing circuit 16 executes image resolution conversion (pixel number conversion) processing in response to a command from the control circuit 27. As an example, when displaying a reproduced image on the monitor 19, the data processing circuit 16 executes resolution conversion (pixel number conversion) processing for matching the number of pixels of the monitor 19 with respect to the data of the image to be reproduced and displayed. (Note that unless otherwise specified, when an image is displayed on the monitor 19 in this specification, the number of pixels of the display image is adjusted by the data processing circuit 16). Then, the data processing circuit 16 outputs the reproduced image data after the resolution conversion to the display control circuit 18. When performing the electronic zoom processing, the data processing circuit 16 executes resolution conversion (pixel number conversion) processing on the input image data, and compresses / decompresses the image data after the resolution conversion. Each is output to the display control circuit 18.

  The first memory 17 is a buffer memory that temporarily stores image data in the pre-process and post-process of the processing by the data processing circuit 16 or the compression / decompression circuit 20.

  In response to a command from the control circuit 27, the display control circuit 18 performs predetermined signal processing on the image data input from the data processing circuit 16 (for example, conversion of gradation characteristics in accordance with the display characteristics of the monitor 19). And output to the monitor 19. The display control circuit 18 further performs processing for superimposing overlay image data such as a shooting menu and a cursor on the image data. By such control of the control circuit 27 and the display control circuit 18, the subject image on which the overlay image is superimposed can be displayed on the monitor 19. Note that the monitor 19 in the present embodiment may be configured with any of an electronic viewfinder having an eyepiece and a liquid crystal display panel provided on the back surface of the camera housing.

  The compression / decompression circuit 20 performs predetermined compression processing on the image data input from the data processing circuit 16 in response to a command from the control circuit 27. The compression / decompression circuit 20 is connected to the recording I / F 21, and the compressed image data is output to the recording I / F 21. The compression / decompression circuit 20 executes a decoding process that is a reverse process of the compression process on the compressed image data. Note that the compression / decompression circuit 20 of the present embodiment has a configuration capable of performing lossless compression (so-called lossless encoding).

  The recording I / F 21 has a connector for connecting the storage medium 29. The recording I / F 21 writes / reads data to / from the storage medium 29 connected to the connector. The storage medium 29 includes a small hard disk, a memory card incorporating a semiconductor memory, an optical disk such as a DVD, and the like. In FIG. 1, a memory card is illustrated as an example of the storage medium 29. The storage medium 29 may be built in the electronic camera or may be detachably attached to the electronic camera. An external storage medium electrically connected via the communication I / F 22 may be used as a storage medium for reading and writing image data.

  Here, when recording data of an image captured in a photographing mode which is one of the operation modes of the electronic camera, the control circuit 27 displays a reproduced image corresponding to the recorded image on the monitor 19. The recorded image in this specification means a still image corresponding to still image data obtained by imaging and finally recorded on the storage medium 29 (or recorded on the storage medium 29). .

  When non-compressed recording of a recorded image is instructed to the control circuit 27 by the user's operation using the operation member 23, the compression / decompression circuit 20 does not perform compression processing and records the recorded image data as a recording I / F 21. Output to. Also in the case of the above uncompressed recording, the control circuit 27 causes the monitor 19 to display a reproduced image corresponding to the recorded image.

  In the playback mode, which is one of the operation modes of the electronic camera, the control circuit 27 causes the monitor 19 to display a playback image based on the image data stored in the storage medium 29. In this playback mode, the recording I / F 21 reads data of an image to be played back from the storage medium 29 in response to a command from the control circuit 27. Then, the compression / decompression circuit 20 performs a decoding process on the image data to be reproduced, and sends the decoded image data to the data processing circuit 16. Thereafter, the data processing circuit 16 and the display control circuit 18 execute the above-described processing on the decoded image data, so that the reproduced image is displayed on the monitor 19. When uncompressed image data is read from the storage medium 29, the compression / decompression circuit 20 sends the image data to the data processing circuit 16 without performing the decoding process.

  The communication I / F 22 controls data transmission / reception with an external device 30 (for example, a personal computer or an external storage medium) in accordance with the specifications of a known communication standard such as wired or wireless. Communication between the electronic camera and the external device 30 is performed via a wired or wireless communication line.

  The operation member 23 includes, for example, a command dial, a cross-shaped cursor key, a zoom operation button, a determination button, and the like. The operation member 23 receives various inputs of the electronic camera from the user. The operation member 23 may be provided with a setting member for setting the number of frames for generating an interpolation image, which will be described later.

  As an example, when receiving an input from the zoom operation button, the control circuit 27 outputs a lens drive command for the zoom lens and causes the lens drive unit 12 to drive the zoom lens forward and backward. As a result, the subject image formed on the imaging surface of the imaging device 13 is enlarged or reduced, and optical zoom adjustment is performed by the imaging optical system 11.

  When the control circuit 27 further receives an input from the zoom operation button, the control circuit 27 outputs a command to the data processing circuit 16 to change the conversion ratio of the resolution conversion processing for the image data in accordance with the user's operation. Thereby, the image displayed on the monitor 19 is enlarged or reduced, and electronic zoom adjustment is performed (electronic zoom). The conversion ratio of the resolution conversion process corresponds to the electronic zoom magnification. When the data processing circuit 16 changes the conversion ratio in the direction of increasing the electronic zoom magnification, a part of the reproduced image is enlarged and displayed on the monitor 19 (while the enlargement ratio is increased, the display range of the reproduced image is narrowed). . On the other hand, when the data processing circuit 16 changes the conversion ratio in the direction of decreasing the electronic zoom magnification, the enlargement ratio of the reproduced image displayed on the monitor 19 is lowered, but the display range of the reproduced image is widened. In the above-described shooting mode, captured image data corresponding to the display image on the monitor 19 can be recorded in the storage medium 29.

  In the shooting mode, the release button 24 receives from the user an instruction input for starting an autofocus (AF) operation before shooting by a half-press operation and an instruction input for starting an imaging operation by a full-press operation.

  The control circuit 27 executes a known contrast detection AF operation in response to a half-press operation of the release button 24. In this AF, a signal corresponding to a focus detection area set in advance in the shooting screen is used among image signals read from the image sensor 13. Specifically, the control circuit is configured to maximize the integrated value (so-called focus evaluation value) of the high frequency component for the data corresponding to the focus detection area among the data of the image signal processed by the signal processing circuit 15. 27 sends a lens drive command for the focus lens to the lens drive unit 12. The position of the focus lens that maximizes the focus evaluation value is a focus position that eliminates blurring of the edge of the subject image captured by the image sensor 13 and maximizes the contrast of the image (increases sharpness).

  The vibration sensor 25 detects the shake of the casing of the electronic camera in two directions orthogonal to each other. The vibration sensor 25 is composed of, for example, an angular velocity sensor, a gyro sensor, or the like, and is arranged in the housing of the electronic camera. The vibration sensor 25 detects a shake applied to the electronic camera in the photographing mode, and outputs shake amount data in two orthogonal directions to the control circuit 27. The control circuit 27 performs camera shake correction based on the shake amount data. For example, when the image pickup optical system 11 has a shake correction lens, the control circuit 27 sets the shake correction lens via the lens driving unit 12 so that the movement of the subject on the image pickup surface due to the shake of the housing is canceled. Camera shake correction is performed by driving.

  The second memory 26 is a non-volatile storage medium such as a flash memory. The second memory 26 stores various setting data and the like.

  The control circuit 27 is a processor that comprehensively controls the operation of the electronic camera. For example, the control circuit 27 obtains the brightness of the object scene from the signal output from the image sensor 13. Then, the control unit executes a known AE calculation based on the brightness information described above, and performs imaging conditions (charge accumulation time of the image sensor 13, aperture value of the aperture (not shown), aperture value of the image signal) in the imaging mode. Amplification) is determined.

  Further, the control circuit 27 executes a program stored in the second memory 26 and the like, thereby executing an interpolation image generation process, a composition process by image addition in the time direction, and the like (these processes will be described later). ).

  Hereinafter, operations in the continuous shooting mode and playback mode of the electronic camera of the first embodiment will be described.

(Explanation of continuous shooting mode)
FIG. 2 is a flowchart showing the operation in the continuous shooting mode in the first embodiment. Here, the continuous shooting mode is one of the above-described shooting modes, in which the electronic camera continuously performs still image capturing operations at predetermined time intervals while the release button 24 is pressed. is there. Note that the control circuit 27 in the continuous shooting mode determines the imaging conditions so that each recorded image that is continuously shot can withstand viewing as a still image. For example, the control circuit 27 reduces the aperture to increase the depth of field.

  Step S100: When the control circuit 27 detects the pressing operation of the release button 24, the control circuit 27 continuously executes the AF operation and performs the continuous shooting operation of the recorded image.

  Here, regarding the AF operation in S100, the control circuit 27 may perform the AF operation by tracking a specific subject moving within the screen. Alternatively, the control circuit 27 may perform the AF operation so that an object at a predetermined shooting distance is always focused. In S <b> 100, the control circuit 27 may perform focus adjustment by a user's manual operation via the operation member 23.

  Regarding the continuous shooting operation in S100, the control circuit 27 instructs the image sensor drive circuit 14 to output a drive signal for executing the continuous shooting operation. The image sensor 13 receives the drive signal and outputs an image signal at a frame rate of, for example, 10 fps to several tens of fps. The image signal of each frame output from the image sensor 13 is subjected to predetermined processing by the signal processing circuit 15 and the data processing circuit 16. Thereafter, the control circuit 27 temporarily stores recorded image data corresponding to each frame in the first memory 17.

  At the time of continuous shooting operation, the data processing circuit 16 performs resolution conversion processing on the recorded image data, and generates view image data in accordance with the number of pixels of the monitor 19. The data processing circuit 16 sequentially supplies view image data of each frame to the monitor 19 via the display control circuit 18. During the continuous shooting operation, view images corresponding to the respective frames are sequentially displayed on the monitor 19 under the control of the display control circuit 18. Thereby, the user can confirm the state of the object scene and the composition of the recorded image by viewing the view image on the monitor 19.

  Step S101: The control circuit 27 performs a feature point extraction process on each recorded image data (S100) stored in the first memory 17. Specifically, the control circuit 27 extracts edge components from the recorded image data, and obtains, for example, the position of the intersection (corner) of the extracted edges as a feature point. Then, the control circuit 27 records the position of the feature point corresponding to each frame of the recorded image in the first memory 17 or the second memory 26. Note that the control circuit 27 may extract points designated by the user on the monitor 19 as feature points.

  Step S102: The control circuit 27 generates an interpolated image for interpolating between frames of a plurality of recorded images. The number of pixels of this interpolated image is set to the same number of pixels as the recorded image. In addition, the control circuit 27 according to the present embodiment generates an interpolation image by performing a geometric morphing process involving deformation of the subject image or a morphing process in which the subject image moves without being deformed.

  Specifically, the control circuit 27 generates an interpolated image according to the following procedures (a) to (g). Here, the number of frames of the interpolated image inserted between the two recorded images is changed by the control circuit 27 according to the user input. In the following example, a case where an interpolated image for two frames is inserted between two recorded images will be described for the sake of simplicity.

  (A) The control circuit 27 designates two frames of recorded images adjacent in the time axis direction as key frames.

  (B) The control circuit 27 associates the feature points included in the two key frames specified in (a) above. For example, the control circuit 27 executes a matching process between the feature points between two key frames, and obtains a correspondence relationship between the feature points.

  (C) The control circuit 27 obtains a function (feature point movement trajectory in the morphing operation) that connects the positions of the pair of feature points associated in (b) above in the spatial direction. Here, the above function may connect a pair of feature points with a straight line, or may connect a pair of feature points with a spline curve or the like. The control circuit 27 obtains the above function for all feature points that can be associated between two key frames.

  (D) The control circuit 27 determines the position of the feature point in the frame of the interpolated image by the function obtained in (c) above. Specifically, the control circuit 27 internally divides a section defined by the above function and a pair of feature points according to the number of interpolation image insertions, and determines the position of the interior division point of the feature point of the interpolation frame. Position.

  FIG. 3 is an explanatory diagram illustrating an example of a method for determining feature points in an interpolated image. In the example of FIG. 3, the feature points D, E, and F of the second key frame correspond to the feature points A, B, and C of the first key frame, respectively. The position of the point (G, J) that internally divides the section of the linear function connecting the first feature points A and D into three becomes the position of the first feature point in each interpolated image. Note that the position (H, K) of the second feature point and the position (I, L) of the third feature point in the interpolated image can be obtained in the same procedure as in the case of the first feature point.

  (E) The control circuit 27 obtains the position of each pixel of interest other than the feature point in the intermediate image. Specifically, the control circuit 27 defines the position of the pixel of interest in the key frame as a vector connecting feature points. Then, the control circuit 27 obtains the position of the target image on the interpolated image based on the above vector definition.

  FIG. 4 is an explanatory diagram illustrating an example of a method for determining a target pixel in an interpolation image.

Therefore, the control circuit 27 can obtain the position of each pixel of interest in the interpolation image by the above method.

  (F) The control circuit 27 obtains a change in the gradation value of each pixel in the interpolation image. Specifically, first, the control circuit 27 obtains the gradation value of each pixel (target pixel) having a correspondence between two key frames. Secondly, the control circuit 27 internally divides the interval between the two gradation values in accordance with the number of interpolation images inserted, and obtains the gradation value of the target pixel in the interpolation image. As an example, when the gradation values of the target pixel are 130 and 136 in two key frames, the control circuit 27 calculates a point that internally divides the interval of the gradation values 130 to 136 into three. Then, the control circuit 27 sets the gradation value (132, 134) corresponding to the above internal dividing point as the gradation value of the target pixel in each interpolation image. Note that the control circuit 27 obtains the gradation value for each value of RGB or YCbCr.

  (G) The control circuit 27 records the interpolated image generated in the above process in the first memory 17 or the second memory 26. Then, the control circuit 27 changes the key frame designated in (A) above and repeats the processing from (B) to (F). As a result, the control circuit 27 generates an interpolated image between all the frames of the continuously shot recorded image.

  Step S103: The control circuit 27 obtains a motion vector of the subject between frames for two frames of the recorded images adjacent in the time axis direction. For example, the control circuit 27 extracts the motion of the subject between frames in units of 16 × 16 pixel macroblocks, and obtains the motion vector of the subject between frames from this result. It should be noted that the control circuit 27 in S103 calculates the motion vector between all frames of the continuously shot recorded image.

  Step S104: The control circuit 27 recognizes a scene of a moving image represented by each recorded image taken continuously, such as a photographed scene or a situation at the time of photographing, based on the motion vector obtained in step S103. For scene recognition. In this scene recognition, the control circuit 27 is a scene in which a subject having a predetermined amount or more of movement exists on the imaging screen when the object scene is imaged, that is, the magnitude of the motion vector obtained in step S103 is a predetermined amount or more. Is recognized as a specific scene. On the other hand, when the magnitude of the motion vector is less than the predetermined amount, it is recognized that the specific scene is not shot in the moving image.

  In step S104 of the present embodiment, the control circuit 27 considers the direction of the motion vector, the overall brightness of the recorded image, the luminance of the subject, the size of the subject, etc. in addition to the magnitude of the motion vector. You may recognize the scene of a moving image. Such a scene recognition method is particularly effective when, for example, the shooting scene is recognized as a specific scene when shooting a fireworks display.

  For example, it is assumed that the brightness of the entire recorded image is brightness (darkness) equivalent to a night scene, the brightness of the subject is equal to or higher than a predetermined value, and the size of the subject is equal to or lower than the predetermined value. Furthermore, it is assumed that there are a plurality of subjects that satisfy these conditions in the recorded image, and the respective motion vectors are arranged radially in the recorded image. In such a case, the control circuit 27 recognizes the photographed scene as a fireworks scene. In this case, each subject is each bright spot of the fireworks.

  In step S104 of this embodiment, the control circuit 27 may recognize a moving image scene in consideration of the movement of the electronic camera in addition to the motion vector. Such a scene recognition method is particularly effective when a panning shot is taken, that is, when a shooting scene is recognized as a specific scene when shooting while moving the electronic camera up and down or left and right. The movement of the electronic camera at this time can be determined from the direction and amount of shake detected by the vibration sensor 25.

  The fireworks and panning scenes described above are merely examples, and the scene that the control circuit 27 recognizes as a specific scene is not limited to this. Any scene that can be recognized based on at least a motion vector may be recognized as a specific scene.

  Step S105: The control circuit 27 obtains the maximum value Z of the magnitude of the motion vector among the motion vectors between frames of each recorded image (obtained in S103). Then, the control circuit 27 records the maximum value Z of the magnitude of the motion vector in the first memory 17.

  Step S106: The control circuit 27 determines whether or not the maximum value Z of motion vector magnitudes (obtained in S105) is a “0” value between all frames. If the above requirement is satisfied (YES side), the process proceeds to S115. On the other hand, when the above requirement is not satisfied (NO side), the process proceeds to S107. Note that the YES side in S106 corresponds to, for example, continuous shooting of a subject that has a change in brightness and color but does not move.

  Step S107: The control circuit 27 selects one reference image from the target image group including the frame of the recording image and the frame of the interpolation image. This reference image is an image used as a reference when generating a composite image to be described later. More preferably, the reference image is selected from the target image group so as to be equally spaced in time when the recorded image and the interpolation image are arranged in time series.

  In S107 of this embodiment, the control circuit 27 sequentially selects the reference image from the frames of the recorded image. This selection is made by selecting all the recorded images arranged in time series without skipping the middle.

  Step S108: The control circuit 27 determines whether or not the current reference image selected in S107 is the first reference image (first recorded image by continuous shooting). If it is the first reference image (YES side), the process proceeds to S113. On the other hand, if it is not the first reference image (NO side), the process proceeds to S109.

  Step S109: The control circuit 27 reads the corresponding values between the current reference image and the next reference image from the maximum value Z of the magnitude of the motion vector obtained in S105. Then, the control circuit 27 determines whether or not the maximum value Z of the magnitude of the read motion vector is less than the threshold Th (Z <Th). If the above requirement is satisfied (YES side), the process proceeds to S110. On the other hand, if the above requirement is not satisfied (NO side), the process proceeds to S111.

  Step S110: The control circuit 27 sets the number of frames to be added when generating a composite image used for moving image reproduction to “3”, and determines the addition ratio between the reference image and the interpolated image. Note that the composite image is an image in which a different image in the time axis direction is added to the reference image to cause image flow in the subject.

  Specifically, the control circuit 27 interpolates the interpolated image for each frame of the previous (past) and the subsequent (future) in the time axis direction with respect to the reference image (that is, the past one frame with respect to the reference image). An interpolated image and a future interpolated image for one frame) are selected as images to be added. Then, the control circuit 27 sets the addition ratio of the reference image to 0.5. Further, the control circuit 27 sets the addition ratio of each added image to 0.25. That is, when expressed in the time axis direction, the image addition ratio in S110 is “0.25: 0.5: 0.25” (see FIG. 5A). Thereafter, the control circuit 27 proceeds to S112. By the processing in steps S109, S110, and S111, the number of additions and the addition ratio when generating a composite image are controlled according to the magnitude of the motion vector (in other words, the amount of motion of the subject).

  Step S111: The control circuit 27 sets the number of frames to be added when generating a composite image used for moving image reproduction to “5”, and determines the addition ratio between the reference image and the interpolated image.

  Specifically, the control circuit 27 interpolates the previous and second interpolated images in the time axis direction with respect to the reference image by two frames (that is, past interpolated images and two frames up to two frames with reference to the reference image). Future interpolated images) are selected as images to be added. Then, the control circuit 27 sets the addition ratio of the reference image to 0.4. In addition, the control circuit 27 sets the addition ratio of the interpolated image of the first and subsequent frames with respect to the reference image among the images to be added to 0.2. Further, the control circuit 27 sets the addition ratio of the interpolated images of the second and subsequent frames with respect to the reference image among the images to be added to 0.1 respectively. That is, when expressed in the time axis direction, the image addition ratio in S111 is “0.1: 0.2: 0.4: 0.2: 0.1” (see FIG. 5B).

  Step S112: The control circuit 27 temporarily stores the number of addition frames and the addition ratio (obtained in S110 or S111) in the first memory 17 in association with the reference image data (S107).

  Step S113: The control circuit 27 determines whether or not the determination is completed from the end of the target image group including the frame of the recording image and the frame of the interpolation image to the frame one frame before. In the present embodiment, it is determined whether or not the determination up to the last frame of the recorded image is completed. If the above requirement is satisfied (YES side), the process proceeds to S114. On the other hand, if the above requirement is not satisfied (NO side), the control circuit 27 returns to S107 and repeats the above operation.

  Step S114: The compression / decompression circuit 20 compresses the Motion-JPEG format in accordance with a command from the control circuit 27 in a state in which the recorded image data and the interpolated image data are not added (the synthesized image is not generated). Go to generate an image file. The compression of the Motion-JPEG format can reduce the recording capacity of the entire image data. Then, the control circuit 27 records the number of added frames and the added ratio regarding each reference image in association with each other in the image file. Further, the control circuit 27 records a flag indicating that the magnitude of the motion vector is not “0” in the image file. In addition, when a specific scene is recognized in step S104, the control circuit 27 records data indicating the specific scene in the image file. This image file is finally recorded on the storage medium 29. Thereafter, the control circuit 27 ends the continuous shooting mode processing.

  Thus, when the image file of S114 is reproduced as a moving image, the control circuit 27 can easily generate a composite image suitable for reproducing the moving image by referring to the data of the number of added frames and the addition ratio. In addition, when the image file of S114 is paused during moving image reproduction, the control circuit 27 can display a composite image suitable as a still image of the specific scene by referring to data indicating the specific scene. Become.

  Step S115: The compression / decompression circuit 20 compresses the Motion-JPEG format in accordance with a command from the control circuit 27 in a state in which the recorded image data and the interpolated image data are not added (the synthesized image is not generated). Go to generate an image file. In the case of S115, the control circuit 27 records a flag indicating that the magnitude of the motion vector is “0” in the image file. In addition, when a specific scene is recognized in step S104, the control circuit 27 records data indicating the specific scene in the image file. This image file is finally recorded on the storage medium 29. Above, description of the flowchart of FIG. 2 is complete | finished.

(Description of playback mode)
FIG. 6 is a flowchart showing the operation in the reproduction mode in the first embodiment. This playback mode will be described on the assumption that the image file in the continuous shooting mode (generated in S114 and S115) is a playback target. Further, the processing of this flowchart is started when the user operates the operation member 23 to give an image reproduction instruction. That is, when the user instructs “still image reproduction” or “moving image reproduction” shown in FIG. 7, the processing of this flowchart is started.

  Step S201: The control circuit 27 determines whether or not an instruction to reproduce a still image of an image file has been given. If reproduction of a still image is instructed (YES side), the process proceeds to S224. On the other hand, when the reproduction of the still image is not instructed (NO side), the process proceeds to S202.

  Step S202: The control circuit 27 reads the image file to be reproduced from the storage medium 29. As a result, the control circuit 27 reads a plurality of still images (recorded image and interpolated image) arranged in time series. Then, the compression / decompression circuit 20 executes the decoding process of the image data in the image file in accordance with the instruction from the control circuit 27. Note that the decoded data of each image is temporarily stored in the first memory 17.

  Step S203: The control circuit 27 determines whether or not a flag indicating that the magnitude of the motion vector is “0” is recorded in the image file to be reproduced. If the above requirement is satisfied (YES side), the process proceeds to S215. The YES side in S203 corresponds to the case where the reproduction target is the image file in S115. On the other hand, if the above requirement is not satisfied (NO side), the process proceeds to S204. The NO side in S203 corresponds to the case where the reproduction target is the image file in S114.

  Step S204: The control circuit 27 displays on the monitor 19 a screen (see FIG. 7) that prompts the user to select “normal video playback” or “frame advance playback (dynamic playback)” for the playback mode of the image file. . Then, the control circuit 27 waits for a reproduction mode selection input from the user via the operation member 23. Note that when the control circuit 27 receives the selection input of the reproduction mode from the operation member 23, the process proceeds to S205.

  Step S205: The control circuit 27 determines whether or not a reproduction mode selection of “normal video reproduction” has been input. When “normal video playback” is selected (YES side), the process proceeds to S206. On the other hand, when “frame advance playback” is selected (NO side), the process proceeds to S215.

  Step S206: The control circuit 27 obtains the data of the number of added frames and the added ratio regarding each reference image from the image file to be reproduced. Then, the control circuit 27 adds the reference image and the interpolation image based on the number of addition frames and the addition ratio to generate a composite image. Then, the control circuit 27 receives the reference image of the first frame, the above-described composite image (moving image display composite image), and the reference image of the final frame via the data processing circuit 16 and the display control circuit 18. A moving image is reproduced on the monitor 19 along the sequence. Therefore, the moving image reproduction on the monitor 19 is started. By executing the processing in step S206 in the control circuit 27, a moving image is displayed on the monitor 19 based on the plurality of still images read in step S202.

  Here, FIG. 8A shows an example of the reference image. FIG. 8B schematically shows a composite image using the reference image of FIG. 8A as a display nucleus. In the example of FIG. 8B, the number of addition frames is “5”, and the image addition ratio is “0.1: 0.2: 0.4: 0.2” when expressed in the time axis direction. : "Is shown as an example. In the composite image, the past image and the future image are added in the time axis direction with respect to the reference image serving as the nucleus of the display, so that an image flow occurs on the image. For this reason, when a plurality of synthesized images are viewed as a moving image, the flow of motion is smooth and preferable. Note that the number of addition frames and the addition ratio when generating a composite image are changed by the control circuit 27 in accordance with the size of the motion frame (the size of the motion vector of the subject) between the continuously shot recorded images. Therefore, in the present embodiment, the image flow of the composite image can be adjusted to a preferable amount in accordance with the movement of the subject in the captured scene.

  Step S207: The control circuit 27 determines whether or not a still image display instruction from the user has been received from the operation member 23 during moving image reproduction. When there is an instruction to display a still image (YES side), that is, when the operation member 23 detects a pause instruction operation input from the user during the display of a moving image, the process proceeds to S208. On the other hand, if there is no such instruction (NO side), the process proceeds to S214.

  Step S208: The control circuit 27 temporarily stops moving image playback. Then, when it is determined in step S207 that there is an instruction to display a still image, that is, whether or not the moving image scene when the pause instruction operation is detected by the operation member 23 is a specific scene, in step S104. Judgment is made based on the result of scene recognition. This determination is made by referring to the data recorded in the image file. If a specific scene as described above, for example, a fireworks display or a panning scene is recognized and data indicating this is recorded in the image file, it is determined that the scene is a specific scene and the process proceeds to step S210. . On the other hand, if data indicating that a specific scene has been recognized is not recorded in the image file, it is determined that the specific scene is not a specific scene, and the process proceeds to step S209.

  Step S209: The control circuit 27 sends the reference image included in the composite image reproduced at the time of the still image display instruction via the data processing circuit 16 and the display control circuit 18 to the monitor 19 in a non-added state. Playback and display as a still image. That is, any one of the still images used to generate one composite image (in the moving image) that was reproduced when the still image display instruction was given is reproduced and displayed on the monitor 19 as a reference image. To do.

  That is, when the moving image scene at the time of the still image display instruction is not a specific scene, the control circuit 27 replaces the moving image that has been reproduced so far with the reference image as the pre-combination image. One of the plurality of still images is displayed on the monitor 19 as it is as a pause display composite image. Since this reference image has almost no image flow compared to the synthesized image, it is possible to reproduce a still image having a good appearance and a preferable state on the monitor 19.

  Step S210: The control circuit 27 reproduces and displays the composite image reproduced at the time of the still image display instruction as a still image on the monitor 19 via the data processing circuit 16 and the display control circuit 18.

  That is, when the moving image scene at the time of the still image display instruction is a specific scene, the control circuit 27 is included in the moving image instead of the moving image that has been reproduced so far. One of the composite images (each of which forms a moving image) is displayed on the monitor 19. Since this single composite image (moving image display composite image) has an image flow, when viewing a still image of a specific scene by pausing during moving image reproduction, there is a natural flow in the movement of the subject. This is preferable.

  In step S210, the control circuit 27 synthesizes still images having a number different from the number of still images to be synthesized in the synthesized image for moving image display, so that a synthesized image different from the synthesized image for moving image display ( A pause display composite image) may be created and displayed on the monitor 19. In this case, in order to ensure a certain degree of visibility as a still image, it is preferable that the number of images combined in the pause display composite image is smaller than the number of images combined in the moving image display composite image. Alternatively, the number of images to be added is the same, but the addition ratio when combining (adding) them is different from the addition ratio when creating the composite image for moving image display, and another composite image (pause display) Composite image) may be created. Also in this case, in order to ensure visibility, it is preferable to reduce the addition ratio of still images before and after the still image that becomes the center at the time of synthesis as much as possible. In these cases (when still images with different numbers and ratios are combined), the number of images to be combined (added) and the addition ratio depend on the size of the motion vector of the subject between the continuously shot recording images. Based on this, the control circuit 27 may automatically control.

  Step S211: The control circuit 27 determines whether or not an instruction to record a still image being reproduced and displayed has been received from the operation member 23. If there is a recording instruction (YES side), the process proceeds to S212. On the other hand, if there is no recording instruction (NO side), the process proceeds to S213.

  Step S212: The control circuit 27 identifies the reference image displayed as a still image in Step S209 or the identification data indicating the composite image (moving image display composite image or pause display composite image) displayed as a still image in Step S210. (Marker) is recorded in the image file. Thereafter, the control circuit 27 shifts the process to S213.

  Step S213: The control circuit 27 determines whether or not an instruction to continue moving image reproduction has been received from the operation member 23. If there is an instruction to continue video playback (YES side), the process proceeds to S214. On the other hand, when there is no instruction to continue moving image reproduction (NO side), the control circuit 27 ends the series of processes.

  Step S214: The control circuit 27 determines whether or not the reference image of the last frame has been reproduced. If the above requirement is satisfied (YES side), the control circuit 27 ends the series of processes as soon as the reproduction of the image file ends. On the other hand, if the above requirement is not satisfied (NO side), the control circuit 27 returns to S206 and repeats the above operation.

  Step S215: The control circuit 27 continuously reproduces only the recorded images of the decoded images on the monitor 19 in time series via the data processing circuit 16 and the display control circuit 18 (moving motion). Replay). Therefore, the dynamic reproduction of the recorded image obtained by continuous shooting is started, and the moving image is reproduced and displayed on the monitor 19. In this case, the control unit may continuously reproduce the interpolated image and the recorded image in time series.

  Step S216: The control circuit 27 determines whether or not a still image display instruction from the user has been received from the operation member 23 during dynamic reproduction. When there is an instruction to display a still image (YES side), that is, when the operation member 23 detects a pause instruction operation input from the user during dynamic reproduction, the process proceeds to S217. On the other hand, if there is no such instruction (NO side), the process proceeds to S223.

  Step S217: The control circuit 27 temporarily stops dynamic reproduction. Then, when it is determined in step S216 that there is an instruction to display a still image, that is, whether or not the scene when the operation member 23 detects a pause instruction operation is a specific scene, the scene recognition in step S104 is performed. Determine based on the results. This determination is performed by referring to the data recorded in the image file, as in step S208 described above. If data indicating a specific scene is recorded in the image file, the process proceeds to step S219, and if not recorded, the process proceeds to step S218.

  Step S218: The control circuit 27 displays the image reproduced at the time of the still image display instruction on the monitor 19 as a still image. That is, if the scene when the still image display instruction is given is not a specific scene, the control circuit 27 displays the reproduced still image on the monitor 19 as it is.

  Step S219: The control circuit 27 generates a composite image obtained by combining a plurality of still images that have been dynamically reproduced at the time of the still image display instruction. At this time, the control circuit 27 sets the number of addition frames and the addition ratio to predetermined values, and generates a composite image by the same method as in step S206 described above. Then, the created composite image is displayed on the monitor 19 as a pause display composite image via the data processing circuit 16 and the display control circuit 18.

  Step S220: The control circuit 27 determines whether or not an instruction to record a still image being reproduced and displayed has been received from the operation member 23. If there is a recording instruction (YES side), the process proceeds to S221. On the other hand, if there is no recording instruction (NO side), the process proceeds to S222.

  Step S221: The control circuit 27 records the identification data (marker) indicating the image displayed as a still image in Step S218 or the pause display composite image displayed as the still image in Step S219 in the image file. Thereafter, the control circuit 27 shifts the process to S222.

  Step S222: The control circuit 27 determines whether or not an instruction to continue dynamic reproduction has been received from the operation member 23. If there is an instruction to continue dynamic reproduction (YES side), the process proceeds to S223. On the other hand, when there is no instruction to continue dynamic reproduction (NO side), the control circuit 27 ends the series of processes.

  Step S223: The control circuit 27 determines whether or not the image of the last frame of the image file has been reproduced. If the above requirement is satisfied (YES side), the control circuit 27 ends the series of processes as soon as the reproduction of the image file ends. On the other hand, if the above requirement is not satisfied (NO side), the control circuit 27 returns to S215 and repeats the above operation.

  Step S224: The control circuit 27 determines whether or not the scene shot in the image file instructed to reproduce the still image is a specific scene based on the result of the scene recognition in step S104. This determination is performed by referring to the data recorded in the image file as in the above-described steps S208 and S217. If data indicating a specific scene is recorded in the image file, the process proceeds to step S226, and if not recorded, the process proceeds to step S225.

  Step S225: The control circuit 27 displays the image in the image file on the monitor 19 via the data processing circuit 16 and the display control circuit 18. When there is identification data (generated in S212 and S221) in the image file, the control circuit 27 extracts an image corresponding to the identification data, and promptly reproduces and displays the image on the monitor 19. be able to. After execution of step S225, the control circuit 27 ends a series of processes.

  Step S226: The control circuit 27 generates a combined image by combining a plurality of images corresponding to the image file instructed to reproduce the still image. At this time, the control circuit 27 generates a composite image by setting the number of addition frames and the addition ratio to predetermined values as in step S219 described above. Then, the created composite image is displayed on the monitor 19 as a pause display composite image via the data processing circuit 16 and the display control circuit 18. After execution of step S226, the control circuit 27 ends a series of processes. Above, description of the flowchart of FIG. 6 is complete | finished.

According to 1st Embodiment described above, there exists the following effect.
(1) The electronic camera reads a plurality of still images, which are a plurality of still images arranged in chronological order by processing of the control circuit 27, and an interpolated image (step S202), and a moving image based on the read still images Is displayed on the monitor 19 (steps S206 and S215). When the operation member 23 detects a pause instruction operation input from the user during the display of the moving image, the control circuit 27 determines that there is a still image display instruction (steps S207 and S216), and the moving image Instead of the image, a pause display composite image obtained by combining at least two still images among the plurality of read still images is displayed on the monitor 19 (steps S210 and S219). Since it did in this way, when pausing and watching a still image during reproduction of a moving picture, a desirable still picture can be displayed.

(2) The electronic camera 1 recognizes a moving image scene by the processing of the control circuit 27 (step S104). Based on the result of this scene recognition, the control circuit 27 determines whether or not the scene of the moving image when the pause instruction operation is detected by the operation member 23 is a specific scene (steps S208 and S217). . As a result, when it is determined that the moving image scene is a specific scene, the control circuit 27 executes step S210 or S219 to display the pause display composite image on the monitor 19 instead of the moving image. Let Since it did in this way, when pausing and watching a still picture of a specific scene during reproduction of a moving picture, a natural flow can be generated in the movement of a subject.

(3) In step S215, the control circuit 27 displays the moving image on the monitor 19 by reproducing and outputting the read still images in chronological order. Since it did in this way, a moving image can be easily displayed from several still images.

(4) In step S206, the control circuit 27 reproduces and outputs a moving image display synthesized image obtained by synthesizing at least two or more still images among a plurality of read still images in time series, thereby monitoring the moving image. 19 is displayed. At this time, when it is determined in step S208 that the moving image scene is a specific scene, the control circuit 27 in step S210 replaces the moving image display synthesized image with the pause display synthesized image instead of the moving image. It can be displayed on the monitor 19 as an image. In this way, while displaying a preferable moving image with a smooth flow of motion, when viewing a still image of a specific scene by pausing during moving image reproduction, a still image with a natural flow on the subject is displayed. It can be displayed easily.

(5) Alternatively, when it is determined in step S208 that the scene of the moving image is a specific scene, the control circuit 27 synthesizes the synthesized image for moving image display instead of the moving image in step S210. It is also possible to display on the monitor 19 a pause display composite image obtained by combining a number of still images different from the number of still images. In this way, when viewing a still image of a specific scene by pausing during playback of a moving image, it is possible to display a still image that has a natural flow and that is easy to view.

(6) When it is determined in step S208 or S217 that the scene of the moving image is not a specific scene, the control circuit 27 displays one of a plurality of still images on the monitor 19 instead of the moving image (step S209). , S218). Since it did in this way, when pausing and recognizing a still picture which is not a specific scene during reproduction of a moving picture, it is possible to display a good-looking still picture with no image flow.

(7) In step S104, the control circuit 27 recognizes a scene in which a subject having a predetermined amount of movement or more exists in the object scene as a specific scene. Specifically, the motion vector of the subject is obtained from a plurality of still images adjacent in the time axis direction, and if the motion vector is a predetermined amount or more, it is recognized as a specific scene. Thereby, for example, a scene is recognized as a specific scene in a fireworks display or a panning shot. Since it did in this way, the scene which should express the motion of a subject smoothly in a moving picture can be recognized as a specific scene reliably.

<Description of Second Embodiment>
Hereinafter, the operation in the continuous shooting mode and the operation in the playback mode of the electronic camera of the second embodiment will be described. Here, the second embodiment is a modification of the first embodiment. The configuration of the electronic camera in the second embodiment is the same as that of the electronic camera in the first embodiment shown in FIG.

(Explanation of continuous shooting mode)
FIG. 9 is a flowchart showing the operation in the continuous shooting mode in the second embodiment. Note that S300 to S311 in FIG. 9 correspond to S100 to S111 in FIG. 2, respectively. Further, S315 in FIG. 9 corresponds to S115 in FIG. For this reason, redundant description of the above steps is omitted.

  Step S312: The control circuit 27 adds the reference image data and the interpolated image based on the number of addition frames and the addition ratio (obtained in S310 or S311) to generate a composite image. Then, the control circuit 27 temporarily stores the generated composite image data in the first memory 17.

  Step S313: The control circuit 27 determines whether or not the determination is completed from the end of the target image group including the frame of the recording image and the frame of the interpolation image to the frame one frame before. In the present embodiment, it is determined whether or not the determination up to the last frame of the recorded image is completed. If the above requirement is satisfied (YES side), the process proceeds to S314. On the other hand, if the above requirement is not satisfied (NO side), the control circuit 27 returns to S307 and repeats the above operation.

  Step S314: The compression / decompression circuit 20 compresses the Motion-JPEG format in accordance with a command from the control circuit 27 in a state in which the recorded image data and the interpolated image data are not added (the synthesized image is not generated) To generate a first image file.

  Further, the compression / decompression circuit 20 performs MPEG compression on the first frame reference image, the above synthesized image, and the final frame reference image as one moving image in accordance with a command from the control circuit 27, and Generate an image file.

  The control circuit 27 records a flag indicating that the magnitude of the motion vector is not “0” in each of the first image file and the second image file. In addition, when a specific scene is recognized in step S304, the control circuit 27 records data indicating the specific scene in the image file. Then, the first image file and the second image file are finally recorded in the storage medium 29. Thereafter, the control circuit 27 ends the continuous shooting mode processing. Above, description of the flowchart of FIG. 9 is complete | finished.

(Description of playback mode)
FIG. 10 is a flowchart showing the operation in the reproduction mode in the second embodiment. This playback mode will be described on the assumption that the image file generated in S314 is the playback target among the image files in the continuous shooting mode. Further, the processing of this flowchart is started when the user operates the operation member 23 to give an image reproduction instruction. That is, when the user instructs “still image reproduction” or “moving image reproduction” shown in FIG. 7, the processing of this flowchart is started.

  Step S401: The control circuit 27 determines whether or not an instruction to reproduce a still image of an image file has been given. If reproduction of a still image is instructed (YES side), the process proceeds to S420. On the other hand, when the reproduction of the still image is not instructed (NO side), the process proceeds to S402.

  Step S402: The control circuit 27 displays on the monitor 19 a screen (see FIG. 7) that prompts the user to select “normal video playback” or “frame advance playback (dynamic playback)” for the playback mode of the image file. . Then, the control circuit 27 waits for a reproduction mode selection input from the user via the operation member 23. Note that when the control circuit 27 receives the selection input of the reproduction mode from the operation member 23, the process proceeds to S403.

  Step S403: The control circuit 27 determines whether or not a reproduction mode selection of “normal video reproduction” has been input. If “normal video playback” is selected (YES side), the process proceeds to S404. On the other hand, when “frame advance playback” is selected (NO side), the process proceeds to S407.

  Step S404: The control circuit 27 reads out the second image file from the storage medium 29 among the image files to be reproduced. Then, the compression / decompression circuit 20 executes a decoding process on the image data in the second image file in accordance with a command from the control circuit 27. Note that the decoded data of each image is temporarily stored in the first memory 17.

  Step S405: The control circuit 27 passes through the data processing circuit 16 and the display control circuit 18 to the image data buffered in the first memory 17 (first frame reference image, composite image, and final frame reference image). Are reproduced on the monitor 19 in time series.

  Step S406: The control circuit 27 determines whether or not the reference image of the last frame has been reproduced. If the above requirement is satisfied (YES side), the control circuit 27 ends the series of processes as soon as the reproduction of the image file ends. On the other hand, if the above requirement is not satisfied (NO side), the control circuit 27 returns to S405 and repeats the above operation.

  Step S407: The control circuit 27 reads the first image file from the storage medium 29 among the image files to be reproduced. Then, the compression / decompression circuit 20 executes the decoding process of the image data in the first image file in accordance with the instruction from the control circuit 27. Note that the decoded data of each image is temporarily stored in the first memory 17.

  Step S408: The control circuit 27 sends only the recorded image of the image data buffered in the first memory 17 via the data processing circuit 16 and the display control circuit 18 to the monitor 19 in time series. Play continuously (dynamic playback). In this case, the control circuit 27 may continuously reproduce the interpolated image and the recorded image in time series.

  Step S409: The control circuit 27 determines whether an instruction to display a still image is received from the operation member 23 during dynamic reproduction. If there is an instruction to display a still image (YES side), the process proceeds to S410. On the other hand, if there is no such instruction (NO side), the process proceeds to S416.

  Step S410: The control circuit 27 temporarily stops dynamic reproduction. Then, when it is determined in step S409 that there is an instruction to display a still image, that is, whether or not the scene when the operation member 23 detects a pause instruction operation is a specific scene, the scene recognition in step S304 is performed. Determine based on the results. This determination is made by referring to the data recorded in the image file. If data indicating a specific scene is recorded in the image file, the process proceeds to step S412. If not recorded, the process proceeds to step S411.

  Step S411: The control circuit 27 displays the image reproduced at the time of the still image display instruction on the monitor 19 as a still image. That is, if the scene when the still image display instruction is given is not a specific scene, the control circuit 27 displays the reproduced still image on the monitor 19 as it is.

  Step S412: The control circuit 27 generates a composite image by combining a plurality of still images including still images that have been dynamically reproduced at the time of the still image display instruction. At this time, the control circuit 27 generates a composite image by setting the number of addition frames and the addition ratio to predetermined values as in step S219 described above. Then, the created composite image is displayed on the monitor 19 as a pause display composite image via the data processing circuit 16 and the display control circuit 18.

  Step S413: The control circuit 27 determines whether or not an instruction to save a still image being reproduced and displayed has been received from the operation member 23. If there is a save instruction (YES side), the process proceeds to S414. On the other hand, if there is no save instruction (NO side), the process proceeds to S415.

  Step S414: The control circuit 27 records identification data (marker) indicating the image displayed as a still image in step S411 or the combined image for pause display displayed as the still image in step S412 in the first image file. .

  Step S415: The control circuit 27 determines whether or not an instruction to continue dynamic reproduction has been received from the operation member 23. If there is an instruction to continue dynamic reproduction (YES side), the process proceeds to S416. On the other hand, if there is no instruction to continue dynamic reproduction (NO side), the process proceeds to S417.

  Step S416: The control circuit 27 determines whether or not the image of the last frame of the first image file has been reproduced. If the above requirement is satisfied (YES side), the control circuit 27 proceeds to S417 upon completion of reproduction of the image file. On the other hand, if the above requirement is not satisfied (NO side), the control circuit 27 returns to S408 and repeats the above operation.

  Step S417: When there is identification data (generated in S414) in the first image file, the control circuit 27 is not associated with the identification data among the image data of the first image file. A confirmation screen (not shown) for confirming the deletion of the image (other images excluding the image displayed as a still image) is displayed on the monitor 19. Then, the control circuit 27 waits for an input from the user via the operation member 23.

  Step S418: The control circuit 27 determines whether or not an image deletion permission input has been received from the operation member 23. If there is an input to delete the image (YES side), the process proceeds to S419. On the other hand, when there is an input to cancel image deletion (NO side), the control circuit 27 ends the series of processes. In this case, the first image file is stored as it is.

  Step S419: The control circuit 27 batches all the image data (recorded image and interpolated image data) except the image associated with the identification data from the image data of the first image file. delete. As a result, the data size of the first image file can be reduced while securing the still image selected by the user. Thereafter, the control circuit 27 ends a series of processes.

  Step S420: The control circuit 27 determines whether or not the scene shot in the image file instructed to reproduce the still image is a specific scene based on the result of the scene recognition in step S304. This determination is performed by referring to the data recorded in the image file, as in step S410 described above. If data indicating a specific scene is recorded in the image file, the process proceeds to step S422, and if not recorded, the process proceeds to step S421.

  Step S421: The control circuit 27 displays the image in the image file on the monitor 19 via the data processing circuit 16 and the display control circuit 18. After execution of step S421, the control circuit 27 ends a series of processes.

  Step S422: The control circuit 27 generates a composite image by combining a plurality of images corresponding to the image file instructed to reproduce the still image. At this time, the control circuit 27 sets the number of addition frames and the addition ratio to predetermined values and generates a composite image, as in step S412 described above. Then, the created composite image is displayed on the monitor 19 as a pause display composite image via the data processing circuit 16 and the display control circuit 18. After execution of step S422, the control circuit 27 ends a series of processes. Above, description of the flowchart of FIG. 10 is complete | finished.

  In the second embodiment, the electronic camera includes a moving image data (second image file) of a composite image generated by adding an added image to a reference image, and data of each reference image (first image). File). Therefore, the electronic camera of the second embodiment can easily reproduce the reference image suitable for still image display and the composite image suitable for moving image display. Further, when the user gives an instruction to display a still image during dynamic reproduction of the first image file (step S409), the pause is a combination of at least two or more of the read still images. The composite image for display is displayed on the monitor 19 (step S412). Thereby, it is possible to display a still image having a natural flow in the movement of the subject.

(Supplementary items of the embodiment)
(1) In the electronic camera of the above-described embodiment, the phase difference AF module may be arranged in the photographing optical path, and in addition to the contrast type AF operation, a known phase difference AF operation by pupil division may be performed. In the above-described embodiment, an example in which AE calculation is performed based on the output of the image sensor 13 has been described. However, a photometric element for AE calculation may be provided separately from the image sensor 13.

  (2) In the above embodiment, an example in which an interpolation image or a composite image is generated from recorded image data has been described. However, in the above-described embodiment, for example, when the recorded image data and the view image data set to be smaller than the display size of the monitor 19 are grouped and recorded in the storage medium 29, the control circuit 27 The view image data may be preferentially selected, and an interpolation image or a composite image may be generated from the view image data.

  (3) In the above embodiment, the motion vector is obtained between the two recorded images, but the motion vector may be obtained between the recorded image and the interpolated image.

  (4) In the above-described embodiment, an example in which the reference image is selected from the continuously captured recording image has been described. However, the reference image is selected from the frame of the interpolation image, and the interpolation image is displayed before the time axis direction. You may produce | generate a synthesized image by adding a subsequent image as a to-be-added image. Alternatively, the synthesized image may be generated by adding only the reference image without using the interpolation image.

  (5) The compression format of the image file in the first embodiment is not limited to Motion-JPEG, and other video lossless compression codecs and other compression formats that do not perform compression in the time axis direction (Motion-JPEG2000, etc.) It may be due to. Alternatively, the image file may be generated by compression processing conforming to the MPEG standard in the first embodiment.

  Also in the second embodiment, the first image file may be compressed in conformity with the MPEG standard, and the second image file may be recorded in a compression format such as Motion-JPEG. .

  (6) In the playback mode of the second embodiment described above, the control circuit 27, when playing back the second image file, receives a moving image playback stop instruction from the operation unit, and combines when playback is stopped. Identification data indicating a reference image corresponding to the image may be generated. Then, as in the case of S417 to S419, the control circuit 27 stores the data of all images (recorded image and interpolated image data) except for the image corresponding to the identification data in the first image file. It may be deleted.

  (7) In the above embodiment, an example in which the control circuit 27 of the electronic camera generates a composite image has been described. For example, an external device 30 (such as a personal computer) connected to the electronic camera controls the control of the above embodiment. The processing of the circuit 27 may be executed. In addition, in the above embodiment, a part of the processing executed by the control circuit 27 of the electronic camera is borne by the external device 30, and the electronic camera and the external device 30 cooperate with each other to perform the first embodiment or the second embodiment. You may implement | achieve the algorithm demonstrated by the form.

  (8) In the above-described embodiment, an example in which a summed image is generated by selecting an added image from images that temporally change with respect to the reference image has been described. However, in the above embodiment, the image to be added may be selected from only an image temporally preceding the reference image (or only an image temporally subsequent to the reference image).

  (9) In S112 of the above embodiment, the configuration in which the data of the number of added frames and the added ratio is recorded in association with only the data of the reference image has been described. However, in the above embodiment, the data indicating the reference image when combining the images and the data of the addition ratio at the time of combining the images are recorded in association with the data of the individual images in the target image group. Also good.

  Hereinafter, the above example will be described more specifically with reference to FIG. In this example, the number of addition frames is “5”, and the addition ratio expressed in the time axis direction is “0.1: 0.2: 0.4: 0.2: 0.1”. For example, in the target image group shown in FIG. 5B, when the central recorded image is the reference image, the data of the second image (interpolated image) from the right includes “center Data indicating “recorded image” and the addition ratio “0.1” at that time are recorded in association with each other. Similarly, when the rightmost recorded image is the reference image, the data of the second image from the right (interpolated image) includes data indicating the “right recorded image” as the reference image, and the data at that time The addition ratio “0.2” is recorded in association with it.

  (10) In the processing of S101 and S301 of the above embodiment, an example of recording the recorded image data in the first memory 17 has been described. However, in the above case, the recorded image data is recorded in the storage medium 29. It may be. In this case, the processes after S102 and S302 are executed based on the data of the recorded image stored in the storage medium 29.

  (11) In the continuous shooting mode of the above embodiment, when the reference image is selected from both the recorded image and the interpolated image, or when the reference image is selected from a part of the recorded image, the control circuit 27 The maximum value Z ′ of the motion vector is obtained from the reference image and the next reference image. Then, the control circuit 27 in the above case executes the determination of Z ′ <Th in S109 and S309.

  (12) In the above embodiment, the example in which the scene of the moving image is recognized at the time of continuous shooting by S104 or S304 has been described. However, in the above embodiment, the scene of the moving image may be recognized during the reproduction of the moving image without performing the scene recognition of the moving image at the time of shooting. Alternatively, when a still image display instruction is given during playback of a moving image, that is, when a pause instruction operation is detected by the operation member 23, whether or not the moving image scene is recognized and whether it is a specific scene is determined. You may make it determine.

  The present invention can be implemented in various other forms without departing from the spirit or the main features thereof. Therefore, the above-described embodiment is merely an example in all respects and should not be interpreted in a limited manner. The present invention is shown by the scope of claims, and the present invention is not limited to the text of the specification. Further, all modifications and changes belonging to the equivalent scope of the claims are within the scope of the present invention.

The block diagram which shows the structure of the electronic camera of 1st Embodiment. Flow chart showing the operation in the continuous shooting mode in the first embodiment. Explanatory drawing which shows an example of the determination method of the feature point in an interpolation image Explanatory drawing which shows an example of the determination method of the attention pixel in an interpolation image The figure which shows the image and addition ratio which comprise a composite image Flow chart showing the operation in the playback mode in the first embodiment The figure which shows an example of the reproduction | regeneration aspect selection screen of an image file (A) The figure which shows an example of a reference | standard image, (b) The figure which shows typically the synthetic | combination image which used Fig.8 (a) as the nucleus of a display. Flow chart showing the operation in the continuous shooting mode in the second embodiment Flow chart showing the operation in the playback mode in the second embodiment

Explanation of symbols

DESCRIPTION OF SYMBOLS 13 ... Image pick-up element, 19 ... Monitor, 21 ... Recording I / F, 22 ... Communication I / F, 23 ... Operation member, 27 ... Control circuit, 29 ... Storage medium, 30 ... External device

Claims (13)

Image reading means for reading a plurality of still images arranged in chronological order;
Moving image display control means for displaying a moving image on a display monitor based on a plurality of still images read by the image reading means;
Operation detecting means for detecting a pause instruction operation input from a user during display of the moving image;
When the operation instruction means detects the pause instruction operation, a pause display composite image obtained by combining at least two or more still images of the plurality of still images is displayed on the display monitor instead of the moving image. An image reproduction apparatus comprising: a pause display control means for displaying. The image reproduction apparatus according to claim 1,
Scene recognition means for recognizing the scene of the moving image;
And determining means for determining whether or not the scene of the moving image is a specific scene when the pause instruction operation is detected by the operation detecting means based on a recognition result by the scene recognizing means. ,
The pause display control unit displays the pause display composite image on the display monitor instead of the moving image when the determination unit determines that the scene of the moving image is the specific scene. An image reproduction apparatus characterized by causing the image reproduction apparatus to operate. The image reproduction apparatus according to claim 2,
The moving image display control means displays the moving image on the display monitor by reproducing and outputting the plurality of still images in time series,
The pause display control unit displays the pause display composite image on the display monitor instead of the moving image when the determination unit determines that the scene of the moving image is the specific scene. An image reproduction apparatus characterized by causing the image reproduction apparatus to operate. The image reproduction apparatus according to claim 2,
The moving image display control means displays the moving image on the display monitor by reproducing and outputting a moving image display combined image obtained by combining at least two or more still images among the plurality of still images in time series. ,
When the determination unit determines that the scene of the moving image is the specific scene, the pause display control unit displays the combined image for moving image display in the pause display instead of the moving image. An image reproducing apparatus for displaying on a display monitor as a combined image. The image reproduction apparatus according to claim 2,
The moving image display control means displays the moving image on the display monitor by reproducing and outputting a moving image display combined image obtained by combining at least two or more still images among the plurality of still images in time series. ,
The pause display control means, when the determining means determines that the scene of the moving image is the specific scene, the still image synthesized in the synthesized image for moving image display instead of the moving image. An image reproducing apparatus for displaying on a display monitor a composite image for pause display in which still images having a number different from the number of images or an addition ratio or an addition ratio are combined. In the image reproducing device according to any one of claims 2 to 5,
When the determination unit determines that the moving image scene is not the specific scene, the pause display control unit displays any of the plurality of still images on the display monitor instead of the moving image. An image reproduction apparatus characterized by causing the image reproduction apparatus to operate. In the image reproducing device according to any one of claims 2 to 6,
The image recognizing device, wherein the scene recognizing unit recognizes a scene in which a subject having a predetermined amount or more of movement exists on an imaging screen of an object scene as the specific scene. The image reproduction device according to claim 7,
The scene recognition unit obtains a motion vector of the subject from a plurality of still images adjacent in the time axis direction, and recognizes the specific scene if the motion vector is equal to or greater than the predetermined amount. Playback device. The image reproduction device according to claim 7 or 8,
The image reproducing apparatus, wherein the scene recognizing unit recognizes a fireworks display or a panning scene as the specific scene. The image reproduction apparatus according to claim 1,
The moving image display control means displays the moving image on the display monitor by reproducing and outputting a moving image display combined image obtained by combining at least two or more still images among the plurality of still images in time series. ,
The pause display control means, instead of the moving image, displays a pause display composite image obtained by combining a number of still images different from the number of still images combined in the moving image display composite image on the display monitor. An image reproducing apparatus characterized by being displayed on the screen. The image generation device according to any one of claims 1 to 10,
An imaging apparatus comprising: an imaging unit that images a subject and generates the plurality of still images. Load multiple still images arranged in chronological order,
Displaying a moving image on a display monitor based on the plurality of still images;
Detecting a pause instruction operation input by a user during the display of the moving image;
When the pause instruction operation is detected, instead of the moving image, a pause display composite image obtained by combining at least two still images among the plurality of still images is displayed on the display monitor. Image playback method. An image reproduction program executed in a computer to which a display monitor and an operation member are connected,
An image reading step for causing the computer to read a plurality of still images arranged in chronological order;
A moving image display control step for causing the computer to display a moving image on the display monitor based on the plurality of still images read in the image reading step;
An operation detection step of causing the computer to detect a pause instruction operation input from a user to the operation member during display of the moving image;
When the pause instruction operation is detected in the operation detecting step, a pause display composition in which at least two still images of the plurality of still images are synthesized instead of the moving image for the computer. And a pause display control step for displaying an image on the display monitor.