KR20210007315A - Method and apparatus of replacing to replacment image from original image - Google Patents

Abstract

The present invention relates to a method and apparatus for replacing an original image with a replacement image.
A method of replacing an original image with a replacement image according to an embodiment of the present invention is a method in which an apparatus for replacing the original image with a replacement image replaces the original image with a replacement image, receiving a replacement command signal, program name , Checking original image coordinate information, original image size information, performing original image recognition using program name, original image coordinate information, and original image size information in an arbitrary frame, and recognizing the original image in a random frame And confirming the replacement area, replacing the original image with a replacement image file in the replacement area within a frame.

Description

Method and device to replace original image with replacement image {METHOD AND APPARATUS OF REPLACING TO REPLACMENT IMAGE FROM ORIGINAL IMAGE}

The present invention relates to a method and apparatus for real-time replacement of an original image with a replacement image in a video.

With the development of broadcasting technology and Internet communication technology, various broadcasting contents are generated, and various types of broadcasting contents thus generated are provided to users.

However, in the case of changing a specific original image displayed on a video during broadcasting, there is a difficulty in creating a new video or changing the entire video.

In addition, in the related art, it has been difficult to replace a specific image displayed in a video while broadcasting in real time.

Republic of Korea Patent Publication No. 10-2018-0093702

A technical problem to be achieved by the present invention is to provide a method and apparatus for replacing an original image with a replacement image that can replace a desired original image with a replacement image in real time in a video.

A method of replacing an original image with a replacement image according to an embodiment of the present invention is a method in which an apparatus for replacing the original image with a replacement image replaces the original image with a replacement image, receiving a replacement command signal, program name , Checking the original image coordinate information and the original image size information, performing the original image recognition using the program name, the original image coordinate information, and the original image size information in an arbitrary frame, the arbitrary frame Recognizing the original image in the step of identifying a replacement area, and replacing the original image with a replacement image file in the replacement area within the arbitrary frame.

A method of replacing an original image with a replacement image according to another embodiment of the present invention is a method in which an apparatus for replacing the original image with a replacement image replaces the original image with a replacement image, receiving a replacement command signal, program name , Checking the coordinate information of the original image, the size information of the original image, checking whether there is information on the training time in the replacement command signal, If the replacement command signal has the programming time information, performing the original image recognition using the program name, the original image coordinate information, and the original image size information in a frame in a time zone according to the programming time information And checking the replacement area by recognizing the original image in the arbitrary frame, and replacing the original image with a replacement image file in the replacement area in the arbitrary frame.

A method of replacing an original image with a replacement image according to another embodiment of the present invention is a method in which an apparatus for replacing the original image with a replacement image replaces the original image with a replacement image, receiving a replacement command signal, a program Checking the name, original image coordinate information, and original image size information, checking whether there is programming time information in the replacement command signal, and checking original image type information if the replacement command signal has the programming time information , If the original image type is a dynamic image, checking the original image dynamic direction information, if the original image type is not the dynamic image, the program name, the original image coordinates in a frame in a time zone according to the programming time information And performing the recognition of the original image using information and the size information of the original image.

In the method for replacing an original image with a replacement image according to embodiments of the present invention, the step of recognizing the original image in the arbitrary frame and confirming the replacement area comprises: reducing the arbitrary frame to a specific magnification, Modifying the original image coordinate information according to the specific magnification to generate corrected original image coordinate information, modifying the original image size information according to the specific magnification to generate corrected original image size information, the arbitrary And performing the original image recognition by comparing the reduced original image reduced by the specific magnification and the original image file using the program name, the modified original image coordinate information, and the modified original image size information in a frame of .

The device for replacing an original image with a replacement image according to an embodiment of the present invention checks the program name, the original image coordinate information, and the original image size information in the memory for storing program name and programming time information, and the replacement command signal. , The program name, the original image coordinate information, and the original image size information are used in an arbitrary frame to recognize an original image, and the original image is recognized in the arbitrary frame to identify a replacement area, and the arbitrary And a control unit that controls to replace the original image in the frame with the replacement image file in the replacement area within the frame.

According to the method and apparatus for replacing an original image with a replacement image according to an embodiment of the present invention, there are the following effects.

First, in the present invention, the original image can be recognized in a short time by checking the program name and programming time information of a specific program and performing original image recognition in a time zone according to the program name and programming time information.

Second, according to the present invention, when a specific original image displayed on a video is changed during broadcasting, the specific original image can be replaced with a replacement image in real time without creating a new video or changing the entire video.

Third, in the present invention, by using the original image coordinate information and the original image size information, the original image can be efficiently recognized in a short time and the replacement area can be identified.

Fourth, according to the present invention, when the original image is a static image or a dynamic image, using the original image type information and the original image dynamic direction information, the original image can be efficiently recognized in a short time and the replacement area can be checked.

Fifth, according to the present invention, an arbitrary frame included in a video is reduced to a specific magnification, and coordinate information of an original image and size information of an original image are corrected according to a specific magnification, thereby recognizing the original image, thereby efficiently identifying a replacement area.

1 is a block diagram illustrating an object designation apparatus for artificial intelligence learning according to an embodiment of the present invention.
2 is a flowchart illustrating a method of replacing an original image with a replacement image according to an embodiment of the present invention.
3 is a flowchart illustrating a method of replacing an original image with a replacement image according to another embodiment of the present invention.
4 is a flowchart illustrating a method of replacing an original image with a replacement image according to another embodiment of the present invention.
5 is a flowchart illustrating a method of identifying a replacement area by recognizing an original image according to an embodiment of the present invention.

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in a variety of different forms, only these embodiments are intended to complete the disclosure of the present invention, and are common in the technical field to which the present invention pertains. It is provided to fully inform the knowledgeable person of the scope of the invention, and the invention is only defined by the scope of the claims.

In addition, terms used in the present specification are for describing exemplary embodiments and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used herein, “comprises” and/or “comprising” do not exclude the presence or addition of elements other than the mentioned elements. Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used as meanings that can be commonly understood by those of ordinary skill in the art to which the present invention belongs.

Hereinafter, embodiments of the present invention will be described in more detail with reference to the accompanying drawings in order to describe the present invention in more detail.

1 is a block diagram illustrating an apparatus for replacing an original image with a replacement image according to an embodiment of the present invention.

Referring to FIG. 1, a device for replacing an original image with a replacement image (hereinafter, referred to as “device”) according to an embodiment of the present invention includes a memory 10, a control unit 20, a display unit 30, and an input unit. (40), and a transmission/reception unit 50. These components communicate through one or more communication buses or signal lines.

The memory 10 is a part that stores various data such as moving pictures, images, command signals, and commands.

For example, the memory 10 may store program name, programming time information, original image coordinate information, original image size information, original image type information, original image dynamic direction information, original image file, replacement image file, and the like.

In addition, the memory 10 may include various preset information (eg, a specific magnification, n-division information for generating a segment original image by dividing the original image by n).

The control unit 20 is a part that controls the device according to the present invention. In addition, the control unit 20 is a part that controls each component of the device.

The control unit 20 checks the program name, original image coordinate information, and original image size information in the replacement command signal, and performs original image recognition using the program name, original image coordinate information, and original image size information in an arbitrary frame. , It is possible to control to recognize the original image in an arbitrary frame to check the replacement area, and to replace the original image with a replacement image file in the replacement area within an arbitrary frame.

In addition, the control unit 20 checks the program name, original image coordinate information, and original image size information in the replacement command signal, checks whether there is programming time information in the replacement command signal, and if there is programming time information in the replacement command signal, The original image recognition is performed using the program name, original image coordinate information, and original image size information in a random frame in the time zone according to the time information, and the replacement area is identified by recognizing the original image in a random frame. You can control to replace the original image with a replacement image file in my replacement area.

In addition, the control unit 20 checks the program name, original image coordinate information, and original image size information in the replacement command signal, checks whether there is programming time information in the replacement command signal, and if there is programming time information in the replacement command signal, the original Check the image type information, and if the original image type is a dynamic image, check the original image dynamic direction information, and if the original image type is not a dynamic image, the program name and original image coordinates in a random frame in the time zone according to the schedule time information It is possible to control to perform original image recognition using information and original image size information.

In addition, in the step of recognizing the original image in an arbitrary frame and confirming the replacement area, the controller 20 reduces the arbitrary frame to a specific magnification, modifies the original image coordinate information according to a specific magnification, and modifies the original image coordinates. Generate information, modify the size information of the original image according to a specific magnification, generate the size information of the corrected original image, and use the program name, the coordinate information of the corrected original image, and the size information of the corrected original image in an arbitrary frame to a specific magnification It is possible to control to perform the original image recognition by comparing the reduced reduced original image and the original image file.

The display unit 30 provides an interface for visual output between the user and the device. The display unit 30 includes video, original image, replacement image, program name, programming time information, original image coordinate information, original image size information, original image type information, original image dynamic direction information, original image file, replacement image file, etc. This is the part that the user can identify. The user checks the schedule time information, the original image coordinate information, the original image size information, the original image type information, the original image dynamic direction information, the original image file, the replacement image file, etc. through the display unit 30, and enters various commands ( 40) can be entered into the device.

The input unit 40 provides an interface for inputting a command signal between a user and a device. That is, the input unit 40 allows the user to input a command signal such as an input signal to the device, and when the user inputs an input signal through the input unit 40, the device detects various types of user input signals and Execute the user's command under the control of (20).

For example, the user may input a command signal such as a replacement command signal through the input unit 40.

However, in some embodiments such as a touch screen, the display unit 30 and the input unit 40 may be integrated or separated.

The transmission/reception unit 50 is a part that transmits and receives data through a signal such as an electromagnetic wave. The transmission/reception unit 50 converts an electric signal into an electromagnetic wave and communicates with a communication network and other communication devices through the electromagnetic wave. The transceiver 50 is, for example, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, a memory 10, etc. Including, but not limited to, may include a well-known circuit for performing this function.

For example, the transmission/reception unit 50 may transmit a moving picture to an external server or the like under the control of the controller 20.

In addition, a video (eg, a video for broadcasting) may be received from a transmission server receiving a replacement command signal, and a replacement video obtained by replacing the original image with a replacement image file may be transmitted to the encoder.

2 is a flowchart illustrating a method of replacing an original image with a replacement image according to an embodiment of the present invention.

In the following description, it may be described that the device operates under the control of the control unit 20 included therein.

2, the device receives a replacement command signal (S201). In the present invention, the replacement command signal may include a program name, programming time information, original image coordinate information, original image size information, original image type information, original image dynamic direction information, original image file, and replacement image file.

In the present invention, program name, programming time information, original image coordinate information, original image size information, original image type information, original image dynamic direction information, original image file, and replacement image file are requested to be received from an external server and stored in memory or , May be input by a signal input by a user.

Program name means the title of a specific program in broadcasting (or video) of a broadcaster or the like. For example, when a broadcaster conducts a home shopping broadcast or sells a travel product through a home shopping broadcast, the travel product name may be a program name.

The schedule time information is time information at which a specific program is organized, and the date, start time, and running time of a specific program are possible.

The original image coordinate information means information on the coordinates of the original image included in a frame in the video. For example, the coordinate information of the original image may display (x, y).

The original image size information means information on the size of the original image included in a frame in the video. For example, the size information of the original image may include the horizontal length and the vertical length of the original image, and (w, h) may be displayed.

The original image type information is information that can confirm whether the original image is a dynamic image or a static image. Here, the dynamic image refers to an image in which the original image includes an animation effect. For example, the dynamic image may be an image in which an original image descends from top to bottom, or an image that moves from left to right.

The original image dynamic direction information means information on how the animation effect appears when the original image type is a dynamic image. For example, if the original image dynamic direction information is from left to right, the original image includes an animation effect that moves from left to right, and if the original image dynamic direction information is from top to bottom, the original image moves from top to bottom. Includes.

The original image file means an original image file identical to the original image to be replaced in a random frame of the video. The original image file can be used to recognize the original image.

The replacement image file means an image file to replace the original image.

The device checks the program name, original image coordinate information, and original image size information (S202).

The device recognizes the original image using the program name, the original image coordinate information, and the original image size information in an arbitrary frame (S203). Here, the arbitrary frame means a specific frame in a plurality of frames included in the video. In the present invention, it is possible to recognize the original image in at least one or more frames in the video.

The device recognizes the original image in an arbitrary frame and checks the replacement area (S204). A detailed description of confirming the replacement area by recognizing the original image will be described below with reference to FIG. 5.

The device replaces the original image with a replacement image file (or replacement image) in a replacement area within an arbitrary frame (S205). In other words, the device replaces the original image with the replacement image in the replacement area within an arbitrary frame.

For example, when the video includes n frames, the present invention performs the above process from the first frame to the nth frame. That is, in the present invention, starting from the replacement of the first original image with the first replacement image file, the nth original image may be replaced with the nth replacement image file according to the setting.

3 is a flowchart illustrating a method of replacing an original image with a replacement image according to another embodiment of the present invention.

3, the device receives a replacement command signal (S301).

The device checks the program name, original image coordinate information, and original image size information (S302).

The device checks whether there is information on the training time in the replacement command signal (S303).

If there is program time information in the replacement command signal, the device recognizes the original image using the program name, the original image coordinate information, and the original image size information in an arbitrary frame in a time zone according to the knitting time information (S304). In this way, the present invention can recognize the original image in a short time by performing the original image recognition in the time zone according to the schedule time information.

If there is no programming time information in the replacement command signal, the device performs original image recognition using the program name, original image coordinate information, and original image size information in a random frame over the entire time zone (S305).

The device recognizes the original image in an arbitrary frame and checks the replacement area (S306).

The device replaces the original image with a replacement image file (or replacement image) in a replacement area within an arbitrary frame (S307).

4 is a flowchart illustrating a method of replacing an original image with a replacement image according to another embodiment of the present invention.

4, the device receives a replacement command signal (S401).

The device checks the program name, original image coordinate information, and original image size information (S402).

The device checks whether there is information on the training time in the replacement command signal (S403).

The device checks the original image type information if there is information on the training time in the replacement command signal (S404).

If there is no programming time information in the replacement command signal, the device recognizes the original image using the program name, the original image coordinate information, and the original image size information in an arbitrary frame over the entire time zone (S405).

The device checks whether the original image type is a dynamic image (S406). Here, the dynamic image refers to an image in which the original image includes an animation effect.

If the original image type is a dynamic image, the device checks the original image dynamic direction information (S407).

If the type of the original image is not a dynamic image, the device recognizes the original image using the program name, the coordinate information of the original image, and the size information of the original image in an arbitrary frame in a time zone according to the programming time information (S408). Here, if the original image type is not a dynamic image, the original image type is a static image.

The device divides the original image by n according to the dynamic direction of the original image, and generates n segmented original images (S409). Here, the segmented original image means an image obtained by dividing the original image into n equal parts according to a preset setting. For example, if the preset n is “5”, the original image is the original image of the first segment, the original image of the second segment, the original image of the third segment, the original image of the fourth segment, and the original image of the fifth segment. May contain images.

The device recognizes the n-th segment original image using the program name, the original image coordinate information, and the original image size information in an arbitrary frame in a time zone according to the programming time information, and checks the n-th replacement area (S410). For example, if the preset n is “5”, the original image of the first segment is recognized to check the first replacement area, the original image of the second segment is recognized to check the second replacement area, and the original image of the third segment By recognizing the 3rd replacement area, the 4th replacement area by recognizing the original image of the 4th segment, and the 5th replacement area by recognizing the original image of the 5th segment can be confirmed.

The device generates n segment replacement images by dividing the relationship value by n from the replacement image file (S411). For example, if the preset n is “5”, the replacement image is replaced with 5 segments such as the 1st segment replacement image, the 2nd segment replacement image, the 3rd segment replacement image, the 4th segment replacement image, and the 5th segment replacement image. May contain images.

The device replaces the n-th segment original image with an n-th segment replacement image file (or n-th segment replacement image) matching the n-th original image in the n-th replacement area in a frame (S412). For example, if the preset n is “5”, the first segment original image is replaced with a first segment replacement image file that matches the first segment original image, and the second segment original image is matched with the second segment original image. The second segment replacement image file is replaced with a second segment replacement image file, the third segment original image is replaced with a third segment replacement image file that matches the third segment original image, and the fourth segment original image is replaced with the fourth segment original image. It is possible to replace with a 4-segment replacement image file, and replace the 5th segment original image with a 5th segment replacement image file matching the 5th segment original image.

The device recognizes the original image in an arbitrary frame and checks the replacement area (S412).

The device replaces the original image with a replacement image file (or replacement image) in a replacement area within an arbitrary frame (S413).

5 is a flowchart illustrating a method of identifying a replacement area by recognizing an original image according to an embodiment of the present invention. Hereinafter, the method of identifying the replacement area by recognizing the original image described in FIG. 5 is applicable to all embodiments of the present invention described in FIGS. 1 to 4.

Referring to FIG. 5, the apparatus reduces an arbitrary frame to a specific magnification (S501). Here, the specific magnification may be set in advance by the user or the like. For example, if the predetermined specific magnification is "4", the device reduces the arbitrary frame to 4 times.

The device modifies the original image coordinate information according to a specific magnification, and generates the corrected original image coordinate information (S502).

The device modifies the original image size information according to a specific magnification, and generates the corrected original image size information (S503).

The device recognizes the original image by comparing the reduced original image and the original image file reduced by a specific magnification using the program name, the corrected original image coordinate information, and the corrected original image size information in an arbitrary frame (S504). Here, the original image means an image to be replaced within an arbitrary frame of the video, and the original image file means the same image to be compared with the original image that is an image to be replaced within an arbitrary frame of the video included in the replacement command signal. do.

The device recognizes the original image in an arbitrary frame and checks the replacement range (S505).

The method according to an embodiment of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, and the like alone or in combination. Programs (program instructions) recorded on the recording medium may be specially designed and constructed for the present invention, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CDROMs and DVDs, and magnetic-optical media such as floptical disks. Hardware devices specially configured to store and execute program instructions such as Magneto-optical media, ROM, RAM, flash memory, etc. are included. Examples of program instructions include not only machine language codes such as those produced by a compiler but also high-level language codes that can be executed by a computer using an interpreter or the like. The above-described hardware device may be configured to operate as one or more software modules to perform the operation of the present invention, and vice versa.

As described above, the present invention has been described with reference to the embodiments shown in the drawings, but this is only for describing the invention, and for those of ordinary skill in the art to which the present invention belongs, various modifications or equivalents from the detailed description of the invention It will be appreciated that one embodiment is possible. Therefore, the true scope of the present invention should be determined by the technical idea of the claims.

10: memory
20: control unit
30: display
40: input
50: transceiver unit

Claims (5)

In the method for replacing the original image with a replacement image by the device for replacing the original image with the replacement image,
Receiving a replacement command signal,
Checking the program name, original image coordinate information, and original image size information,
Recognizing the original image using the program name, the original image coordinate information, and the original image size information in an arbitrary frame,
Recognizing the original image in the arbitrary frame to confirm a replacement area,
Replacing the original image with a replacement image file in the replacement area within the arbitrary frame. In the method for replacing the original image with a replacement image by the device for replacing the original image with the replacement image,
Receiving a replacement command signal,
Checking the program name, original image coordinate information, and original image size information,
Checking whether there is information on the training time in the replacement command signal,
If the replacement command signal has the programming time information, performing the original image recognition using the program name, the original image coordinate information, and the original image size information in a frame in a time zone according to the programming time information ,
Recognizing the original image in the arbitrary frame to confirm a replacement area,
Replacing the original image with a replacement image file in the replacement area within the arbitrary frame. In the method for replacing the original image with a replacement image by the device for replacing the original image with the replacement image,
Receiving a replacement command signal,
Checking the program name, original image coordinate information, and original image size information,
Checking whether there is information on the training time in the replacement command signal,
If there is the training time information in the replacement command signal, checking the original image type information,
If the original image type is a dynamic image, checking the dynamic direction information of the original image,
If the type of the original image is not the dynamic image, performing the recognition of the original image using the program name, the original image coordinate information, and the original image size information in an arbitrary frame in a time zone according to the programming time information. How to replace the included original image with a replacement image. The method according to any one of claims 1 to 3,
Recognizing the original image in the arbitrary frame to confirm the replacement area,
Reducing the arbitrary frame to a specific magnification,
Generating modified original image coordinate information by modifying the original image coordinate information according to the specific magnification,
Generating modified original image size information by modifying the original image size information according to the specific magnification,
Performing the original image recognition by comparing the reduced original image and the original image file reduced by the specific magnification using the program name, the modified original image coordinate information, and the modified original image size information in the arbitrary frame. How to replace the included original image with a replacement image. Memory to store program name and schedule time information,
In the replacement command signal, the program name, original image coordinate information, and original image size information are checked, and the original image recognition is performed using the program name, the original image coordinate information, and the original image size information in an arbitrary frame. , Recognizing the original image in the arbitrary frame to check the replacement area, and replacing the original image including a control unit that controls to replace the original image in the frame with a replacement image file in the replacement area in the arbitrary frame Device.

Images