CN104639970A - Video stream processing device and method for recording specific video segment - Google Patents

Abstract

The invention provides a video streaming processing device and a method for recording specific video segments by the same. And receiving the video streaming and storing the video streaming in the register module. Text information associated with the video stream is received. In the process of receiving the text message, whether a specific event occurs is detected by judging whether the text message meets the acquisition condition. When the text information accords with the capturing condition, capturing a video clip with a specific event from the video streaming stored in the register module, and storing the video clip.

Description

Video stream processing device and method for recording specific video segment

technical field

The present invention relates to a video stream processing technology, and in particular to a video stream processing device and a method for recording a specific video clip.

Background technique

The invention of television and the vigorous development of mass media enable modern people to easily obtain various information through television, and because of this, watching television has become one of the main leisure entertainments of modern people. With the advancement of network technology, people can also easily share videos and music through the Internet. Rich multimedia information and various videos can be shared through set-top boxes, USB receivers, tablets, smart phones or Other devices capable of video streaming processing can be shared on the TV, so that viewers can enjoy the high-quality viewing experience provided by the TV in a more comfortable way, and it is also easier for viewers to share information through the TV.

However, in the viewing situation where many people share a TV set, since each viewer has different viewing preferences, the viewers will switch the TV set to play multiple video programs from time to time, so as to satisfy each viewer at the same time. That is to say, when many people share a TV, it is easy for everyone to watch the video programs they want to watch in fragments, and it is very easy for the viewers to miss the wonderful pictures of the video programs because of the fragments. In particular, nowadays people are very accustomed to using the Internet to watch live video streams, such as the live broadcast of large-scale games or performances. Once the viewers miss the wonderful pictures of the live programs, they will not be able to immediately use the TV to replay the missed highlights. The clips make the viewers regret watching the live broadcast. Therefore, how to allow the viewer to watch a specific segment in the video program in real time when the video is switched is a major issue for improving the user experience.

Contents of the invention

In view of this, the present invention proposes a video stream processing device and its method for recording a specific video clip, which can automatically and instantly record the wonderful pictures that the viewer is interested in while receiving the video stream, so as to Improve the user experience of watching video programs.

The present invention provides a method for recording a specific video segment, which is suitable for a video stream processing device, and the method includes the following steps. Receive the video stream and store the video stream in the storage module. Receive text information associated with the video stream. In the process of receiving text information, whether a specific event occurs is detected by judging whether the text information meets the retrieval condition. When the text information meets the retrieval conditions, the video clips with specific events are retrieved from the video stream stored in the storage module, and the video clips are stored.

From another point of view, the present invention provides a video stream processing device, which includes a video receiving module, a registering module, a text message receiving module, a judging module, an extracting module and a storing module. The video receiving module is used for receiving video streams. The register module is coupled to the video receiving module for storing the video stream. The text information receiving module is used for receiving text information associated with the video stream. The judging module is coupled to the text information receiving module. During the process of receiving the text information, the judging module is used to detect whether a specific event occurs by judging whether the text information meets the retrieval condition. The capture module is coupled to the judgment module and the storage module. When the text information meets the retrieval conditions, the retrieval module is used to retrieve video clips with specific events from the video stream stored in the storage module. The storage module is coupled to the capture module and stores video clips.

Based on the above, the present invention also receives text information associated with the video stream while receiving the video stream, and detects whether a specific event of interest to viewers occurs in the video program by judging whether the text information meets the retrieval conditions. If a specific event of interest to the viewer is detected in the video program, the video segment corresponding to the specific event will be captured and stored in the storage device. Thereby, the video streaming processing device of the present invention can monitor the content of the video program in real time, so that the viewer will not miss the wonderful picture to watch.

In order to make the above-mentioned features and advantages of the present invention more comprehensible, the following specific embodiments are described in detail together with the accompanying drawings.

Description of drawings

FIG. 1 is a schematic diagram of a system architecture of a video service system according to an embodiment of the present invention.

FIG. 2 is a schematic diagram of a processing unit of a video stream processing device according to an embodiment of the present invention.

FIG. 3 is a flowchart of a method for recording a specific video clip according to an exemplary embodiment of the present invention.

FIG. 4 is a flowchart of a method for recording a specific video clip according to an exemplary embodiment of the present invention.

FIG. 5 is a schematic diagram of text relay according to an exemplary embodiment of the present invention.

[Description of Reference Signs]

10: Video service system

100: Video streaming processing device

200: Video screen playback device

300: Video streaming provider

400: message provider

500: Video playback device

110: processing unit

120: communication interface

601, 602: Network

210: screen

220: speaker

111: Video receiving module

112: Registration module

114: text information receiving module

115: Judgment module

113: Capture module

116: storage module

117: Auxiliary judgment module

118: Transmission module

Msg_1: text message

t1: time information

S301-S304: each step of the method for recording a specific video clip according to an exemplary embodiment of the present invention

S401-S406: each step of the method for recording a specific video clip according to an exemplary embodiment of the present invention

Detailed ways

In order for viewers not to miss the highlights of the video program, the present invention uses the video stream processing device receiving the video stream to monitor whether a specific event occurs. When a specific event occurs in a video program, the video stream processing device can start the mechanism of recording a specific video segment according to the text information associated with the video program. In order to make the content of the present invention clearer, the following examples are listed as examples in which the present invention can actually be implemented.

FIG. 1 is a schematic diagram of a system architecture of a video service system 10 according to an embodiment of the present invention. Referring to FIG. 1 , the video service system 10 includes a video stream processing device 100 , a video image playing device 200 , a video streaming provider 300 , a message provider 400 and a video playing device 500 .

In this exemplary embodiment, the video stream processing device 100 is, for example, an electronic device capable of processing video signals, such as a digital set-top box (Set Top Box, STB), a video game console, or a DVD player. The video stream processing device 100 includes a communication interface 120 and a processing unit 110 . The video stream processing device 100 can be connected to the network 601 and the network 602 through the communication interface 120 , and send and receive network information. For example, the communication interface 120 may include communication chips such as a wired network card and a wireless network card. In addition, the communication interface 120 may also include a conventional signal line through which television signals may be received. The processing unit 110 is electrically connected to the communication interface 120 . The processing unit 110 is responsible for the overall operation and main data processing of the video stream processing device 100. The processing unit 110 may be composed of a hardware device with computing power, such as a CPU, a micro-processor (micro-processor) or an embedded controller. etc., the present invention is not limited thereto.

In this exemplary embodiment, the network 601 and the network 602 may be wireless or wired wide area communication networks, such as wired Internet, Worldwide Interoperability for Microwave Access (WiMAX), third generation communication (3G), fourth generation communication (4G), etc., the present invention is not limited thereto. In addition, the network 601 and the network 602 can also be wireless or wired regional communication networks, such as wired regional intranet, wireless compatible authentication (Wi-Fi), Bluetooth (Bluetooth), etc. limit.

The video frame playing device 200 is electrically connected to the video stream processing device 100 . The video image playing device 200 at least includes a screen 210 . The screen 210 is used to play video images. For example, the screen 210 may receive the video stream after the processing unit 110 performs decoding (decoding) or decompression (decompression) and other video processing operations, and display it as a video frame. In addition, in an exemplary embodiment, the video display device 200 further includes a speaker 220 . The speaker 220 can receive the audio signal in the processed video stream from the processing unit 110 and output the audio signal.

In addition, in an exemplary embodiment, the video stream processing device 100 can be combined with the video image playing device 200 to be a smart TV (Smart TV), an Internet TV (Internet TV), a smart phone (smartphone), a tablet computer (tablet PC), notebook computer (notebook), handheld game console or desktop computer and other electronic devices with video signal processing and video image display capabilities.

The video stream provider 300 is used for providing video signals to the video stream processing device 100 . In this exemplary embodiment, the video stream processing device 100 can be wired and/or wirelessly connected to the network 601 through the communication interface 120, and obtain a specific video or video signal from the video stream provider 300 through the network 601 . In addition, the video stream processing device 100 can also obtain a specific video signal from the video stream provider 300 through a traditional physical TV signal cable.

It is worth mentioning that the video streaming provider 300 can provide live video signals. For example, the video streaming provider 300 may be a TV station and/or a live web site. The video stream provider 300 can broadcast through digital video (for example, DVB-S/S2, DVB-C/C2, DVB-T/T2 or DVB-H/H2), National Television Standards Committee (National Television Standards Committee, NTSC ), Phase Alternating Line (PAL), Integrated Digital Services Broadcasting (Integrated Services Digital Broadcasting, ISDB), Radio and Television Portugal (RTP), Internet Protocol Television (Internet Protocol Television, IPTV) and other standards related to live video broadcasting, to transmit the video signal to the video stream processing device 100 .

As mentioned above, after the video stream processing device 100 receives a specific video or video signal from the video stream provider 300 through the network 601, or receives a live video stream or an instant video signal from the video stream provider 300, the video stream The processing unit 110 of the processing device 100 can perform related video processing operations, and play the processed video signal or video stream via the video image playing device 200 .

In this exemplary embodiment, in addition to receiving the video stream provided by the video stream provider 300 , the audio-video stream processing device 100 can also receive text information associated with the video stream. Here, the text information associated with the video stream carries relevant news and information about the video program, and the viewer can know or infer the content of the video program or other relevant information through the text information. Moreover, the text information associated with the video stream is provided by at least one of a message provider 400 or a video stream provider 300 .

Specifically, the message provider 400 is used to provide accompanying text information associated with the video stream. The video stream processing device 100 can be connected to the network 601 through the communication interface 120 , and obtain relevant text information from the video stream provider 300 or the message provider 400 via the network 601 . For example, the text information associated with the video stream is provided by the official broadcaster (video stream provider 300), and the viewer can display the text relay of the video program on the screen 210 through the relevant application program. . However, the text transmission of the video program may also be provided by other unofficial text transmission providers (information provider 400).

In addition, the message provider 400 may also be a social service provider, and the text information associated with the video stream is, for example, the text content provided by the social service provider. Specifically, the viewer can edit a text message corresponding to a certain video program through the service provided by the community service provider, and upload the edited text message to the message provider 400 . For example, the news provider 400, such as a community service provider, can open a video discussion area, so that viewers who are watching the same video program can share their watching experience or discuss the video content in real time through text.

It is worth mentioning that, in an exemplary embodiment, the text information associated with the video stream may also be the subtitle of the video program, which is provided by the video stream provider 300 . That is to say, the video stream provider 300 not only provides the image file and audio file of the video program, but also provides the subtitle file of the video program to the video stream processing device 100 .

FIG. 2 is a schematic diagram of a processing unit according to an embodiment of the invention. Referring to FIG. 2 , the processing unit 110 at least includes a video receiving module 111 , a registering module 112 , a text information receiving module 114 , a judging module 115 , an extracting module 113 , a storage module 116 , an auxiliary judging module 117 and a transmitting module 118 . In this exemplary embodiment, the video receiving module 111, the registering module 112, the text information receiving module 114, the judging module 115, the capturing module 113, the storage module 116, the auxiliary judging module 117 and the transmitting module 118 are directly or indirectly coupled to each other each other.

The video receiving module 111 , the text information receiving module 114 , the judging module 115 , the capturing module 113 , the auxiliary judging module 117 and the transmitting module 118 can be implemented by software, hardware or a combination thereof, without limitation here. The software is, for example, source code, an operating system, application software, or a driver. The hardware is, for example, a central processing unit (Central Processing Unit, CPU), or other programmable general-purpose or special-purpose microprocessors (Microprocessor).

The storage module 112 and the storage module 116 include at least one of hard disk (Hard Drive Disc, HDD), volatile memory (volatile memory) and non-volatile memory (non-volatile memory), or a combination thereof, or any storage medium. In an exemplary embodiment, the registration module 112 and the storage module 116 may also include storage media such as a hard disk, a volatile memory, and a non-volatile memory disposed outside the processing unit 110 , which are not limited by the present invention.

FIG. 3 is a flowchart of a method for recording a specific video clip according to an exemplary embodiment of the present invention. The method of this exemplary embodiment is applicable to the video stream processing device 100 shown in FIG. 1 . The detailed steps of this embodiment will be described below with the modules and components shown in FIG. 1 and FIG. 2 .

First, in step S301 , the video receiving module 111 receives the video stream from the video stream provider 300 through the communication interface 120 , and stores the video stream in the storage module 112 . In other words, after the viewer selects a video program, the video receiving module 111 continues to receive the video stream of the selected video program, and stores the video stream in the storage module 112, so that the video stream of the selected video program Stream for real-time video recording. For example, assume that the register module 112 is a buffer register. When the storage space of the buffer register (the registration module 112 ) is used up, the registration module 112 can delete and store the video stream according to a first-in-first-out mechanism, so as to continuously store the currently received video stream.

Afterwards, in step S302 , the text information receiving module 114 receives text information associated with the video stream through the communication interface 120 . Based on the above, the text information associated with the video stream may be the text relay or subtitles provided by the video stream provider 300 , or the text relay or other text messages provided by the message provider 400 .

In step S303, the judging module 115 detects whether a specific event occurs by judging whether the text information meets the retrieval condition during the process of receiving the text information. Specifically, assuming that the video program is a live football game, when the judging module 115 detects that the text information has the keyword "shooting", the judging module 115 can deduce that the video program should broadcast a picture of a football player shooting, thereby detecting The timing of a specific event (shooting event) in the video stream. Assuming that the video program is a live concert, when the judging module 115 detects that the text information has the keyword "song name A", the judging module 115 can deduce that the video program is playing the song "song name A" sung by a certain singer, thereby detecting Occurrence timing of a specific event (specific song singing event) in the video stream.

Furthermore, when the viewer selects a video program to be recorded, the viewer can select keywords through various input methods. Therefore, the judging module 115 can set a keyword associated with the retrieval condition according to an input operation of the user, and continuously monitor whether the text information includes the keyword selected by the user during the process of continuously receiving the text information. When the text information includes the keyword, the judging module 115 judges that a specific event that the viewer wants to watch has been detected.

Afterwards, when the text information meets the extraction condition (step S303 is judged as yes), in step S304, the extraction module 113 extracts video clips with specific events from the video stream stored in the storage module 112, and stores the video clips in Storage module 116. Specifically, when the text information meets the retrieval conditions, the retrieval module 113 can directly record the current time information of the video stream processing device 100 or obtain the time information from external text information. Therefore, according to the above time information, the retrieval module 113 can retrieve video clips corresponding to the above time information and having specific events from the video stream stored in the storage module 112 .

For example, when the judging module 115 judges that a text message in the text relay has a keyword that meets the retrieval condition, the retrieval module 113 can obtain the broadcasting time point of the text message from the text relay. Furthermore, due to the execution of buffered video recording, the capture module 113 can use the broadcast time point of the text message as a reference and go back a first preset time (for example: 30 seconds) to obtain the start of the specific video segment to be captured. start time point. Therefore, the retrieval module 113 can retrieve a specific video segment with a duration of a second preset time (for example: 2 minutes) from the registration module 112 according to the starting time point, and store the specific video segment extracted permanently. to the storage module 116. Wherein, the lengths of the first preset time and the second preset time can be set according to actual application conditions. In this way, the above-mentioned specific video segment of the second preset time will have a specific event that the user is interested in, and the viewer can control the video stream processing device 100 to replay the specific video segment stored in the storage module 116 .

On the other hand, when the text information does not meet the extraction condition (step S303 judges as NO), it means that the judgment module 115 has not detected the occurrence of a specific event, and the judgment module 115 will repeat step S303 to continuously monitor whether a specific event occurs in the video program. If there is no specific event meeting the capture condition in the video program, the video stream temporarily stored in the storage module 112 can be deleted to release the storage space of the storage module 112 .

However, the implementation manner of the present invention is not limited to the above description, and the content of the above embodiments may be modified according to actual requirements. For example, in another exemplary embodiment of the present invention, the video stream processing device 100 can also use image information or audio information other than text information to determine whether a specific event occurs in the video program. Another exemplary embodiment will be described in detail below.

FIG. 4 is a flow chart of a method for recording a specific video clip according to an embodiment of the present invention. The method of this exemplary embodiment is applicable to the video stream processing device 100 shown in FIG. 1 . The detailed steps of this embodiment will be described below with the modules and components shown in FIG. 1 and FIG. 2 .

In step S401 , the video receiving module 111 receives the video stream from the video stream provider 300 through the communication interface 120 , and stores the video stream in the storage module 112 . In step S402 , the text information receiving module 114 receives text information associated with the video stream through the communication interface 120 . In step S403, the judging module 115 detects whether a specific event occurs by judging whether the text information meets the retrieval condition during the process of receiving the text information. The above-mentioned steps S401-S403 are the same or similar to the steps S301-S303 shown in FIG. 3 , and the detailed content thereof can refer to the description of FIG. 3 , and will not be repeated here.

For example, FIG. 5 is a schematic diagram of text relay according to an exemplary embodiment of the present invention. In this example, the video stream processing device 100 can obtain the text relay screen shown in FIG. 5 from the video stream provider 300 or the message provider 400 . While the video receiving module 111 is continuously receiving video streams, the text information receiving module 114 is also continuously receiving text messages corresponding to different time points. For example: the text message Msg_1 corresponds to the time point t1. The judging module 115 continues to judge whether the plurality of text messages include the keyword "shoot". In this way, as shown in FIG. 5 , assuming that the text message Msg_1 includes the keyword “shooting”, the judging module 115 judges that a specific event meeting the retrieval condition has been detected, and the video stream processing device 100 can transfer the data from the registration module according to the time point t1. In step 112, video clips with specific events are extracted.

In addition, different from the foregoing embodiments, in step S404, during the process of receiving the video stream, the auxiliary judgment module 117 judges whether the video stream includes a single-frame picture with picture features or audio data with voice features, to detect if a specific event has occurred. By means of the auxiliary determination module 117 based on the auxiliary determination of image processing or audio processing, the images that the viewer is interested in can be further accurately filtered out. In an exemplary embodiment, the video stream processing device 100 can establish a user interface according to the relevant information of the video program, so that the viewer can determine the picture feature and the voice feature by manipulating the user interface.

For example, assuming that the video program is a live football match, the viewer can select a jersey number (for example: No. 11) through the above-mentioned user interface, and use the jersey number as a picture feature. Therefore, the auxiliary judging module 117 will use image processing technology to judge whether the selected jersey back number (for example: No. 11) appears in each single frame, so as to further track and judge whether a specific event occurs. In addition, the auxiliary judging module 117 can also judge the voice characteristics of the broadcaster of the ball game according to the audio information in the video stream, so as to judge whether a specific event occurs based on the voice characteristics of the broadcaster of the ball game. It should be noted that the auxiliary judgment module 117 is used to assist the video stream processing device 100 to detect the occurrence of a specific event by using different judgment conditions, so this embodiment does not limit the actual execution sequence of steps S403 and S404.

Therefore, when both step S403 and step S404 are determined to be yes, the retrieval module 113 retrieves video clips with specific events from the video stream stored in the storage module 112 , and stores the video clips in the storage module 116 . That is to say, after the viewer has set the selected video program and the capture condition, even if the screen 210 is playing other video programs, the video stream processing device 100 will automatically record the video segment that the user is interested in.

Afterwards, in step S406 , the transmission module 118 transmits the video segment to at least one video playback device 500 so as to play the video segment with a specific event through the video playback device 500 . Furthermore, since the specific video segment will be recorded in the storage module 116 and will not be automatically deleted as time goes by, it can be transmitted to the video playback device 500 such as a handheld device through multi-screen sharing. Based on this, when a specific event occurs, the video stream processing device 100 can share the video segment to other video playback devices, so that viewers in another space can also enjoy wonderful pictures.

To sum up, the present invention also receives text information associated with the video stream while receiving the video stream, and detects whether a specific event of interest to the viewer occurs in the video program by judging whether the text information meets the retrieval conditions. In this way, when the viewer pre-sets the selected video program and the capturing conditions of the specific event, the video stream processing device can record and store the specific video segment in real time by monitoring the selected video stream. In this way, even if the viewer cannot appear in front of the video playback device on time or is watching multiple video programs at the same time, the viewer will not miss any exciting pictures of interest, and can immediately watch a specific video through instant replay segments, thereby enhancing the user experience of watching video programs.

Although the present invention has been disclosed as above with the embodiments, it is not intended to limit the present invention. Anyone with ordinary knowledge in the technical field can make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention should be defined by the claims.

Claims (14)

1. record a method for specific video clip, be applicable to video streaming processing unit, it is characterized in that, described method comprises:

Receiver, video crossfire, and store this video streaming in registration module;

Receive the Word message being associated with this video streaming;

In the process receiving this Word message, whether there is particular event by judging whether this Word message meets capturing conditions to detect; And

When this this capturing conditions of word information conforms, from this video streaming stored by this registration module, capture the video segment with this particular event, and store this video segment.

2. the method for claim 1, is characterized in that, receives this video streaming, and stores this video streaming in the step of this registration module and comprise:

When finishing using in the storage area of this registration module, deleting according to first in first out mechanism and storing this video streaming, to continue this video streaming of current reception to be stored in this registration module.

3. the method for claim 1, is characterized in that, this video streaming provided by video streaming supplier, and this Word message by message provider or this video streaming supplier at least one of them provided.

4. the method for claim 1, is characterized in that, in the process receiving this Word message, by judging whether this Word message meets this capturing conditions to detect the step whether this particular event occurs and comprise:

The keyword of this capturing conditions is set according to input operation; And

Judge whether this Word message comprises this keyword, wherein when this word packets of information draws together this keyword, judge this particular event to be detected.

5. the method for claim 1, is characterized in that, when this this capturing conditions of word information conforms, the step capturing this video segment with this particular event from this video streaming stored by this registration module comprises:

When this this capturing conditions of word information conforms, directly record this video streaming processing unit temporal information instantly or from this this temporal information of word acquisition of information; And

According to this temporal information, capture from this video streaming stored by this registration module and correspond to this temporal information and this video segment with this particular event.

6. the method for claim 1, is characterized in that, more comprises:

In the process receiving this video streaming, by judging whether this video streaming comprises the single frames picture with pictorial feature or the voice data with phonetic feature, detects and whether particular event occurs.

7. the method for claim 1, is characterized in that, more comprises:

Transmit this video segment at least one video play device; And

This video segment with this particular event is play by described video play device.

8. a video streaming processing unit, is characterized in that, this device comprises:

Video reception module, in order to receiver, video crossfire;

Registration module, couples this video reception module, in order to store this video streaming;

Word message receiver module, in order to receive the Word message being associated with this video streaming;

Judge module, couples this word information receiving module, and in the process receiving this Word message, whether this judge module is in order to particular event to occur by judging whether this Word message meets capturing conditions to detect;

Acquisition module, couples this judge module and this registration module, and when this this capturing conditions of word information conforms, this acquisition module in order to capture the video segment with this particular event from this video streaming stored by this registration module; And

Storage module, couples this acquisition module, stores this video segment.

9. video streaming processing unit as claimed in claim 8, is characterized in that, when finishing using in the storage area of this registration module, this registration module is deleted according to first in first out mechanism and stored this video streaming, with this video streaming of the current reception of lasting storage.

10. video streaming processing unit as claimed in claim 8, it is characterized in that, this video streaming provided by video streaming supplier, and this Word message by message provider or this video streaming supplier at least one of them provided.

11. video streaming processing unit as claimed in claim 8, it is characterized in that, this judge module sets the keyword of this capturing conditions according to input operation, and judge whether this Word message comprises this keyword, when this word packets of information draws together this keyword, this judge module judges this particular event to be detected.

12. video streaming processing unit as claimed in claim 8, is characterized in that, when this this capturing conditions of word information conforms, this acquisition module directly records this video streaming processing unit temporal information instantly or from this this temporal information of word acquisition of information;

Wherein, this acquisition module captures and corresponds to this temporal information and this video segment with this particular event from this video streaming stored by this registration module.

13. video streaming processing unit as claimed in claim 8, is characterized in that, more comprise:

Auxiliary judgment module, couple this video reception module, in the process receiving this video streaming, this auxiliary judgment module is in order to by judging whether this video streaming comprises the single frames picture with pictorial feature or the voice data with phonetic feature, detects and whether particular event occurs.

14. video streaming processing unit as claimed in claim 8, is characterized in that, more comprise:

Delivery module, couples this storage module, in order to transmit this video segment at least one video play device, to be play this video segment with this particular event by described video play device.