CN113709552A - Video generation method and device and electronic equipment - Google Patents
Video generation method and device and electronic equipment Download PDFInfo
- Publication number
- CN113709552A CN113709552A CN202111017982.1A CN202111017982A CN113709552A CN 113709552 A CN113709552 A CN 113709552A CN 202111017982 A CN202111017982 A CN 202111017982A CN 113709552 A CN113709552 A CN 113709552A
- Authority
- CN
- China
- Prior art keywords
- video
- target
- user
- concentration degree
- original video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 66
- 230000006399 behavior Effects 0.000 claims description 38
- 230000009471 action Effects 0.000 claims description 21
- 230000008451 emotion Effects 0.000 claims description 21
- 230000001815 facial effect Effects 0.000 claims description 15
- 230000003542 behavioural effect Effects 0.000 claims description 8
- 230000002452 interceptive effect Effects 0.000 claims description 8
- 238000012937 correction Methods 0.000 claims description 6
- 208000019901 Anxiety disease Diseases 0.000 claims description 5
- 230000036506 anxiety Effects 0.000 claims description 4
- 230000004044 response Effects 0.000 claims description 4
- 238000012545 processing Methods 0.000 abstract description 5
- 230000008569 process Effects 0.000 description 19
- 238000004891 communication Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 210000003128 head Anatomy 0.000 description 5
- 230000009467 reduction Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 3
- 239000012141 concentrate Substances 0.000 description 2
- 230000008909 emotion recognition Effects 0.000 description 2
- 230000004438 eyesight Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000012552 review Methods 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 206010010305 Confusional state Diseases 0.000 description 1
- 235000013559 Schnittsellerie Nutrition 0.000 description 1
- 244000169997 Schnittsellerie Species 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 230000003796 beauty Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 230000008921 facial expression Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 238000010792 warming Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4334—Recording operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/441—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card
- H04N21/4415—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
- H04N21/4668—Learning process for intelligent management, e.g. learning user preferences for recommending movies for recommending content, e.g. movies
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Social Psychology (AREA)
- Biomedical Technology (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
本申请公开了一种视频生成方法、装置及电子设备，属于视频处理技术领域。该方法包括：在播放原始视频的情况下，采集用户的行为数据，其中，所述用户为观看所述原始视频的用户；根据所述行为数据，确定所述用户的目标专注度，其中，所述目标专注度表示所述用户观看所述原始视频的专注程度；根据所述目标专注度和所述原始视频，生成目标视频，其中，所述目标视频包括在所述目标专注度下，所述原始视频中被播放的视频数据。
The present application discloses a video generation method, device and electronic device, which belong to the technical field of video processing. The method includes: in the case of playing the original video, collecting behavior data of the user, wherein the user is a user who watches the original video; and determining the target concentration of the user according to the behavior data, wherein the The target concentration degree represents the concentration degree of the user watching the original video; according to the target concentration degree and the original video, a target video is generated, wherein the target video is included under the target concentration degree, the The video data being played in the original video.
Description
Technical Field
The present application belongs to the technical field of video processing, and in particular, to a video generation method, an apparatus and an electronic device.
Background
It is a common practice for users to receive education currently to attend a class in a remote manner through electronic devices.
Currently, in the field of online education, a general focus is how to enable the electronic device to intelligently restrain and remind a user without supervision of a teacher or a parent during a course of the user accessing a lesson, so that the user can continuously concentrate on receiving education.
However, in the process of receiving online education, the reduction of the user concentration degree is difficult to avoid, so that how to enable the user to learn missing knowledge points through the electronic device in the case of the reduction of the user concentration degree becomes a problem to be solved at present.
Disclosure of Invention
The embodiment of the application aims to provide a video generation method and a video generation device, which can solve the problem that when an original video is played, knowledge points in the original video can be missed to learn due to the fact that the concentration of a user is reduced.
In order to solve the technical problem, the present application is implemented as follows:
in a first aspect, an embodiment of the present application provides a video generation method, where the method includes:
the method comprises the steps of collecting behavior data of a user under the condition of playing an original video, wherein the user is a user watching the original video;
determining a target concentration degree of the user according to the behavior data, wherein the target concentration degree represents the concentration degree of the user for watching the original video;
generating a target video according to the target concentration degree and the original video, wherein the target video comprises video data played in the original video under the target concentration degree.
In a second aspect, an embodiment of the present application provides a video generating apparatus, including:
the system comprises a collecting module, a judging module and a display module, wherein the collecting module is used for collecting behavior data of a user under the condition of playing an original video, and the user is a user watching the original video;
a concentration determination module for determining a target concentration of the user based on the behavior data, wherein the target concentration represents a concentration of the user viewing the original video;
and the target video generation module is used for generating a target video according to the target concentration degree and the original video, wherein the target video comprises video data played in the original video under the target concentration degree.
In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, and when executed by the processor, the program or instructions implement the steps of the method according to the first aspect.
In a fourth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first aspect.
In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.
In the embodiment of the application, in the process of playing the original video by the electronic device, the target concentration degree of the user is obtained by collecting the behavior data of the user watching the original video, so that the electronic device can record the video data corresponding to the target concentration degree in the original video to obtain the target video, and therefore the user can exercise the knowledge points which are missed due to the reduction of the user concentration degree caused by various reasons in the playing process of the original video according to the target video, and the user can be ensured to comprehensively understand the knowledge points contained in the original video.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is a flowchart illustrating steps of a video generation method according to the present embodiment;
fig. 2 is a schematic diagram of collecting behavior data of a user according to this embodiment;
FIG. 3 is a schematic diagram of acquiring gesture data of a user according to the present embodiment;
fig. 4 is a schematic structural diagram of a video generating apparatus provided in this embodiment;
fig. 5 is a schematic structural diagram of an electronic device provided in this embodiment;
fig. 6 is a schematic diagram of a hardware structure of another electronic device provided in this embodiment.
Detailed Description
The technical solutions in the embodiments of the present application will be described clearly below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments that can be derived by one of ordinary skill in the art from the embodiments given herein are intended to be within the scope of the present disclosure.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
The video generation method provided by the embodiment of the present application is described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.
Please refer to fig. 1, which is a flowchart illustrating a video generation method according to an embodiment of the present application. The method can be applied to electronic equipment, and the electronic equipment can be a mobile phone, a tablet computer, a notebook computer and the like. As shown in FIG. 1, the method may include steps S1100-S1300, described in detail below.
S1100, under the condition of playing an original video, collecting behavior data of a user, wherein the user is a user watching the original video.
The original video refers to an online education video played in the electronic device, for example, the original video may be a network course video provided to the user for watching in a live broadcast manner; for another example, the original video may be a video provided to the user for viewing by the network education platform.
The behavior data of the user refers to behavior data representing the behavior of the user in the process of playing the original video. For example, the behavioral data may be data of a user's eye gaze focus, facial data, pose data, voice data, and so on. In the embodiment of the application, the behavior data of the user can be obtained by the electronic device after various data acquisition devices acquire images of the user watching the original video and perform image recognition under the condition of obtaining the authorization of the user.
In the related art, since online education generally provides knowledge points to a user in the form of live video, in order to prevent the user from missing knowledge points, in the process of receiving online education through an electronic device, the electronic device generally detects the class attendance state data of the user, so as to send a prompt message to the user in time to restrain the user from attentively listening to classes under the condition that the user may not concentrate on listening to the speech.
However, at the first moment when the concentration degree of the user is reduced, even if the electronic equipment sends out the reminding information in time, the user can improve the concentration degree and listen and talk again with concentration according to the reminding information at the second moment; however, the user has also missed a knowledge point of the original video in the time length range between the first time and the second time.
In order to enable a user to conveniently warm and learn about missed knowledge points in an original video, in the embodiment of the application, the electronic device can continuously acquire behavior data of the user through a data acquisition device in communication connection with the electronic device under the condition that the original video is played, so that video data corresponding to a target concentration degree in the original video is recorded under the condition that the concentration degree of the user is detected to be the target concentration degree according to the behavior data, and therefore the user can perform key warming on the missed knowledge points according to the recorded target video.
In an embodiment of the present application, the data acquisition device may be an image sensor, an audio input device, or the like.
Specifically, in one embodiment, referring to fig. 2, in the case that a user watches a live web lesson through a tablet, the tablet may collect at least one user image of the user watching a video through its front camera and/or microphone, and recognize the image through an image recognition process, such as a facial recognition algorithm, a gesture recognition algorithm, and the like, to obtain behavior data.
S1200, obtaining the target concentration degree of the user according to the behavior data, wherein the target concentration degree represents the concentration degree of the user watching the original video.
Optionally, the target concentration degree represents the concentration degree of the user watching the original video. In an embodiment of the application, the target concentration may be at least one of preset level concentrations associated with the behavioral data of the user, wherein the preset level concentrations may include a first level concentration, a second level concentration, and a third level concentration.
Optionally, the different preset levels of concentration respectively represent the degree of concentration of the user when watching the original video, for example, a first level of concentration corresponds to the user not looking at the screen or the user not appearing in front of the camera for more than a threshold time, a second level of concentration corresponds to the user's facial expression being an expression of frowning, anxious, puzzling, etc., and a third level of concentration corresponds to the user having a small difference action, for example, there is a shaking head, looking right at left, eating, playing a toy, etc.
Hereinafter, how to determine the target concentration degree of the user based on the behavior data of the user will be described.
In one embodiment, the determining the target concentration of the user from the behavioral data includes: according to the behavior data, obtaining an eye gazing focus of the user; acquiring a video position area of the original video; determining the target concentration degree as a first level concentration degree if an offset value of the eye gaze focus and the video location area is greater than a preset offset threshold.
The focus is watched by eyes, the electronic equipment can collect eye data of a user, and the eye data is obtained by obtaining the position data of the eye focus of the user through a face recognition algorithm.
The video position area may be position data representing a play area of the original video in the screen of the electronic device. For example, the video position area can be simply expressed by position data corresponding to all screen areas of the electronic device; alternatively, to improve the accuracy, the video position area may be position data of a corresponding playing area in the original apparent electronic device screen.
Specifically, the electronic device may determine whether the eye gaze focus is located in the video position area by converting the eye gaze focus and the video position area into the same coordinate space, and if not, obtain an offset value of the eye gaze focus with respect to a boundary line of the video position area, and determine that the target concentration degree is the first-level concentration degree when the offset value is greater than a preset offset threshold value.
In this embodiment, to avoid the erroneous determination, in the case that the offset value between the eye gazing focus and the video position area is greater than a preset offset threshold, the determining that the target concentration degree is the first level concentration degree may be: acquiring unfocused time length of the user under the condition that the deviation value is larger than the deviation threshold value; and under the condition that the unfocused time length is greater than a preset time length threshold value, determining the target concentration degree as the first level concentration degree.
The unfocused duration represents a duration that the user does not watch the original video, that is, the target concentration degree can be determined to be the first-level concentration degree under the condition that the gaze of the user deviates from the original video and the deviation duration reaches a preset duration threshold.
For example, in the course of a user surfing a lesson through a tablet computer, when the user has at least one of the conditions that the duration of the user not watching the screen exceeds 20 seconds, the eyesight is frequently removed from the screen, the eyesight does not watch the lesson area in the screen, the user does not hear seriously, and the like, the user is judged to be low in concentration degree and not to be talking seriously, and the target concentration degree can be determined to be the first level of concentration degree.
Because the user gazing focus can be obtained by collecting eye data of the user and quickly calculating, the concentration degree of the user watching the original video can be quickly judged through the eye gazing focus and the deviation value of the video position area corresponding to the original video.
In another embodiment, the determining a target concentration of the user from the behavioral data includes: obtaining facial feature information of the user according to the behavior data; obtaining emotion information of the user according to the facial feature information; determining the target concentration degree as a second level concentration degree under the condition that the emotion information comprises preset emotion information, wherein the preset emotion information comprises at least one of anxiety information and confusion information.
Specifically, the electronic device may extract facial feature information of the user according to the collected user facial data; to identify the current emotion information of the user according to the obtained facial feature information; and, when the recognized emotion information includes a state indicating that the user is in an anxiety state, a confusion state, or the like, it is determined that the user does not understand the knowledge points being played and concentration is reduced, and therefore, it is possible to specify the target concentration in this case as the second level concentration.
In specific implementation, an emotion recognition model for recognizing emotion information of the user can be trained in advance, so that facial feature information in facial data in behavior data is extracted through the emotion recognition model, current emotion information of the user is further obtained, and the concentration degree of the user when the user watches the original video is rapidly judged.
In yet another embodiment, the determining a target concentration of the user from the behavioral data includes: acquiring attitude characteristic information of the user according to the behavior data; acquiring action information of the user according to the posture characteristic information; and determining the target concentration degree as a third level concentration degree under the condition that the action information comprises preset action information, wherein the preset action information comprises at least one of information representing shaking head, looking aside, eating and playing toys.
The posture characteristic information of the user may be information indicating a current posture of the user. For example, the posture characteristic information may be information indicating an operation state of the upper body of the user as shown in fig. 2.
In specific implementation, whether the user has poor movements such as shaking head, looking ahead, eating, playing toys and the like in the process of playing the original video can be identified according to the posture characteristic information of the user, and if the poor movements exist, the current concentration degree of the user is reduced, so that the target concentration degree in the situation can be determined to be the third level concentration degree.
As can be seen from the above description, in the process of playing the original video, according to the embodiment of the application, by acquiring the behavior data of the user and according to the information such as the eye gazing focus, the emotion information, and the gesture action of the user, the concentration degree of the user can be quickly and conveniently determined, so that the corresponding video data is recorded to obtain the target video when the concentration degree of the user is the target concentration degree.
It should be noted that, the above embodiments of determining the target concentration degree are only provided for the embodiments of the present disclosure, and the target concentration degree may also be determined by other steps in the specific implementation, and is not particularly limited herein. In addition, in the embodiment of the present application, the concentration degree is set to different levels to represent that the concentration degree of the user decreases according to the concentration degree of the corresponding level, and the concentration degree of the user may also be directly represented in a numerical form in concrete implementation, and is not particularly limited herein.
S1300, generating a target video according to the target concentration degree and the original video, wherein the target video comprises video data played in the original video under the target concentration degree.
The target video may be a video obtained by recording the original video and/or comment information corresponding to the original video and identifying video data that the user wrongly watched under the target concentration level.
Specifically, under the condition that the user concentration obtained according to the above steps is the target concentration, the corresponding video data in the original video may be recorded according to the target concentration, so that the user may review the video and review the knowledge points that may be missed according to the key information identified in the video.
In an embodiment of the application, the generating a target video according to the target concentration degree and the original video includes: under the condition that the target concentration degree is a preset level concentration degree, acquiring the target starting and ending time played in the original video under the target concentration degree; and obtaining the target video according to the target start-stop time and the original video.
The target start-stop time may be a start-stop time corresponding to a start playing time of the original video, which represents a playing progress of the original video with the user at the target concentration.
In the embodiment of the present application, since the user may have a plurality of attentiveness reduction during playing of the original video, the target attentiveness may be at least one, and the target start-stop time corresponding to the target attentiveness may also be at least one.
For example, the user is at 19: 00 start a web session with the tablet, and the tablet determines that the user is at 19: 01-19: if the user does not watch the web lesson in the period of 02, the corresponding target starting and stopping time in the situation can be set to be 1-2 minutes, so as to indicate that the user does not pay attention to listening to the speech within the 1 st minute to the 2 nd minute of the playing progress of the web lesson; and if it is also determined that the user is at 19: 06-19: when eating during 10 hours, the corresponding target start-stop time in this case can be set to [ 6-10 points ], so as to indicate that the user is not paying attention to listening and speaking within the 6 th to 10 th minutes of the web class playing progress; and if it is also determined that the user is at 19: 15-19: if the face has expression indicating confusion such as frowning, puzzling, and tight mouth during 16 hours, the corresponding target start-stop time in this case may be set to [15 min-16 min ] to indicate the knowledge points in the 15 th minute to 16 th minute when the user does not understand the playing progress of the web lesson.
In one embodiment, the obtaining the target video according to the target start-stop time and the original video comprises at least one of: according to the target starting and stopping time, adding identification information corresponding to the target concentration degree in a progress bar of a recorded video to obtain the target video, wherein the recorded video is obtained by recording the original video, and the identification information comprises color information; and extracting video data corresponding to the target start-stop time from the original video to generate the target video.
Specifically, in the process of playing a video, the electronic device may record an original video, and after the recording is completed, the electronic device adds identification information corresponding to the target concentration degree to a progress bar of the recorded video according to the obtained target start-stop time, so that a user may warm knowledge points that may be missed due to the reduction of the concentration degree according to the obtained identification information in the target video.
For example, in a progress bar of a complete recorded video obtained by recording a web lesson, a progress bar segment corresponding to a first level of concentration, i.e., an eye-unattended web lesson playing area, may be marked red, a progress bar segment corresponding to a second level of concentration, i.e., a face appearing in a confused expression, may be marked orange, and a progress bar segment corresponding to a third level of concentration, i.e., a little-away situation, may be marked yellow. After the target video is obtained according to the setting, the user can conveniently obtain the front and back contents of the corresponding progress bar section according to the color information in the progress bar of the target video so as to warm and learn the knowledge points which may be missed.
Of course, in order to make the target video more targeted, the target video may also be a video obtained by extracting video data corresponding to the target start-stop time in the original video and performing compression editing, and the detailed processing procedure is not described herein again.
Referring additionally to fig. 3, in an embodiment of the present application, in the case of playing an original video, the method further includes: receiving a target instruction, wherein the target instruction is generated by triggering preset video data in the original video; collecting gesture data of the user in response to the target instruction; and performing preset interactive operation with the user according to the attitude data, wherein the preset interactive operation comprises at least one of question answering operation and attitude correction operation.
Specifically, since users of a small age are not used to a web lesson, when a teacher needs to hold his hands to answer a question, clicking a button on a screen to answer a question is less intuitive for children. Therefore, in the process of playing the original video, the electronic device can identify the hand-lifting gesture of the user according to the first instruction generated by triggering the preset video data, so as to naturally and directly guide the user to answer the question.
In addition, considering the original video, that is, the web lesson is not only a Chinese language, but also may be a member action requiring, for example, a classroom exercise, an eye exercise, a physical education course, etc., at the same time, the electronic device may also help the user to complete part of body training in a remote manner by collecting the posture data of the user, so as to fully develop the moral character and beauty, and in the process of playing the original video, perform posture judgment and correction on the user in training of doing exercises, doing sit-ups, etc., so as to help the teacher to automatically remind the user whether the action is standard, etc.
In this embodiment, some accessories can be collocated at the same time, so that the electronic device can perform gesture correction on gesture actions with higher requirements on details, such as lifting a teach-in taijiquan and the like. Of course, the method provided by the embodiment can also be used for the user to play games so as to guide the user to do limb exercise and correct posture in the educational games.
It should be noted that in the video generation method provided in the embodiment of the present application, the execution subject may be a video generation apparatus, or a control module in the video generation apparatus for executing loading of a video generation method. In the embodiment of the present application, a video generation device executes a loaded video generation method as an example, and a video generation method provided in the embodiment of the present application is described.
Corresponding to the above embodiments, referring to fig. 4, an embodiment of the present application further provides a video generating apparatus 400, including:
the collecting module 410 is configured to collect behavior data of a user in a case that an original video is played, where the user is a user watching the original video.
A concentration determination module 420, configured to determine a concentration of the user according to the behavior data, wherein the concentration represents a concentration of the user viewing the original video.
A target video generation module 430, configured to generate a target video according to the concentration degree and the original video, where the target video includes video data of the user when viewing the original video at the target concentration degree.
In an embodiment, the target video generating module 430 is specifically configured to: under the condition that the target concentration degree is a preset level concentration degree, acquiring the target starting and ending time of the video data played in the original video under the target concentration degree; and obtaining the target video according to the target start-stop time and the original video.
In an embodiment, the target video generating module 430 is specifically configured to obtain the target video by any one of: according to the target starting and stopping time, adding identification information corresponding to the target concentration degree in a progress bar of a recorded video to obtain the target video, wherein the recorded video is obtained by recording the original video, and the identification information comprises color information; and extracting video data corresponding to the target start-stop time from the original video to generate the target video.
In one embodiment, the concentration determination module 420 is specifically configured to: according to the behavior data, obtaining an eye gazing focus of the user; acquiring a video position area of the original video; determining the target concentration degree as a first level concentration degree if an offset value of the eye gaze focus and the video location area is greater than a preset offset threshold.
In one embodiment, the concentration determination module 420 is specifically configured to: acquiring unfocused time length of the user under the condition that the deviation value is larger than the deviation threshold value; and under the condition that the unfocused time length is greater than a preset time length threshold value, determining the target concentration degree as the first level concentration degree.
In one embodiment, the concentration determination module 420 is specifically configured to: obtaining facial feature information of the user according to the behavior data; obtaining emotion information of the user according to the facial feature information; determining the target concentration degree as a second level concentration degree under the condition that the emotion information comprises preset emotion information, wherein the preset emotion information comprises at least one of anxiety information and confusion information.
In one embodiment, the concentration determination module 420 is specifically configured to: acquiring attitude characteristic information of the user according to the behavior data; acquiring action information of the user according to the posture characteristic information; and determining the target concentration degree as a third level concentration degree under the condition that the action information comprises preset action information, wherein the preset action information comprises at least one of information representing shaking head, looking aside, eating and playing toys.
In one embodiment, the apparatus 400 further includes an interaction module, specifically configured to: receiving a target instruction, wherein the target instruction is generated by triggering preset video data in the original video; collecting gesture data of the user in response to the target instruction; and performing preset interactive operation with the user according to the attitude data, wherein the preset interactive operation comprises at least one of question answering operation and attitude correction operation.
The video generation apparatus 400 in the embodiment of the present application may be an apparatus, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine, a self-service machine, and the like, and the embodiments of the present application are not particularly limited.
The video generation apparatus in the embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.
The video generation device provided in the embodiment of the present application can implement each process implemented by the above method embodiment, and is not described here again to avoid repetition.
Corresponding to the foregoing embodiment, optionally, as shown in fig. 5, an electronic device 500 is further provided in this embodiment of the present application, and includes a processor 501, a memory 502, and a program or an instruction stored in the memory 502 and capable of being executed on the processor 501, where the program or the instruction is executed by the processor 501 to implement each process of the foregoing video generation method embodiment, and can achieve the same technical effect, and no further description is provided here to avoid repetition.
It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.
Fig. 6 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
The electronic device 1000 includes, but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010.
Those skilled in the art will appreciate that the electronic device 1000 may further comprise a power source (e.g., a battery) for supplying power to various components, and the power source may be logically connected to the processor 1010 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. The electronic device structure shown in fig. 6 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.
The processor 1010 is configured to collect behavior data of a user in a case that an original video is played, where the user is a user watching the original video; determining a target concentration degree of the user according to the behavior data, wherein the target concentration degree represents the concentration degree of the user for watching the original video; generating a target video according to the target concentration degree and the original video, wherein the target video comprises video data played in the original video under the target concentration degree.
In an embodiment, the processor 1010 is further configured to, if the target concentration degree is a preset level concentration degree, obtain a target start-stop time of video data played in the original video at the target concentration degree; and obtaining the target video according to the target start-stop time and the original video.
In one embodiment, processor 1010 is further configured to perform any of the following:
according to the target starting and stopping time, adding identification information corresponding to the target concentration degree in a progress bar of a recorded video to obtain the target video, wherein the recorded video is obtained by recording the original video, and the identification information comprises color information; and extracting video data corresponding to the target start-stop time from the original video to generate the target video.
In one embodiment, the processor 1010 is further configured to obtain an eye gaze focus of the user according to the behavior data; acquiring a video position area of the original video; determining the target concentration degree as a first level concentration degree if an offset value of the eye gaze focus and the video location area is greater than a preset offset threshold.
In one embodiment, the processor 1010 is further configured to obtain an unfocused duration of the user if the offset value is greater than the offset threshold; and under the condition that the unfocused time length is greater than a preset time length threshold value, determining the target concentration degree as the first level concentration degree.
In one embodiment, the processor 1010 is further configured to obtain facial feature information of the user according to the behavior data; obtaining emotion information of the user according to the facial feature information; determining the target concentration degree as a second level concentration degree under the condition that the emotion information comprises preset emotion information, wherein the preset emotion information comprises at least one of anxiety information and confusion information.
In one embodiment, the processor 1010 is further configured to obtain posture feature information of the user according to the behavior data; acquiring action information of the user according to the posture characteristic information; and determining the target concentration degree as a third level concentration degree under the condition that the action information comprises preset action information, wherein the preset action information comprises at least one of information representing shaking head, looking aside, eating and playing toys.
In one embodiment, the processor 1010 is further configured to receive a target instruction, where the target instruction is triggered and generated by preset video data in the original video; collecting gesture data of the user in response to the target instruction; and performing preset interactive operation with the user according to the attitude data, wherein the preset interactive operation comprises at least one of question answering operation and attitude correction operation.
It should be understood that in the embodiment of the present application, the input unit 1004 may include a Graphics Processing Unit (GPU) 10041 and a microphone 10042, and the graphics processing unit 10041 processes image data of still pictures or videos obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1007 includes a touch panel 10071 and other input devices 10072. The touch panel 10071 is also referred to as a touch screen. The touch panel 10071 may include two parts, a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 1009 may be used to store software programs as well as various data, including but not limited to application programs and operating systems. Processor 1010 may integrate an application processor that handles primarily operating systems, user interfaces, applications, etc. and a modem processor that handles primarily wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 1010.
The embodiments of the present application further provide a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the video processing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and the like.
The embodiment of the application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, the processor is configured to run a program or an instruction, implement each process of the above comment displaying method embodiment, and achieve the same technical effect, and the details are not repeated here to avoid repetition.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (11)
1. A method of video generation, the method comprising:
the method comprises the steps of collecting behavior data of a user under the condition of playing an original video, wherein the user is a user watching the original video;
determining a target concentration degree of the user according to the behavior data, wherein the target concentration degree represents the concentration degree of the user for watching the original video;
generating a target video according to the target concentration degree and the original video, wherein the target video comprises video data played in the original video under the target concentration degree.
2. The method of claim 1, wherein generating a target video from the target concentration and the original video comprises:
under the condition that the target concentration degree is a preset level concentration degree, acquiring a target start-stop time corresponding to video data played in the original video under the target concentration degree;
and obtaining the target video according to the target start-stop time and the original video.
3. The method of claim 2, wherein obtaining the target video from the target start-stop time and the original video comprises at least one of:
according to the target starting and stopping time, adding identification information corresponding to the target concentration degree in a progress bar of a recorded video to obtain the target video, wherein the recorded video is obtained by recording the original video, and the identification information comprises color information;
and extracting video data corresponding to the target start-stop time from the original video to generate the target video.
4. The method of claim 1, wherein determining the target concentration of the user based on the behavioral data comprises:
according to the behavior data, obtaining an eye gazing focus of the user;
acquiring a video position area of the original video;
determining the target concentration degree as a first level concentration degree if an offset value of the eye gaze focus and the video location area is greater than a preset offset threshold.
5. The method of claim 4, wherein determining the target concentration as a first level concentration if an offset value of the eye gaze focus from the video location area is greater than a preset offset threshold comprises:
acquiring unfocused time length of the user under the condition that the deviation value is larger than the deviation threshold value;
and under the condition that the unfocused time length is greater than a preset time length threshold value, determining the target concentration degree as the first level concentration degree.
6. The method of claim 1, wherein determining the target concentration of the user based on the behavioral data comprises:
obtaining facial feature information of the user according to the behavior data;
obtaining emotion information of the user according to the facial feature information;
determining the target concentration degree as a second level concentration degree under the condition that the emotion information comprises preset emotion information, wherein the preset emotion information comprises at least one of anxiety information and confusion information.
7. The method of claim 1, wherein determining the target concentration of the user based on the behavioral data comprises:
acquiring attitude characteristic information of the user according to the behavior data;
acquiring action information of the user according to the posture characteristic information;
and determining the target concentration degree as a third level concentration degree under the condition that the action information comprises preset action information, wherein the preset action information comprises at least one of information representing shaking head, looking aside, eating and playing toys.
8. The method of claim 1, wherein in the case of playing an original video, the method further comprises:
receiving a target instruction, wherein the target instruction is generated by triggering preset video data in the original video;
collecting gesture data of the user in response to the target instruction;
and performing preset interactive operation with the user according to the attitude data, wherein the preset interactive operation comprises at least one of question answering operation and attitude correction operation.
9. A video generation apparatus, characterized in that the apparatus comprises:
the system comprises a collecting module, a judging module and a display module, wherein the collecting module is used for collecting behavior data of a user under the condition of playing an original video, and the user is a user watching the original video;
a concentration determination module for determining a target concentration of the user based on the behavior data, wherein the target concentration represents a concentration of the user viewing the original video;
and the target video generation module is used for generating a target video according to the target concentration degree and the original video, wherein the target video comprises video data played in the original video under the target concentration degree.
10. An electronic device comprising a processor, a memory, and a program or instructions stored on the memory and executable on the processor, the program or instructions when executed by the processor implementing the steps of the video generation method of any of claims 1-8.
11. A readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the video generation method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111017982.1A CN113709552A (en) | 2021-08-31 | 2021-08-31 | Video generation method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111017982.1A CN113709552A (en) | 2021-08-31 | 2021-08-31 | Video generation method and device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113709552A true CN113709552A (en) | 2021-11-26 |
Family
ID=78658488
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111017982.1A Pending CN113709552A (en) | 2021-08-31 | 2021-08-31 | Video generation method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113709552A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090097822A1 (en) * | 2006-05-15 | 2009-04-16 | Kyoji Hirata | Method for optimizing the reading by a user equipment of mcch (mbms point-to-multipoint control channel) information |
| WO2017083875A1 (en) * | 2015-11-13 | 2017-05-18 | Reaction Stream Llc | A system and method for recording and displaying a reaction to a focus |
| CN110945522A (en) * | 2019-10-25 | 2020-03-31 | 中新智擎科技有限公司 | Learning state judgment method and device and intelligent robot |
| CN111178294A (en) * | 2019-12-31 | 2020-05-19 | 北京市商汤科技开发有限公司 | State recognition method, device, equipment and storage medium |
| CN112399239A (en) * | 2020-10-28 | 2021-02-23 | 维沃移动通信有限公司 | Video playing method and device |
| CN112801052A (en) * | 2021-04-01 | 2021-05-14 | 北京百家视联科技有限公司 | User concentration degree detection method and user concentration degree detection system |
| CN112866808A (en) * | 2020-12-31 | 2021-05-28 | 北京市商汤科技开发有限公司 | Video processing method and device, electronic equipment and storage medium |
-
2021
- 2021-08-31 CN CN202111017982.1A patent/CN113709552A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090097822A1 (en) * | 2006-05-15 | 2009-04-16 | Kyoji Hirata | Method for optimizing the reading by a user equipment of mcch (mbms point-to-multipoint control channel) information |
| CN101444092A (en) * | 2006-05-15 | 2009-05-27 | 日本电气株式会社 | Video reproduction device, video reproduction method, and video reproduction program |
| WO2017083875A1 (en) * | 2015-11-13 | 2017-05-18 | Reaction Stream Llc | A system and method for recording and displaying a reaction to a focus |
| CN110945522A (en) * | 2019-10-25 | 2020-03-31 | 中新智擎科技有限公司 | Learning state judgment method and device and intelligent robot |
| CN111178294A (en) * | 2019-12-31 | 2020-05-19 | 北京市商汤科技开发有限公司 | State recognition method, device, equipment and storage medium |
| CN112399239A (en) * | 2020-10-28 | 2021-02-23 | 维沃移动通信有限公司 | Video playing method and device |
| CN112866808A (en) * | 2020-12-31 | 2021-05-28 | 北京市商汤科技开发有限公司 | Video processing method and device, electronic equipment and storage medium |
| CN112801052A (en) * | 2021-04-01 | 2021-05-14 | 北京百家视联科技有限公司 | User concentration degree detection method and user concentration degree detection system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107203953B (en) | Teaching system based on internet, expression recognition and voice recognition and implementation method thereof | |
| US20190240842A1 (en) | Robot assisted interaction system and method thereof | |
| US11463611B2 (en) | Interactive application adapted for use by multiple users via a distributed computer-based system | |
| WO2017166622A1 (en) | Video playing method, playing terminal and media server | |
| JP6636670B1 (en) | Learning system, learning lecture providing method, and program | |
| US20220013026A1 (en) | Method for video interaction and electronic device | |
| EP3133471A1 (en) | Play control method, apparatus, terminal, and recording medium | |
| JP2013097311A (en) | Learning support device, learning support method and learning support program | |
| CN111723855A (en) | A display method, terminal device and storage medium for learning knowledge points | |
| CN110992222A (en) | Teaching interaction method and device, terminal equipment and storage medium | |
| WO2023051334A1 (en) | Information presentation method and apparatus, and device and storage medium | |
| CN108877357A (en) | Interaction method based on family education machine and family education machine | |
| CN112883851A (en) | Learning state detection method and device, electronic equipment and storage medium | |
| CN112399239A (en) | Video playing method and device | |
| CN111027356A (en) | A dictation content generation method, learning device and storage medium | |
| WO2023221233A1 (en) | Interactive mirroring apparatus, system and method | |
| CN111223549B (en) | A mobile terminal system and method for disease prevention based on posture correction | |
| CN112055257B (en) | Interactive method, device, device and storage medium for video classroom | |
| CN112752159A (en) | Interaction method and related device | |
| CN113992972A (en) | A subtitle display method, apparatus, electronic device and readable storage medium | |
| Steinert et al. | Evaluation of an engagement-aware recommender system for people with dementia | |
| CN113157174B (en) | Data processing method, device, electronic equipment and computer storage medium | |
| CN113794934A (en) | Anti-addiction boot method, television and computer-readable storage medium | |
| CN113709552A (en) | Video generation method and device and electronic equipment | |
| CN116578185A (en) | User capability analysis method and device based on virtual reality and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20211126 |