JP2015535971A - Display device and control method thereof - Google Patents

Abstract

A display device and a control method thereof are provided. The angle-of-view setting method of the present display device displays an angle-of-view guide UI that guides the setting of the angle of view of the camera connected to the display device in an area of the display screen when a preset event occurs. The angle of view of the camera is set using the UI. Thereby, the user can set the angle of view of the camera more easily using the angle of view guide UI.

Description

  The present invention relates to a display device and a control method thereof, and more particularly to a display device controlled by user voice or user motion and a control method thereof.

  With the development of electronic technology, various types of display devices have been developed and spread. In particular, various types of display devices such as televisions have recently been used in ordinary homes. These display devices are provided with more various functions according to a user's request. In particular, in the case of a television, recently, it is connected to the Internet and supports Internet services. The user can also watch many digital broadcast channels through the television.

  Therefore, various input methods for efficiently using various functions of the display device are required. For example, an input method using a remote controller, an input method using a mouse, an input method using a touch pad, and the like are applied to the display device.

  However, it has been difficult to effectively use various functions of the display device only with such a simple input method. If all functions of the display device are controlled only by the remote controller, the number of buttons on the remote controller has to be increased. In this case, it is not easy for a general user to learn how to use the remote control. In the case of a method in which various menus are displayed on the screen and the user finds and selects the menu, it is inconvenient because the user has to check a complicated menu tree and select a desired menu. there were.

Therefore, recently, in order to control the display apparatus more conveniently and intuitively, a technique using voice recognition and motion recognition has been developed. In particular, in order for a user to more efficiently control a display device using voice recognition or motion recognition, the display device needs a UI for guiding voice recognition or motion recognition.

However, conventionally, since there is no appropriate UI for controlling the display device by voice recognition or motion recognition, there is a great inconvenience for the user to control the display device using voice recognition or motion recognition. Yes.

  Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to provide various UIs for a user to more conveniently control a display device using voice recognition or motion recognition. To provide a display device and a control method thereof.

  A method for controlling a display device according to an embodiment of the present invention for achieving the above object includes the steps of: displaying first voice guide information for guiding user voice for controlling the display device; A step of inputting a user command for controlling a connected external device; and a step of guiding a user voice for controlling the external device using the first voice guide information when the user command is input. 2 and changing to voice guide information and displaying.

  And it may further include a step of searching and reading second voice guide information corresponding to the external device among a plurality of voice guide information stored in advance in the display device.

  When the display device is a television, the first voice guide information includes at least one of a voice command for power control, a voice command for execution of an external device, a voice command for channel setting, and a voice command for volume setting. When the external device is one of a DVD player and a BD player, the second voice guide information includes a voice command word related to power control, a voice command word related to execution of the external device, and a voice command word related to playback settings. At least one of them may be included.

  When the first voice guide information is displayed, when a user voice command word included in the first voice guide information is input, the display device is controlled according to the user voice command word. When the second voice guide information is displayed, when a user voice command word included in the second voice guide information is input, a control signal corresponding to the input user voice command word is generated. And transmitting the generated control signal to the external device.

  In addition, when the second voice guide information is displayed, when a user voice command word corresponding to one of the voice command words included in the second voice guide information is input, the input user is input. The method may further include generating a control signal corresponding to the voice command word and wirelessly transmitting the generated control signal to a relay device for transmitting the generated control signal to the external device.

  The generated control signal may be transmitted to the relay device by Bluetooth communication, and the relay device may convert the transmitted control signal into an IR signal and transmit the IR signal to the external device.

Each of the first voice guide information and the second voice guide information may include an icon indicating that the mode of the display device is a voice control mode.
The first voice guide information and the second voice guide information may be displayed in a lower part of a screen on which content is displayed.
The user command may be a user voice command input via a voice input unit for controlling an external device.

  Meanwhile, a display device according to an embodiment of the present invention for achieving the above object includes a voice input unit to which a user voice is input, a display unit, and a user voice for controlling the display device. 1 voice guide information is displayed on the display unit, and when a user command for controlling an external device connected to the display device is input, the first voice guide information is used to control the external device. And a control unit that controls the display unit to display the second voice guide information that is changed to the second voice guide information that guides the user voice.

  And a storage unit that stores a plurality of voice guide information, wherein the control unit searches for the second voice guide information corresponding to the external device among the plurality of voice guide information stored in the storage unit. You can read it.

  When the display device is a television, the first voice guide information includes at least one of a voice command for power control, a voice command for execution of an external device, a voice command for channel setting, and a voice command for volume setting. When the external device is one of a DVD player and a BD player, the second voice guide information includes a voice command word related to power control, a voice command word related to execution of the external device, and a voice command word related to playback settings. At least one of them may be included.

  And an external terminal input unit for connecting to the external device, wherein the control unit inputs a user voice command word included in the first voice guide information when the first voice guide information is displayed. Then, when the display device is controlled according to the user voice command word and the second voice guide information is displayed, the user voice command word included in the second voice guide information is input. Then, a control signal corresponding to the input user voice command word may be generated, and the generated control signal may be transmitted to the external device via the external terminal input unit.

  In addition, it further includes a network interface unit that communicates with a relay device that communicates with the external device, and the control unit, when the second audio guide information is displayed, the audio included in the second audio guide information When a user voice command word corresponding to one of the command words is input, a control signal corresponding to the input user voice command word is generated, and the generated control signal is transmitted via the network interface unit. Then, it may be transmitted wirelessly to the relay device.

  The generated control signal may be transmitted to the relay device by Bluetooth communication, and the relay device may convert the transmitted control signal into an IR signal and transmit the IR signal to the external device.

Each of the first voice guide information and the second voice guide information may include an icon indicating that the mode of the display device is a voice control mode.
The first voice guide information and the second voice guide information may be displayed in a lower part of a screen on which content is displayed.
The user command may be a user voice command input via the voice input unit for controlling the external device.

  Meanwhile, a method of controlling a display device according to an embodiment of the present invention for achieving the above object includes a step of displaying first motion guide information for guiding a user motion for controlling the display device, and the display A step of inputting a user command for controlling an external device connected to the apparatus; and, when the user command is input, guiding the first motion guide information and a user motion for controlling the external device. And changing to the second motion guide information to be displayed.

  On the other hand, a display device according to an embodiment of the present invention for achieving the above object includes an audio motion unit to which a user motion is input, a display unit, and a user motion for controlling the display device. 1 motion guide information is displayed on the display unit, and when a user command for controlling an external device connected to the display device is input, the first motion guide information is used to control the external device. And a control unit that controls the display unit to display the second motion guide information that is changed to the second motion guide information that guides the user motion.

On the other hand, according to an embodiment of the present invention for achieving the above-described object, a display angle setting method according to an embodiment of the present invention provides a camera image connected to the display device in an area of a display screen when a preset event occurs. Displaying an angle-of-view guide UI for guiding the setting of the angle, and setting the angle of view of the camera using the angle-of-view guide UI.
The field angle guide UI may not be displayed when an event for shifting to the motion task mode occurs.
The view angle guide UI may include a screen that displays an image captured by the camera when the view angle is set.

  In the setting step, a user command is input while adjusting the camera so that the angle of view of the camera automatically moves in a preset speed and direction, and adjusting the camera. And setting the angle of view at the time when the user command is input to the angle of view of the camera.

  Note that the setting step includes a step of adjusting the camera by a user operation using an external device, and when a user command is input while adjusting the camera, an image at the time when the user command is input. Setting the angle to the angle of view of the camera.

The preset event includes an event in which power is applied to the display device when the display device is first installed, an event in which a motion task mode is turned on, and a control menu of the display device. One of the events for which the view angle setting menu is selected may be used.
The camera may be a camera that captures a user's motion for controlling the display device in a motion task mode.

  On the other hand, a display device according to an embodiment of the present invention for achieving the above object includes a camera that captures a user's motion, a display unit, and an area of the display unit when a preset event occurs. A control unit configured to display an angle-of-view guide UI for guiding setting of the camera angle of view and to set an angle of view of the camera using the angle-of-view guide UI.

The control unit may display a screen provided by the display device without displaying the angle-of-view guide UI even when shifting to the motion task mode.
The angle of view guide UI may include a screen for displaying an image captured by the camera when the angle of view is set.

  The controller adjusts the camera so that the angle of view of the camera automatically moves in a preset speed and direction, and when a user command is input while adjusting the camera, The angle of view when the user command is input may be set to the angle of view of the camera.

  The control unit adjusts the camera by a user operation using an external device, and when a user command is input while adjusting the camera, the angle of view at the time when the user command is input is You may set the angle of view of the camera.

The preset event includes an event in which power is applied to the display device when the display device is first installed, an event in which a motion task mode is turned on, and a control menu of the display device. One of the events for which the view angle setting menu is selected may be used.
The camera may be a camera that captures a user's motion for controlling the display device in a motion task mode.

Meanwhile, a method of controlling a display device according to an embodiment of the present invention for achieving the above object includes a step of displaying an icon and a pointer for performing a motion task mode when a motion start command is input, and a user Moving the pointer in accordance with the first motion of the user, and executing a function corresponding to the icon when the second motion of the user is input while the pointer is positioned on the icon. .
The pointer positioned on the icon may be fixed without moving while the second motion of the user is input.

  The step of executing may continuously execute the function of the icon at which the pointer is positioned when the input of the second motion is held while the pointer is positioned at the icon.

The first motion of the user may be a spread motion that opens the user's hand, and the second motion of the user may be a grab motion that grips the user's hand.
The icon may include at least one of a volume up icon, a volume down icon, a channel up icon, and a channel down icon.

  The icon is displayed in one of the volume up icon and the volume down icon displayed in one of a left area and a right area of the display screen and one of the left area and the right area of the display screen. The channel up icon and the channel down icon may be included.

  The area where the volume up icon and the volume down icon are displayed displays current volume level information of the display device, and the area where the channel up icon and the channel down icon are displayed includes The current channel information of the display device may be displayed.

  When a motion end motion is input, the method may further include removing the displayed icons and pointers from the display screen.

Meanwhile, a display device according to an embodiment of the present invention for achieving the above object includes a motion input unit to which a user's motion is input, a display unit, and a motion start command input via the motion input unit. Then, an icon and a pointer for performing a motion task mode are displayed, and the display unit is controlled to move the pointer according to the first motion of the user input to the motion input unit. A control unit that executes a function corresponding to the icon when the second motion of the user is input to the motion input unit in a state where the icon is positioned on the icon.
The control unit may fix the position of the pointer without moving while the second motion of the user is input.

  The controller may continuously execute the function of the icon at which the pointer is positioned when the second motion is held while the pointer is positioned at the icon.

The first motion of the user may be a spread motion that opens the user's hand, and the second motion of the user may be a grab motion that grips the user's hand.
The icon may include at least one of a volume up icon, a volume down icon, a channel up icon, and a channel down icon.

  The icon is displayed in one of the volume up icon and the volume down icon displayed in one of a left area and a right area of the display screen and one of the left area and the right area of the display screen. The channel up icon and the channel down icon may be included.

  The area where the volume up icon and the volume down icon are displayed displays current volume level information of the display device, and the area where the channel up icon and the channel down icon are displayed includes The current channel information of the display device may be displayed.

  When the motion end motion is input through the motion input unit, the control unit may remove the displayed icons and pointers from the display screen of the display unit.

  Meanwhile, a method for controlling a display device capable of voice recognition according to an embodiment of the present invention for achieving the above object includes a step of inputting a voice start command, and the voice start command is a first voice start command. In some cases, the mode is switched to the first voice task mode controlled in accordance with the user voice input to the voice input unit of the display device, and when the voice start command is a second voice start command, the display device is linked. A step of switching to a second voice task mode controlled according to a user voice input to an external device, and a step of displaying voice guide information corresponding to the switched voice task mode.

The first voice start command is a voice command of a user including a preset word, and the second voice start command is a user who presses a preset button included in the external device. It may be an instruction.
The voice guide information may include an icon area indicating a switched mode of the first voice task mode and the second voice task mode.

  The voice guide information includes a plurality of voice command words for guiding a user voice in order to perform a voice task mode. The voice guide information in the first voice task mode and the voice guide information in the second voice task. The voice command words included in and may be different from each other.

The voice guide information in the first voice task mode includes a voice command word for performing a channel up / down command, and the voice guide information in the second voice task mode is for performing a channel up / down command. Voice command words for providing a channel list may be included.
The second voice task mode may be controlled by a user voice command input to the external device when a preset second button of the external device is pressed.
The external device may be a remote controller.

  On the other hand, a display device according to an embodiment of the present invention for achieving the object includes a voice input unit to which user voice is input, a display unit, and a voice start command input via the voice input unit. When it is a first voice start command, it is switched to a first voice task mode controlled according to a user voice input to the voice input unit of the display device, and when the voice start command is a second voice start command, A control unit that switches to a second voice task mode that is controlled in accordance with a user voice input to an external device that is linked to the display device, and that displays voice guide information corresponding to the switched voice task mode on the display unit. Including.

The first voice start command is a voice command of a user including a preset word, and the second voice start command is a user who presses a preset button included in the external device. It may be an instruction.
The voice guide information may include an icon area indicating a switched mode of the first voice task mode and the second voice task mode.

  The voice guide information includes a plurality of voice command words for guiding a user voice in order to perform a voice task mode. The voice guide information in the first voice task mode and the voice guide information in the second voice task. The voice command words included in and may be different from each other.

The voice guide information in the first voice task mode includes a voice command word for performing a channel up / down command, and the voice guide information in the second voice task mode is for performing a channel up / down command. Voice command words for providing a channel list may be included.
The second voice task mode may be controlled by a user voice command input to the external device when a preset second button of the external device is pressed.
The external device may be a remote controller.

  Meanwhile, a method for controlling a display apparatus according to an embodiment of the present invention for achieving the above object includes a step of inputting a both-hands start command for performing a motion task using two hands, When a start command is input, a step of switching to a two-handed task mode for performing a motion task using both hands, and a two-handed input guide GUI for performing a motion task using the both hands when displayed in the two-handed task mode are displayed. Including the step of.

In the input step, when a motion start command using one hand is input, the mode is switched to a motion task mode for performing a motion task, and the motion using the other hand is switched to the motion task mode. When a start command is input, it may be recognized that the two-hand start command is input.
The input step may recognize that the both-hands start command is input when a shake motion that simultaneously shakes both hands a plurality of times is input.
The motion task using both hands may be a task for enlarging or reducing the display screen.

  In addition, when a motion in which the two hands are separated from each other is input in a state where the two-hand input guide GUI is displayed in one area on the display screen, a predetermined position in the area where the two-hand guide GUI is displayed is used as a reference. When the display screen is enlarged and a motion in which the two hands approach each other is input, the display screen may be reduced based on a predetermined position in the area where the two-hand input guide GUI is displayed.

  The step of displaying the two-hand input guide GUI may display a circular two-hand input guide GUI located in a central area of the display screen.

  In addition, when the movement motion of both hands is input, a step of moving the circular two-hand input guide GUI so as to correspond to the movement motion of both hands may be included.

  The two-hand input guide GUI is two pointers displayed at a point corresponding to the position of both hands of the user. Does the motion task using both hands enlarge the display screen using the two pointers? It may be a task to reduce.

  Meanwhile, a display apparatus according to an embodiment of the present invention for achieving the above object uses a motion input unit to which a user's motion is input, a display unit, and two hands (two hands) for the motion input unit. When a two-hand start command for performing a motion task is input, the mode is switched to a two-hand task mode for performing a motion task using both hands, and a two-hand input guide GUI for performing a motion task using both hands is displayed on the display unit. And a control unit.

  When the motion start command using one hand is input to the motion input unit, the control unit switches to a motion task mode for performing a motion task, and the motion input unit is switched to the motion task mode. When a motion start command using the other hand is input to the hand, it may be recognized that the two-hand start command is input.

The control unit may recognize that the both-hands start command is input when a shake motion that simultaneously shakes both hands a plurality of times is input via the motion input unit.
The motion task using both hands may be a task for enlarging or reducing the display screen.

When the two-hand input guide GUI is displayed in one area on the display screen and a motion in which the two hands are separated from each other is input, the control unit When a display screen is enlarged with reference to a predetermined position and a motion in which both hands approach each other is input, the display screen may be reduced with reference to a predetermined position in an area where the two-hand input guide GUI is displayed.
The two-hand input guide GUI may be a circular GUI located in a central area of the display screen.

  When the movement motion of both hands is input via the motion input unit, the control unit may move the circular two-hand input guide GUI so as to correspond to the movement motion of both hands.

  The two-hand input guide GUI is two pointers displayed at a point corresponding to the position of both hands of the user. Does the motion task using both hands enlarge the display screen using the two pointers? It may be a task to reduce.

  Meanwhile, a method of controlling a display device according to an embodiment of the present invention for achieving the above object includes a step of inputting a voice start command via a voice input unit, and a step of inputting the voice start command. A step of switching the mode of the display device to a voice task mode; and a step of displaying one of a plurality of feedback messages for guiding a voice recognition error guide when a voice recognition error occurs in the voice task mode. Including.

  When a voice recognition error repeatedly occurs in the voice task mode, a step of randomly selecting and displaying one of the plurality of feedback messages may be included.

The voice task mode includes a first voice task mode controlled according to a user voice input to the voice input unit of the display device and a user voice input to an external device linked to the display device. A controlled second audio task mode may be included.
The plurality of feedback messages may differ depending on the type of the voice task mode.
Note that the plurality of feedback messages may differ depending on the type of the speech recognition error.

The voice recognition error is an error that the user voice input through the voice input unit cannot be clearly recognized, and the recognition button of the external device is preset for a preset time after the user voice is input. It may include at least one of an error being pressed for a time and an error in which a user voice is not input for a preset time after pressing the recognition button of the external device.

  The display step may display a default feedback message when the voice recognition error occurs for the first time.

  Meanwhile, a display device according to an embodiment of the present invention for achieving the above object includes a voice input unit to which a user voice is input, a display unit, and a voice start command is input through the voice input unit. When a voice recognition error occurs in the voice task mode, the display device displays one of a plurality of feedback messages for guiding the voice recognition error guide on the display unit. And a control unit.

  The controller may randomly select and display one of the plurality of feedback messages when a voice recognition error repeatedly occurs in the voice task mode.

The voice task mode includes a first voice task mode controlled according to a user voice input to the voice input unit of the display device and a user voice input to an external device linked to the display device. A controlled second audio task mode may be included.
The plurality of feedback messages may differ depending on the type of the voice task mode.
Note that the plurality of feedback messages may differ depending on the type of the speech recognition error.

  The voice recognition error is an error that the user voice input through the voice input unit cannot be clearly recognized, and the recognition button of the external device is preset for a preset time after the user voice is input. It may include at least one of an error being pressed for a time and an error in which a user voice is not input for a preset time after pressing the recognition button of the external device.

  The control unit may display a default feedback message on the display unit when the voice recognition error occurs for the first time.

Meanwhile, a method of controlling a display device according to an embodiment of the present invention for achieving the above object includes a step of inputting a voice start command via a voice input unit, and a step of inputting the voice start command. Switching the mode of the display device to a voice task mode controlled by user voice, displaying voice guide information including a plurality of voice command words for performing the voice task mode on the display device, and according to a user input And changing at least one of the plurality of voice command words to another voice command word.
The voice guide information may include a fixed command word area where the voice command word is fixedly displayed and a change command word area where the voice command word is variably changed.
The fixed command word area may include a voice command word for powering off the display device.

  In the changing step, when a user command for executing an application is input, the step of executing the application; and when the application is executed, at least one of the plurality of voice command words is executed. And changing to a voice command corresponding to the executed application.

The changing step includes a step of inputting a user command for displaying the user-preferred voice command word, and a step of inputting at least one of the plurality of voice command words when the user command is input. And changing to a user-preferred voice command word set by the user.
The changed voice guide information may include a voice command word for switching to the voice guide information before the change.

Meanwhile, a display device according to an embodiment of the present invention for achieving the above object includes a voice input unit to which a user voice is input, a display unit, and a voice start command is input through the voice input unit. And switching the mode of the display device to a voice task mode controlled by a user voice, displaying voice guide information including a plurality of voice command words for performing the voice task mode on the display device on the display unit, And a control unit that changes at least one of the plurality of voice command words into another voice command word by input.
The voice guide information may include a fixed command word area where the voice command word is fixedly displayed and a change command word area where the voice command word is variably changed.
The fixed command word area may include a voice command word for powering off the display device.

  When the user command for executing the application is input, the control unit executes the application, and at least one of the plurality of voice command words is a voice command word corresponding to the executed application. You may change to

When the user command for displaying the user-preferred voice command word is input, the control unit receives at least one of the plurality of voice command words as a user-preferred voice command word set by the user. You may change to
The changed voice guide information may include a voice command word for switching to the voice guide information before the change.

  Meanwhile, a method of controlling a display device according to an embodiment of the present invention for achieving the above object includes a step of inputting a motion start command via a motion input unit, and a step of inputting the motion start command. The mode of the display device is switched to a motion task mode controlled by user motion, and motion guide information including a plurality of motion items for performing the motion task mode on the display device is displayed, and the application execution instruction is input And changing at least one of the plurality of motion items to a motion item corresponding to the application to be executed.

  Meanwhile, a display apparatus according to an embodiment of the present invention for achieving the above object includes a motion input unit to which a user motion is input, a display unit, and a motion start command input via the motion input unit. The mode of the display device is switched to a motion task mode controlled by user motion, and motion guide information including a plurality of motion items for performing the motion task mode on the display device is displayed on the display unit, and an application is executed. And a control unit that changes at least one of the plurality of motion items into a motion item corresponding to the application to be executed when an instruction is input.

  On the other hand, an angle-of-view setting method for a display device according to another embodiment of the present invention includes a step of displaying an angle-of-view guide UI to be guided by setting an angle of view of a camera, and a camera using the angle-of-view guide UI. Setting an angle of view.

  Further, the method of the present invention includes the steps of automatically adjusting the camera angle at a preset speed, and receiving a user command while adjusting the camera angle, In the setting, the angle of view of the camera may be set to the angle of the camera at the time when the user command is received.

  In addition, when a preset event occurs, displaying the angle of view guide UI means that at least one event in which power is applied to the display device while the display device is first installed, the motion task mode is on. It may be one of the events for which the angle of view setting menu is selected from the control menu of the display device.

  As described above, according to the present invention, the user can control the display device more easily and conveniently by using various audio UIs or motion UIs.

FIG. 5 is a block diagram illustrating a configuration of a display apparatus according to various embodiments of the present invention. FIG. 5 is a block diagram illustrating a configuration of a display apparatus according to various embodiments of the present invention. FIG. 5 is a block diagram illustrating a configuration of a display apparatus according to various embodiments of the present invention. FIG. 5 is a diagram for explaining a method for providing different audio guide information depending on an external device connected to a display device according to an embodiment of the present invention. FIG. 5 is a diagram for explaining a method for providing different audio guide information depending on an external device connected to a display device according to an embodiment of the present invention. FIG. 5 is a diagram for explaining a method for providing different audio guide information depending on an external device connected to a display device according to an embodiment of the present invention. FIG. 5 is a diagram for explaining a method for providing different audio guide information depending on an external device connected to a display device according to an embodiment of the present invention. 5 is a flowchart for explaining a method for providing different audio guide information depending on an external device connected to a display apparatus according to an exemplary embodiment of the present invention. 1 is a diagram illustrating a system including a display device, an external device, and a relay device that relays the display device and the external device according to an embodiment of the present invention. It is a figure which shows the camera with which the display apparatus which concerns on embodiment of this invention was equipped. It is a figure which shows the view angle setting UI for the view angle setting of the camera with which the display apparatus which concerns on one Embodiment of this invention was equipped. 5 is a flowchart for explaining a method of setting an angle of view of a display device according to an embodiment of the present invention. FIG. 5 is a diagram illustrating a method for performing channel control and volume control using user motion according to various embodiments of the present invention. FIG. 5 is a diagram illustrating a method for performing channel control and volume control using user motion according to various embodiments of the present invention. FIG. 5 is a diagram illustrating a method for performing channel control and volume control using user motion according to various embodiments of the present invention. FIG. 5 is a diagram illustrating a method for performing channel control and volume control using user motion according to various embodiments of the present invention. FIG. 5 is a diagram illustrating a method for performing channel control and volume control using user motion according to various embodiments of the present invention. FIG. 5 is a diagram illustrating a method for performing channel control and volume control using user motion according to various embodiments of the present invention. 5 is a flowchart for explaining a control method of a display apparatus using user motion according to an embodiment of the present invention. It is a figure which shows the 1st audio | voice guidance information displayed in the 1st audio | voice task mode in which a user audio | voice is input via the audio | voice input part with which the display apparatus which concerns on one Embodiment of this invention was equipped. It is a figure which shows the 2nd audio | voice guidance information displayed in the 2nd audio | voice task mode in which a user's audio | voice is input via the audio | voice input part with which the external apparatus linked with the display apparatus which concerns on one Embodiment of this invention was equipped. . 5 is a flowchart illustrating a method for providing a method for providing different voice task modes according to a voice input method according to an embodiment of the present invention. FIG. 6 is a view for explaining a method of controlling a display device using user motion using both hands according to various embodiments of the present invention. FIG. 6 is a view for explaining a method of controlling a display device using user motion using both hands according to various embodiments of the present invention. FIG. 6 is a view for explaining a method of controlling a display device using user motion using both hands according to various embodiments of the present invention. FIG. 6 is a view for explaining a method of controlling a display device using user motion using both hands according to various embodiments of the present invention. 6 is a flowchart for explaining a method of controlling a display device using user motion using both hands according to an embodiment of the present invention. FIG. 10 is a diagram illustrating a feedback message when a voice recognition error according to an embodiment of the present invention occurs. FIG. 6 is a diagram illustrating feedback messages displayed according to a voice task mode and a voice error type according to various embodiments of the present invention. FIG. 6 is a diagram illustrating feedback messages displayed according to a voice task mode and a voice error type according to various embodiments of the present invention. FIG. 6 is a diagram illustrating feedback messages displayed according to a voice task mode and a voice error type according to various embodiments of the present invention. FIG. 6 is a diagram illustrating feedback messages displayed according to a voice task mode and a voice error type according to various embodiments of the present invention. 5 is a flowchart for explaining a control method of a display apparatus according to an embodiment of the present invention. It is a figure for demonstrating general audio | voice guidance information in the audio | voice task mode which concerns on one Embodiment of this invention. It is a figure for demonstrating general audio | voice guidance information in the audio | voice task mode which concerns on one Embodiment of this invention. It is a figure which shows the audio | voice guide information specialized for the application in the audio | voice task mode which concerns on one Embodiment of this invention. It is a figure which shows the audio | voice guide information in which the audio | voice item of the user preference was contained in the audio | voice task mode which concerns on one Embodiment of this invention. 7 is a flowchart for explaining a control method of a display device for changing a part of voice commands of an application according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.
FIG. 1 is a schematic block diagram showing a display apparatus according to an embodiment of the present invention.

  Referring to FIG. 1, the display apparatus 100 includes an audio input unit 110, a motion input unit 120, a storage unit 130, a control unit 140, and a display unit 193. The display device 100 may be realized by a smart TV, a set-top box, a PC, or a digital TV, a mobile phone, or the like that can be connected to an external network, but is not limited thereto.

  The voice input unit 110 receives voice uttered by the user. The voice input unit 110 converts the input voice signal into an electrical signal and outputs the electrical signal to the control unit 140. For example, the voice input unit 110 may be realized by a microphone. Note that the voice input unit 110 may be realized not only in an integrated form with the display apparatus 100 (All-in-one) but also in a separated form. The separated audio input unit 110 may be connected to the display apparatus 100 through a wired or wireless network.

  The motion input unit 120 receives a video signal (for example, continuous frames) obtained by imaging the user's motion and provides it to the control unit 140. For example, the motion input unit 120 may be realized by a camera unit including a lens and an image sensor. Note that the motion input unit 120 may be realized not only in an integrated form with the display apparatus 100 but also in a separated form. The separated motion input unit 120 may be connected to the display apparatus 100 through a wired or wireless network.

  The storage unit 130 stores various data and programs for driving and controlling the display apparatus 100. The storage unit 130 stores a voice recognition module for recognizing a voice input via the voice input unit 110 and a motion recognition module for recognizing a motion input via the motion input unit 120.

  The storage unit 130 may include an audio database and a motion database. The voice database means a database in which a voice task that matches a preset voice and a preset voice is recorded. The motion database refers to a data verse in which a preset motion and a motion task that matches the preset motion are recorded.

  The display unit 193 displays an image corresponding to the broadcast signal received via the broadcast receiving unit. The display unit 193 can display video data (for example, a moving image) input via the external terminal input unit. The display unit 193 can display voice guide information for performing a voice task and motion guide information for performing a motion task in accordance with control of the control unit 140.

  The control unit 140 controls the voice input unit 110, the motion input unit 120, the storage unit 130, and the display unit 193. The control unit 140 may include a CPU (Central Processing Unit), a module for controlling the display apparatus 100, a ROM (Read Only Memory) for storing data, and a RAM (Random Access Memory).

  When voice is input via the voice input unit 110, the control unit 140 recognizes voice using the voice recognition module and the voice database. Voice recognition is an isolated word recognition that recognizes speech spoken by dividing each word according to the form of input speech, continuous speech that recognizes continuous words, continuous sentences, and conversational speech. It is an intermediate form between recognition (Continuous speech Recognition) and isolated word recognition and continuous speech recognition, and may be classified by keyword detection (Keyword Spotting) for detecting and recognizing a predetermined keyword.

  When a user voice is input, the control unit 140 determines the voice section by detecting the start and end of the voice spoken by the user in the input voice signal. The controller 140 may calculate the energy of the input voice signal, classify the energy level of the voice signal according to the calculated energy, and detect a voice section through dynamic programming. The control unit 140 detects phonemes, which are the minimum units of speech, based on an acoustic model in the detected speech signal in the speech section, and generates phoneme data. The control unit 140 generates text information by applying an HMM (Hidden Markov Model) probability model to the generated phoneme data. However, as described above, the method of recognizing the user's voice is only one embodiment, and the user's voice can be recognized using other methods. Accordingly, the control unit 140 can recognize the user's voice included in the voice signal.

  When a motion is input via the motion input unit 120, the control unit 140 recognizes the motion using the motion detection module and the motion database. Motion recognition separates the video (for example, continuous frames) input through the motion input unit 120 into the surrounding background and the object object (for example, user's hand) area of the user motion. The movement of the object to be recognized can be recognized. When a user motion is input, the control unit 140 stores the received video in units of frames and detects an object using the stored frames. The controller 140 detects an object by detecting at least one of the shape, color, and movement of the object included in the frame. The control unit 140 can track the movement of the object detected using the position of each object and the shape of each object included in the plurality of frames.

  The control unit 140 determines the user motion according to the motion of the tracked object. For example, the control unit 140 determines the user's motion using at least one of the change in the shape of the object, the speed, the position, and the direction. The user's motion is grab (Grab), which is a motion to hold a hand, pointing movement (Pointing move), which is a motion to move the displayed cursor by hand, and slap (motion), which is a motion that moves the hand in one direction at a certain speed or more. Slap) includes a shake that is a motion that shakes the hand left / right or up / down, and a rotate that is a motion that rotates the hand. The technical idea of the present invention may be applied to other motions in the above-described embodiment. For example, a spread motion that opens a grasped hand may be further included, and even when the hand is in a fixed position for a certain time, it can be determined as a specific motion.

  In order to determine whether the user's motion is a pointing movement or a slap, the control unit 140 moves out of a certain area (for example, a 40 cm × 40 cm square) within a certain time (for example, 800 ms). Judgment is made. If the object has not deviated from the certain area within a certain time, the control unit 140 may determine that the user's motion is a pointing movement. When the object is out of the determined region within a certain time, the control unit 140 may determine that the user's motion is slap. As another example, when it is determined that the speed of the object is equal to or lower than a predetermined speed (for example, 30 cm / s), the control unit 140 determines the user's motion as a pointing movement. When it is determined that the speed of the object exceeds the preset speed, the control unit 140 determines that the user's motion is slap.

The controller 140 performs a task of the display apparatus 100 using the recognized voice and motion. The tasks of the display device 100 include power control, channel change, volume adjustment, playback of content (eg, video, music, photos, etc.), selection of GUI (Graphical User Interface) displayed on the screen, or Internet service (eg, search) At least one of the functions that can be executed by the display apparatus 100, such as browsing, etc.).
A specific method by which the control unit 140 controls the display device 100 will be described later in detail.

  FIG. 2 is a block diagram showing a configuration of a display apparatus 100 according to another embodiment of the present invention. Referring to FIG. 2, the display apparatus 100 includes an audio input unit 110, a motion input unit 120, a storage unit 130, a control unit 140, a broadcast receiving unit 150, an external terminal input unit 160, and a remote control signal receiving unit 170. The network interface unit 180 and the output unit 190 are included. The display apparatus 100 illustrated in FIG. 2 may be realized by a set-top box, a smart TV, or the like.

  Meanwhile, the description of the voice input unit 110, the motion input unit 120, the storage unit 130, and the control unit 140 shown in FIG. 2 is the same as that of the voice input unit 110, the motion input unit 120, and the storage unit described in FIG. Since it is the same as the description with respect to 130 and the control unit 140, detailed description is omitted.

  The broadcast receiving unit 150 receives broadcast signals from outside by wired / wireless. The broadcast signal includes video (Video), audio (Audio), and additional data (for example, EPG, metadata, etc.). The broadcast receiving unit 150 can receive various types of broadcast signals such as terrestrial broadcast, cable broadcast, satellite broadcast, and internet broadcast.

  The external terminal input unit 160 receives video data (for example, moving images and photos), audio data (for example, music) and the like from the outside of the display apparatus 100. The external terminal input unit 160 may include at least one of an HDMI (registered trademark) input terminal (High-Definition Multimedia Interface Input), a component input terminal, a PC input terminal, or a USB input terminal. Remote control signal receiving unit 170 receives a remote control signal input from an external remote control.

  The remote control signal receiving unit 170 can receive a remote control signal even when the display apparatus 100 is in the voice task mode or the motion task mode. The remote control signal receiving unit 170 can be realized by a wired or wireless communication interface, and can be realized by a one-way or two-way communication interface.

  The network interface unit 180 can connect the display device 100 and an external device (for example, a server or another display device) under the control of the control unit 140. The control unit 140 can control an application to download an application from an external device connected via the network interface unit 180 and provide Internet services such as web browsing to the user. Data, text data, etc. can be controlled to be received. The network interface unit 180 can be realized by a wired / wireless communication interface, and can be realized by various types of bidirectional communication interfaces. For example, at least one of Ethernet (registered trademark) (Ethernet (registered trademark)), wireless LAN 182 and Bluetooth (Bluetooth (registered trademark)) can be provided.

  The output unit 190 receives an external broadcast signal received through the broadcast receiving unit 150, data input through the external terminal input unit 160, data stored in the storage unit 130, or the network interface 180. Output data to an external display device (for example, a monitor, a television, a speaker, etc.). In addition, when the display apparatus 100 is provided with a display, a speaker, etc., it can output via the display of the display apparatus 100, a speaker.

  FIG. 3 is a block diagram of a display device 100 according to still another embodiment of the present invention. As shown in FIG. 3, the display device 100 includes an audio input unit 110, a motion input unit 120, a storage unit 130, a control unit 140, a broadcast reception unit 150, an external terminal input unit 160, and a remote control signal reception. Unit 170, network interface unit 180, display unit 193, and audio output unit 196. At this time, the display apparatus 100 may be a digital television, but is not limited thereto.

  On the other hand, in FIG. 3, the voice input unit 110, the motion input unit 120, the storage unit 130, the control unit 140, the broadcast receiving unit 150, the external terminal input unit 160, the remote control signal receiving unit 170, and the network interface unit 180. The description of the display unit 193 is the same as the description of the configuration having the same reference numerals in FIGS.

  The audio output unit 196 outputs sound corresponding to the broadcast signal under the control of the control unit 140 or outputs sound received via the network interface unit 180. The audio output unit 196 may include at least one of a speaker 196a, a headphone output terminal 196b, and an S / PDIF output terminal 163c.

  On the other hand, as shown in FIG. 3, the storage unit 130 includes a power control module 130a, a channel control module 130b, a volume control module 130c, an external input control module 130d, a screen control module 130e, an audio control module 130f, an Internet control module 130g, An application module 130h, a search control module 130i, a UI processing module 130j, a speech recognition module 130k, a motion recognition module 130l, a speech database 130m, and a motion database 130n are included. These modules (130a to 130n) are respectively a power control function, a channel control function, a volume control function, an external input control function, a screen control function, an audio control function, an Internet control function, an application execution function, a search control function, a UI. It may be implemented in software to perform processing functions. The control unit 140 can execute these functions by executing these software stored in the storage unit 130.

As described above, each control module (130a to 130n) may be realized by software stored in the storage unit 130, but may be realized through separate hardware.
Hereinafter, various embodiments of the present invention will be described with reference to the drawings.
In particular, an embodiment for providing different audio guide information or motion guide information depending on connected external devices will be described with reference to FIGS.

  The control unit 140 displays on the display unit 193 first voice guide information that guides voice command words for controlling the display apparatus 100 in the voice task mode. At this time, the voice task mode is a mode in which a voice start command is input via the voice input unit 110, and then the display apparatus 100 is controlled by the input voice command word. Note that the voice task mode may be a mode in which the display apparatus 100 is controlled by a voice command word input without a voice start command. In this case, instead of the voice start command, another type of user command for starting the voice task mode can be used. Another type of user command may include remote controller specific button input, display device 100 specific button input, user specific motion, and the like.

  When a user command for controlling an external device connected to the display apparatus 100 is input, the controller 140 guides the first voice guide information by the user voice for controlling the external device. The display unit 193 is controlled so as to change the guide information to display. In particular, a plurality of voice guide information is stored in the storage unit 130, and the control unit 140 detects and reads second voice guide information corresponding to the external device among the plurality of voice guide information stored in the storage unit 130. The read second voice guide information can be displayed on the display unit 193. The plurality of voice guide information corresponds to the display device 100 and a plurality of external devices connected to the display device 100, respectively. If the voice guide information for the external device to be controlled by the user is not stored in the storage unit 130, it can be received via the external terminal input unit 160 and the network interface unit 180.

  At this time, the first voice guide information and the second voice guide information may include different voice command words. For example, when the display device 100 is a television, the first voice guide information includes a voice command word related to power control, a voice command word related to external device execution, a voice command word related to channel setting, a voice command word related to volume setting, and the like. It's okay. When the external device is one of a DVD player and a BD player, the second voice guide information includes a voice command word related to TV power control, a voice command word related to external device power control, and a voice command related to function execution of the external device. Words may be included.

  In particular, when the first voice guide information is displayed, when the voice command word included in the first voice guide information is input via the voice input unit 110, the control unit 140 responds to the input voice command word. To control the display apparatus 100.

  However, when the second voice guide information is displayed, if the voice command word included in the second voice guide information is input via the voice input unit 110, the control unit 130 corresponds to the input voice command word. The control signal to be generated can be generated, and the generated control signal can be transmitted to the external device via the external terminal input unit 160.

When there is a relay device provided for communication between the display apparatus 100 and an external device, when a voice command word included in the second voice guide information is input via the voice input unit 110, the control unit 140 generates a control signal corresponding to the inputted voice command word, and can transmit the generated control signal to an external device via a relay device. Here, the relay device and the display apparatus 100 may communicate via the network interface unit 180, and the relay device and the external device may communicate via the wireless communication interface. In this case, the generated control signal may be transmitted to the relay device by the display apparatus 100 by Bluetooth communication, and the relay device converts the transmitted control signal into an IR (Infrared) signal and transmits the control signal to the external device. Can be realized. The wireless communication interface used for communication between the relay device and the external device may include an RF communication interface in addition to the IR communication interface, and the RF (Radio Frequency) communication interface may be NFC (near field communication) communication. An interface, a ZigBee communication interface, a Bluetooth communication interface, or the like may be used. The interface between the relay device and the display apparatus 100, and the interface between the relay device and the external device are not limited to the above-described interfaces, and can be realized by a wired / wireless communication interface, and can be realized by various bidirectional communication interfaces. It is feasible. In particular, when an existing interface used for remote control of an external device is used for communication between the relay device and the external device, a voice command word input via the display device 100 of the present invention or a user's It is easy to realize to control external devices through motion.
A specific embodiment in which voice guide information is provided by a connected external device will be described in detail with reference to FIGS.

  The control unit 140 receives a broadcast signal transmitted from an external broadcast station via the broadcast receiving unit 150, and performs signal processing on the received broadcast signal. As shown in FIG. 4, the control unit 140 displays the signal-processed broadcast video on the display unit 193, and outputs the sound of the signal-processed broadcast signal via the audio output unit 196.

  When a voice start command is input via the voice input unit 110, the control unit 140 recognizes the voice start command and switches to the voice task mode. At this time, the voice start command is a user command for starting the voice task mode, and the voice task mode is a mode controlled by the voice command word input to the voice input unit 110 by the display device 100. As described above, instead of the voice start command, another type of user command for starting the voice task mode can be utilized. Another type of user command may include remote controller specific button input, display device 100 specific button input, user specific motion, and the like.

  Then, when switching to the voice task mode, the control unit 140 displays the first voice guide information 500 for performing the voice task mode, as shown in FIG. At this time, the first audio guide information 500 is displayed in the lower part of the screen on which the broadcast video is displayed. The first voice guide information 500 includes an icon 510 for notifying that the current display device mode is the voice task mode, and a plurality of voice command words 521 to 526 and 530 for guiding voice command words to the user. . The display position of the voice guide information can be changed, and the position where the icon 510 and the plurality of voice command words 521 to 526, 530 in the voice guide information are displayed can be changed.

  The plurality of voice command words include a power-off voice command word 521, an external input voice command word 522, a channel shortcut voice command word 523, a channel up / down (UP / DOWN) voice command word 524, a volume amplifier / down (UP / DOWN) voice command word 525, mute voice command word 526, and MORE voice command word 530. The MORE voice command word 530 is a command word for further viewing a voice command word other than the displayed voice command word. However, the voice command word included in the first voice guide information 500 as described above is merely an embodiment, and other voice command words (for example, a channel list voice command word) may be included.

  When the voice command word “Universal Control” is input through the voice input unit 110 in a state where the first voice guide information 500 is displayed, the control unit 140 causes the external to be controlled as shown in FIG. The third voice guide information 600 for selecting the device is displayed. At this time, the third voice guide information 600 includes an icon 610 for notifying that the current display device mode is the voice task mode, and a plurality of voice command words 621 to 625 and 630 for guiding the user's voice. . The plurality of voice command words include a Watch TV voice command word 621, a Watch Video voice command word 622, a TV voice command word 623, a set top box (STB) voice command word 624, a Blu-ray Disc player (BD) voice command word 625, and A MORE voice command 630 is included. However, the voice command word included in the third voice guide information 600 as described above is merely an embodiment, and includes other voice command words (for example, a DVD player voice command word, a USB voice command word, etc.). It's okay.

  When the user voice “BD” is input via the voice input unit 110 in a state where the third voice guide information is displayed, the control unit 140 can control the BD using the user voice. And the control part 140 searches the audio | voice guide information for controlling BD among the several audio | voice guidance information preserve | saved at the preservation | save part 130, and displays it as shown in FIG.

  That is, the control unit 140 displays the first voice guide information 500 as shown in FIG. 5 when the broadcast receiving function is assumed, but when an external device to be controlled is selected, the control unit 140 displays the first voice guide information 500 as shown in FIG. 2 Change to voice guide information 700 and display. At this time, the second voice guide information 700 includes an icon 710 for notifying that the current display device mode is the voice task mode, and a plurality of voice command words 721 to 726 and 730 for guiding the user's voice. .

  The plurality of voice command words include power-off voice command word 721, external input voice command word 722, playback (pause) voice command word 723, previous file voice command word 724, next file voice command word 725, volume amplifier / Down voice command word 726 is included. However, the voice command word included in the second voice guide information 700 as described above is only one embodiment, and includes other voice command words (for example, fast-forward voice command word, rewind voice command word, etc.). It's okay.

  Therefore, as described above, by providing different voice guide information according to the type of the selected external device, the user can control the external device more conveniently and intuitively using voice recognition. become.

On the other hand, in the above-described embodiment, the BD is selected as the external device to be controlled through the voice command word. However, this is only one embodiment, and the BD can be selected using a remote controller or the like. In the above-described embodiment, it is described that the voice guide information is provided so as to be different in the voice task mode according to the type of the selected external device. However, this is only one embodiment and is selected. Depending on the type of external device, the motion guide information may be provided differently in the motion task mode.
Hereinafter, a method for controlling a display apparatus according to an embodiment of the present invention will be described with reference to FIG.

  First, the display apparatus 100 switches to the voice task mode (S810). Specifically, when a voice guidance command is input through the voice input unit 110 of the display apparatus 100, the display apparatus 100 switches the control mode of the display apparatus 100 to a voice task mode in which the display apparatus 100 is controlled by user voice. .

  When switching to the voice task mode, the display apparatus 100 displays the first voice guide information (S820). At this time, when the display apparatus 100 has a broadcast receiving function, the first voice guide information includes a voice command word for controlling the broadcast receiving function. For example, the first voice guide information may include a voice command word for channel setting.

  Then, the display apparatus 100 determines whether a user command to control the external device is input (S830). At this time, as described with reference to FIG. 6, the user command may be a user voice command, or may be a command by an external input change button provided in a remote controller that is linked to the display apparatus 100.

  When a user command to control the external device is input (S830-Y), the display apparatus 100 changes the first voice guide information to the second voice guide information and displays it (S840). At this time, the type of the external device can be selected, but when the external device is a BD (Blue-ray) player or a DVD player, the voice command word for channel setting disappears in the second voice guide information, and the video A voice command word for reproduction (for example, a voice command word for stopping reproduction, a voice command word for reproducing the next file, etc.) may be included.

  As described above, the voice guide information is displayed differently depending on the type of the selected external device, so that the user can more conveniently and intuitively control the connected external device using voice recognition. Will be able to.

  On the other hand, in the above-described embodiment, the display apparatus 100 is described as being directly connected to an external device via the external terminal input unit 160. However, this is only an embodiment, and the display apparatus 100 is connected to the network interface unit 180. The embodiment in which the technical idea of the present invention is applied to an embodiment connected to an external device using a relay device connected via the display device 100 and the external device using all the external terminal input unit 160 and the relay device. The technical idea of the present invention is also applied to the embodiment in which the and are connected. Specifically, a system 10 as illustrated in FIG. 9 includes a display device 100, a relay device 200, and an external device 300. At this time, the display device 100 is connected to the external device 300 via the relay device 200.

  Specifically, when a user voice corresponding to a voice command word included in the second voice guide information is input via the voice input unit 110, the display apparatus 100 generates a control signal corresponding to the input voice command word. Generate. The display apparatus 100 transmits a control signal to the relay device 200 using the Bluetooth communication of the network interface unit 180. When the control signal is transmitted, the relay device 200 converts the received control signal into an IR signal form and transmits the IR signal to the external device 300. When the external device 300 receives the IR signal, the external device 300 demodulates the IR signal and is controlled in accordance with the voice command word input to the display device 100.

The interface between the relay device and the display apparatus 100 and the interface between the relay device and the external device are not limited to the above-described interfaces, and can be realized by a wired / wireless communication interface. It can be realized with a bidirectional communication interface.
Hereinafter, an embodiment for an angle-of-view setting UI for setting an angle of view of the motion input unit 120 will be described with reference to FIGS. 10 to 12.

  In particular, in the present embodiment, the motion input unit 120 may be a camera. At this time, as shown in FIG. 10, the camera may be disposed so as to protrude from an upper bezel in a bezel surrounding the display unit 193 of the display apparatus 100. However, this is only an embodiment, and the camera may be arranged so as not to protrude from the top bezel, and a part of the bezel corresponding to the position of the camera is made of a transparent material or a hole is formed. May be realized. Note that the camera may be arranged on any of the four surfaces as well as the upper end of the bezel.

  When a preset event occurs, the control unit 140 displays an angle-of-view guide UI for guiding the angle of view of the camera in one area of the display screen. The control unit 140 can set the angle of view of the camera according to a user command input using the angle of view guide UI.

  At this time, a preset event includes an event in which power is applied to the display device 100 when the display device 100 is first installed, an event in which the motion task mode is turned on, and a control menu of the display device 100. The view angle setting menu may be one of the selected events. On the other hand, when a preset event occurs, the control unit 140 displays an angle-of-view guide UI 1100 in the center area of the display screen as shown in FIG. At this time, the view angle guide UI 1100 is not displayed on the entire display screen, but is displayed on one area (for example, the central area) of the display screen. Therefore, the user can continue to view the content video currently being viewed. Of course, the view angle guide UI 1100 can be displayed in the entire area of the screen.

  The angle of view guide UI 1100 includes a camera image display screen 1110 that displays an image captured by the camera. Therefore, the user can check the video currently captured by the camera and can guide the current angle of view of the camera.

  At this time, the angle-of-view guide UI 1100 may include guidelines for guiding the camera image display screen 1110 and a suitable user position. The view angle guide UI 1100 may include a camera image display screen 1110 and guidelines for guiding a suitable camera view angle according to the position of the user on the camera image display screen 1110.

  If the angle of view guide UI 1100 includes a guideline for guiding the camera image display screen 1110 and a suitable angle of view of the camera, the angle of view of the camera may be manually adjusted by the user, and is realized to be adjusted automatically. Good. In this case, the position of the guideline for guiding a suitable angle of view of the camera may be changed by changing the position of the user in the camera video display screen 1110.

  Here, the angle of view of the camera can be adjusted by adjusting the actual position and angle of the camera. It should be noted that the video can be adjusted by selecting a video displayed on the camera video display screen 1110 among videos shot without adjusting the actual camera position and angle. A screen 1110 is a part of the captured video. When a user command is input through the view angle guide UI 1100 while the angle of view of the camera is adjusted, the control unit 140 recognizes the user's motion from the video on the camera video display screen 1110 at the time when the user command is input. You can set the video to be used.

  In particular, when the user adjusts the angle of view of the camera using the direction buttons provided on the remote controller, the remote controller generates a signal including the selected direction button information and transmits the signal to the display apparatus 100, and the control unit 140. Can adjust the camera according to the signal transmitted from the remote control.

  The angle of view guide UI 1100 as described above can be used to generate an image for more accurately recognizing the user's motion. FIG. 12 is a flowchart for explaining a camera field angle setting method of the display apparatus 100 according to an embodiment of the present invention.

  First, the display apparatus 100 determines whether a preset event has occurred (S1210). At this time, a preset event includes an event in which power is applied to the display device 100 when the display device 100 is first installed, an event in which the motion task mode is turned on, and a control menu of the display device 100. The view angle setting menu may be one of the selected events. That is, even when shifting to the motion task mode for controlling the display apparatus 100 by user motion, the angle-of-view setting UI is not displayed and the angle-of-view setting UI is displayed only when a preset event occurs. can do.

  When a preset event occurs (S1210-Y), the display device 100 displays an angle of view guide UI for setting the angle of view of the camera 120 (S1220). At this time, the view angle guide UI 1100 may be displayed in the center area of the display screen as shown in FIG. 11, and may include a screen 1110 that displays an image captured by the current camera. Accordingly, the user can set the camera angle of view while viewing the content video output from the current display device 100. Of course, the view angle guide UI 1100 can be displayed in the entire area of the screen.

  The display apparatus 100 can set the angle of view of the camera using the displayed angle of view guide UI (S1230). At this time, if the angle of view guide UI 1100 includes a camera image display screen 1110 and a guideline for guiding a suitable angle of view of the camera, the angle of view of the camera may be manually adjusted by the user and may be automatically adjusted. Can be realized. In this case, the position of the guideline for guiding a suitable angle of view of the camera may be changed by changing the position of the user in the camera video display screen 1110.

  Here, the angle of view of the camera can be adjusted by adjusting the actual position and angle of the camera. In addition, it can adjust by selecting the image | video displayed on the camera image display screen 1110 among the images image | photographed in the state which does not adjust the position and angle of an actual camera, In this case, the camera image display screen 1110 can be adjusted. Is a part of the captured video.

  When a user command is input through the view angle guide UI 1100 while the angle of view of the camera is adjusted, the display apparatus 100 recognizes the user's motion from the video on the camera video display screen 1110 at the time when the user command is input. You can set the video to be used.

  In particular, when the user adjusts the angle of view of the camera using the direction button provided on the remote controller, the remote controller generates a signal including the selected direction button information and transmits the signal to the display apparatus 100, and the display apparatus 100 Can adjust the camera according to the signal transmitted from the remote control.

  Thereby, the user can set the angle of view of the camera more easily using the angle of view guide UI. Note that instead of setting the angle of view each time the mode is switched to the motion task mode, the camera is set every time a preset event occurs, so that the user can set the camera angle every time the mode is switched to the motion task mode. This makes it possible to save the trouble of setting the angle of view.

  Hereinafter, an embodiment for a motion UI for controlling the display apparatus 100 according to a user motion will be described with reference to FIGS. 13 to 19.

  When a motion start command is input via the motion input unit 120, the control unit 140 switches the mode of the display apparatus 100 to the motion task mode. At this time, the motion start command may be a motion of shaking one hand of the user left and right a plurality of times. The motion task mode is a mode that is controlled by the user's motion input to the display apparatus 100 via the motion input unit 120. Instead of the motion start command, another type of user command for starting the voice task mode can be used. Another type of user command may include a specific button input on the remote control, a specific button input on the display device 100, a user specific voice, and the like.

  When the mode is switched to the motion task mode, the control unit 140 displays an icon and a pointer for performing the motion task mode on the display unit 193. At this time, the displayed icon is an icon for controlling the function of the display apparatus 100. The icons may be displayed in the left area and the right area of the display screen. The pointer may be displayed in the central area of the display screen.

  In particular, when a broadcast signal is output when switching to the motion task mode, the control unit 140 displays icons for volume adjustment and channel change. Each icon may be displayed in a left area and a right area of the display screen. The volume control icon includes a volume up icon and a volume down icon, and the channel change icon includes a channel up icon and a channel down icon. The pointer may be displayed at a specific position on the display screen (for example, the center area of the screen).

  Then, the control unit 140 moves the pointer along the first motion of the user input via the motion input unit 120. At this time, the first motion of the user may be a spread motion with the user's hand opened. That is, when a motion that is moved in a state where the user's hand is opened is input via the motion input unit 120, the control unit 140 can move the pointer along the movement of the user's hand.

  When the user's second motion is input via the motion input unit 120 with the pointer positioned on the icon, the control unit 140 executes a function corresponding to the icon. At this time, the second motion of the user may be a grab motion that holds a hand. For example, when a user's grab motion is input through the motion input unit 120 with the pointer positioned on the volume up icon, the control unit 140 can increase the volume level by “1” from the current volume level. .

  Here, the control unit 140 performs control so that the position of the pointer is fixed without moving while the second motion of the user is input. This is because when the user's second motion is input, if the user's hand is determined to have moved and the position of the pointer is changed, the user cannot accurately control the display device 100.

  If the input of the second motion is held while the pointer is positioned on the icon, the control unit 140 can continuously execute the function of the icon where the pointer is positioned. For example, if the input of the second motion is held while the pointer is positioned on the volume down icon, the control unit 140 can continue to decrease the volume level. At this time, if the input of the second motion is continuously held, the control unit 140 can more quickly execute the function of the icon where the pointer is located. For example, when the input of the second motion is held while the pointer is positioned at the volume down icon, the control unit 140 can gradually decrease the volume level.

Then, a motion end motion may be input via the motion input unit 120. When the motion end motion is input, the control unit 140 removes the displayed icons and pointers from the display screen of the display unit 110. be able to. At this time, the motion end motion and the motion start command may be the same motion.
A method of controlling the display apparatus 100 using a user's motion, a plurality of icons, and a pointer will be described in detail with reference to FIGS.
The controller 140 processes the broadcast signal received via the broadcast receiver 150 and displays the broadcast video 1300 on the display screen as shown in FIG.

  At this time, when a motion start command is input via the motion input unit 120, the control unit 140 switches the control mode of the display apparatus 100 to the motion task mode. At this time, the motion task mode is a mode in which the display device 100 is controlled by the user's motion via the motion input unit 120. Another type of user command to start the motion task mode can be used instead of the motion start command. Another type of user command may include a specific button input on the remote control, a specific button input on the display device 100, a user specific voice, and the like.

  When switching to the motion task mode, the control unit 140 displays a plurality of icons 1410, 1430, 1440, 1460 and pointers for performing a specific function of the display apparatus 100 on the display 1470. Specifically, as shown in FIG. 14, the control unit 140 displays a volume up icon 1410 and a volume down icon 1430 for volume level control in the left area of the display screen, and performs channel control in the right area of the display screen. A channel up icon 1440 and a channel down icon 1460 are displayed, and a pointer 1470 is displayed in the center area of the display screen.

  At this time, current volume level information 1420 of the display device 100 is displayed between the volume up icon 1410 and the volume down icon 1430. Between the channel up icon 1440 and the channel down icon 1460, current channel information (for example, channel name, channel number) 1450 of the display apparatus 100 is displayed. Therefore, the user can easily check the currently set channel information and volume level information. The display position of the current volume level information 1420 and the current channel information 1450 may be different from the above-described position. When the current task is switched to the motion task mode, the current volume level information 1420 and the current channel information 1450 are displayed. It may be displayed immediately.

  On the other hand, in the above-described embodiment, it has been described that the icons 1410 and 1430 for volume level control are displayed in the left area, and the icons 1440 and 1460 for channel control are displayed in the right area. It is only a form and may be displayed in other areas.

  In the above-described embodiment, it has been described that the icons 1410 and 1430 for volume level control and the icons 1440 and 1460 for channel control are displayed, but for controlling other functions of the display device 100. Icons for icons (eg, mute, power off, etc.) may be displayed.

  When a plurality of icons 1410, 1430, 1440, 1460 and a pointer 1470 are displayed and a motion that is moved while the user's hand is opened is input via the motion input unit 120, the control unit 140 The pointer 1470 is moved along the moving motion.

  When the user's grab motion is input via the motion input unit 120 in a state where the pointer 1470 is positioned on one of the plurality of icons 1410, 1430, 1440, 1460, the control unit 140 displays the pointer The function corresponding to the icon 1470 can be executed.

  For example, when a motion that is moved to the left side with the user's hand being opened is input via the motion input unit 120, the control unit 140 moves the pointer 1470 to the left side along the movement motion. As shown in FIG. 15, when a grab motion of the user is input via the motion input unit 120 with the pointer 1470 positioned on the volume down icon 1430, the control unit 140 is currently set to the display device 100. Decrease the sound volume level by “1”. That is, when the volume level set in the current display apparatus 100 is “21”, when a grab motion of the user is input via the motion input unit 120 with the pointer 1470 positioned on the volume down icon 1430, The control unit 140 sets the current volume level of the display device 100 to “20”. Then, the control unit 140 not only adjusts the volume level of the display apparatus 100 but also changes the volume level information 1420 as shown in FIG.

  At this time, when a grab motion is input via the motion input unit 120, the control unit 140 can fix the pointer 1470 without changing the position even if the user's hand moves.

  Note that the control unit 140 continues to decrease the current volume level of the display device 100 according to the number of times the user's grab motion is input via the motion input unit 120 with the pointer 1470 positioned on the volume down icon 1430. can do. The number of times grab motion is input can be calculated by the number of times of switching from spread mode to grab motion.

  As yet another example, when a motion that is moved to the right side is input through the motion input unit 120 while the user's hand is opened, the control unit 140 moves the pointer 1470 to the right side along the movement motion. . As illustrated in FIG. 17, when the user's grab motion is input twice through the motion input unit 120 with the pointer 1470 positioned on the channel down icon 1460, the control unit 140 is currently displayed on the display device 100. The broadcast video reduced by “2” from the set channel number is received and displayed. That is, when the channel number currently set in the display apparatus 100 is “11”, the user's grab motion is input twice via the motion input unit 120 with the pointer 1470 positioned on the channel down icon 1460. Then, the control unit 140 can receive and display the broadcast video whose channel number of the current display device 100 is “9”. Then, the controller 140 not only controls the channel of the display apparatus 100 but also changes the channel information 1450 as shown in FIG.

  Note that the control unit 140 determines the channel number of the current display device 100 according to the number of times the user's grab motion is input via the motion input unit 120 with the pointer 1470 positioned on the channel down icon 1460. It can continue to decrease.

The display device 100 as described above allows a user to control the display device conveniently and intuitively using motion, and controls the function of the display device using only hand position information and hand shape changes. And the speed at which the user's motion is recognized can be improved.
FIG. 10 is a flowchart for explaining a control method of the display apparatus 100 using user motion according to an embodiment of the present invention.

  First, the display apparatus 100 determines whether a motion start command is input through the motion input unit 120 (S1910). At this time, the motion start command may be a motion of shaking the user's hand left and right a plurality of times. Here, instead of the motion start command, another type of user command for starting the motion task mode can be used. Another type of user command may include remote controller specific button input, display device 100 specific button input, user specific voice, and the like.

  When the motion start command is input (S1910-Y), the display apparatus 100 switches the mode of the display apparatus 100 to the motion task mode (S1920). At this time, the motion task mode is a mode in which the display apparatus 100 is controlled by user motion.

  When the mode is switched to the motion task mode, the display apparatus 100 displays a plurality of icons and pointers on the display screen (S1930). At this time, the plurality of icons may be displayed in the left area or right area of the display screen, and the pointer may be displayed in the central area of the display screen. The plurality of icons may include an icon for channel setting and an icon for volume level setting. At this time, the current volume level information of the display device 100 is displayed around the icon for setting the volume level. The current channel information (for example, channel name and channel number) of the display device 100 is displayed around the icon for channel setting.

  Then, the display apparatus 100 determines whether or not the user's first motion is input through the motion input unit 120 (S1940). At this time, the user motion may be a motion that moves with the user's hand open.

  If it is determined that the first motion is input (S1940-Y), the display apparatus 100 moves the pointer on the display screen along the first motion (S1950).

  Then, the display apparatus 100 determines whether the user's second motion is input via the motion input unit 120 (S1960). At this time, the user motion may be a grab motion that holds the user's hand.

If it is determined that the second motion is input (S1960-Y), the display apparatus 100 executes a function corresponding to the icon on which the pointer is positioned (S1970). For example, when it is determined that the pointer is positioned at the volume up icon and the second motion is input, the display apparatus 100 increases the volume level currently set in the display apparatus 100. Note that the display apparatus 100 can execute the function of the icon at which the pointer is positioned according to the number of times the second motion is input while the pointer is positioned at the specific icon. The number of times the second motion is input can be calculated by the number of times the first motion is switched to the second motion.
When the second motion is input, the display apparatus 100 can be fixed without moving the pointer even if the user's hand moves.

According to the display device control method as described above, the user can more conveniently and intuitively control the display device 100 using user motion, and the display device can be used only by using hand position information and a change in hand shape. Can be controlled, and the speed at which the user's motion is recognized can be improved.
Hereinafter, with reference to FIG. 20 to FIG. 22, an embodiment value that provides different voice guide information depending on the voice input method will be described.

  In particular, when a voice start command is input, the control unit 140 determines whether the input voice start command is a first voice start command or a second voice start command. Here, the voice start command is a command for shifting the control mode of the display apparatus 100 to the voice task mode controlled by the user voice input via the voice input unit 110. In particular, the first voice start command is a user voice command including a preset word input via the voice input unit 110 included in the display apparatus 100, and the second voice start command is the display apparatus 100. It may be a user command to press a preset button included in an external device (for example, a remote controller) linked with the. However, the first voice start command and the second voice start command described above are only one embodiment, and may be realized by a voice start command of another method.

  When the voice start command is determined to be the first voice start command, the control unit 140 switches the mode of the display device 100 to the first voice task mode. At this time, the first voice task mode is a voice task mode controlled in accordance with the user voice input to the voice input unit of the display apparatus 100.

  When the voice start command is determined to be the second voice start command, the control unit 140 switches the control mode of the display apparatus 100 to the second voice task mode. The second voice task mode is a voice task mode that is controlled in accordance with a user voice input to an external device that is linked to the display apparatus 100. In particular, in the second voice task mode, the user's voice may be input while pressing a voice input button provided on the external device. Alternatively, in the second voice task mode, the user's voice may be input by pressing the voice input button provided in the external device once, inputting the user voice, and then pressing the voice input button again.

  In particular, in the first voice task mode, the display apparatus 100 is not controlled by the user's voice input from an external device, and in the second voice task mode, the user input to the voice input unit included in the display apparatus 100. The display apparatus 100 may not be controlled by sound.

When the control mode of the display apparatus 100 is switched to the voice start command, the control unit 140 displays voice guide information corresponding to the switched voice task mode. Specifically, when the mode of the display device 100 is switched to the first voice task mode, the control unit 140 displays first voice guide information corresponding to the first voice task mode. When the control mode of the display device 100 is switched to the second voice task mode, the control unit 140 displays the second voice guide information corresponding to the second voice task mode.
The first voice guide information and the second voice guide information will be described in more detail with reference to FIGS.

FIG. 20 is a diagram showing first voice guide information according to an embodiment of the present invention. As shown in FIG. 20, the first audio guide information 2000 is displayed at the lower part of the screen on which the broadcast video is displayed. The first voice guide information 2000 includes an icon 2010 for notifying that the current display device control mode is the first voice task mode, and a plurality of voice command words 2021 to 2027 for guiding the user's voice. The plurality of voice command words include a power-off voice command word 2021, an external input voice command word 2022, a channel shortcut voice command word 2023, a channel up / down (UP / DOWN) voice command word 2024, a volume amplifier / down (UP / DOWN) voice command word 2025, mute voice command word 2026, and MORE voice command word 2027 are included. The MORE voice command word 2027 is a command word for further viewing a voice command word other than the displayed voice command word.
At this time, the icon 2010 for notifying that it is the first voice task mode may have a microphone shape as shown in FIG.

  In particular, the first voice guide information 2000 may include a voice command word corresponding to a button that can be executed by pressing once among buttons provided on the remote control. For example, the first voice guide information 2000 may include a channel up / down voice command word 2024, a volume up / down voice command word 2025, a mute voice command word 2026, and the like.

  FIG. 21 is a diagram showing second audio guide information 2100 according to an embodiment of the present invention. As shown in FIG. 21, the second audio guide information 2100 is displayed at the lower part of the screen on which broadcast video in the same area as the area where the first audio guide information 2000 is displayed. The second voice guide information 2100 includes an icon 2110 for notifying that the current display device mode is the second voice task mode, and a plurality of voice command words 2121 to 2127 for guiding the voice of the user. The plurality of voice command words include a channel shortcut voice command word 2121, a search voice command word 2122, an external input voice command word 2123, a channel list voice command word 2124, a favorite voice command word 2125, and a MORE voice command word 2126. At this time, the favorite voice command word 2125 is a voice command word for displaying a menu including a function frequently used by the user (for example, execution of a specific application).

  At this time, the icon 2110 for notifying that it is the second voice task mode may have a remote control shape different from the icon 2010 for notifying the first voice task mode shown in FIG. Therefore, the user can check whether the current voice task mode is the first voice task mode or the second voice task mode through the icons 2010 and 2110 included in the voice guide information 2000 and 2100.

  The plurality of voice command words included in the second voice guide information 2100 may be partially different from the plurality of voice command words included in the first voice guide information 2000. In particular, the second voice guide information 2100 may not include a voice command word corresponding to a button that can be executed by pressing once among buttons provided on the remote controller. For example, the second voice guide information 2100 may not include the channel up / down voice command word 2024, the volume up / down voice command word 2025, the mute voice command word 2026, and the like. This is because the user holds the remote control in the second voice task mode, and it is more convenient to press the remote control button than the user speaks.

  Instead, in the second voice guide information 2100, functions such as a search voice command word 2122, an external input voice command word 2123, a channel list voice command word 2124, and a favorite voice command word 2125 are used to function. In order to shift, a voice command word corresponding to a function that requires two or more button inputs may be included.

  That is, as described above, by providing different voice guide information according to the first voice task mode and the second voice task mode, the user can efficiently and conveniently display the display device 100 according to the plurality of voice task modes. Will be able to control.

When one of the first voice guide information 2000 and the second voice guide information 2100 is displayed, the control unit 140 changes the display device 100 according to the user voice input to the voice input unit 110 in the voice task mode. Control. For example, when the user voice “mute” is input through the voice input unit 110 while the first voice guide information 2000 is displayed, the control unit 140 sets the volume level of the display device 100 to “0”. can do. When the user voice “channel list” is input via the voice input unit 110 in a state where the second voice guide information 2100 is displayed, the control unit 140 may display the channel list on the display unit 193. it can.
FIG. 22 is a flowchart illustrating a method for providing different voice task modes according to a voice input method according to an embodiment of the present invention.

First, the display apparatus 100 receives a voice start command (S2210). Here, the voice start command is a command for shifting the mode of the display apparatus 100 to a voice task mode controlled by user voice input via the voice input unit 110. In particular, the first voice start command is a user voice command including a preset word input via the voice input unit 110 included in the display apparatus 100, and the second voice start command is the display apparatus 100. It may be a user command to press a preset button included in an external device (for example, a remote controller) linked with the.
The display apparatus 100 determines whether the input voice start command is a first voice start command (S2220).

  If the input voice start command is the first voice start command (S2220-Y), the display apparatus 100 switches the mode of the display apparatus 100 to the first voice task mode (S2230). Here, the first voice task mode is a mode for controlling the display apparatus 100 in accordance with a user voice input via the voice input unit 110 provided in the display apparatus 100.

In particular, when switching to the first voice task mode, the display apparatus 100 displays the first voice guide information (S2240). Here, the first voice guide information includes an icon for guiding that the current mode of the display apparatus 100 is the first voice task mode, and a plurality of voice command words for performing the first voice task mode. Good. At this time, the plurality of command words included in the first voice guide information include “channel up / down voice command word”, “volume up / down voice command word”, and “mute voice command word”. When a voice is input, a voice command word that can immediately execute the function of the display apparatus 100 may be included.
The display apparatus 100 performs a voice task using the first voice guide information (S2280).

  However, if the voice start command is not the first voice start command (S2220-N), the display apparatus 100 determines that the input voice start command is the second voice start command (S2250).

  Then, the display apparatus 100 switches the mode of the display apparatus 100 to the second voice task mode (S2260). At this time, the second voice task mode is a mode in which the display apparatus 100 is controlled in accordance with a user voice input via the voice input unit 110 included in an external device (for example, a remote controller) linked to the display apparatus 100. is there. In particular, in the second voice task mode, the second voice task mode may be controlled by a user voice input to the external device after a second button (for example, a voice input button) set in advance on the external device is pressed.

When switching to the second voice task mode, the display apparatus 100 displays the second voice guide information (S2270). Here, the second voice guide information may include an icon for guiding that the current mode of the display apparatus 100 is the second voice task mode and a plurality of voice command words for performing the second voice task. . At this time, the icon for guiding the second voice task mode is different from the icon for notifying that the first voice task mode is set. A plurality of command words included in the second voice guide information include voice command words having a depth such as “external input voice command word”, “channel list voice command word”, and “favorite voice command word”. May be included.
The display apparatus 100 performs a voice task using the second voice guide information (S2280).

The control method of the display apparatus 100 as described above allows the user to more efficiently control the display apparatus 100 using different voice input methods.
Hereinafter, an embodiment of a two-hand input guide GUI for performing a two-hand task mode will be described with reference to FIGS.

When a two-hand start command for performing a motion task using two hands (hereinafter referred to as “two-hand task”) is input, the control unit 140 switches to a two-hand task mode in which a motion task is performed using both hands. Here, the two-hand task may be a task for zooming in or zooming out the display screen. Here, instead of the two-hand start command, another type of user command for starting the two-hand task mode can be used. Another type of user command may include remote control specific button input, display device 100 specific button input, user specific motion, and the like.
In particular, a two-hand start command for performing a two-hand task may be input sequentially one by one, or both hands may be input simultaneously.

  Specifically, when a motion start command using one hand is input via the motion input unit 120, the control unit 140 switches to a motion task mode for performing a motion task using one hand. When a motion start command using the other hand is input via the motion input unit 120 in the state switched to the motion task mode, the control unit 140 can recognize that the two-hand start command is input. Here, the motion start command using one hand may be a shake motion in which one hand is shaken a plurality of times in the left-right direction.

Alternatively, when a shake motion in which both hands are simultaneously shaken in the left-right direction is input via the motion input unit 120 in the general control mode in which the display apparatus 100 is controlled using the remote controller, the control unit 140 receives a two-hand start command. Can be recognized as input.
When switching to the two-handed task mode, the control unit 140 displays a two-handed input guide GUI for performing a two-handed task.

  Specifically, the two-hand input guide GUI may be a circular GUI having a diameter of a straight line connecting two points on the screen corresponding to the positions of both hands. This will be specifically described with reference to FIGS.

  When a two-hand start command is input via the motion input unit 120, the control unit 140 switches the control mode of the display apparatus 100 to the two-hand task mode, and displays motion guide information 2300 for performing the motion task mode.

  At this time, the motion guide information 2300 may be displayed only when a motion start command using one hand is sequentially input, and not displayed when a motion start command using both hands simultaneously is input. Good.

  When a two-hand start command is input, the control unit 140 displays a two-hand input guide GUI 2330 for performing a two-hand task mode. At this time, the two-hand input guide GUI 2330 may be a circular GUI as shown in FIG. Of course, another shape GUI may be used as long as it can intuitively recognize the position of both hands of the user, such as an ellipse, a triangle, a square, and a straight line. The position of the two-hand input guide GUI 2330 is determined according to the position of both hands of the user, but can be set to be displayed in the central area of the display screen.

  When a motion in which the user's hands move while maintaining a constant interval is input via the motion input unit 120, the control unit 140 moves the two-hand input guide GUI 2330 on the display screen. For example, as illustrated in FIG. 23, a motion in which the user's hands move to the right while maintaining a constant interval via the motion input unit 120 with the two-hand input guide GUI 2330 displayed in the center area of the display screen When input, the control unit 140 moves the two-hand input guide GUI 2330 to the right as shown in FIG.

  When a motion in which both hands are separated from each other is input while the two-hand input guide GUI 2330 is displayed in one area on the display screen, the control unit 140 uses the predetermined position in the area where the two-hand input guide GUI 2330 is displayed as a reference. Zoom in. For example, as illustrated in FIG. 24, when a motion in which both hands are separated in a state where the two-hand input guide GUI 2330 is displayed in the right region on the display screen is input, the control unit 140 may include the two-hand input guide as illustrated in FIG. The display device can be enlarged based on a predetermined position in the area where the GUI 2330 is displayed. At this time, the motion in which both hands are separated may be a motion in which both hands are moved away from each other, and may be a motion in which one hand is fixed and only the other hand is moved.

  In addition, when a motion in which both hands approach each other is input in a state where the two-hand input guide GUI 2330 is displayed in one area on the display screen, the control unit 140 uses a predetermined position in the area where the two-hand input guide GUI 2330 is displayed as a reference. You can zoom out. Here, the predetermined position in the area where the two-hand input guide GUI 2330 is displayed may be a position that becomes the center point or the center of the weight of the area where the two-hand input guide GUI is displayed.

  According to still another embodiment of the present invention, the two-hand input guide GUI is not a circular GUI, as shown in FIGS. 23 to 25, but two pointers 2630-1 and 2630-2 as shown in FIG. May be realized. At this time, each of the two pointers 2630-1 and 2630-2 may be one of a circle, an ellipse, a palm shape, and an arrow shape, but is not limited thereto.

  At this time, of course, when a motion in which both hands are separated from each other in a state where the two pointers 2630-1 and 2630-2 are displayed in one area on the display screen, the control unit 140 receives the two pointers 2630-1, The zoom-in is performed based on a predetermined position related to 2630-2. Note that when a motion in which both hands approach each other is input in a state where the two pointers 2630-1 and 2630-2 are displayed in one area on the display screen, the control unit 140 causes the two pointers 2630-1 and 2630-2 to be input. Zoom-out can be performed with reference to a predetermined position related to. Here, the predetermined position related to the two pointers is a center point of a straight line connecting the two pointers or a center point of a figure (for example, a circle, an ellipse, a triangle, a square, etc.) including an outline line including the two pointers. It can be set to the center point of weight. Note that one of the two pointers can be set to a predetermined position. In this case, the pointer corresponding to the non-moving hand out of the two hands corresponding to the two pointers may be the reference, and the display screen may be enlarged or reduced according to the movement of the moving hand.

  However, when two pointers 2630-1 and 2630-2 are displayed, when only one hand moves, the position of the pointer corresponding to the moved hand is moved according to the movement of one hand, and both hands move. Both the positions of the two pointers are moved. While the position of the pointer moves, the display screen is enlarged or reduced.

As described above, the user can more intuitively and conveniently enlarge / reduce the screen using both hands, and enlarge the screen using multi-touch that can be executed on a display device capable of touch input. / Provides a user experience similar to reduction.
FIG. 27 is a flowchart for explaining a method for performing a motion task using both hands according to an embodiment of the present invention.

  First, the display apparatus 100 determines whether a two-hand start command is input (S2710). At this time, the two-hand start command may be sequentially input by one hand or both hands may be input simultaneously.

  Specifically, when a motion start command using one hand is input after a motion start command using one hand is input via the motion input unit 120, the display apparatus 100 recognizes that a two-hand start command is input. can do. Alternatively, when a shake motion that simultaneously shakes both hands in the left-right direction through the motion input unit 120 is input, the display apparatus 100 can recognize that a both-hands start command has been input.

  When a two-hand start command is input (S2710-Y), the display apparatus 100 switches the control mode of the display apparatus 100 to the two-hand task mode (S2720). At this time, the two-hand task mode is a mode for controlling the display apparatus 100 using the motion of both hands, and the two-hand task may include a task for enlarging or reducing the display screen.

When switching to the two-handed task mode, the display apparatus 100 generates and displays a two-handed input guide GUI for performing a two-handed task (S2730). At this time, the two-hand input guide GUI may be a circular GUI 2330 as shown in FIG. 23, or may be two pointer GUIs 2630-1 and 2630-2 as shown in FIG. However, this is merely an embodiment, and a GUI having another shape may be used as long as it can intuitively recognize the position of both hands of the user, such as an ellipse, a triangle, a square, and a straight line.
Then, the display apparatus 100 performs a two-hand task using the two-hand input guide GUI (S2740).

  Specifically, when the two-hand input guide GUI is a circular GUI, the display apparatus 100 moves the circular GUI when a motion is input through the motion input unit 120 while moving both hands while maintaining a constant interval. be able to. When a motion in which both hands are separated or approached is input, the display apparatus 100 can enlarge or reduce the display screen based on the point where the circular GUI is displayed.

  Alternatively, when the two-hand input guide GUI is two pointers, when a motion in which one hand is moved is input via the motion input unit 120, the display apparatus 100 displays a pointer corresponding to the moved hand among the two pointers. Move. When a motion in which both hands are separated or approached is input, the display apparatus 100 can enlarge or reduce the display screen based on the midpoint between the two pointers.

According to various embodiments of the present invention as described above, a user can perform a display screen enlargement / reduction function more intuitively and conveniently using a two-hand control GUI, and a display device capable of touch input. Provides a user experience similar to screen scaling using multi-touch that can be performed at
Hereinafter, an embodiment in which a feedback message for guiding a voice error is randomly output will be described with reference to FIGS.

  When the voice start command is input, the control unit 140 switches the control mode of the display apparatus 100 to the voice task mode. At this time, the voice task mode is a mode in which the display apparatus 100 is controlled by a user voice input via the voice input unit 110.

  The voice start command is a user voice command including a preset word input via the voice input unit 110 included in the display device 100 (hereinafter referred to as “first voice start command”), It may be a user command (hereinafter referred to as “second voice start command”) for pressing a preset button included in an external device (for example, a remote controller) linked to the display device 100. In particular, when the first voice start command is input, the control unit 140 switches the mode of the display apparatus 100 to the first voice task mode. At this time, the first voice task mode is a voice task mode controlled in accordance with the user voice input to the voice input unit of the display apparatus 100. When the second voice start command is input, the control unit 140 switches the control mode of the display apparatus 100 to the second voice task mode. The second voice task mode is a voice task mode that is controlled in accordance with a user voice input to an external device that is linked to the display apparatus 100. In particular, in the second voice task mode, the user's voice may be input while the voice input button provided on the external device is pressed.

  When the mode of the display apparatus 100 is switched to one of the first voice task mode and the second voice task mode, the control unit 140 displays voice guide information for guiding user voice for performing the voice task mode. The display unit 193 is controlled. At this time, the voice guide information 400 includes a mode guide icon 2810 indicating the current display device mode and a plurality of voice command words 2821 to 2827 for guiding the voice of the user, as shown in the lower part of FIG. The plurality of voice command words include a power-off voice command word 2821, an external input voice command word 2822, a channel shortcut voice command word 2823, a channel up / down (UP / DOWN) voice command word 2824, a volume amplifier / down (UP / DOWN) voice command word 2825, mute voice command word 2826, and MORE voice command word 2827 may be included. Here, the MORE voice command word 2827 is a command word for further viewing a voice command word other than the displayed voice command word.

  The mode guide icon 2810 differs depending on the first voice task mode and the second voice task mode. For example, the mode guide icon 2810 in the first voice task mode may include a microphone-shaped icon, and the mode guide icon 2810 in the second voice task mode may include a remote-controlled icon.

  When a voice recognition error occurs during the voice task using the voice guide information 2800, the control unit 140 displays one of a plurality of feedback messages 2850 for guiding the voice recognition error as shown in FIG. To do. Here, when a voice recognition error occurs, if the user's voice input via the voice input unit 110 is too low, the user's voice input via the voice input unit 110 is recognized as a result of recognition. It may include at least one of a case where there is no command word matching in the database and a case where the user is not familiar with the operation.

  In particular, the control unit 140 may display the feedback message 2850 differently depending on the voice task mode and the type of voice recognition error.

  Specifically, the controller 140 may display the feedback message differently depending on whether a voice recognition error has occurred in the first voice task mode and a voice recognition error has occurred in the second voice task mode. . For example, in the case of a voice recognition error in the first voice task mode, the controller 140 can display one of a plurality of feedback messages 2901 to 2913 shown in FIG. In the case of a voice recognition error in the second voice task mode, the controller 140 may display one of a plurality of feedback messages 3001 to 3015, 3101 to 3107, 3201 to 3206 shown in FIGS.

  The control unit 140 can display the feedback message 450 differently depending on the type of voice recognition error in the second voice task mode. For example, the user's voice cannot be recognized because the recognition result of the user's voice input via the voice input unit 110 has no command word that matches the voice database or the user's voice is smaller than a preset value. In this case, the controller 140 may display one of a plurality of feedback messages 3001 to 3015 shown in FIG. When the voice input button of the external device is continuously pressed after the user voice is input, the control unit 140 can display one of the plurality of feedback messages 3101 to 3107 shown in FIG. If the user's voice is not inputted for a preset time after pressing the voice input button of the external device, the control unit 140 displays one of a plurality of feedback messages 3201 to 3206 shown in FIG. be able to.

  In particular, the controller 140 may display a default feedback message according to the voice task mode and the type of voice recognition error when the first voice recognition occurs. For example, when a voice recognition error occurs in the first voice task mode, the control unit 140 can display “Please speak again” which is the first message 2901 among a plurality of feedback messages as shown in FIG. . When the user voice input in the second voice task mode is not recognized, the control unit 140 can display “Please speak again” which is the first message 3001 among the plurality of feedback messages shown in FIG. . In the second voice task mode, when the voice input button is pressed for a preset time after the user voice input, the control unit 140 displays the first message 3101 among a plurality of feedback messages as shown in FIG. You can display “Release the button”. If no user voice is input for a preset time after pressing the voice input button in the second voice task mode, the control unit 140 receives a first message 3201 from among a plurality of feedback messages as shown in FIG. A certain “Please tell me your desired order” can be displayed.

  On the other hand, as described above, the default feedback message according to the voice task mode and the type of the voice recognition error may be set at the time of manufacturing and may be changed by a user operation.

  When a repeated speech recognition error occurs, the controller 140 can display one of the remaining messages except the default feedback message at random. For example, when a repeated voice recognition error occurs in the first voice task mode, the control unit 140 can randomly display one of the remaining messages 2902 to 2913 except for the first message 2901 shown in FIG. If the user voice input in the second voice task mode cannot be repeatedly recognized, the control unit 140 may randomly display one of the remaining messages 3002 to 3015 except the first message 3001 shown in FIG. Can do. When the voice input button is continuously pressed even after the user voice is input in the second voice task mode, the control unit 140 sets one of the remaining messages 3102 to 3107 except the first message 3101 shown in FIG. 31 for a preset time. It can be displayed at random (for example, every 10 seconds). When the user voice is not inputted for a preset time after the voice input button is pressed in the second voice task mode, the control unit 140 determines the remaining messages 3202 except for the first message 3201 as shown in FIG. 1 to 3206 can be randomly displayed every preset time (for example, 10 seconds).

  As described above, the plurality of feedback messages are provided so as to be different for each voice recognition error and each voice task mode, so that the user can accurately check the voice recognition error. In addition, the effect that a user can interact with a display apparatus can be obtained, and an entertainment factor increases.

  FIG. 33 is a flowchart illustrating a method for providing a feedback message when a voice recognition error occurs in the display apparatus 100 according to an embodiment of the present invention.

  First, the display apparatus 100 determines whether a voice start command has been input (S3310). At this time, the voice start command includes a preset word input through the voice input unit 110 provided in the display device 100 as a user command for switching the control mode of the display device 100 to the voice task mode. A first voice start command that is a user voice command and a second voice start command that is a user command to press a preset button included in an external device (for example, a remote controller) linked to the display apparatus 100 may be included. .

  When the voice start command is input (S3310-Y), the display apparatus 100 switches the control mode of the display apparatus 100 to the voice task mode (S3320). At this time, if the input voice start command is the first voice start command, the display apparatus 100 switches to the first voice task mode controlled by the user voice input via the voice input unit 110 of the display apparatus 100. When the input voice start command is the second voice start command, the display apparatus 100 switches to the second voice task mode controlled by the user voice input via the voice input unit 110 of the external device.

  During the voice task mode, the display apparatus 100 determines whether a voice recognition error has occurred (S3330). At this time, if a voice recognition error has occurred, if the user's voice input through the voice input unit 110 is smaller than a preset value, the user's input through the voice input unit 110 As a result of recognizing the voice, at least one of a case where a command word matching the voice database is present and a case where the user is not familiar with the operation may be included.

When a voice recognition error occurs (S3330-Y), the display apparatus 100 displays one of a plurality of feedback messages (S3340). At this time, the feedback message may be displayed differently for each voice task and each voice recognition error. For example, when a voice recognition error occurs in the first voice task mode, the display apparatus 100 displays one of a plurality of feedback messages 2901 to 2913 shown in FIG. Alternatively, when a voice recognition error occurs in the second voice task mode, the display apparatus 100 displays one of a plurality of feedback messages 3001 to 3015, 3101 to 3107, 3201 to 3206 shown in FIGS. be able to. At this time, when a voice recognition error occurs first, the display apparatus 100 can display a default feedback message among a plurality of feedback messages.
The display apparatus 100 determines whether a voice recognition error has repeatedly occurred (S3350).

  When the voice recognition error occurs repeatedly (S3350-Y), the display apparatus 100 can display other feedback messages among a plurality of feedback messages at random (S3360). For example, when a repeated voice recognition error occurs in the first voice task mode, the display apparatus 100 can randomly display one of the remaining messages 2902 to 2913 except for the first message 2901 shown in FIG. When the user voice input in the second voice task mode cannot be repeatedly recognized, the display apparatus 100 randomly displays one of the remaining messages 3002 to 3015 except the first message 3001 shown in FIG. can do. When the voice input button is continuously pressed after the user voice is input in the second voice task mode, the display apparatus 100 sets one of the remaining messages 3102 to 3107 except the first message 3101 shown in FIG. 31 for a preset time. It can be displayed at random (for example, every 10 seconds). After the user presses the voice input button in the second voice task mode, if no user voice is continuously input for a preset time, the display apparatus 100 displays the remaining messages 3202 to 3206 except for the first message 3201 shown in FIG. One of these can be randomly displayed every preset time (for example, 10 seconds).

  As described above, the plurality of feedback messages are provided so as to be different for each voice recognition error and each voice task mode, so that the user can accurately check the voice recognition error. In addition, the effect that the user can interact with the display device can be obtained, and the entertainment factor increases.

  Hereinafter, an embodiment in which different guide information is provided according to an application or different guide information is provided according to a user's preference will be described with reference to FIGS.

  The control unit 140 determines whether a voice start command for shifting to the voice task mode is input. When the voice start command is input, the control unit 140 switches the mode of the display apparatus 100 to the voice task mode. At this time, the voice task mode is a mode in which the display device is controlled by a user voice command input by the voice input unit 110. As described above, instead of the voice start command, another type of user command for starting the voice task mode can be utilized. Another type of user command may include remote control specific button input, display device 100 specific button input, user specific motion, and the like. When the voice task mode is switched, the control unit 150 displays voice guide information on the display screen. At this time, the voice guide information includes a plurality of voice command words for guiding user voice input in order to perform the voice task mode on the display apparatus 100.

  And if a user's specific command is input, the control part 140 will change at least 1 among the several command words contained in the audio | voice guide information to another voice command word. At this time, the user specific command may be a user command for executing a specific application or a user command for displaying a voice command word of a user preference.

  In particular, in the voice guide information, a part of voice command words (for example, “power-off” voice command words) of a plurality of voice command words is fixedly displayed, and a voice command word is variable. The change instruction word area to be changed to Therefore, when a user's specific command is input, the control unit 140 can change the voice command word included in the change command word area in the voice guide information to another command word.

  As an embodiment of the present invention, when a user command for executing a specific application is input, the control unit 140 executes the application corresponding to the user command. Then, the control unit 140 can change at least one command word among a plurality of voice command words included in the voice guide information to a voice command word necessary for an application currently being executed.

  At this time, voice command words necessary for the application are stored in the storage unit 130 of the display apparatus 100 when the application is installed. When an application execution command is input, the control unit 140 can read a voice command word necessary for the application stored in the storage unit 130 and display the voice command word on the display unit 193.

  As another embodiment of the present invention, when a user command for displaying a user-preferred voice command word is input, the control unit 140 may select at least one of a plurality of voice command words included in the voice guide information. The command word can be changed to a user-spoken voice command word. At this time, the voice command word preferred by the user may be a voice command word registered in advance by the user using the voice command word setting menu.

  The changed voice guide information may include a voice command word for switching to the voice guide information before the change. For example, the voice command word for switching to the voice guide information before the change may include an “end” voice command word.

  Therefore, the user can perform the voice task mode using the voice guide information optimized for each application and each user preference. Specific embodiments of the present invention will be described in more detail below with reference to FIGS.

  As an embodiment of the present invention, the control unit 140 receives a broadcast signal transmitted from an external broadcast station via the broadcast receiving unit 150 and performs signal processing on the received broadcast signal. Then, as shown in FIG. 34, the control unit 140 displays the broadcast video subjected to signal processing on the display unit 193.

  When a voice start command is input via the voice input unit 110, the control unit 140 recognizes the voice start command and switches to the voice task mode. At this time, the voice start command is a user command for switching to the voice task mode, and the voice task mode is a mode controlled by the user voice input to the voice input unit 110 by the display device 100. At this time, another type of user command for starting the voice task mode can be used instead of the voice start command. Another type of user command may include remote controller specific button input, display device 100 specific button input, user specific motion, and the like.

  Then, when switching to the voice task mode, the control unit 140 displays first voice guide information 3500 for performing the voice task mode, as shown in FIG. At this time, the first audio guide information 3500 is displayed in the lower part of the screen on which the broadcast video is displayed.

  The first voice guide information 3500 includes an icon 3510 for notifying that the current display device mode is the voice task mode, and a plurality of voice command words 3521 to 3526, 3530 for guiding the voice of the user. The plurality of voice command words include a power-off voice command word 3521, an external input voice command word 3522, a channel shortcut voice command word 3523, a channel up / down (UP / DOWN) voice command word 3524, a volume amplifier / down (UP / DOWN) voice command word 3525, mute voice command word 3526, and MORE voice command word 3530 may be included. The MORE voice command word 3530 is a command word for further viewing a voice command word other than the displayed voice command word. At this time, the power-off voice command word 3521 and the MORE voice command word 3530 are located in the fixed command word area displayed in a fixed manner, and the external input voice command word 3522, the channel shortcut voice command word 3523, the channel up / down (UP) / DOWN) voice command word 3524, volume amplifier / down (UP / DOWN) voice command word 3525, and mute voice command word 3526 can be located in a change command word area that can be variably changed.

  When a map application execution command is input, the control unit 140 executes the map application and changes the first voice guide information 3500 to the second voice guide information 3600 corresponding to the map application, as shown in FIG. .

  Specifically, when the map application is executed, the control unit 140 reads a voice command word corresponding to the map application stored in the storage unit 130. Then, the control unit 140 changes the voice command word displayed in the change item area to the read voice command word.

For example, as shown in FIG. 36, the control unit 140 displays the power-off voice command word 3621 and the MORE voice command word 3630 displayed in the fixed command word area as they are. Then, the control unit 140 displays an external input voice command word 3522, a channel shortcut voice command word 3523, a channel up / down (UP / DOWN) voice command word 3524, a volume amplifier / down (UP) displayed in the change command word area. / DOWN) voice command word 3525 and mute voice command word 3526 can be changed to external input voice command word 3522, location search voice command word 3623, route search voice command word 3624 and end voice command word 3625. At this time, the end voice command word 3625 is a voice command word for guiding the user voice input for returning to the voice guide information before the change. At this time, when the termination voice command word 3625 is executed, the control unit 140 can also terminate the application at the same time.
Therefore, the user can easily confirm the functions that can be used using the map application through the voice guide information.

  As yet another embodiment of the present invention, as shown in FIG. 35, a user command for executing a user-preferred voice command word with the first voice guide information displayed (for example, a user voice “Favorite”). ) Is input, the control unit 140 changes the voice guide information 3500 to the third voice guide information 3700 including the user-preferred voice command as shown in FIG. Specifically, when a user command for executing a user-preferred voice command word is input, the control unit 140 reads the user-preferred voice command word stored in the storage unit 130. Then, the control unit 140 changes the voice command word displayed in the change command word area to the read voice command word.

For example, as shown in FIG. 37, the control unit 140 displays the power-off voice command word 3721 and the MORE voice command word 3730 displayed in the fixed command word area as they are. Then, the control unit 140 displays an external input voice command word 3522, a channel shortcut voice command word 3523, a channel up / down (UP / DOWN) voice command word 3524, a volume amplifier / down (UP /) displayed in the change item area. DOWN) voice command word 3525 and mute voice command word 3526 may be changed to Internet voice command word 3722, 3D voice command word 3723, program guide voice command word 3724 and end voice command word 3725 which are user preferred voice command words. it can. At this time, the end voice command word 3725 is a voice command word for guiding user voice input for returning to the first voice guide information before the change.
Accordingly, the user can display the display apparatus 100 using his / her preferred voice command.
FIG. 38 is a flowchart for explaining a method for changing a voice command word using voice guide information according to an embodiment of the present invention.

  First, the display apparatus 100 determines whether a voice start command has been input (S3810). At this time, the voice start command is a user command for switching the mode of the display apparatus 100 to the voice task mode.

  When the voice start command is input (S3810-Y), the display apparatus 100 switches the control mode of the display apparatus 100 to the voice task mode (S3820). At this time, the voice task mode is a mode in which the display apparatus 100 is controlled by a user voice input via the voice input unit 110.

  When switching to the voice task mode, the display apparatus 100 displays voice guide information (S3830). At this time, when the display apparatus 100 performs a broadcast reception function, the voice guide information includes a voice command word for controlling the broadcast reception function.

  Then, the display apparatus 100 determines whether a user command for changing a voice command word is input (S3840). For example, the display apparatus 100 determines whether a user command for executing a specific application (for example, a map application) is input and whether a user command for displaying a user-preferred voice command is input. To do.

  If it is determined that the user command for changing the voice command word is input (S3840-Y), the display apparatus 100 changes at least one of the voice command words included in the voice guide information (S3850). At this time, at least one voice command word to be changed may be a voice command word displayed in the change command word area among the voice command words included in the voice guide information.

For example, when the user command for changing the voice command word is a user command for executing the specific application, the display apparatus 100 displays the voice command displayed in the change command word area among the voice command words included in the voice guide information. The word can be changed to a voice command word corresponding to a specific application. Alternatively, when the user command for changing the voice command word is a user command for displaying a voice command word preferred by the user, the display apparatus 100 displays the command command included in the voice guide information in the change command word area. The voice command word thus made can be changed to a user-preferred voice command word.
The display apparatus 100 performs a voice task using the changed voice guide information (S3860).

  As described above, by providing different voice guide information depending on the application executed on the display device and the user preference, the user can control the electronic device more conveniently and efficiently.

  On the other hand, in FIG. 34 to FIG. 38, it has been described that the voice guide information is changed. However, this is only an embodiment, and the motion command word included in the motion guide information for performing the motion task mode is changed. These embodiments may also be included in the technical idea of the present invention.

  Specifically, when a motion start command is input via the motion input unit 120, the control unit 140 switches the display device mode to a motion task mode controlled by user motion. The control unit 140 displays motion guide information including a plurality of motion command words for performing the motion task mode on the display device 100.

  When an application execution command is input in a state where the motion guide information is displayed, the control unit 140 can change the motion command to a motion command corresponding to at least one of the plurality of motion commands. .

  As described above, the user can control the electronic device more conveniently and efficiently by changing and providing the voice command word according to the application executed on the display device.

  On the other hand, in the above-described embodiment, a remote controller is assumed as an external device for controlling the display device 100. However, this is only one embodiment, and a display is performed using a portable terminal device such as a smartphone or a PDA. The device 100 can be controlled.

  Program codes for performing control methods according to various embodiments as described above may be stored in various types of recording media. Specifically, RAM (Random Access Memory), flash memory, ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electronically Erasable and Programmable ROM), register, hard disk, memory disk, rim It may be stored in various types of recording media that can be read by a terminal such as a CD-ROM.

  The preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, but the present invention is not limited to the above embodiments. It is obvious that a person having ordinary knowledge in the technical field to which the present invention belongs can come up with various changes or modifications within the scope of the technical spirit described in the claims. Of course, it is understood that these also belong to the technical scope of the present invention.

DESCRIPTION OF SYMBOLS 100 Display apparatus 110 Audio | voice input part 120 Motion input part 130 Storage part 140 Control part 150 Broadcast receiving part 160 External terminal input part 170 Remote control signal receiving part 180 Network interface part 190 Output part 193 Display part 200 Relay apparatus 300 External apparatus

Claims (14)

In the field angle setting method of the display device,
When a preset event occurs, displaying an angle of view guide UI for guiding setting of a camera angle of view connected to the display device in an area of the display screen;
And a step of setting an angle of view of the camera using the angle of view guide UI. The angle of view guide UI is
2. The angle-of-view setting method according to claim 1, wherein no display is performed when an event for shifting to the motion task mode occurs. The angle of view guide UI is
The angle-of-view setting method according to claim 1, further comprising a screen for displaying an image photographed by the camera at the time of setting the angle of view. The setting step includes:
Adjusting the camera so that the angle of view of the camera automatically moves in a preset speed and direction;
The method according to claim 1, further comprising: setting an angle of view at the time when the user command is input to the angle of view of the camera when a user command is input while adjusting the camera. How to set the angle of view. The setting step includes:
Adjusting the camera by a user operation using an external device;
The method according to claim 1, further comprising: setting an angle of view at the time when the user command is input to the angle of view of the camera when a user command is input while adjusting the camera. How to set the angle of view. The preset event is:
An event in which power is applied to the display device at the time of initial installation of the display device, an event in which a motion task mode is turned on, an event in which an angle of view setting menu is selected from the control menu of the display device The angle-of-view setting method according to claim 1, wherein the angle of view is one of them. The camera
The angle-of-view setting method according to claim 1, wherein the angle-of-view setting method is a camera that captures a user motion for controlling the display device in a motion task mode. In the display device,
A camera that captures the user's motion;
A display unit;
When a preset event occurs, a field angle guide UI for guiding setting of the camera field angle is displayed in one area of the display unit, and control for setting the field angle of the camera using the field angle guide UI is performed. And a display device. The controller is
The display device according to claim 8, wherein the screen provided by the display device is displayed without displaying the angle-of-view guide UI even when shifting to the motion task mode. The angle of view guide UI is
The display apparatus according to claim 8, further comprising a screen that displays an image captured by the camera when the angle of view is set. The controller is
When the camera command is adjusted so that the angle of view of the camera automatically moves in a preset speed and direction, and a user command is input while adjusting the camera, the user command is input The display device according to claim 8, wherein the angle of view of the camera is set to the angle of view of the camera. The controller is
The camera is adjusted by a user operation using an external device, and when a user command is input while adjusting the camera, the angle of view at the time when the user command is input is set as the angle of view of the camera. The display device according to claim 8, wherein: The preset event is:
An event in which power is applied to the display device at the time of initial installation of the display device, an event in which a motion task mode is turned on, an event in which an angle of view setting menu is selected from the control menu of the display device The display device according to claim 8, wherein the display device is one of them. The camera
The display apparatus according to claim 8, wherein the display apparatus is a camera that captures a user motion for controlling the display apparatus in a motion task mode.

Images