KR102026728B1 - Media system, electronic device and method of providing screen interface feedback - Google Patents

Abstract

Disclosed are a media system, an electronic device, and a screen interface feedback method. The media system includes an electronic device, a display and a remote control device, the electronic device instructs the display to display content, receives a transmission from the remote control device indicating that the grab button of the remote control device has been pressed, and transmits the transmission. In response to receiving, it operates to provide graphical feedback indicating that the screen of the display has been touched.

Description

Media system, electronic device and method of providing screen interface feedback

The present invention relates to a media system, an electronic device, and a screen interface feedback method. More particularly, the present invention relates to a media system, an electronic device, and a screen interface feedback method for providing screen interface feedback for a user operation to a remote control device. will be.

As the use of various multimedia devices is generalized, a remote control device for easily operating a desired multimedia device at a long distance is widely used because of its convenience compared to its price. However, with the explosive spread of multimedia displays with larger displays and more complex functions, operations by remote control devices are becoming increasingly difficult and complex.

For example, if the user wants to change the color of the screen through the TV, the user must press a particular button on the remote control to launch the desired menu, select the desired menu from the menus with the direction buttons on the remote control, and then After adjusting the desired value in the lower menu, press the specific button on the remote control again to complete the operation and return to the upper menu, and press the specific button on the remote control again to exit the menu screen. do.

On the other hand, the integration of several functions into a limited-size remote control device increases the number and type of buttons, making it difficult to remember the functions correctly. In some cases, multiple functions can be selectively used on a single button. It is also difficult to do. First of all, there are many types of buttons, but many operations are possible, but the necessity of new input means is increasing because the size of the remote control device is large, difficult to manage, and high in cost.

On the other hand, VOD (Video On Demand) system to select a desired channel among various channels, multimedia player connected to a display device to perform multimedia playback, and IPTV that can acquire and exchange information according to internet connection are rapidly increasing. As it is increasingly difficult to effectively use services that provide a variety of functions through input using a simple remote controller, alternatives such as using a wireless keyboard or a wireless mouse have emerged. However, remote control devices have been used in terms of cost, portability, and ease of use. It is considered difficult to replace.

 In order to solve the above problems, researches are being conducted to apply various types of wireless pointing devices to a computer or a multimedia home appliance.

SUMMARY OF THE INVENTION The present invention provides a media system, an electronic device, a remote control device, and a method for adjusting the zoom of content, which can provide a user with a function to conveniently and easily adjust the zoom of the displayed content. There is.

Another technical problem to be solved by the present invention is a media system, an electronic device, and a remote control, which provide a function to conveniently and easily adjust the zoom of the displayed content according to a usage pattern, a grab pattern, and a movement pattern of a user's remote control device. It is to provide a method for adjusting the zoom of the device and content.

Another technical problem to be solved by the present invention is a media system, an electronic device, and a remote control device for easily selecting a channel list among various graphic objects displayed on a screen, and easily searching and selecting a channel included in the selected channel list. And a method for moving a channel list.

Another technical problem to be solved by the present invention is a media system, an electronic device, and a remote control device for easily searching and selecting a channel included in a channel list according to a usage pattern, a grab pattern, and a movement pattern of a user's remote control device. And a method for moving a channel list.

Another object of the present invention is to provide a media system, an electronic device, a remote control device, and a screen interface feedback method that provide an effect and a function such as a remote user touching a screen.

Another technical problem to be solved by the present invention is a media system, an electronic device, a remote control device, and a screen interface feedback method capable of easily searching and switching channels according to a usage pattern, a grab pattern, and a movement pattern of a user's remote control device. To provide.

In order to achieve the above technical problem, a method for adjusting the zoom of content according to the present invention is directed to a method for adjusting the zoom of content using a media system including a display and a remote control device for providing motion information. The method includes: displaying content on a screen of the display; receiving a transmission from the remote control device; the transmission includes a down signal of a first button and a down signal of a second button of the remote control device; Checking whether there is a signal, and adjusting a zoom of the displayed content based on motion information included in the received transmission, when the down signal of the first button and the down signal of the second button are included. It may include. Here, the first button and the second button may be disposed on different surfaces of the remote control device. The first button may be disposed on the rear surface of the remote control device, and the second button may be disposed on the front surface of the remote control device. Other buttons may not be disposed on the surface where the first button is disposed, and other buttons may be disposed on the surface where the second button is disposed. The first button may be a grab button, and the second button may be an ok button.

The displayed content may include at least one of a web page, an application, a broadcast program, a video, a photo, an image, and an icon.

The displayed content may include at least one of content stored in a local storage area, a real time broadcast program, content transmitted through streaming, downloaded content, and content captured by a camera included in the media system.

The adjusting of the zoom may be performed based on at least one of motion information on a first axis corresponding to a vertical axis of the screen included in the motion information and motion information on a second axis corresponding to an axis perpendicular to the screen. Adjusting the zoom of the content may be included.

The adjusting of the zoom may include: zooming in the content when the motion information on the first axis indicates a motion in an upward direction on the first axis, and the motion information on the first axis is stored in the first axis. When instructing movement in a downward direction on one axis, the method may include zooming out the content.

The adjusting of the zoom may include: zooming in the content when the motion information on the second axis indicates a motion away from the screen, and the motion information on the second axis is closer to the screen. When instructing movement in a losing direction, the method may include zooming out the content.

The adjusting of the zoom may include: when the motion information on the first axis indicates a motion in an upward direction on the first axis, and when the motion information on the second axis indicates a motion away from the screen. Zooming in the content, and the motion information on the first axis indicates a downward movement on the first axis, and the motion information on the second axis is moved closer to the screen. If instructed, the method may include zooming out the content.

The method for adjusting the zoom of the content further includes checking whether the transmission includes at least one of an up signal of a first button and an up signal of a second button of the remote control device. When at least one of the up signal of the first button and the up signal of the second button is included, the adjusting of the zoom may be stopped.

In the method for adjusting the zoom of the content, when the down signal of the first button and the down signal of the second button are not included, the position of the pointer displayed on the screen is based on the motion information included in the transmission. It may further comprise the step of adjusting to.

The method for adjusting the zoom of the content may include providing graphic feedback indicating that the screen is touched when the down signal of the first button is included and the down signal of the second button is not included. It may further include.

The method for adjusting the zoom of the content may include dragging the selected graphic object based on the motion information when the down signal of the first button is not included and the down signal of the second button is included. It may further include.

According to another aspect of the present invention, there is provided a remote control apparatus for controlling an electronic device, the remote control apparatus comprising: motion information for sensing a movement of the remote control apparatus and instructing the sensed movement A sensor unit generating a sensor signal including a first button and a second button disposed on different surfaces of the remote control device, wherein the user action is performed on at least one of the first button and the second button; A user interface unit configured to detect a user signal, generating a down signal of the first button in response to detecting a user action of pressing the first button, and receiving a down signal of the second button in response to detecting a user action of pressing the second button. And generating an up signal of the first button in response to detecting a user action of releasing the first button, and releasing the second button. A controller configured to generate an up signal of the second button in response to the self action detection, motion information included in the generated sensor signal, a down signal of the generated first button, a down signal of the generated second button, The apparatus may include a communication unit configured to transmit the generated up signal of the first button and up signal of the generated second button to the electronic device.

According to another aspect of the present invention, there is provided an electronic device, comprising: a communication unit for receiving a transmission from a remote control device; and an electronic device for instructing display of content on a display; And a control unit for controlling an instruction and controlling an adjustment of the zoom of the content displayed on the screen of the display based on the motion information included in the received transmission.

The electronic device may further include the display.

In accordance with another aspect of the present invention, there is provided a media system according to the present invention, wherein the media system includes an electronic device, a display, and a remote control device. Instruct a display to display content, receive a transmission from the remote control device indicating that the first and second buttons of the remote control device have been pressed, and in response to the reception, to the transmission of the remote control device. The electronic device may operate to adjust a zoom of content displayed on the screen of the display based on the included motion information.

The electronic device may be operable to determine whether to perform a zoom operation according to the type of content displayed on the screen of the display.

The electronic device and the display may be physically integrated devices or physically independent devices, respectively.

In order to achieve the above technical problem, a method for moving a channel list according to the present invention includes moving thumbnails included in a channel list using a media system including a display and a remote control device for providing motion information. A method for receiving, the method comprising: receiving a transmission from the remote control indicating that the grab button of the remote control has been pressed, and in response to receiving the transmission, a channel list is being displayed on the screen of the display. Checking whether the channel list is being displayed, providing graphic feedback indicating that the displayed channel list has been selected, and providing motion information indicating movement of the remote control device from the remote control device. Inclusive transmission Receiving, and in response to the received response to the motion information can include a moving of a thumbnail included in the selected channel list.

The screen of the display may simultaneously display a broadcast program and a channel list.

The method for moving the channel list may further include providing graphical feedback indicating that the screen of the display is touched when the channel list is not being displayed.

Each thumbnail included in the channel list may be associated with a specific channel.

The graphic feedback may include at least one of highlighting an area in which the channel list is displayed, decreasing an area in which the channel list is displayed, and shrinking and expanding an area in which the channel list is displayed. have.

The direction and speed at which the thumbnails move may vary according to the direction and speed of the movement of the remote control device.

When the movement speed of the remote control device exceeds a preset speed, the thumbnail is moved above a predetermined speed for a preset time, and when the preset time elapses, the movement speed is decreased and the movement is decreased. You can stop.

The method for moving the channel list further comprises receiving a transmission from the remote control device indicating that the grab button has been released, and deselecting the selected channel list in response to the receiving. Can be.

The method for moving the channel list may further include adjusting a position of the pointer displayed on the screen based on the motion information when the selection of the channel list is released.

The method for moving the channel list comprises the steps of: receiving from the remote control a transmission indicating that an OK button of the remote control has been pressed, and in response to receiving the pointer, the position adjusted pointer The method may further include displaying a broadcast program of a channel associated with a thumbnail on a channel list in which is located.

The method for moving the channel list may include: tuning a channel, receiving a broadcast program of the tuned channel, generating a thumbnail using an image of the received broadcast program, and storing the generated thumbnail. And changing the tuned channel to another channel, wherein the thumbnail included in the channel list may be the stored thumbnail.

Tuning the channel may include tuning the channel based on a channel number of a broadcast program displayed on a screen of the display.

According to another aspect of the present invention, there is provided an electronic device that transmits content indicating that a grab button of the remote control device is pressed from the remote control device in an electronic device instructing to display content on a display. And a communication unit for receiving a transmission including movement information indicating movement of the remote control device, and in response to receiving a transmission indicating that the grab button has been pressed, a channel list is being displayed on the screen of the display. Check whether the channel list is being displayed, control to provide graphical feedback indicating that the displayed channel list has been selected, and respond to the motion information in response to receiving a transmission comprising the motion information. According to the award Are the thumbnails contained in the selected channel list may include a control section for controlling to move.

The electronic device may further include the display.

In accordance with another aspect of the present invention, there is provided a media system, wherein the media system includes an electronic device, a display, and a remote control device. Receives a transmission from the control device indicating that the grab button of the remote control has been pressed, and in response to receiving the transmission, checks whether a channel list is being displayed on the screen of the display, and the channel list is If being displayed, provide a graphical feedback indicating that the displayed channel list has been selected, receive a transmission from the remote control device comprising motion information indicating movement of the remote control device, Help me in response According to the information being capable of operating so as to move the thumbnails included in the selected channel list.

The electronic device may include at least one of a tuner that receives a real time broadcast and a network interface that receives an IPTV broadcast.

According to another aspect of the present invention, there is provided a screen interface feedback method according to the present invention, the screen interface feedback method of a media system including a remote control apparatus and a display, the method comprising: displaying content on the display screen; Receiving from the remote control device a transmission indicating that the grab button of the remote control has been pressed, and providing graphical feedback indicating that the screen has been touched in response to the receiving.

The displaying may include displaying the content in a full screen mode in which the content is displayed on a full screen.

The providing of the graphic feedback may include displaying the content in a grab mode in which an area in which the content is displayed is shrunk.

The providing of the graphic feedback may include disappearing a cursor displayed on the screen, and displaying a still image of the content.

The content may be a real-time broadcast program.

The graphic feedback may be to shrink an area in which the real-time broadcast program is displayed and to display a real-time broadcast program of at least one channel different from the channel of the real-time broadcast program.

The area in which the real-time broadcast program is displayed may be reduced from at least one of the upper side, the lower side, the left side and the right side of the screen to the center.

The screen interface method may further include receiving a transmission including motion information indicating movement of the remote control device from the remote control device, the reduced area and the other channel according to the motion information in response to the reception. The method may further include moving the displayed area of the real-time broadcast program.

Depending on the direction and the speed of the movement of the remote control device, the direction and speed at which the reduced area and the area where the real-time broadcast program of the other channel is displayed may move may vary.

When the speed of the movement of the remote control device exceeds a preset speed, the still images of a plurality of channels are sequentially displayed for a preset time and moved over a predetermined speed, and when the preset time elapses, As the speed of the movement is decreased, the movement is stopped, and a real-time broadcast program of a channel associated with a still image displayed on the screen may be displayed on the screen while the movement is stopped. A plurality of still images among the still images may be simultaneously displayed on the screen. A plurality of still images simultaneously displayed on the screen may be displayed with mutual perspective.

The method for providing a screen interface includes receiving a transmission indicating that the grab button has been released from the remote control device while the displayed still images are moved, and stopping the movement in response to the receiving, The method may further include displaying a real-time broadcast program of a channel associated with a still image displayed on the screen in the stopped state.

The method for providing a screen interface may include: tuning a channel, receiving a real-time broadcast program of the tuned channel, generating a still image by using the image of the received real-time broadcast program, and storing the generated still image. And changing the tuned channel to another channel, wherein the stored still image may be displayed in an area where a real-time broadcast program of the other channel is displayed.

Tuning the channel may include tuning the channel based on the channel number of the real-time broadcast program displayed in the reduced area.

The method for providing a screen interface may further include receiving a transmission indicating that the pressed grab button has been released from the remote control device, and stopping the provided graphical feedback in response to the receiving.

In another aspect of the present invention, an electronic device according to the present invention, in an electronic device instructing to display content on a display, transmits a signal indicating that a grab button of the remote control device is pressed from a remote control device. And a control unit for controlling an indication of a display of content to the display and controlling to provide graphic feedback indicating that the screen of the display is touched in response to receiving the transmission. .

The electronic device may further include the display.

In accordance with another aspect of the present invention, there is provided a media system according to the present invention, wherein the media system includes an electronic device, a display, and a remote control device. Instruct a display to display content, receive a transmission from the remote control indicating that the grab button of the remote control has been pressed, and in response to receiving the graphic feedback indicating that the screen of the display has been touched. Can be operated to provide. The electronic device may include at least one of a tuner that receives a real time broadcast and a network interface that receives an IPTV broadcast.

According to the method for adjusting the zoom of a media system, an electronic device, a remote control device and a content according to the present invention, an effect similar to that of providing a grab button to a remote control device and touching the display screen for pressing the grab button To provide the user with the ability to conveniently and easily adjust the zoom of the content displayed on the remote screen, and adjust the content according to the placement of the grab button and the movement of the remote control device according to the user's body structure. Since the zoom is adjusted, a function of conveniently and easily adjusting the zoom of the displayed content according to the use pattern, the grab pattern, and the movement pattern of the user's remote control device may be provided.

According to the method for moving a media system, an electronic device, a remote control device, and a channel list according to the present invention, a grab button is provided to a remote control device, so that an effect similar to touching the display screen with respect to pressing the grab button is provided. It allows the user to easily select a list of channels displayed on the screen, to easily navigate and select channels included in the selected channel list, and to arrange the grab buttons and move the remote control device according to the user's body structure. Since the channel included in the content list is moved according to the above, the user can easily select a channel included in the channel list according to the usage pattern, grab pattern, and movement pattern of the user's remote control apparatus.

According to the media system, the electronic device, the remote control device, and the screen interface feedback method according to the present invention, by providing a grab button to the remote control device, an effect similar to touching the display screen with respect to the operation of pressing the grab button is far, In addition, the user can provide the same effects and functions as the user touches the screen, and provides a list of channels according to the movement of the remote control device. Can be easily navigated and switched.

1 is a block diagram showing the configuration of a preferred embodiment of a media system according to the present invention;
2 is a block diagram showing the configuration of a preferred embodiment of an electronic device according to the present invention;
Figure 3 is a block diagram showing the configuration of a preferred embodiment of a remote control device according to the present invention,
4 is a view showing an upper side view, a lower side view and a perspective view of a remote control device according to the present invention;
5 is a view for explaining the movement of the pointer according to the movement of the remote control device according to the present invention;
6 is a view for explaining the movement of the graphic object in accordance with the movement of the remote control device according to the present invention;
7 is a view for explaining the display of the menu according to the movement of the remote control device according to the present invention;
8 illustrates an embodiment of a screen on which content is displayed;
9 illustrates one embodiment of graphical feedback indicating that a screen of a display has been touched;
10 illustrates another embodiment of graphical feedback indicating that a screen of a display is touched;
11 illustrates another embodiment of graphical feedback indicating that a screen of a display is touched;
12 illustrates yet another embodiment of graphical feedback indicating that a screen of a display is touched;
13 is a view showing an embodiment in which the content displayed on the screen is moved in accordance with the movement of the remote control device according to the present invention;
14 is a view showing another embodiment in which the content displayed on the screen is moved according to the movement of the remote control apparatus according to the present invention;
15 is a view showing another embodiment in which the content displayed on the screen is moved according to the movement of the remote control apparatus according to the present invention;
FIG. 16 illustrates a screen on which a real-time broadcast program associated with content displayed on the screen of FIG. 15 is displayed;
17 is a diagram illustrating an embodiment in which a plurality of still images are displayed with mutual perspective;
18 is a flowchart illustrating a process of performing a preferred embodiment of a screen interface providing method according to the present invention;
19 illustrates another embodiment of a screen on which content is displayed;
20 is a diagram illustrating an embodiment of a screen on which content shown in FIG. 19 is zoomed in;
FIG. 21 is a diagram illustrating an embodiment of a screen on which content shown in FIG. 19 is zoomed out;
22 is a flowchart illustrating a process of performing a preferred temporary method for a method for adjusting a zoom of content according to the present invention;
FIG. 23 illustrates an embodiment of a screen on which a content list is displayed; FIG.
24 is a view showing another embodiment of a screen on which a content list is displayed;
25 illustrates one preferred embodiment for graphical feedback indicating that a content list has been selected;
FIG. 26 illustrates another embodiment for graphical feedback indicating that a content list has been selected; FIG.
27 is a diagram illustrating an embodiment in which an item included in a content list is moved according to a movement of a remote control apparatus according to the present invention;
28 is a view showing another embodiment in which an item included in a content list is moved according to the movement of a remote control apparatus according to the present invention;
29 is a view for explaining a process of selecting an item included in a displayed content list, and
30 is a flowchart illustrating a process of performing a preferred embodiment of the method for moving a channel list according to the present invention.

Hereinafter, with reference to the accompanying drawings, preferred embodiments of the present invention that can specifically realize the above object will be described. At this time, the configuration and operation of the present invention shown in the drawings and described by it will be described as at least one embodiment, by which the technical spirit of the present invention and its core configuration and operation is not limited.

The terms used in the present invention have been selected as general terms widely used as possible in consideration of the functions in the present invention, but may vary according to the intention or custom of a person skilled in the art or the emergence of a new technology. In addition, in certain cases, there is also a term arbitrarily selected by the applicant, in which case the meaning will be described in detail in the description of the invention. Therefore, it is intended that the terms used in the present invention should be defined based on the meanings of the terms and the general contents of the present invention rather than the names of the simple terms.

1 is a block diagram showing the configuration of a preferred embodiment of a media system according to the present invention.

Referring to FIG. 1, the media system 100 may include at least one of the electronic device 110, the display 130, and the remote control device 150. The media system 100 may be a personal computer system such as a desktop, laptop, tablet, or handheld computer, and may be a display device.

The media system 100 may operate according to a display mode that defines the manner in which the content is displayed, the size, shape, position, movement, or color of the region where the content is displayed, or whether the highlight is displayed on the region. The display mode of the media system 100 may include at least one of a normal mode, a grab mode, a motion mode, a flicking mode, a quick menu mode, and a content list mode. The media system 100 may differently display the shape, size, position, movement, or color of the content displayed on the screen of the display 130 or the shape, size, position, movement, or color of the area in which the content is displayed, according to the display mode. You can choose to show or not highlight the. The media system 100 can also provide graphical feedback associated with the changed graphics mode upon changing the display mode.

The normal mode refers to a general display mode and is a display mode that is maintained after the media system 100 is booted but before a user action of changing the display mode is detected. The normal mode may include a full screen mode for displaying content in full screen. That is, when specific content is displayed in the normal mode, the content may be displayed in the full screen mode. When the other content is additionally displayed while the content is displayed in the full screen mode, it may be displayed in screen division as shown in FIG. 24, and the additionally displayed content may be displayed in full screen.

The grab mode is a mode in which graphic feedback indicating that the screen of the display 130 is touched or a mode in which graphic feedback is maintained. In the full screen mode, when the grab button of the remote control device 150 is pressed, the media system 100 may operate in the grab mode in the full screen mode.

 The movement mode is a display mode for moving the area of the displayed content according to the movement of the remote control apparatus 150. When the media system 100 detects a movement of the remote control device 150 while operating in the grab mode, the media system 100 may operate in the movement mode.

The flicking mode is a display mode for moving the content displayed on the screen in a manner to be described later with reference to FIG. 17 in response to detecting a user action requesting flicking. The media system 100 may operate in a flicking mode when a movement of the remote control device 150 at a predetermined speed or more is detected while operating in the grab mode or the movement mode.

The quick menu mode is a display mode for displaying a menu. The media system 100 may operate in the quick menu mode when a movement in a specific direction is detected among the movements of the remote control apparatus 150 while operating in the grab mode.

The channel list mode is a display mode in which a channel list displayed on the screen of the display 130 is selected. When the grab button of the remote controller 150 is pressed while the channel list is displayed on the screen of the display 130, the media system 100 may operate in the channel list mode in the normal mode.

 The electronic device 110 and the display 130 may be manufactured and sold as one integrated product, and the electronic device 110 and the display 130 may be manufactured and sold as individual products. The electronic device 110 may be a mobile terminal such as a mobile phone, a smart phone, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, or the like, and may be a fixed home appliance such as a set-top box or a digital TV. It may be a device.

The electronic device 110 may be a multimedia device capable of playing multimedia data stored in a storage medium, and may be a broadcast receiver capable of receiving a broadcast signal and decoding multimedia data included in the received broadcast signal. The multimedia data may include stereoscopic images as well as two-dimensional images. The stereoscopic image may also be a multiview image. The multi-view image refers to a plurality of images obtained by photographing the same subject with a plurality of cameras having a certain distance or angle, and define images obtained by each camera as viewpoint images.

The broadcast receiver may be a broadcast receiver capable of receiving broadcast signals transmitted through terrestrial waves, satellites, and cables and broadcast signals transmitted through the Internet. In addition, the broadcast receiver may be a broadcast receiver capable of providing an Internet service to a viewer. The Internet service includes content services such as CoD (Content's on Demand), YouTube service, weather, news, local information and search, entertainment services such as games and karaoke, TV mail, and TV SMS (Short Message Service). This means a service that can be provided through the Internet. Accordingly, in the present invention, the broadcast receiver may include a network TV, a web TV, and a broadband TV.

Also, the broadcast receiver may be a smart TV capable of receiving an application from a server through a network, and installing and executing the application.

The electronic device 110 may perform pairing to perform wireless communication with the remote control device 150. When the electronic device 110 receives an RF signal for requesting pairing from the remote control device 150, the electronic device 110 generates identification information in response to receiving the RF signal, and sends the generated identification information to the remote control device 150. Can transmit

The remote control device 150 may transmit an RF signal for requesting pairing to the electronic device 110 and receive an RF signal for notifying identification information from the electronic device 110. The remote control device 150 may store the identification information. The remote control device 150 may transmit an RF signal including a control signal and the stored identification information to the electronic device 110. The electronic device 110 may compare the identification information included in the RF signal with the stored identification information to exclude the received RF signal or input an RF signal according to the comparison result.

Display 130 displays the content. The display 130 may be instructed to display the content from the electronic device 110, receive the transmission transmitted from the remote control device 150, and display the content according to the information included in the received transmission. The content displayed by the display 130 may include at least one of a web page, an application, a broadcast program, a video, a photo, an image, and an icon. In addition, the content displayed by the display 130 may include content stored in a local storage area of the electronic device 110, a real-time broadcast program, content transmitted by streaming, downloaded content, and content captured by a camera included in the media system. It may include at least one of.

In addition, the image displayed by the display 130 may be a two-dimensional image, a two-view image or a multi-view image, or may be a hologram.

In addition, the display 130 may be connected to the electronic device to operate. The display 130 may display a graphical user interface (GUI) that provides an easy-to-use interface between a user of the electronic device and an operating system or an application running on the operating system.

2 is a block diagram illustrating a configuration of a preferred embodiment of an electronic device according to the present invention.

Referring to FIG. 2, the electronic device 110 according to the present invention includes a receiver 201, a demultiplexer 240, a video decoder 244, an audio decoder 248, a voice output unit 260, and an input device ( 270, a storage 280, and a controller 290. According to an embodiment, the electronic device 110 may include a photographing device 295. In addition, the electronic device 110 may include a display 130.

The receiver 201 may receive broadcast data, video data, audio data, information data, and application data. The image data may be image data for displaying a 2D image and image data for displaying a 3D image. In addition, the 3D image may include at least one of a hologram or a stereo image. The hologram may be a computer-generated hologram (CGH).

The receiver 201 may include a tuner 210, a demodulator 220, a mobile communicator 215, a network interface 230, a voice detector 233, and an external signal receiver 235. The tuner 210 may receive a stream signal including data through a broadcast network, and the demodulator 220 demodulates the received stream signal. The tuner unit 210 may include two tuners, and one tuner receives a real time broadcast program of a channel being displayed. The other tuner continuously switches channels, receives a real-time broadcast program of each channel, and the controller 290 generates a still image or thumbnail by using the received real-time broadcast program, and stores it in the storage unit 280. Can be controlled.

The mobile communication unit 215 may receive data through a mobile communication network such as a 2G communication network, a 3G communication network, and a 4G communication network. In addition, the network interface 230 may transmit and receive an IP packet through a network, the external signal receiver 230 may receive an application and content from an external device, and may receive an image frame from the photographing device 295. . The image frame may be an image frame captured by the user.

The demultiplexer 240 demultiplexes the stream signal output from the demodulator 220 into a video signal and an audio signal. In addition, the demultiplexer 240 may receive image data, audio data, broadcast data, information data, and application data from the mobile communication unit 215, the network interface unit 230, and the external signal receiver 235.

The video decoder 244 decodes the video signal demultiplexed by the demultiplexer 240, and outputs the decoded video signal to the display 130.

The audio decoder 248 decodes the audio signal demultiplexed by the demultiplexer 240, and outputs the decoded audio signal to the voice output unit 260.

The voice output unit 260 may receive voice data from the audio decoder 248 and the controller 290 and output a sound 261 in which the received voice data is reproduced.

The input device 270 may be a touch screen disposed on or in front of the display 130 and may be a communication unit that receives a signal from the remote control device 150. The input device 270 may receive a transmission from the remote control device 150.

According to some embodiments, the receiving unit 201 may be a communication unit that receives a signal from the remote control apparatus 150. That is, the external signal receiver 235 may receive a transmission from the remote control device 150.

The storage unit 280 generally provides a place for storing program code and data used by the electronic device 110. Here, the program code may be a program code of an application received by the receiver 201 and a program code of an application stored when the electronic device 110 is manufactured. Applications can also be written in programming languages such as HTML, XML, HTML5, CSS, CSS3, JavaScript, Java, C, C ++, Visual C ++, and C #. The storage unit 280 may store still images or thumbnails of channels currently being broadcast in the real time broadcast program. The full-length still image or thumbnail may be updated with a still image or thumbnail generated using a real-time broadcast program broadcasted by a corresponding channel.

The storage unit 280 may be implemented as a read only memory (ROM), a random access memory (RAM), a hard disk drive, or the like. The program code and data may reside in removable storage media and may be loaded or installed onto electronic device 110 as needed. Removable storage media may include CD-ROM, PC-CARD, memory cards, floppy disks, magnetic tape, and network components.

The controller 290 executes a command and performs an operation associated with the electronic device 110. For example, the controller 290 may control input and output between components of the electronic device 110 and reception and processing of data by using a command retrieved from the storage 280. The controller 290 may execute a command associated with information included in the transmission received from the remote control device 150.

The controller 290 executes program code along with an operating system and generates and uses data. Operating systems are generally known and will not be described in more detail. By way of example, the operating system may be a Window based OS, Unix, Linux, Palm OS, DOS, Android, Macintosh, and the like. The operating system, other computer code, and data may reside in a storage 280 that operates in conjunction with the controller 290.

The controller 290 may be implemented on a single chip, multiple chips, or multiple electrical components. For example, various architectures may be used for the control unit 290, including dedicated or embedded processors, single purpose processors, controllers, ASICs, and the like.

The controller 290 may recognize the user action and control the electronic device 110 based on the recognized user action. The user action may include selecting a physical button of an electronic device or a remote control device, performing a predetermined gesture on a touch screen display surface, or selecting a soft button, and performing a predetermined gesture recognized from an image captured by the imaging device 295. And the execution of a predetermined utterance recognized by speech recognition. The gesture may include a touch gesture and a space gesture.

In addition, the controller 290 may check the user action detected by the remote control device 150 based on the information included in the transmission received from the remote control device 150, and based on the checked user action, the electronic device 110 may be used. ) Or the display 130.

When the grab button of the remote controller 150 is pressed while the electronic device 110 operates in the full screen mode, the controller 290 may control the electronic device 110 to operate in the grab mode in the full screen mode. Can be.

 If the movement of the remote control device 150 is detected while the electronic device 110 operates in the grab mode, the controller 290 may control the electronic device 110 to operate in the movement mode.

While the electronic device 110 is operating in the grab mode or the movement mode, when the movement of the remote control device 150 at a predetermined speed or more is detected, the controller 290 may determine that the electronic device 110 is in the flicking mode. It can be controlled to operate as.

While the electronic device 110 operates in the grab mode, when a specific movement is detected during the movement of the remote control device 150, the controller 290 may control the electronic device 110 to operate in the quick menu mode. have.

If the grab button of the remote controller 150 is pressed while the channel list is displayed on the screen of the display 130, the controller 290 may allow the electronic device 110 to operate in the channel list mode from the normal mode. Can be controlled.

The controller 290 may control the transmission to instruct the display 130 to display the image 252 or the GUI 253 to be transmitted.

The input device 270 receives the gesture 271, and the controller 290 executes commands for performing operations associated with the gesture 271. In addition, the storage unit 280 may include a gesture operating program 281 which may be part of an operating system or a separate application. Gesture operator 281 generally recognizes the occurrence of gesture 271 and in response to gesture 271 and / or gesture 271 tells one or more software agents what action (s) to take. Contains the command of.

Figure 3 is a block diagram showing the configuration of a preferred embodiment of a remote control device according to the present invention.

Referring to FIG. 3, the remote control apparatus 150 includes a communication unit 310, a user interface unit 320, a sensor unit 330, an output unit 340, a power supply unit 350, a storage unit 360, and a control unit. 370 and the light irradiation unit 380 may include at least one.

The communication unit 310 is a communication module that provides bidirectional omnidirectional (or nondirectional) communication means. The communication unit 310 may perform wireless communication with the electronic device 110 in a communication method according to a predetermined communication standard. The communication standard may be Zigbee, Bluetooth, Ultra Wideband (UWB), Radio Frequency Identification (RFID), and Wireless Lan (Wireless Lan). The communicator 310 may transmit a control signal to the electronic device 110. The control signal may be a signal containing information on the movement of the remote control device 150 or the like, and may be a signal indicating a command to be executed in the electronic device 110. The control signal may also include a control signal corresponding to the sensed user action. In addition, the control signal may be generated based on the point where the contact is detected on the user interface 320 and the control mode. The user action may include selection of a physical button of the remote control device, movement of the remote control device, execution of a predetermined touch gesture on the interface provided by the user interface unit 320, or selection of a soft button.

The controller 370 may control various items related to the control of the remote control apparatus 150. The controller 370 may control the communicator 310 to transmit an RF signal including a control signal. In addition, the controller 370 may control the communication unit 310 to receive a signal transmitted by the electronic device 110.

The controller 370 receives a sensor signal from the sensor unit 330. The sensor signal is generated based on at least one of the position, direction, movement, and contact of the remote control device 150.

The controller 370 may receive a sensor signal indicating the movement of the remote control device 150 from the sensor unit 330, and may receive a user action from the user interface 320. The controller 370 may generate a data packet including information on a movement indicated by the received sensor signal and a control signal associated with the received user action, and the generated data packet is sent to the electronic device 110. Can be controlled to be transmitted.

The user interface 320 provides an interface for controlling the electronic device 110 or the display 130, and the user interface 320 senses a user action performed on the provided interface. The user interface 320 may be configured as a keypad, a button, a touch pad, or a touch screen. The user may input a command for controlling the electronic device 110 or the display 130 to the remote control device 150 by manipulating the user interface 320.

The user interface 320 may include a first button and a second button disposed on different surfaces, and detect a user action on at least one of the first button and the second button. In some embodiments, the first button may be disposed on the back of the remote control device 150, and the second button may be disposed on the front of the remote control device 150. In addition, another button may not be disposed on the surface where the first button is disposed, and another button may be disposed on the surface where the second button is disposed. In the following, the first button is called a grab button, and the second button is called an ok button.

The grab button may be used to grab or touch the graphic object displayed on the screen of the display 130 or the screen of the display 130. For example, when the user presses the grab button, the electronic device 110 or the display 130 may respond as the user touches the screen of the display 130 and provide feedback thereto. The provided feedback may be that at least one of time, hearing and tactile sense may also be perceived.

The OK button may be used to select a graphic object or a menu item where an indicator on the screen of the display 130 is located. Herein, the indicator may be a graphic pointer or a pointer.

The difference between the grab button and the ok button in the selection of the graphic object is that the grab button selects a particular graphic object irrespective of the position of the indicator, and the ok button selects in relation to the position of the indicator.

The controller 370 may generate the down signal of the grab button in response to the user action detection of pressing the grab button, and may generate the down signal of the ok button in response to the user action detection of pressing the ok button. In addition, the controller 370 may generate an up signal of the grab button in response to the user action of releasing the grab button, and generate an up signal of the ok button in response to the user action of releasing the ok button. The controller 370 may control the generated down signal and up signal of the graphic button and the down signal and up signal of the OK button to be transmitted to the electronic device 110 or the display 130. Here, the down signal and the up signal of the graphic button, the down signal and the up signal of the OK button may be transmitted simultaneously or separately. In addition, the down signal and the up signal of the grab button and the down signal and the up signal of the OK button may be transmitted simultaneously with or separately from the motion information of the remote control apparatus 150.

The sensor unit 330 generates a sensor signal based on at least one of the position, direction, movement, and contact of the remote control device. The sensor unit 330 includes a gyro sensor 331, an acceleration sensor 332, a gravity sensor 333, a geomagnetic sensor 334, an illuminance sensor 335, a proximity sensor 336, a contact sensor unit 337, and a distance. It may include at least one of the measurement sensor 338.

The gyro sensor 331 may sense a movement of the remote control device 150 and generate a sensor signal indicating the sensed movement. For example, the gyro sensor 331 may sense the movement of the remote control device 150 based on the x, y, and z axes, and generate a sensor signal indicating a space vector based on the sensing result.

The acceleration sensor 332 may sense a moving speed of the remote control device 150 and generate a sensor signal indicating the sensed moving speed.

The gravity sensor 333 may sense the top and bottom of the remote control device 150 using the gravity of the earth, and generate a sensor signal indicating the direction of the remote control device 150.

The geomagnetic sensor 334 may sense the direction of the remote control device 150 using the geomagnetism of the earth, and generate a sensor signal indicating the sensed direction.

The illuminance sensor 335 may sense illuminance around the remote control device 150 and generate a sensor signal indicating the sensed illuminance.

The proximity sensor 336 may sense an object approaching the remote control device 150 and generate a sensor signal indicating a sensing result.

The touch sensor 337 may sense a contact of the remote control device 150 and generate a sensor signal indicating a sensing result.

The distance measuring sensor 338 may sense a distance from the electronic device 110 and generate a sensor signal indicating the sensed distance.

The output unit 340 may output at least one of an image signal, an audio signal, light, and haptic feedback corresponding to a user action sensed by the user interface 320 or a signal transmitted from the electronic device 110. . The output unit 340 is an LED module 341 that is turned on when the user interface 320 is manipulated or a signal is transmitted and received with the electronic device 110 through the communication unit 310, the vibration module 343 generating vibration, and the sound. It may include at least one of a sound output module 345 for outputting a display, or a display module 347 for outputting an image.

The power supply unit 350 supplies power to the remote control device 150. The power supply unit 350 may reduce power waste by stopping power supply when the remote control unit 150 does not move for a predetermined time. The power supply unit 350 may resume power supply when a predetermined key provided in the remote control apparatus 150 is operated.

The storage unit 360 may store various types of programs, program data, and the like necessary for controlling or operating the electronic device 110. The storage unit 360 may store control data corresponding to a user action. The controller 370 may access control data corresponding to the user action detected by the user interface 320 from the storage 360, and may control to transmit a control signal including the accessed control data.

In addition, the storage unit 360 may store information about a frequency band. The remote control device 150 may transmit and receive a signal with the electronic device 110 through a frequency band indicated by the stored information. The information on the frequency band may include information indicating a management frequency channel and information indicating a pairing frequency channel.

4 is a front view, a rear view and a perspective view of the remote control device according to the present invention.

4A is a front view of the remote control device 150, FIG. 4B is a rear view of the remote control device 150, and FIG. 4C is a perspective view of the remote control device 150. FIG. have.

Referring to FIG. 4, the grab button 401 is disposed on the rear surface 420 of the remote control device 150, and the ok button 403 is disposed on the front surface 410 of the remote control device 150. Accordingly, the present invention allows the user to easily press the grab button 401 and the OK button 403 on the remote control device 150 simultaneously with one hand, and also allow the user to press the grab button 401 simultaneously. And while pressing the OK button 403 at the same time, it is easy to move the remote control device 150.

Other buttons are not disposed on the rear surface 420 where the grab button 401 is disposed, and other buttons 406, 407, 408, and 409 are disposed on the front surface 410 where the OK button 403 is disposed. The user can operate the grab button 401 by touch without visually confirming the position of the grab button 401. Accordingly, the present invention allows the user to easily manipulate the grab button 401 and other buttons 406, 407, 408, 409.

5 is a view for explaining the movement of the pointer according to the movement of the remote control device according to the present invention.

As illustrated in FIG. 5A, the display pointer 505 is displayed on the display 130.

The user may perform a user action of moving or rotating the remote control device 150 up and down, left and right (FIG. 5B) and front and rear (FIG. 5C). Hereinafter, to define a direction, an axis corresponding to the vertical axis of the screen 130 is defined as the y axis, an axis corresponding to the horizontal axis of the screen 130 is defined as the x axis, and an axis perpendicular to the screen 130 is defined. Define the corresponding axis as the z axis. Up and down movement of the remote control device 150 means movement on the y-axis, left and right movements mean movement on the x-axis, and front and rear movements indicate movement on the z-axis.

The display pointer 505 displayed on the display 130 may move in response to the movement of the remote control device 150. The remote control apparatus 150 may be referred to as a space remote controller or a magic remote controller because the display pointer 505 is moved and displayed according to the movement in the 3D space as shown in the drawing. The movement of the display pointer 505 may be performed without pressing a different button of the remote control device 150. In some embodiments, when the grab button and the OK button of the remote control device 150 are not pressed, the display pointer 505 may move according to the movement of the remote control device 150.

FIG. 5B illustrates that when the user moves the remote control device 150 to the left side, the display pointer 505 displayed on the display 130 also moves to the left side correspondingly.

Movement information, which is information about the movement of the remote control apparatus 150 sensed through the sensor of the remote control apparatus 150, is transmitted to the electronic device 110. The electronic device 110 may calculate the coordinates of the display pointer 505 from information about the movement of the remote control device 150. The electronic device 110 may control the display pointer 505 to be displayed at a screen position corresponding to the calculated coordinates.

Meanwhile, the moving speed or the moving direction of the display pointer 505 may correspond to the moving speed or the moving direction of the remote control apparatus 150.

Meanwhile, the display pointer in the present specification refers to an object displayed on the display 130 in response to the operation of the remote control apparatus 150. Accordingly, the display pointer 505 may allow objects of various shapes in addition to the arrow shape shown in the drawing. For example, the concept may include a point, a cursor, a prompt, a thick outline, and the like. In addition, the display pointer 505 may be displayed corresponding to any one of a horizontal axis and a vertical axis on the display 130, and may also be displayed corresponding to a plurality of points such as a line and a surface. Do.

6 is a view for explaining the movement of the graphic object in accordance with the movement of the remote control device according to the present invention.

Referring to FIG. 6, when the display pointer 130 is positioned on the graphic object 610 displayed on the screen of the display 130, when the OK button of the remote control device 150 is clicked, the graphic object 610 is displayed. Can be selected.

In addition, when the display pointer 130 is positioned on the graphic object 610 displayed on the screen of the display 130, the remote control device 150 moves while the OK button of the remote control device 150 is pressed. The graphic object 610 may move in response to the movement of the remote control device 150. In some embodiments, when the grab button of the remote control device 150 is not pressed and the OK button is pressed, the graphic object 610 may move according to the movement of the remote control device 150.

7 is a view for explaining the display of the menu according to the movement of the remote control device according to the present invention.

Referring to FIG. 7, when the grab button of the remote control device 150 is pressed, the menu items 711, 712, 713, 714, 715 when the remote control device 150 moves upward on the y axis. May be displayed, and further an indicator 720 for selecting menu items 711, 712, 713, 714, 715 may be displayed.

The indicator 720 may be moved according to the movement of the remote control device 150. The user may move the indicator 720 to select menu items 711, 712, 713, 714, and 715 included in the menu 710. When the grab button of the remote control apparatus 150 is released, the menu item 712 in which the indicator 720 is located among the menu items 711, 712, 713, 714, and 715 may be selected.

The menu 710 illustrated in FIG. 7 is an example of a menu displayed by the display 130 in the quick menu mode.

8 is a diagram illustrating an embodiment of a screen on which content is displayed.

Referring to FIG. 8, the display 130 may display content 810 on a screen. The electronic device 110 may instruct the display 130 to display the content, and the display 130 may display the content according to the instructions of the electronic device 110.

The content displayed by the display 130 may include at least one of a web page, an application, a broadcast program, a video, a photo, an image, and an icon. In addition, the content displayed by the display 130 may include content stored in a local storage area of the electronic device 110, a real-time broadcast program, content transmitted by streaming, downloaded content, and content captured by a camera included in the media system. It may include at least one of.

The real-time broadcast program may be received by the tuner unit 210 or the network interface unit 230 of the electronic device 110. In addition, the real-time broadcast program 810 may be a broadcast program transmitted through terrestrial, satellite, and cable and a broadcast program transmitted through the Internet.

FIG. 9 illustrates an embodiment of graphic feedback indicating that a screen of a display is touched.

Referring to FIG. 9, the graphic feedback indicating that the screen of the display 130 is touched may be a region in which the content is displayed is reduced from one of the upper side, the lower side, the left side, and the right side of the screen of the display 130 to the center. . For example, the graphic feedback indicating that the screen 130 illustrated in FIG. 8 is touched may be reduced from the left side to the center by the region 920 of FIG. 9A. It becomes the area | region 910 of 9 (a).

The region 920 may display content different from the region 810. The area 920 may display content related to the content displayed in the area 810 illustrated in FIG. 8. In some embodiments, when a real time broadcast program is displayed in the region 810, the real time broadcast program of a channel adjacent to a channel of the real time broadcast program displayed in the region 810 may be displayed in the region 920. For example, the adjacent channel may have a front number of the channel number of the real-time broadcast program displayed in the area 810 and may have a rear number. In addition, the adjacent channel may have a front number of the channel number of the real-time broadcasting program displayed in the region 810 among the channels included in the preferred channel list, or may have a rear number.

In some embodiments, the graphic feedback indicating that the screen 130 shown in FIG. 8 is touched is such that the area 810 where the content is displayed is reduced from left to center by the area 940 of FIG. 9B. At the same time, it is reduced to the center by the area 931 to become the area 930 of FIG. 9B. The width of the region 940 may be different from the width of the region 931, and the width of the region 940 may be greater than the width of the region 931.

In the area 940, content different from the area 810 may be displayed. In the area 940, content associated with the content displayed in the area 810 may be displayed. Region 931 may be marked blank or filled with a specific color. The specific color may be a color represented by a combination of red, green, and blue, and may be black.

FIG. 10 illustrates another embodiment of graphical feedback indicating that a screen of a display is touched.

The graphic feedback indicating that the screen of the display 130 is touched may be a region in which the content is displayed is reduced from the center of the top, bottom, left and right of the screen of the display 130. For example, the graphic feedback indicating that the screen 130 illustrated in FIG. 8 is touched may correspond to the area 810 where content is displayed is reduced from the left side to the center by the region 1020 of FIG. 10A. At the same time, the area 1030 of FIG. 10A is reduced from the right side to the center to become the area 1010 of FIG. 10A.

The widths of the regions 1020 and 1030 may be the same and may vary. Contents different from the area 810 may be displayed in the area 1020 and the area 1030, and content associated with the content displayed in the area 810 may be displayed in the area 1020 and the area 1030. Also, the area 1020 and the area 1030 may display the same content, and may display different content. For example, region 1020 may display a real-time broadcast program of a channel having a number ahead of a channel of the real-time broadcast program displayed in region 810, and region 1030 may display a real-time broadcast program of a channel having a later number. The live broadcast program can be displayed.

In some embodiments, the graphic feedback indicating that the screen 130 shown in FIG. 8 is touched is such that the area 810 where content is displayed is reduced from left to center by the area 1050 of FIG. 10B. At the same time, the area 1040 of FIG. 10B is reduced from the right side to the center, and the area 1041 of FIG. 10B is reduced to the center by the area 1041 and 1042. . The width of the region 1050 may be different from the width of the region 1041, and the width of the region 1050 may be greater than the width of the region 1041. In addition, the widths of the regions 1041 and 1042 may be the same and may be different.

Contents different from the area 810 may be displayed in the area 1050 and the area 1060. Areas 1050 and 1060 may display content associated with content displayed in area 810. Also, area 1050 and area 1060 may display the same content, and may display different content. Regions 1041 and 1042 may be marked blank or filled with a specific color. The specific color may be a color represented by a combination of red, green, and blue, and may be black.

FIG. 11 illustrates another embodiment of graphic feedback indicating that a screen of a display is touched.

The graphic feedback indicating that the screen of the display 130 is touched may be an area in which the content is displayed is reduced from three places among the upper side, the lower side, the left side, and the right side of the screen of the display 130 to the center. For example, the graphic feedback indicating that the screen 130 illustrated in FIG. 8 is touched may correspond to the area 810 where content is displayed is reduced from the left side to the center by the region 1120 of FIG. 11A. At the same time, the area 1130 of FIG. 11A is reduced from the right side to the center, and the area 1140 of FIG. 11A is reduced from the top side to the center to be the area 1110 of FIG. 11A. will be.

Widths of the region 1120, the region 1130, and the region 1140 may be the same or may be different from each other. Contents different from the region 810 may be displayed in the region 1120, the region 1130, and the region 1140, and contents displayed in the region 810 in the region 1120, the region 1130, and the region 1140. Content associated with may be displayed. In addition, the region 1120, the region 1130, and the region 1140 may display the same content, and may display different contents. For example, region 1120 may display a real-time broadcast program of a channel having a number ahead of a channel of the real-time broadcast program displayed in region 810, and region 1130 may display a real-time broadcast program of a channel having a later number. The real-time broadcast program may be displayed, and the region 1140 may display the real-time broadcast program of the channel having a number earlier than the region 1120.

In some embodiments, the graphic feedback indicating that the screen 130 shown in FIG. 8 is touched is such that the area 810 where content is displayed is reduced from left to center by the area 1170 of FIG. 11B. At the same time, the area 1180 of FIG. 11 (b) is reduced from the right side to the center, and the area 1118 of FIG. 11 (b) is reduced from the top side to the center. It becomes the area | region 1160 of FIG. The width of the region 1170 may be different from the width of the region 1161, and the width of the region 1170 may be greater than the width of the region 1161.

The widths of the regions 1170, 1180 and 1190 may be the same and may be different. Contents different from the area 810 may be displayed in the areas 1170, 1180, and 1190, and content displayed in the area 810 in the areas 1170, 1180, and 1190. Content associated with may be displayed. In addition, the region 1170, the region 1180, and the region 1190 may display the same content, and may display different contents. Region 1161 may be marked with a blank or filled with a specific color. The specific color may be a color represented by a combination of red, green, and blue, and may be black.

12 illustrates another embodiment of graphical feedback indicating that a screen of a display is touched.

Referring to FIG. 12, the graphic feedback indicating that the screen of the display 130 is touched may be a region in which content is displayed is reduced from the upper side, the lower side, the left side, and the right side of the screen of the display 130 to the center. For example, the graphic feedback indicating that the screen 130 shown in FIG. 8 is touched is reduced by the area 1230 at the same time as the area 810 where the content is displayed is reduced from the left to the center by the area 1220. Is reduced to the center at the center, and is reduced from the top to the center by the area 1240, and is the area 1210 reduced from the bottom to the center by the area 1250.

The widths of the region 1220, the region 1230, the region 1240, and the region 1250 may be the same or may be different from each other. Regions 1220, 1230, 1240, and 1250 may display content different from region 810, and may be regions 1220, 1230, 1240, and 1250. ) May display content associated with the content displayed in the area 810. In addition, the region 1220, the region 1230, the region 1240, and the region 1250 may display the same contents, and may display different contents. For example, region 1220 may display a real-time broadcast program of a channel having a number ahead of a channel of the real-time broadcast program displayed in region 810, and region 1230 may display a real-time broadcast program of a channel having a later number. The real time broadcast program may be displayed, and the region 1240 may display the real time broadcast program of a channel having a number before the region 1220, and the region 1250 has a number after the region 1230. The live broadcast program of the channel can be displayed.

13 is a view showing an embodiment in which the content displayed on the screen is moved according to the movement of the remote control device according to the present invention, Figure 14 is a content displayed on the screen according to the movement of the remote control device according to the present invention Is a view showing another embodiment in which is moved.

13 and 14, when the grab button of the remote control device 150 is pressed, graphic feedback indicating that the screen of the display 130 is touched is displayed. In the state where the grab button is pressed, the remote control device ( The area of the displayed content may be moved as the 150 is moved. The moving speed and direction of the area of the displayed content may be changed in real time according to the moving speed and direction of the remote control apparatus 150.

For example, when (a) of FIG. 10 is displayed on the screen of the display 130, when the remote control device 150 moves from right to left with respect to the x-axis while the grab button is pressed, the area 1010 is displayed. ) And region 1030 move from right to left to be located at point 1310 and point 1320. Herein, the moving speeds of the area 1010 and the area 1030 may be proportional to the moving speed of the remote control device 150.

When the remote control device 150 moves from the left to the right with respect to the x axis while the grab button is pressed while the grab button is displayed on the screen of the display 130, the area 1010 and the area ( 1020 moves from left to right to be located at point 1410 and point 1420. Here, the moving speeds of the area 1010 and the area 1020 may be proportional to the moving speed of the remote control device 150.

15 is a view showing another embodiment in which the content displayed on the screen is moved in accordance with the movement of the remote control apparatus according to the present invention.

Referring to FIG. 15, when the area of the displayed content is moved according to the movement of the remote control apparatus 150 to generate an area having an empty space, other content is displayed in the empty space.

For example, when the area 1310 and the area 1320 shown in FIG. 13 move to the point 1510 and the point 1520 as the remote control device 150 moves, an empty space 1530 occurs. In another example, the empty space 1530 may display another content. In this case, the content displayed in the region 1530 may be a real-time broadcast program that is broadcast on a channel after the channel number of the channel of the real-time broadcast program displayed in the region 1520.

FIG. 16 is a diagram illustrating a screen on which a real-time broadcast program associated with content displayed on the screen of FIG. 15 is displayed.

When the grab button of the remote control device 150 is released, the graphic feedback is stopped. In addition, if the grab button is released while the area where the content is displayed is moved, the content displayed on the screen of the display 130 is displayed in the released state. When the content is real time broadcast content, the real time broadcast content may be displayed on the screen of the display 130. In this case, the real-time broadcast content may be displayed on a full screen.

For example, if the grab button of the remote controller 150 is released while the content 1510, the content 1520, and the content 1530 are displayed on the screen 130 as illustrated in FIG. 15, the content is displayed as illustrated in FIG. 16. 1520 is displayed in area 1610.

In addition, when the grab button of the remote controller 150 is released while the content 1010, the content 1020, and the content 1030 are displayed on the screen 130 as shown in FIG. Similarly, the content 1010 is displayed in the area 810.

In addition, when the user clicks the grab button of the remote control apparatus 150, graphic feedback indicating that the screen is touched may appear for a while, and the screen may return to the original screen. For example, when the grab button of the remote control device 150 is clicked while the display 130 is displaying the screen shown in FIG. 8, the screens shown in FIGS. 9 to 12 are displayed and continuously. The screen shown in FIG. 8 is displayed again.

17 is a diagram illustrating an embodiment in which a plurality of still images are displayed with mutual perspective.

When the grab button of the remote control device 150 is pressed, graphic feedback indicating that the screen of the display 130 is touched is displayed, and the content displayed according to the movement of the remote control device 150 while the grab button is pressed. You can move the area of. When the moving speed of the remote control device 150 exceeds a preset speed, a plurality of contents are sequentially displayed for a preset time and moved above a predetermined speed. When the displayed content is real-time broadcast content, still images of a plurality of channels are sequentially displayed for the preset time and moved at a predetermined speed or more. In addition, the plurality of channels may be selected as preferred channels. In addition, a plurality of still images of the still images may be simultaneously displayed on the screen. A plurality of still images simultaneously displayed on the screen may be displayed with mutual perspective. For example, the plurality of still images 1710, 1720, 1730, 1740, and 1750 of FIG. 17 are displayed with mutual perspective.

Here, the media system 100 may recognize a user action for moving the remote control device 150 faster than the preset speed as a user action for requesting flicking. In addition, in response to detecting a user action requesting flicking, the media system 100 operates in the flicking mode. A mode of moving the content displayed on the screen in the manner described above with reference to FIG. 17 is defined as a flicking mode. The preset speed may be 0.1 m / s and the preset time may be 2 seconds.

When the preset time elapses, the movement speed is decreased and the movement of the contents is stopped, and the content displayed on the screen or the content positioned in the center of the screen is displayed on the screen while the movement is stopped. Can be. When the displayed content is real time broadcast content, a real time broadcast program of a still image displayed on the screen or a channel associated with a still image located at the center of the screen may be displayed on the screen while the movement is stopped. . For example, when the movement is stopped, the content 1510, the content 1520, and the content 1530 are displayed on the screen 130 as shown in FIG. 15, as shown in FIG. 16. Is displayed in area 1610.

18 is a flowchart illustrating a process of performing an embodiment of a method for providing a screen interface according to the present invention.

Referring to FIG. 18, the media system 100 operates in a normal mode (S100). The display 130 may display content on the display screen. The display 130 may display the content in the full screen mode. Here, the displayed content may be at least one of a web page, an application, a broadcast program, a video, a photo, an image, and an icon. The displayed content may include content stored in a local storage area, a real time broadcast program, content transmitted through streaming, At least one of the downloaded content and the content captured by the camera included in the media system.

For example, the display 130 may display the screen shown in FIG. 8 in the normal mode.

The remote control device 150 detects a user action of pressing the grab button (S105). The user action may include selection of a physical button of the remote control device, movement of the remote control device, execution of a predetermined touch gesture on the interface provided by the user interface unit 320, or selection of a soft button. The remote control device 150 may transmit a transmission indicating the user action to the electronic device 110 in response to the user action detection. Here, the transmission may include at least one of motion information of the remote control apparatus 150, a down signal of a button of the user interface unit 320, and an up signal.

The electronic device 110 receives a transmission from the remote control device 150 indicating that the grab button of the remote control device 150 has been pressed.

The media system 100 operates in a grab mode (S110). The electronic device 110 may instruct the display 130 to display the screen of the display 130 in grab mode in response to receiving the transmission indicating that the grab button has been pressed. In addition, the display 130 may display the content in a grab mode. The area in which the content is displayed in the grab mode may be reduced from at least one of the upper side, the lower side, the left side, and the right side of the screen to the center. In addition, in the grab mode, the display 130 may disappear the cursor displayed on the screen, and may display a still image instead of the video of the content.

In operation S110, the electronic device 110 may instruct the display 130 to provide graphic feedback indicating that the screen is touched. Display 130 provides graphical feedback. The graphic feedback provided by the display 130 may be one of the graphic feedbacks illustrated in FIGS. 9 to 12.

In the grab mode, the electronic device 110 determines whether a user action of releasing the grab button is detected (S115). When the remote control device 150 detects a user action of releasing the grab button, the remote control device 150 may transmit a transmission to the electronic device 110 indicating that the grab button is released. When the transmission is received, the electronic device 110 may determine that a user action of releasing the grab button is detected.

If a user action of releasing the grab button is detected in step S115, the media system 100 operates in the normal mode. The electronic device 110 may stop the graphic feedback provided in the grab mode.

The remote control device 150 detects the movement of the remote control device (S120). The remote control device 150 may transmit a transmission including the motion information indicating the detected motion to the electronic device 110. The electronic device 110 may receive a transmission including motion information indicating movement of the remote control device 150 from the remote control device 150.

The electronic device 110 checks the movement of the remote control device (S125). The electronic device 110 may check the movement of the remote control device based on the motion information included in the transmission received from the remote control device 150. When the motion information included in the received transmission indicates the movement in the x-axis direction, the electronic device 110 further determines whether the speed of the movement of the remote control device 150 exceeds a preset speed. You can check it.

When the motion information included in the received transmission indicates the movement in the y-axis direction, the media system 100 operates in the quick menu mode (S130). In the quick menu mode, the electronic device 110 may instruct the display 130 to display the menu. The display 130 may display the menu 710 illustrated in FIG. 7.

If the movement speed in the x-axis direction of the remote control device 150 does not exceed the preset speed, the media system 100 operates in the movement mode (S135). In the movement mode, the electronic device 110 may instruct the screen of the display 130 to be displayed in the movement mode. In the motion mode, the electronic device 110 moves the area where the content is displayed according to the motion information. Here, the area caused by the reduction of the area where the content is displayed may move together with the area where the content is displayed. Other content may be displayed in the generated area. For example, the generated area may be the area 1020 and the area 1030 illustrated in FIG. 10.

In addition, the direction and speed at which the area where the content is displayed and the area where the other content is displayed may vary according to the direction and speed of the movement of the remote control apparatus 150. Here, the area where the content is displayed and the area where the content of the other channel is displayed may move in the manner described above with reference to FIG. 13, 14, or 15.

While the displayed contents are moved, the remote controller 150 detects a user action of releasing the grab button (S140). In response to the user action detection, the remote control device 150 may transmit a transmission to the electronic device 110 indicating that the grab button is released. The electronic device 110 may receive a transmission indicating that the grab button has been released from the remote control device.

In response to the user action detection, the media system operates in a normal mode (S145). In operation S145, the electronic device 110 may instruct the screen of the display 130 to be displayed in the normal mode. In operation S145, the electronic device 110 may stop the movement and display a real-time broadcast program of a channel associated with a still image displayed on the screen in the stopped state on the screen.

If the speed of the movement in the x-axis direction of the remote control device 150 exceeds a preset speed, the electronic device 110 instructs the screen of the display 130 to be displayed in the flickering mode (S150). . In the flicking mode, the electronic device 110 displays a plurality of contents sequentially for a preset time and moves at a predetermined speed or more, and stops the movement while decreasing the speed of the movement when the preset time elapses. The display 130 may instruct the display 130 to display the content of the channel associated with the content displayed on the screen of the display 130 while the movement is stopped. Here, the plurality of contents may be contents associated with the contents displayed in step S100. For example, the associated contents may be contents stored in the same folder as the contents displayed in step S100, or contents included in the same contents list.

When the displayed content is real-time broadcast content, still images of a plurality of channels are sequentially displayed for the preset time and moved at a predetermined speed or more. In addition, the plurality of channels may be selected as preferred channels. The plurality of still images simultaneously displayed on the screen may be displayed with mutual perspective as shown in FIG. 17.

The method of providing a screen interface illustrated in FIG. 18 may further include tuning the channel by the electronic device 110 and receiving a real-time broadcast program of the tuned channel. The electronic device may tune the channel based on the channel number of the real-time broadcast program displayed in step S100. According to an embodiment of the present disclosure, the electronic device may select a channel having a front number or a rear number of the channel number of the real broadcast program. In addition, the electronic device 110 may change the tuned channel to another channel. Here, another channel may be a channel having a front number or a rear number of the tuned channel.

In the method for providing a screen interface shown in FIG. 18, the electronic device 110 generates a still image using the received image of the real-time broadcast program, and the electronic device 110 stores the generated still image. It may further include.

In addition, the electronic device 110 may repeatedly change to another channel to acquire a still image for a channel that broadcasts a real-time broadcast program, and the obtained still image may be grabbed in a grab mode, a motion mode, and a flickering mode. Available at

19 illustrates another embodiment of a screen on which content is displayed.

Referring to FIG. 19, the display 130 may display a web page 1910. The web page 1910 may be zoomed in and zoomed out according to the movement of the remote control device 150.

In some embodiments, when the remote control device 150 moves while both the grab button and the OK button of the remote control device 150 are pressed, the web page 1910 according to the movement of the remote control device 150. Can be zoomed in and zoomed out.

20 is a diagram illustrating an embodiment of a screen on which content shown in FIG. 19 is zoomed in.

Referring to FIG. 20, the web page 2010 is a zoom-in of the web page 1910 illustrated in FIG. 19. In some embodiments, when the remote control device 150 moves upward on the y axis, the webpage 1910 may be zoomed in to the webpage 2010. In some embodiments, when the remote control device 150 moves away from the screen 130 on the z-axis, the webpage 1910 may be zoomed in to the webpage 2010. In some embodiments, when the remote control device 150 moves in an upward direction on the y axis and away from the screen 130 on the z axis, the webpage 1910 may be zoomed in to the webpage 2010.

FIG. 21 is a diagram illustrating an embodiment of a screen on which the content illustrated in FIG. 19 is zoomed out.

Referring to FIG. 21, the web page 2110 is a zoomed out web page 1910 shown in FIG. 19. In some embodiments, when the remote control device 150 moves downward on the y axis, the webpage 1910 may be zoomed out to the webpage 2110. In some embodiments, when the remote control device 150 moves in a direction closer to the screen 130 on the z-axis, the webpage 1910 may be zoomed out to the webpage 2110. In some embodiments, when the remote control device 150 moves in a downward direction on the y-axis and closer to the screen 130 on the z-axis, the webpage 1910 may be zoomed out to the webpage 2010. .

22 is a flowchart illustrating a process of performing a preferred temporary method for a method for adjusting a zoom of content according to the present invention.

Referring to FIG. 22, the display 130 displays content on a screen (S200). The content may be displayed in full screen mode. Here, the displayed content may be at least one of a web page, an application, a broadcast program, a video, a photo, an image, and an icon. The displayed content may include content stored in a local storage area, a real time broadcast program, content transmitted through streaming, At least one of the downloaded content and the content captured by the camera included in the media system.

Step S200 may further include instructing the electronic device 110 to display the content on the display 130, and the display 130 may display the content on the screen in response to the instruction.

The remote control device 150 detects a user action (S210). The user action may include selection of a physical button of the remote control device, movement of the remote control device, execution of a predetermined touch gesture on the interface provided by the user interface unit 320, or selection of a soft button. The remote control device 150 may transmit a transmission indicating the user action to the electronic device 110 in response to the user action detection. Here, the transmission may include at least one of motion information of the remote control apparatus 150, a down signal of a button of the user interface unit 320, and an up signal.

The electronic device 110 receives a transmission from the remote control device 150 and checks a signal or information included in the received transmission (S220).

In addition, the electronic device 110 may check a user action based on the signal or information included in the received transmission. When the transmission includes the down signal of the grab button of the remote control device and the down signal of the ok button, the electronic device 110 confirms that the grab button min ok button of the remote control device 150 is pressed. When the down signal of the grab button is not included in the transmission and the down signal of the oak button is not included, the electronic device 110 confirms that the grab button of the remote control device 150 is pressed.

If the down signal of the grab button is not included in the transmission and the down signal of the ok button is included, the electronic device 110 confirms that the ok button of the remote control device 150 is pressed.

When the down signal of the grab button and the down signal of the ok button are not included, the electronic device 110 confirms that the grab button and the ok button of the remote control device 150 are not pressed.

When the transmission includes the down signal of the grab button of the remote control device and the down signal of the ok button, the electronic device 110 zooms the displayed content based on the motion information included in the received transmission. Adjust (S230).

In some embodiments, step S230 may include adjusting the zoom of the content based on at least one of motion information on a y-axis and motion information on a z-axis included in the motion information.

In some embodiments, step S230, when the motion information on the y-axis indicates the movement in the upper direction on the y-axis, the step of zooming in the content and the motion information on the y-axis moves downward in the y-axis If instructing, the method may include zooming out the content.

In some embodiments, when the motion information on the z axis indicates a motion away from the screen 130, the step S230 may include zooming in the content and moving information on the z axis closer to the screen 130. When instructing movement in a losing direction, the method may include zooming out the content.

In some embodiments, step S230, when the motion information on the y-axis indicates the movement in the upper direction on the y-axis, and the motion information on the z-axis indicates the movement in the direction away from the screen 130, Zooming in the content, and when the motion information on the y axis indicates a downward movement on the y axis, and the motion information on the z axis indicates the motion toward a direction closer to the screen 130, the content. Zooming out may be included.

When the down signal of the grab button is included and the down signal of the oak button is not included, the electronic device 110 provides graphic feedback (S240). Here, the graphic feedback may be graphic feedback indicating that the screen is touched or graphic feedback indicating that a content list displayed on the screen is selected.

When the down signal of the grab button is not included and the down signal of the OK button is included, the electronic device 110 selects a graphic object in which the display point is located, and displays motion information of the remote control device 150. The selected graphic object is dragged as a basis (S250).

When the down signal of the first button and the down signal of the second button are not included, the electronic device 110 transmits the motion information included in the transmission to the position of the pointer displayed on the screen of the remote control device 150. Adjust to the basis (S260).

The method for adjusting the zoom of the content illustrated in FIG. 22 includes whether the transmission received from the remote controller 150 includes at least one of an up signal of a grab button of the remote controller 150 and an up signal of an ok button. The method may further include checking a step, and when at least one of the up signal of the grab button and the up signal of the ok button is included, step S230 may be stopped.

23 is a diagram illustrating an embodiment of a screen on which a content list is displayed.

Referring to FIG. 23, the display 150 may display a content 2310 and a content list 2320 on a screen. The content list 2320 may include at least one of a channel list, a video list, an audio list, and an application list. In addition, an item included in the content list 2320 may be associated with a specific content, and may be thumbnails 2321, 2322, 2323, 2324, 2325, and 2326. The user may select an area in which the simple channel, the premier content, the smart share, and the my app are displayed to display a content list associated with the selected area.

In the normal mode, when the user presses the grab button of the remote control device 150, at least one of the display mode, the graphic feedback, and the graphic object based on the priority between the graphic object and the graphic object displayed on the screen 130. Can be determined. Here, the priority between the graphic objects may be set in the media system 100, updated during the operation of the media system 100, and may be changed according to a user's setting.

In the screen 130 of FIG. 23, the graphic object becomes a content 2310, a content list 2320, and a menu (simple channel, premier content, smart share, and my app).

In some embodiments, the content list 2320 may be the highest priority. When the user presses the grab button of the remote control device 150, the media system 100 provides graphical feedback indicating that the content list 2320 has been selected and operates in the content list mode.

24 illustrates another embodiment of a screen on which a content list is displayed on a display device according to the present invention.

Referring to FIG. 24, the display 130 may display a broadcast program 2410, an execution window 2420 of an application, and a content list 2430 on a screen. The display object may be a broadcast program 2410, an execution window 2420 of an application, and a content list 2430. When the priority of the broadcast program 2410 is set highest, when the user presses the grab button of the remote control device 150, graphic feedback indicating that the broadcast program 2410 is selected may be provided. In addition, when the priority of the content list 2430 is set to the highest, when the user presses the grab button of the remote control device 150, graphic feedback indicating that the content list 2430 is selected may be provided, and the media system ( 100 may operate in a content list mode.

25 illustrates one preferred embodiment for graphical feedback indicating that a content list has been selected.

Referring to FIG. 25, the media system 100 may highlight 2521 an item included in the content list 2520 with graphic feedback indicating that the content list is selected.

FIG. 26 illustrates another embodiment for graphical feedback indicating that a content list has been selected.

Referring to FIG. 26, the media system 100 may reduce thumbnails included in the content list 2620 with graphic feedback indicating that the content list is selected. That is, the thumbnail may be reduced in a direction toward the center of the thumbnail in at least one of the upper side, the lower side, the left side and the right side of the thumbnail.

In some embodiments, the media system 100 may reduce and then expand the thumbnails included in the content list 2620 with graphical feedback indicating that the content list has been selected. That is, the thumbnail is reduced in the direction toward the center of the thumbnail at least one of the upper side, the lower side, the left side and the right side of the thumbnail, and then returns to the original state.

FIG. 27 is a diagram illustrating an embodiment in which an item included in a content list is moved as a remote control apparatus moves according to the present invention.

Referring to FIG. 27, in the content list mode, an item included in the selected content list 2720 may be moved according to the movement of the remote control apparatus 150. The user may move the item included in the selected content list by moving the remote control device 150.

When the user moves the remote control device 150 from the right side to the left side, the thumbnails 2321, 2322, 2323, 2324, 2325, and 2326 included in the content list 2320 illustrated in FIG. 23 are points 2721 and 2722, respectively. , 2723, 2724, 2725, 2725).

FIG. 28 is a diagram illustrating another embodiment in which an item included in a content list is moved as a remote control apparatus moves according to the present invention.

Referring to FIG. 28, when the user moves the remote control device 150 from left to right, the thumbnails 2321, 2322, and 2323 included in the content list 2320 illustrated in FIG. 23 may be points 2824 and 2825, respectively. , 2826, thumbnails 2324, 2325, and 2326 disappear from the right side of the screen 130, respectively, and thumbnails 2812, 2822, and 2823 appear at the left side of the screen 130.

29 is a diagram for describing a process of selecting an item included in the displayed content list.

Referring to FIG. 29, in the content list mode, when the user releases the grab button of the remote control device 150, the graphic feedback indicating that the content list 2920 is selected is stopped, and the media system 100 returns to the normal mode. It works.

In the normal mode, the display point 2901 can move according to the movement of the remote control device 150. The user may move the remote control device 150 to adjust the display point 2901. Here, the electronic device 110 may adjust the position of the pointer displayed on the screen based on the motion information transmitted from the remote control device 150.

The user may press the OK button on the remote control device 150 to select a thumbnail 2827 located at the display point 2901. The remote control apparatus 150 may detect a user action of pressing the OK button, and transmit a transmission indicating the user action to the electronic device 110 in response to the user action detection. The electronic device 110 may receive a transmission from the remote control device 150 indicating that the OK button of the remote control device has been pressed, and in response to receiving the transmission, display the display 130. The real time broadcast program 2910 broadcasted in the channel associated with the thumbnail 2827 where the displayed point is located may be displayed.

30 is a flowchart illustrating a process of performing a preferred embodiment of the method for moving a content list according to the present invention.

Referring to FIG. 30, the media system 100 operates in a normal mode (S300). The display 130 may display content on the display screen. The display 130 may display the content in the full screen mode. Here, the displayed content may be at least one of a web page, an application, a broadcast program, a video, a photo, an image, and an icon. The displayed content may include content stored in a local storage area, a real time broadcast program, content transmitted through streaming, At least one of the downloaded content and the content captured by the camera included in the media system.

For example, the display 130 may display the screens shown in FIGS. 8, 19, 23, and 24 in the normal mode.

The remote control device 150 detects a user action of pressing the grab button (S305). The user action may include selection of a physical button of the remote control device, movement of the remote control device, execution of a predetermined touch gesture on the interface provided by the user interface unit 320, or selection of a soft button. The remote control device 150 may transmit a transmission indicating the user action to the electronic device 110 in response to the user action detection. Here, the transmission may include at least one of motion information of the remote control apparatus 150, a down signal of a button of the user interface unit 320, and an up signal. The electronic device 110 may receive a transmission from the remote control device 150 indicating that the grab button of the remote control device 150 has been pressed.

In response to receiving the transmission, the electronic device 110 checks whether a content list is displayed on the screen of the display 130 (S310). The content list may include at least one of a channel list, a video list, an audio list, and an application list. The channel list may be a preferred channel list. Each thumbnail included in the channel list may be associated with a specific channel.

If the content list is not displayed, the media system 100 operates in a grab mode (S315). In grab mode, media system 100 may provide graphical feedback indicating that the screen of display 130 has been touched.

If a content list is being displayed, in content list mode, the media system 100 provides graphical feedback indicating that the displayed content list has been selected. Here, the content list may be the channel list 2320 illustrated in FIG. 23. The graphic feedback may include at least one of highlighting an area where a content list is displayed, decreasing an area where the content list is displayed, and shrinking and expanding the area where the content list is displayed. . The graphical feedback may be the graphical feedback described above in FIG. 25 or 26.

In the content list mode, the electronic device 110 checks whether a user action of releasing the grab button is detected (S325). When the remote control device 150 detects a user action of releasing the grab button, the remote control device 150 may transmit a transmission to the electronic device 110 indicating that the grab button is released. When the transmission is received, the electronic device 110 may determine that a user action of releasing the grab button is detected.

If a user action of releasing the grab button is detected in step S325, the media system 100 operates in the normal mode. The electronic device 110 may stop the graphic feedback provided in the content list mode. In addition, the electronic device 110 releases the selection of the selected content list in response to detecting a user action.

The remote control device 150 detects the movement of the remote control device (S330). The remote control device 150 may transmit a transmission including the motion information indicating the detected motion to the electronic device 110. The electronic device 110 may receive a transmission including motion information indicating movement of the remote control device 150 from the remote control device 150.

The electronic device 110 checks the movement of the remote control device (S335). The electronic device 110 may check the movement of the remote control device based on the motion information included in the transmission received from the remote control device 150. Here, the electronic device 110 may further check whether the speed of the movement of the remote control device 150 exceeds a preset speed.

If the movement speed of the remote control device 150 does not exceed the preset speed, the media system 100 operates in the movement mode (S340). In the movement mode, the electronic device 110 may instruct the screen of the display 130 to be displayed in the movement mode. In the movement mode, the electronic device 110 moves an item included in the content list according to the movement information. In addition, the moving direction and speed of an item included in the content list may vary according to the direction and speed of the movement of the remote control apparatus 150.

In some embodiments, an item included in the content list may be a thumbnail, and the movement of the thumbnail may vary depending on the direction and speed of the movement of the remote control apparatus 150. Here, the items included in the content list may be moved in the manner described above with reference to FIGS. 27 and 28.

If the speed of the movement of the remote control device 150 exceeds the preset speed, the electronic device 110 instructs the screen of the display 130 to be displayed in the flickering mode (S345). In the flicking mode, the electronic device 110 moves an item included in the content list at a predetermined speed or more for a preset time, and stops the movement while decreasing the speed of the movement when the preset time elapses. . In some embodiments, when an item included in the content list is a thumbnail, the thumbnail is moved in a shape rotated by a predetermined angle clockwise or counterclockwise with respect to the y axis.

While the displayed contents are moved, the remote controller 150 detects a user action of releasing the grab button (S350). In response to the user action detection, the remote control device 150 may transmit a transmission to the electronic device 110 indicating that the grab button is released. The electronic device 110 may receive a transmission indicating that the grab button has been released from the remote control device.

In response to the user action detection, the media system operates in a normal mode (S355). In operation S355, the electronic device 110 may instruct the screen of the display 130 to be displayed in the normal mode. In operation S355, the electronic device 110 may stop the movement of the item of the content list. In addition, the electronic device 110 may stop the graphic feedback indicating that the content list has been selected and deselect the content list. In the normal mode, the media system 100 may adjust the position of the pointer displayed on the screen according to the movement of the remote control device 150. Here, the electronic device 110 may adjust the position of the pointer displayed on the screen based on the motion information transmitted from the remote control device 150.

The remote control device 150 detects a user action of pressing the OK button (S360). The remote control device 150 may transmit a transmission indicating the user action to the electronic device 110 in response to the user action detection. The electronic device 110 may receive a transmission indicating that the OK button of the remote control device is pressed from the remote control device 150.

In response to detecting the user action, the media system 100 displays content associated with an item on a content list in which the displayed point is located (S365). In response to receiving the transmission indicating that the OK button of the remote control device was pressed, the electronic device 110 displays on the display 130 a display of the content associated with the item on the content list where the displayed point is located. Can be directed.

In some embodiments, if the content list is a channel list that includes thumbnails, media system 100 displays the broadcast program of the channel associated with the thumbnail on the channel list where the displayed point is located. For example, when the display pointer 2901 is positioned at the thumbnail 2827 as shown in FIG. 29, when a user action of pressing the ok button is detected, the real-time broadcast program 2910 broadcasted on the channel associated with the thumbnail 2827 is detected. Can be displayed.

The method for moving the content list shown in FIG. 30 may further include tuning the channel by the electronic device 110 and receiving a real-time broadcast program of the tuned channel. The electronic device 110 may tune the channel based on the channel number of the real-time broadcast program displayed in step S300. In some embodiments, the electronic device 110 may select a channel having a front number or a rear number of the channel number of the real broadcast program. In addition, the electronic device 110 may change the tuned channel to another channel. Here, another channel may be a channel having a front number or a rear number of the tuned channel.

In the method for moving the content list shown in FIG. 30, the electronic device 110 generates a thumbnail using the received image of the real-time broadcast program, and the electronic device 110 stores the generated thumbnail. It may further comprise a step. The thumbnail displayed in the content list may be the stored thumbnail. For example, the thumbnails 2321, 2322, 2323, 2324, 2325, and 2326 illustrated in FIG. 23 may be the full-length thumbnails.

The invention can also be embodied as computer readable code on a computer readable recording medium. The computer-readable recording medium includes all kinds of recording devices in which data that can be read by a computer device is stored. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and may also be implemented in the form of a carrier wave (for example, transmission over the Internet). Include. The computer readable recording medium can also be distributed over network coupled computer devices so that the computer readable code is stored and executed in a distributed fashion.

Although the preferred embodiments of the present invention have been shown and described above, the present invention is not limited to the specific preferred embodiments described above, and the present invention belongs to the present invention without departing from the gist of the present invention as claimed in the claims. Various modifications can be made by those skilled in the art, and such changes are within the scope of the claims.

Claims (20)

In the screen interface feedback method of the media system controlled by the remote control device,
Displaying content on a display screen;
Receiving a first transmission from the remote control device indicating that the grab button of the remote control device has been pressed;
Providing graphical feedback indicating that the screen is selected in response to the received first transmission;
Receiving a second transmission from the remote control device indicating that the pressed grab button has been released; And
Ceasing to provide the graphical feedback in response to the received second transmission;
Providing the graphical feedback
Reduce the area where the content is displayed from the top, bottom, left, and right side of the screen to the center, and display content related to the displayed content in the left and right areas where the area where the content is displayed is reduced;
Ceasing to provide the graphical feedback
And stopping displaying the associated content and expanding and displaying an area where the content is displayed in a pre-minified state. The method of claim 1,
The grab button,
And a button for selecting a specific graphic object irrespective of the position of the indicator. The method of claim 1,
The displaying step,
And displaying the content in a full screen mode in which the content is displayed in full screen. delete The method of claim 1,
Providing the graphical feedback,
Making the cursor displayed on the screen disappear; And
And displaying a still image of the content. The method of claim 1,
And the content is a real-time broadcast program. The method of claim 6,
The graphic feedback,
And shrinking an area on which the real-time broadcast program is displayed, and displaying a real-time broadcast program of a channel different from a channel of the real-time broadcast program. delete The method of claim 7, wherein
Receiving a transmission from the remote control device including movement information indicating movement of the remote control device; And
And responsive to the received movement, moving the reduced region and the region where the real-time broadcast program of the other channel is displayed according to the motion information. The method of claim 9,
And a direction and a speed at which the reduced area and the area where the real-time broadcast program of the other channel is displayed are moved according to the direction and speed of the movement of the remote control device. The method of claim 9,
When the speed of the movement of the remote control device exceeds a preset speed, the still images of a plurality of channels are sequentially displayed for a preset time and moved over a predetermined speed, and when the preset time elapses, And the movement is stopped while the movement speed is decreased, and a real-time broadcast program of a channel associated with a still image displayed on the screen is displayed on the screen while the movement is stopped. The method of claim 11,
And a plurality of still images of the still images are simultaneously displayed on the screen. The method of claim 11,
And a plurality of still images simultaneously displayed on the screen are displayed with mutual perspective. The method of claim 10,
While the displayed still images are being moved, receiving a transmission indicating that the grab button has been released from the remote control device; And
And stopping the movement in response to the reception, and displaying, on the screen, a real-time broadcast program of a channel associated with a still image displayed on the screen in the stopped state. . The method of claim 7, wherein
Tuning a channel and receiving a real-time broadcast program of the tuned channel;
Generating a still image using the received image of the real-time broadcast program;
Storing the generated still image; And
Changing the tuned channel to another channel;
And the stored still image is displayed in a region where the real-time broadcast program of the other channel is displayed. The method of claim 15,
Tuning the channel,
And tuning the channel based on the channel number of the real-time broadcast program displayed in the reduced area. delete In a media system for displaying content,
The media system includes an electronic device and a remote control device,
The electronic device,
Instruct the display to display content,
Receive a first transmission from the remote control device indicating that the grab button of the remote control device has been pressed,
In response to the received first transmission, provide graphic feedback indicating that a screen of the display is selected,
Receive a second transmission from the remote control device indicating that the pressed grab button has been released,
Stop providing the graphical feedback in response to the received second transmission,
The graphical feedback is
Reducing the area where the content is displayed from the top, bottom, left, and right sides of the screen to the center, and displaying the content associated with the displayed content in the left and right areas where the area where the content is displayed is reduced; Characterized by a media system. delete delete

Images