KR101110276B1 - Image processing device and image processing methods using multiple screens - Google Patents

Abstract

An image processing apparatus including a first image display apparatus adapted to display a first image and a second image display apparatus adapted to spatially project a second image toward a specific direction are disclosed. The particular direction is determined by one or more parameters that determine the direction of the light source set for the first image. The second image may have a shadow shape of the first image.

Image processing, screen

Description

Image processing apparatus and image processing method using multiple screens {IMAGE PROCESSING DEVICE AND IMAGE PROCESSING METHODS USING MULTIPLE SCREENS}

The present invention relates to an image processing apparatus and an image processing method, and more particularly, to an image processing apparatus and an image processing method using a plurality of screens.

Providing an appropriately selected image or video in a partially or totally enclosed space can provide a pleasant environment for the person in that space. To this end, an image or video can be displayed using display devices such as CRT, PDP, LCD, OLED, and projector.

The image or video may be pre-stored in a storage medium and reproduced once or repeatedly on the display device. If you want to play a video with a long running time, there is a problem that the capacity of the storage medium for storing the video is increased. On the other hand, if a video having a short running time is repeatedly played, a person who observes the video repeatedly feels bored. In addition, when only the stored image is screened, the observer may feel lack of realism.

One problem to be solved by the present invention is to display the associated image on several screens at the same time.

However, the object of the present invention is not limited to those mentioned above, and other objects, which are not mentioned above, will be clearly understood by those skilled in the art from the following description.

An image processing apparatus according to an aspect of the present invention for solving the above problems is to perform a spatial projection of the first image display device and the second image to display a first image toward a specific direction And a second image display device, wherein the specific direction is determined by one or more parameters that determine a direction of a light source set for the first image.

The one or more parameters may comprise one or more of latitude, time of day, date, and direction angle. The first image may include a first subimage, and the second image may include a second subimage corresponding to a shadow of the first subimage. The second image may be a part of the entire image projected by the second image display device. The second image may be an entire image projected by the lens of the second image display device, and the lens may be rotatable in accordance with the projection direction.

An image processing apparatus according to another aspect of the present invention includes a first image display apparatus adapted to display a first image, and a second image display apparatus adapted to display an image including a second image. The shape and position of the two images is determined by one or more parameters that determine the direction of the light source set for the first image. The first image may include a first subimage, and the second image may include a second subimage corresponding to a shadow of the first subimage.

An image processing method according to another aspect of the present invention includes displaying a first image on a first image display device, and spatially projecting the second image toward a specific direction on the second image display device. The particular direction is determined by one or more parameters that determine the direction of light represented in the first image. The first image may include a first subimage, and the second image may include a second subimage corresponding to a shadow of the first subimage.

An image processing apparatus according to another aspect of the present invention includes a data processing unit, wherein the data processing unit generates a first image displayed on a first image display device, and spatially projects a specific direction on the second image display device. A second image is generated, wherein the specific direction is determined by one or more parameters that determine the direction of the light source set for the first image. The image processing apparatus may optionally further include a data acquisition unit, a screen, an image display apparatus, and a cover.

According to the invention it is possible to realistically display the associated image simultaneously on several screens.

However, the effects that can be achieved by the present invention are not limited thereto.

The effects of the present invention are not limited to those mentioned above, and other effects that are not mentioned will be clearly understood by those skilled in the art from the following description.

DETAILED DESCRIPTION Herein, reference numerals are provided to provide embodiments of the present invention. The reference numerals are shown in the accompanying drawings of the present invention, the detailed description of the invention can be described with reference to the accompanying drawings. Like elements in each drawing have like reference numerals. In the description of the invention reference numerals are indicated in parentheses.

Hereinafter, an image processing apparatus and an image processing method according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings. The specific embodiments below are merely illustrative of the image processing apparatus and the image processing method according to the present invention, and are not intended to limit the scope of the present invention. In describing the present invention, when it is determined that the detailed description of the related well-known configuration or function may obscure the gist of the present invention, the detailed description thereof will be omitted.

In this document, 'video' may be used as a term for a series of 'images' that change with time. In contrast, 'image' may be used as a term indicating a still image displayed at a specific time. In this document, the term 'image' may include the concepts of 'image' and 'video', and the terms 'image processing apparatus' and 'image processing method' are related to the 'image' and / or the 'video'. Can be used.

Through windows formed on the walls separating indoor and outdoor, functions such as ventilation, light, and external views can be provided. In general, these features can have a positive impact on people in the room. The image display device according to an embodiment of the present invention may display a virtual external environment viewed through a window as an image or a video. In this case, the screen in which the image is formed may be installed indoors. Here, the interior may be a space separated from the outside by a partially or wholly opaque wall.

In one embodiment of the present invention, a video display device such as a PDP display, LCD, OLED display, CRT monitor can generally be provided as an integrated device with a screen. In this case, the screen may refer to a virtual surface on which an image is displayed.

Alternatively, in one embodiment of the present invention, an image display device such as a projector may be provided as a separate device from the screen. In this case, the screen may refer to an existing surface and / or a virtual surface to which an image can actually be formed, for example, a white cloth or paper.

1 is a view showing a state in which the image display device 1 according to an embodiment of the present invention is installed.

Referring to FIGS. 1A and 1B, an image display apparatus 1 according to an exemplary embodiment of the present invention may be installed indoors or installed on a wall 15. The interior can be distinguished from the outdoors by the wall 15. The interior may be separated from the exterior by side walls 12, ceilings 13, and floors 14. In FIG. 1A, if the image display device 1 and the screen 2 connected thereto are provided as separate devices, the image display device 1 is provided outdoors and only the screen 2 is indoor or wall 15. Or the like).

The image display device 1 may be a device such as a PDP display, an LCD, an OLED display, or a CRT monitor. The image display apparatus 1 may be installed in such a manner as to be embedded in, suspended from, or secured to a near side of the side wall 12, the ceiling 13, the floor 14, and the wall 15. have. The image display device 1 may display an image on the screen 2. In this case, the screen 2 may be supplied as a single device in combination with the image display device 1 or may be supplied as a separate device.

Referring to FIG. 1B, the image display device 1 may be a projection type device such as a projector. The image display device 1 may be installed at any one point A of the side wall 12, the ceiling 13, and the floor 14. The image display apparatus 1 may project an image onto the screen 2 installed on the wall 15.

In a modified example of this embodiment, unlike shown in FIG. 1B, a concave space is formed inside the wall 15 (not shown), and the image display device 1 is installed in the concave space. It is also possible to project an image onto the screen 2. In this case, the image display device 1 may not be hidden by the screen 2.

In an embodiment of the invention according to FIG. 1, the screen 2 is mounted on the wall 15 so that the projected image can produce an effect as if it is an image of an external environment seen through a real window in real life. It can be located as close as possible. In addition, a window frame 20 structure formed of a material such as wood or metal may be selectively formed around the screen 2 so as to appear as if the actual window exists.

In an embodiment of the present invention, the image displayed on the screen 2 may be generated by an image processing apparatus (not shown in FIG. 1 and reference numeral 3 of FIG. 2) according to an embodiment of the present invention. . The image processing apparatus 3 may be combined with the image display apparatus 1 and provided as a single device. Alternatively, the image processing apparatus 3 may be provided as a separate device separate from the image display apparatus 1, and may be physically and / or electrically connected to the image display apparatus 1.

It can be easily understood that the present invention is not limited to the specific type of the image display apparatus 1 described above.

2 is a block diagram showing the configuration of an image display apparatus 1 and an image processing apparatus 3 according to an embodiment of the present invention.

The image processing apparatus 3 may include a data processor 301 and a data acquirer 302.

The data processor 301 may receive various information necessary for generating an image from the data acquirer 302. The image generated by the data processor 301 may be a composite image composed of one or more image layers. Each image layer may be generated by a predetermined rule using one or more of the information.

Hereinafter, the configuration of the data acquisition unit 302 for acquiring the information required for generating the composite image will be described. At this time, the information necessary for generating the composite image includes information such as climate, ecological information, time, weather, solar radiation, precipitation, snowfall, temperature, wind direction, wind speed, humidity, wave height, latitude, longitude, date, direction of light source. May be weather and / or environmental information.

In the first configuration, the data acquisition unit 302 may request and / or receive information necessary for generating the composite image through the communication channel 303 and the communication network 304. The communication channel 303 may be a wireless channel or a wired channel well known in the communication field. The data acquirer 302 may receive information necessary for generating the composite image from the server 306 connected to the communication network 304. The communication network 304 may be the Internet, for example. Information necessary for generating the composite image may be provided to the server 306 by the Meteorological Administration. The server 306 may be managed by the meteorological office or by a subject different from the meteorological office.

In a second configuration, the data acquisition unit 302 may request and / or receive information necessary for generating the composite image from the sensor 305 through the communication channel 303. The sensor 305 may be composed of well-known devices suitable for collecting information necessary for generating the composite image. For example, the device may be a thermometer, a wind vane, an anemometer, a hygrometer, a GPS module, a clock, a solar light measuring device, a rain gauge, a snow cover, a crest meter, and the like.

In a third configuration, the image processing apparatus 3 may further include a user input unit 310. The user input unit 310 may be various user input means well known in the art, such as a keyboard, a mouse, a touch panel, and the like. The user inputs various information necessary for generating the composite image through the user input unit 310, for example, climate, ecological information, time, weather, solar radiation, precipitation, snowfall, temperature, wind direction, wind speed, humidity, wave height, latitude, Information such as longitude, date, and direction of the light source can be entered. The information such as climate, ecological information, latitude, longitude can be used as information specifying the region. Information input through the user input unit 310 may be transferred to the data acquirer 302.

The data processor 301 may generate a composite image by using the information necessary for generating the composite image, and then transfer the generated composite image to the image display apparatus 1.

According to an embodiment of the present invention, the image display apparatus 1, the screen 2, and the image processing apparatus 3 may be integrally combined. Alternatively, according to another embodiment of the present invention, the image display device 1 is provided integrally coupled with the screen 2, while the image processing device 3 is a separate device such as a set-top box. It may be provided as.

In a projection type imaging apparatus such as a projector, the image display apparatus 1 and the screen 2 may be provided as separate apparatuses, respectively. That is, for example, the image display apparatus 1 may mean a device including a projection lens, and the screen 2 may be a white screen on which an image emitted through the lens may be projected. In this case, the image processing apparatus 3 may be integrally combined with the image display apparatus 1 and provided as a single device, or the image processing apparatus 3 may be provided as a separate device such as a set top box.

The image processing apparatus 3 may optionally further include a sound output unit 320. In this case, the sound output unit 320 may be connected to the data processor 301. The data processor 301 may transmit a sound output signal to the sound output unit 320 using the information necessary for generating the composite image received from the data acquirer 302. For example, when the raining scene is included in the composite image, the data processor 301 may transmit the raining sound to the sound output unit 320.

The data acquisition unit 302 illustrated and described in FIG. 2 may be replaced with the term communication unit.

3 and 4 illustrate a process of generating a composite image according to an exemplary embodiment of the present invention, and illustrate a method of generating a composite image including one or more image layers by the image processing apparatus.

Information necessary for generating the composite image or one or more image layers may be composed of the parameters listed in Table 1. The parameters illustrated in Table 1 are for illustration only, and thus the present invention is not limited by Table 1.

parameter property Numeric property Numerical range P _ecology ecology Discrete value Bamboo (0), Grassland (1), Palm Tree (2), Snowfield (3), Sea (4), City (5) P _rain ratio Discrete value None (0), Weak (1), Normal (2), Strong (3) P _snow Eye Discrete value None (0), Weak (1), Normal (2), Strong (3) P _hail hail Discrete value None (0), Weak (1), Normal (2), Strong (3) P _lightning Lightning Discrete value None (0), Weak (1), Normal (2), Strong (3) P _{cloud _ amount} Cloud cover Discrete value None (0), Little (1), Moderate (2), Many (3) P _{cloud _ shape} Cloud Discrete value Cumulus cloud (0), stratified cloud (1) P _{wind _ direction} Wind direction Discrete value N (0), NE (1), E (2), SE (3), S (4), SW (5), W (6), NW (7) P _{wind _ velocity} Wind speed Discrete value None (0), Weak (1), Normal (2), Strong (3) P _humidity Humidity Discrete value None (0), Low (1), Medium (2), High (3) P _{wave _ height} Digging Discrete value None (0), Low (1), Medium (2), High (3) P _{falling _ leaves} Falling leaves Discrete value None (0), Small (1), Medium (2), Large (3) P _shadow shadow Discrete value None (0), Yes (1) P _date date Discrete value Mon. Sun. P _time Time Continuous value 0 ^h to 24 ^h P _latitude Latitude Continuous value + 90 ° ~ -90 ° P _direction Light source direction Continuous value (θ _x , θ _y , θ _z )

Referring to Table 1, parameters P _ecology to P _date have different attributes and may be assigned discrete values. For example, the parameter P _ecology having an ecological property has an integer value of 0 to 5, for example, P _ecology = 'bamboo (0)' indicates an environment in which bamboo is present. The same is true for the parameters P _rain to P _date . The parameter P _{wind _ velocity} representing the wind speed in Table 1 may represent the horizontal wind speed.

The parameters P _time , P _latitude , and P _direction may have consecutive values according to their attributes. For example, the parameter P _time having a visual attribute may have a substantially continuous value from '0h' to '24h'. The same applies to the parameters P _latitude and P _direction . The origin o of the (x, y, z) axis can be set in relation to the parameter P _direction . The origin o can be set near the screen 2 according to the invention. The continuous value may be quantized and stored or transmitted for convenience by the image processing apparatus and / or the above-described server or sensor according to the present invention.

Whether a parameter has a discrete value or a continuous value may be determined depending on the performance of the image processing apparatus as well as the attribute of the parameter. For example, the parameter P _{wind _ velocity} indicating the wind speed may have a continuous value in its property, but may have a discrete value as shown in Table 1 to simplify the processing of the value.

One image layer can be created using one or more parameter values listed in Table 1. Hereinafter, a method of generating an image layer using the one or more parameters will be described with reference to FIG. 3.

(A), (b), (c), (d), and (e) of FIG. 3 each represent N (N = 5) image layers L1, L2, L3, L4, and L5 constituting the composite image. Indicates. 3 is illustratively illustrated for purposes of illustration, and thus the scope of the present invention is not limited thereto.

For example, an image mapped to the image layer L1 may be generated according to the value of the parameter P _ecology . If the parameter P _ecology = 'meadow 1' is given, an image of a meadow may be mapped to the image layer L1 ((a-1) of FIG. 3). In contrast, when the parameter P _ecology = 'bamboo (0)' is given, an image of bamboo may be mapped to the image layer L1 ((a-2) of FIG. 3). That is, an image mapped to the image layer L1 may be generated by the parameter P _ecology .

Similarly, an image mapped to the image layer L2 may be generated according to the value of the parameter P _rain . If the parameter P _rain = 'none (0)' is given, since no rain falls, no image may be mapped to the image layer L2 ((b-1) of FIG. 3). On the contrary, when the parameter P _rain = 'normal (2)' is given, since the rain of the normal intensity falls, the rain layer image of the normal intensity may be mapped to the image layer L2 (FIG. 3B-2). ). That is, the image mapped to the image layer L2 may be generated by the parameter P _ecology .

Similarly, an image mapped to the image layer L3 may be generated according to the value of the parameter P _{falling _ leaves} . If the parameter P _{falling _ leaves} = 'none (0)' is given, since no falling leaves exist, no image may be mapped to the image layer L3 ((c-1) of FIG. 3). However, when the parameter P _{falling _ leaves} = 'a small amount (1)' is given, since some falling leaves exist, an image of some falling leaves may be mapped to the image layer L3 (FIG. 3C). -2)). That is, the image mapped to the image layer L3 may be generated by the parameter P _{falling _ leaves} .

In addition, an image mapped to the image layer L4 may be generated according to the value of the parameter P _shadow . If the parameter P _shadow = 'none (0)' is given, since no shadow exists, no image may be mapped to the image layer L4 ((d-1) of FIG. 3). However, when the parameter P _shadow = 'the present (1)' is given, the shadow may be mapped to the image layer (L4) because the shadow exists (Fig. 3 (d-2)). In this case, since the shape of the shadow is determined according to the shape of the object that casts the shadow, the image mapped to the image layer L4 representing the shadow may be determined according to the value of the parameter P _ecology specified in the image layer L1. . That is, in the above example, since the parameter P _ecology = 'bamboo (0)', the shadow image mapped to the image layer L4 may have the form of bamboo. That is, the image mapped to the image layer L4 may be generated by the parameter P _shadow .

In addition, an image of the sun may be mapped to the image layer L5, which may vary according to the value of the parameter P _time . When the parameter P _time = '6h' indicates that the sun starts to rise, an image of the sun mapped to the image layer L5 may be located at s1. However, in contrast to this, when the parameter P _time = '12h' represents the state of the sun rises in midheaven, the image of the sun mapped to the image layer (L5) may be located in s2. That is, the position of the sun image mapped to the image layer L5 may be a specific point of the predetermined path r1 according to the value of P _time .

If the parameters P _rain = 'none (0)', P _{falling _ leaves} = 'none (0)', and P _shadow = 'none (0)' are given, then the corresponding image layers (L2, L3, L4) Although no image is described as being mapped, in this case, the above-described image layers L2, L3, and L4 may not be generated at all.

Since the image of the bamboo mapped to the image layer L1 and the image of the shadow mapped to the image layer L4 have a corresponding relationship, they are not represented in the two image layers L1 and L4 as above. It may be expressed by being integrated into one image layer.

According to an embodiment of the present invention described above, the image mapped to the image layer (L1, L2, L3, L4, L5) is generated by the parameters P _ecology , P _rain , P _{falling _ leaves} , P _shadow , P _time , respectively It became. However, the image of the image layer L1 may be generated by two or more parameters. For example, an image of a parameter P _{_ wind velocity} is added to the image layer (L1, L2, L3, L4) described above is given by case on the wind speed can be changed.

For example, given the parameters P _{wind _ velocity} = 'none (0)' for _wind speed, and the parameters P _ecology = 'bamboo (0)', P _rain = 'normal (2)', P _{falling _ leaves} = 'A small amount (1)', P _shadow = 'with (1)' will be described. At this time, bamboo is present, rain is falling in the middle of the century, there are small amounts of falling leaves, shadows, and no wind. In this case, an image of bamboo extending vertically as shown in (a-2) of FIG. 3 may be mapped to the image layer L1, and vertically as shown in (b-2) of FIG. 3 to the image layer L2. An image of rain falling may be mapped, and an image of fallen leaves falling quietly may be mapped to the image layer L3 as shown in FIG. 3C-2.

However, unlike above, the parameter P _{wind _ velocity} = 'strong (3)' is given and the parameter P _ecology . P _rain , P _{falling _ leaves} , and P _shadow may have the same value as above. In this case, since the wind is strong, the image mapped to each image layer may be different from the above-described image. That is, an image of bamboo chopped in the horizontal direction may be mapped to the image layer L1 as shown in FIG. 3A-3, and the image layer L2 is lowered diagonally as shown in FIG. 3B-3. An image of rain may be mapped, and an image of fallen leaves falling while flying in the air may be mapped to the image layer L3 as illustrated in FIG. 3C.

In addition, even when the _time parameter P _time is given, an image mapped to a specific image layer may be changed. For example, given the parameters P _ecology = 'bamboo (0)', P _shadow = 'with (1)', P _time = '7h', bamboo exists, shadow exists, and the sun rises. The image of the bamboo shadow pointing to the west may be mapped to the image layer L4 ((d-2) of FIG. 3). In contrast, if P _ecology = 'bamboo (0)', P _shadow = 'with (1)', P _time = '12h', bamboo is present, shadow is present, and the sun is in the middle In addition, an image of a bamboo shadow pointing north may be mapped to the image layer L4 ((d-3) of FIG. 3). Similarly, given P _time = '18h', the image of the bamboo shadow may extend east (FIG. 3 (d-4)).

In addition, although not shown separately, since the amount of light may vary depending on the position of the sun, the brightness of each image layer constituting the composite image may be changed according to the value of the parameter P _time . That is, while a new image layer is generated by a parameter such as a parameter indicating the position of the sun and a parameter indicating the amount of clouds, the saturation, brightness, etc. of the image layer generated as described above may be changed.

It can be seen from the above description that an image mapped to a specific image layer can be generated from two parameters. However, one of ordinary skill in the art appreciates that the image can be determined by more than two parameters. For example, given the parameters P _ecology = 'bamboo (0)', P _{wind _ velocity} = 'strong (3)', P _time = '12h', the image layer (L1) of the bright and horizontally curved bamboo The image may be mapped ((a-3) of FIG. 3). Alternatively, given the parameters P _ecology = 'bamboo (0)', P _{wind _ velocity} = 'none (0)', P _time = '18h', the image of bamboo extending dark and vertically to the image layer L1. May be mapped ((a-4) of FIG. 3).

Although not described above, an image generated by one parameter may be affected by another parameter. For example, the position of the sun image can be changed not only by the parameter P _time representing the _time , but also by the parameter P _date representing the _date and the parameter P _latitude representing the _latitude . Or the position of the sun image may be determined by the parameter P _direction .

In addition, one parameter may be processed with a higher priority than another parameter. For example, if the parameter P representing _shadow is given by '= (1)', the shadow exists, but the parameter P _time representing the _time has a value of, for example, '23h' to '4h'. If not, the shadow may not exist because the sun is not rising. At this time, the parameter P _shadow = 'one (1)' needs to be changed or ignored as P _shadow = 'none (0)'. Thus, when one parameter has a specific value, the other parameter may be changed to a predetermined value or ignored depending on the specific value.

4 is a view for explaining a process of generating a composite image by synthesizing one or more image layers according to an embodiment of the present invention.

4A illustrates an example of a composite image formed according to an embodiment of the present invention. Among the parameters listed in Table 1, P _ecology = 'bamboo (0)', P _rain = 'normal (2)', P _{wind_velocity} = 'strong (3)', P _{falling _ leaves} = 'normal (2)', P _shadow If 'none (0)' is given, the wind blows so strongly that an image of bamboo tilted to one side is mapped to the image layer (L1), and an image of the normal intensity rain straight down is mapped to the image layer (L2). The fallen leaves scattered to and from the image layer L3 are mapped to the image layer L3, and the image of the shadowless state is mapped to the image layer L4. When the four image layers L1, L2, L3, and L4 are synthesized, a synthesized image as shown by reference numeral 401 of FIG. 4A can be obtained.

4B illustrates another example of a composite image formed according to an embodiment of the present invention. Among the parameters listed in Table 1, P _ecology = 'bamboo (0)', P _rain = 'none (0)', P _{cloud_amount} = 'none (0)', P _{wind _ velocity} = 'none (0)', P _{falling _ If leaves} = 'none (0)', P _shadow = 'one (1)', P _time = '14h', the image of bamboo is mapped to the image layer (L1), and rain on the image layer (L2) Images that do not fall are mapped, images without clouds are mapped to image layer L3, images without wind are mapped to image layer L4, and images without falling leaves are mapped to image layer L5. Are mapped to the image layer L6, and the image of the state where the shadow exists is mapped, and to the image layer L7, the image of the state of the sun at the position of 14h is mapped. When the seven image layers L1, L2, L3, L4, L5, L6, and L7 are synthesized, a synthesized image as shown by reference numeral 402 of FIG. 4B may be obtained.

When composing multiple image layers as described above, one image layer may overwrite another image layer. For example, in the example of FIG. 4 (b), if the parameter P _{cloud _ amount} = 'high (3)' is a large amount of cloud, the sun is hidden by the cloud even if the sun exists. You may not. In this case, the image layer L3 to which the cloud image is mapped may overwrite the image layer L7 to which the sun image is mapped. The same is true for other image layers.

In addition, as described above, another image layer may be ignored or changed by one image layer. For example, in the example of FIG. 4B, when the parameter P _{cloud _ amount} = 'many (3)', the shadow is not present in the image layer L6 because the cloud amount is large. Can be

The composite images according to the exemplary embodiment of the present invention illustrated in FIGS. 3 and 4 are one composite image each representing a specific moment. However, according to an embodiment of the present invention, an image mapped to each image layer may change with time according to the information necessary for generating the composite image or one or more image layers.

5 illustrates that an image mapped to an image layer changes over time according to an embodiment of the present invention. For the purpose of illustration, each image layer is horizontally divided into four regions (H1, H2, H3, H4, H5) and vertically divided into four regions (V1, V2, V3, V4).

FIG. 5A shows a change over time of an image mapped to an image layer that may be generated when the parameters P _{wind _ velocity} = 'strong (3)' and P _{falling _ leaves} = 'small amount (1)' are given. It is shown. The parameters given above indicate the presence of strong winds and leaves. As the wind blows, the leaves may descend as they move horizontally over time. Referring to FIG. 5A, the fallen leaves that existed in the areas [H3, V2] at time t = 1 move to the areas [H2, V3] at time t = 2, and at time t = 3. Moves to the area [H1, V4].

On the other hand, FIG. 5B shows the time of an image mapped to an image layer that may be generated when the parameters P _{wind _ velocity} = 'none (0)' and P _{falling _ leaves} = 'small amount (1)' are given. The change is shown. In this case, because there is no wind, the leaves can only descend in the vertical direction. Referring to FIG. 5B, the fallen leaves that existed in the regions [H3, V2] at the time t = 1 move to the regions [H3, V3] at the time t = 2 and the time (t = 3). Moves to the area [H3, V4].

As such, when the image mapped to a specific image layer changes over time, the synthesized image changes as a whole. Therefore, a video may be displayed on the screen described above.

FIG. 5C illustrates a change over time of an image that may be generated when parameters P _date = 'December 23' and P _time = '6h' to '18h' are given. The aspect may be located in regions [H1, V4], [H3, V2], and [H5, V4] at 6h, 12h, and 18h, respectively.

On the contrary, FIG. 5 (d) shows a change over time of an image mapped to an image layer that may be generated when parameters P _date = 'June 23' and P _time = '6h' to '18h' are given. It is shown. The aspect may be located in regions [H1, V3], [H3, V1], and [H5, V3] at 6h, 12h, and 18h, respectively. Referring to (c) and (d) of FIG. 5, it can be seen that the position of the sun image changes with time, and the altitude of the sun changes with the date. 5 (c) and 5 (d) illustrate the regions located in the northern hemisphere.

Combining the embodiments of the invention described with reference to FIGS. 3 to 5, one or more image layers can be created using various parameters, as well as one or more by varying the images mapped to the image layers over time. It can be seen that a video layer can be created. Therefore, according to the present invention, one or more image layers and one or more video layers may be synthesized to generate a composite video.

According to the embodiments of the present invention described above, the storage space required for outputting a video can be reduced. For example, assuming that a video is to be screened for two days, a video of bamboo with falling leaves is screened day and night on the first day, and a video of bamboo with rain falls on the second day. In this case, according to the conventional method, the video of the day depicting the bamboo forest in which the fallen leaves and the video of the day depicting the bamboo forest in the rain should be stored separately.

However, in this case, according to an embodiment of the present invention, an image corresponding to bamboo, an image representing rain, and an image of falling leaves are each generated from a predetermined template image, and each image is generated according to a predetermined rule according to time. You can create a video by changing it. That is, the video may be determined according to a predetermined template image corresponding to the parameter value described as an example in FIGS. 3 to 5 and the predetermined rule. Therefore, according to an embodiment of the present invention, unlike the prior art, a storage space for storing two days worth of images is not necessary, but only a space for storing some basic template images. Furthermore, even such template images can be generated whenever needed by the above-described parameters and predetermined rules, without having to store them in advance. Since the above-described parameters can be requested or received by the image processing apparatus 3 shown in FIG. 2 whenever necessary, the overall storage space required for the image processing apparatus 3 can be reduced.

Although the basic unit constituting the composite image has been referred to as an 'image layer' so far, the term 'layer' is used for convenience in describing the concept of the present invention and is not intended to limit the present invention. That is, it can be easily understood that combining a plurality of 'image layers' to form a single composite image is used in the same sense as combining multiple 'images' to form a single composite image.

The image processing apparatus 3 according to another exemplary embodiment of the present invention may include at least one of the location, color, brightness, saturation, and shape of the data acquisition unit 302 and the first image configured to acquire environmental information. It may include a data processor 301 that is to be processed according to the information.

The environmental information may include, but is not limited to, earth scientific information such as weather, solar radiation, precipitation, snowfall, temperature, wind direction, wind speed, humidity, wave height, time, latitude, and date.

The first image may be an image depicting a specific object. For example, the specific object may be a natural object such as clouds, rain, snow, lightning, dust, sun, sea, land, animals, plants, shadows, or artificial objects such as buildings, cars, airplanes, poisons, and the like. have.

The data processor 301 may be configured to process one or more of the location, color, brightness, saturation, and shape of the first image to describe the effect of the attribute of the environmental information on the specific object. For example, assuming that the environment information is wind and a certain object is a plant, if the wind is strong, the shape and position of the plant may be changed. As another example, assuming that the environment information is the sun and time, and assuming that the specific object is a shadow, the shadow may be processed to change shape, position, and brightness according to the position and time of the sun.

The data acquisition unit 302 may be configured to acquire the environment information from a remote server through a communication channel.

The data processor may be configured to synthesize the first image and the second image to generate a composite image. In this case, the second image may be processed in the same manner as the first image as described above.

The first image and the second image may be template images having a predetermined shape, color, brightness, and saturation.

The video may be provided by changing one or more of the position, color, brightness, saturation, and shape of the first image over time.

The image processing apparatus 3 may further include a memory, and the template of the first image and the template of the second image may be previously stored in the memory. In addition, the image processing apparatus 3 may further include an image display apparatus 1 adapted to display the composite image. The screen 2 may be integrally formed on the image display device 1 or may be separately formed. In addition, the image processing apparatus 3 may further include a sound output unit 320 configured to output a sound generated by the specific object.

The image processing method corresponding to the above-described embodiment of the present invention will be readily apparent to those skilled in the art.

A part of the image generated by the image processing apparatus 3 may be generated based on a template of the first image, and another part of the image generated by the image processing apparatus 3 may be generated by the image of the second image. Can be generated based on the template.

6 illustrates a positional relationship between a screen installed according to an embodiment of the present invention and a cover covering the screen.

Referring to (a), (b) and (c) of FIG. 6, the covers 601 and 602 may be installed in front of the screen 2, and the covers 601 and 602 may be formed around the hinge 610. It can be opened and closed by rotation. The hinge 610 may be fixedly coupled to the screen 2 as shown in FIG. Alternatively, unlike FIG. 6, the hinge may be fixedly coupled to a separate frame (not shown) installed near the boundary of the screen 2. The screen 2 may have a horizontal and vertical size of W * H. 6A shows a state in which the covers 601 and 602 cover all of the screen 2, (B) states a cover 601 and 602 covers a part of the screen 2, and (c) shows a cover ( 601 and 602 show an example in which the screen 2 is not covered at all.

The covers 601 and 602 may be formed of a transparent / opaque / translucent membrane material. In addition, as shown in Figure 6 may be formed by further comprising a grate-shaped frame. The film may be composed of various conventionally known materials such as paper or glass. However, the present invention is not limited to the above, and the structure of the frame and its inner region may be modified in various ways according to specific embodiments. For example, the covers 601 and 602 may include a frame defining the area, and the inside of the frame may be empty. That is, it may have a configuration such as a window sash without a glass window inserted therein.

Each cover 602 may further include a sensor (not shown). The sensor may be a gyroscope. The gyroscope may measure an angle between the cover 602 and the screen 2. For example, the angles formed by the cover 602 and the screen 2 in Figs. 6A, 6B, and 6C are 0 °, θ °, and 180 °, respectively. This allows the relative position between the cover 602 and the screen 2 to be measured. The same applies to the cover 601.

Alternatively, the sensor may be a distance measuring sensor installed at points A and B of the screen 2 and the cover 602, as shown in FIG. 6 (b). The sensor may measure the relative position of the screen 2 and the cover 602 by measuring the distance between the screen 2 and the cover 602. The same applies to the cover 601.

7 shows a positional relationship between a screen installed according to another embodiment of the present invention and a cover covering the screen.

While the covers 601, 602 of FIG. 6 are joined to the screen 2 by hinges, the covers 701, 702 of FIG. 7 operate in a sliding manner to cover the screen 2. Have

Referring to FIGS. 7A, 7B, and 7C, the covers 701 and 702 may be coupled to a window frame 703 configured near the boundary of the screen 2. The covers 701 and 702 may be composed of cover frames 701_1 and 702_1 and regions 701_2 and 702_2 surrounded by the cover frame, respectively. The areas 701_2 and 702_2 surrounded by the cover frame may be provided with a transparent / opaque / translucent film. The film may be composed of various conventionally known materials such as paper or glass. Alternatively, the regions 701_2 and 702_2 surrounded by the cover frame may be empty. That is, it may have a configuration such as a window sash without a glass window inserted therein.

The screen 2 may have a horizontal and vertical size of W * H. FIG. 7A illustrates a state in which covers 701 and 702 cover the screen 2 (A1 and A2), and FIG. 7B illustrates that covers 701 and 702 cover part of the screen 2. The states A1, A2, A4, and FIG. 7C show a state A3 in which the covers 701 and 702 open the screen 2 as much as possible. In FIG. 7, even if the covers 701 and 702 are completely open, the screen 2 has a hidden portion. However, different configurations of the covers 701 and 702 may be readily apparent to those skilled in the art, as will be appreciated by those skilled in the art that a modified configuration that may allow all portions of the screen 2 to be exposed when the covers 701 and 702 are fully open. In FIG. 7, area 'A1' is an area obscured by cover 701, area 'A2' is an area obscured by cover 702, and area 'A3' is an area not covered by cover 701, 702. 'A4' represents the area covered by the cover 701 and the cover 702.

Sensors may be installed on the cover frame 701_1 and the window frame 703. The distance L between the cover frame 701_1 and the window frame 703 may be measured by the sensor. The distance L shows how much the covers 701 and 702 are opened.

6 and 7 are for explaining an embodiment of the present invention described below, and the present invention is not limited by the specific structure shown in FIG. 6 or 7.

8 illustrates a configuration of an image system including an image processing apparatus according to an embodiment of the present invention.

The image processing apparatus 3 according to an embodiment of the present invention illustrated in FIG. 8 may include a data acquisition unit 302 and a data processing unit 301.

In this case, the image processing apparatus 3 may optionally include a position sensor 5, a temperature / humidity sensor 6, an image sensor 7, and an audio output unit installed on the screen 2 and / or the cover 4. One or more of 320 may be provided in a state of being integrally included. Alternatively, the image processing apparatus 3 may be separate from the position sensor 5, the temperature / humidity sensor 6, the image sensor 7, and the sound output unit 320 installed on the screen 2 and / or the cover 4. It can be provided as a device of.

The image processing apparatus 3 may be configured to receive a measurement signal from the position sensor 5.

In addition, the image processing apparatus 3 may be configured to additionally receive information about the temperature and / or humidity of the room from the temperature / humidity sensor 6 for measuring the temperature and / or humidity of the room.

The image sensor 7 may be configured to obtain an image in the direction of an observer observing the screen 2. For example, when the user is located indoors, the image sensor 7 may acquire an image of the interior.

Covers 601 and 602 and covers 701 and 702 described in FIGS. 6 and 7 may be one embodiment of the cover 4 of FIG. 8.

The position sensor 5 is a device described as an example in FIGS. 6 and 7, and may be a sensor for obtaining information about a relative position of the cover 4 and the screen 2. The data acquisition unit 302 may receive information regarding the relative positional relationship between the screen 2 and the cover 4 from the position sensor 5. In addition, the data acquisition unit 302 may acquire information necessary for generating an image, such as the parameters listed and exemplified in Table 1, through the communication channel 303.

As described above with reference to FIGS. 3 to 5, the data processor 301 may acquire information necessary for generating the image from the data acquirer 302, and then generate a composite image. When it is natural that one or more images constituting the composite image are essentially accompanied by sound, it may be natural to output a corresponding sound when the one or more images are displayed. For example, a raining sound may be combined with a raining image, and a thunder sound may be combined with a lightning strike. Although not listed in Table 1, a parameter representing an image of a frog or other animal is set, and when an image related to this parameter is displayed, a sound generated by the frog or other animal may be output together. When the image combined with the above sound constitutes the composite image, the sound may be output to the sound output unit 320.

The intensity of this sound output can be automatically adjusted according to the extent that the cover 4 covers the screen 2. In this case, the cover 4 may have a shape that mimics the shape of the window separating the interior from the outdoors, for example, the shape of FIG. 6 or 7. At this time, for example, when the composite image of rain is output on the screen 2, if the cover 4 is fully open, the raining sound output through the sound output unit 320 is maximized, and vice versa. When (4) completely covers the screen 2, it is possible to minimize the rain sound output through the sound output unit 320. That is, the size of the rain sound can be automatically adjusted according to the extent that the cover 4 covers the screen 2. In addition, in this case, when the cover 4 covers part or all of the screen 2, the sound of rain hitting the window may be output through the sound output unit 320.

In addition, depending on the extent that the cover 4 covers the screen 2, the image displayed on the screen 2 may be modified. For example, as shown in (a) of FIG. 6, when the cover 4 covers all of the screens 2 and the parameter P _rain = 'normal' 2 in Table 1 is given, the screen 2 looks like rain. You can show a composite image that seems to hit a window and flow down the window. Further, for example, when the covers 701 and 702 cover at least a part of the screen 2 as shown in FIG. 7B, when the parameter P _rain = 'normal 2' of Table 1 is given, In the areas A1, A2, and A4 covered by the covers 701 and 702, an image of rain water flowing down the window may be displayed on the screen 2. To generate such a composite image, the data processor 301 generates a separate image layer to which an image of rainwater flowing down a window is mapped, and combines the image layer with other image layers to generate the composite image. Can be. This image layer is preferably not obscured by other image layers.

As described above, when the data acquisition unit 302 is configured to receive the indoor temperature and / or humidity from the temperature / humidity sensor 6 and to receive information about the outdoor temperature from the sensor 305, This can have a steaming effect on the inside of the window. For example, if the outdoor temperature is lower than the indoor temperature and the humidity is high, the gaseous H ₂ O, which had existed in an unsaturated state in the warm air of the room, condenses near the window that is cold due to the low temperature of the outdoor window. Condensation may cause frost. If the above temperature / humidity conditions are satisfied and the window is partially or completely closed, the data processor 301 may further create a separate image layer to depict this phenomenon. Alternatively, the data processor 301 may additionally generate a separate image layer for describing the phenomenon of steaming without such specific conditions.

FIG. 9 illustrates a process of obtaining an indoor image from an image sensor and displaying the same on a screen according to an embodiment of the present invention.

Referring to FIG. 9A, the observer 100 may observe the screen 2 in a room including a ceiling 13, a floor 14, and a wall 15. In this case, the screen 2 and the image processing apparatus 3 (not shown) connected to the screen 2 may actually display an image that can be viewed when the observer 100 sees the glass window at the screen 2 position. Can be configured. Depending on the difference between the optical brightness of the outdoor and the indoor, for example, when the outdoor is dark and the indoor is bright, the interior of the room may be mirrored on the glass window. At this time, the interior of the room has a translucent characteristic, and may appear to overlap with the outside of the glass window. In order to depict and present such an image, an image sensor 7 can be installed anywhere in the room, for example near the screen 2, to capture the picture of the room. The image sensor 7 may transmit the captured image of the room to the image processing apparatus 3.

However, the image of the room taken by the image sensor 7 may be different from the image of the room seen by the observer 100 through the glass window simulated by the screen 2. The captured indoor image may be corrected by the height of the observer 100 's gaze and the distance from the screen 2 of the observer 100' s gaze.

The distance between the observer 100 and the screen 2 is given by L1 in FIG. 9A and L2 in FIG. 9C (L2> L1). As shown in FIG. 9, when the observer 100 approaches the screen 2, the effect as if the observer approaches the mirror of the same size at the same position as the screen 2 can be obtained. Therefore, as the distance between the observer 100 and the screen 2 gets closer, the observer 100 can observe more indoor images of the area through the screen 2.

FIG. 9B shows an image that can be displayed on the screen 2 when the observer 100 is at a position L1 away from the screen as shown in FIG. 9A. In this example, the screen 2 shows all the images Image1, Image2, Image3 hanging on the wall with the observer 100 itself. In addition, if the screen 2 is to provide a function of the glass window, the image depicting the scenery outside the glass window may be superimposed on the background of the image shown in FIG. 9B.

FIG. 9D shows an image that can be displayed on the screen 2 when the observer 100 is at a position L2 away from the screen as shown in FIG. 9C. At this time. As can be seen by comparing FIGS. 9A and 9C, the observer 100 of FIG. 9C can see an indoor image having a narrower area than that of FIG. 9A. In this example, the screen 2 shows some of the images hanging on the wall with the observer 100 itself, ie a part of the image Image1 and the image Image2.

As described above, the indoor image observed by the image sensor 7 may be processed as one of the image layers constituting the composite image generated by the image processing apparatus 3.

From the foregoing, it can be seen that the indoor image displayed on the screen 2 can be adjusted if the relative positional relationship between the screen 2 and the observer 100 can be known. Therefore, a first sensor (not shown) and a second sensor (not shown) are respectively installed at one portion of the body of the observer 100 and the periphery of the screen 2, and the first sensor and the second sensor are two. It can be seen that the above-described functions can be performed by transmitting the information on the relative positional relationship therebetween to the image processing apparatus 3. Any part of the body of the observer 100 may be, for example, a belt / glasses / hat of the observer 100.

Alternatively, the sensor 100 may be installed only on the periphery of the screen 2 without installing the sensor, so that the sensor may determine the distance to the observer 100. To this end, a device having an infrared detection function and a distance measuring function to an object may be used as the sensor. Alternatively, by using a face recognition function and an auto focusing function used in a recent digital camera, the position of the observer 100 can be sufficiently detected. An algorithm for performing such a function may be implemented in the data processing unit 301, and a function for detecting an image for applying such an algorithm may be performed in the image sensor 7 or separately in a separate sensor (not shown). Can be.

According to one embodiment of the invention, the image processing apparatus 3 is arranged to be able to cover the screen 2 which is to display an image, the data processing unit 301 which is to generate the image, and the screen 2. It can include a cover (4). In this case, the data processor 301 may be configured to change the image when the cover 4 covers the screen 2.

The data processor 301 may be configured to filter an area of the image that is covered by the cover 4. The filtering includes techniques that can give blurring, distortion, noise, rendering, texturing and various effects not mentioned here. For example, the above-mentioned effect of the fog on the glass window can be obtained by performing blurring or filtering to add noise. In addition, the above-described 'filtering' means a process of changing the color balance, brightness, contrast, saturation, hue, etc. of the image.

The image may depict a specific object present in the air. For example, it may be a visible object such as leaves, snow, or rain, or small particles, such as dust or water vapor, may be objects of description when they occur badly like yellow dust or clouds. In the area covered by the cover 4, the image can be converted into an image which is seen when the particular object is in contact with a plane forming an angle with the horizontal plane. In other words, being covered by the cover 4 means, for example, that the window is blocked through the glass. In this case, assuming that the specific object is rain and a plane forming the predetermined angle is the glass window, the image seen when contacting the plane may be an image of rain water flowing down the glass window. In a real building, because the glass window can be installed anywhere on the floor, wall, or ceiling, the predetermined angle here can have a variety of values without limitation in size.

The image processing apparatus 3 may further include an image sensor. The data processor 301 may generate a first image layer using some or all of the image observed by the image sensor, and the image may be configured to include the first image layer and one or more image layers. . The image observed by the image sensor may be an image of the room described above. The other one or more image layers may be a landscape that extends outside the window.

The image processing apparatus 3 may further include a sensor for detecting a position of the observer 100 positioned in front of the screen 2. The data processor 301 cuts at least a portion of the image observed by the image sensor 7 according to the relative position between the screen 2 and the observer 100 to generate a crop image, and generates the crop image. Can be mapped to 1 image layer. In this case, the cropped image may be zoomed in or zoomed out in order to adjust the size of the screen.

10 is a view for explaining a process of cropping an image observed by the image sensor 7 according to an embodiment of the present invention.

FIG. 10B illustrates an example of an image 300 captured by the image sensor 7 installed as shown in FIG. 10A. When the angle of view of the image sensor 7 is given at θ ° as shown in FIG. 10 (b), the image 300 captured by the image sensor 7 is divided into images (Image1, Image2, Image3) and the observer 100 and the lamp. It may include all 200. In this case, as described with reference to FIG. 9, in order to display an image such as (b) and (d) of FIG. 9 on the screen 2 in consideration of the position of the gaze of the observer 100, You can cut some. That is, when the region C1 defined by the dotted line in FIG. 10B is cut out, an image as shown in FIG. 9B can be obtained.

In addition, the data processor 301 may process the first image layer to have transparency, and to prevent the first image layer from being blocked by the other image layers.

The image processing method corresponding to the above-described embodiment of the present invention will be readily apparent to those skilled in the art. For example, the image processing method according to another embodiment of the present invention may be performed by the image processing apparatus 3 including the screen 2, the cover 4, and the data processor 301. The image processing method may include determining whether the cover 4 covers the screen 2, and changing the image displayed on the screen 2 when the cover 4 covers the screen 2. Can be.

11 is a diagram for describing an image processing apparatus according to another exemplary embodiment.

The image processing apparatus according to an embodiment of the present invention may collect and process data to perform some functions of a window that distinguishes indoors from outdoors. Referring to FIG. 11, indoor and outdoor are divided by the wall 15, and the window H1 is installed on the wall 15. A light source, such as light from the sun, may enter the window H1 and shine through the bottom 14. Window-shaped shadows may be formed on the floor 14 by the light incident through the window H1.

The position of the sun may change with time, and the direction of light incident through the window H1 may also change with time. For example, when the sun is in the position S1, the portion of the floor 14 except for the region P1 is cast by the shadow of the wall 15, and the sun P is shined in the region P1. When the sun is in the position S2 and the position S3, the sun light is reflected in the region P2 and the region P3, respectively. Since the distance from each point of the floor 14 to the window H1 is not constant, the boundary shape of the shadow formed by the window H1 when the sun light shines may be distorted. For example, in FIG. 11, the edge of the window H1 has a rectangular shape, and the shadow formed by the window H1 according to the positions S1, S2, and S3 of the sun may be a lozenge or a square (P1). , P2, P3). That is, the position and shape of the shadow boundary may change according to the position of the light source. The light source may not be the sun but may be another kind of light source such as a street lamp. The direction of the light source may be determined by an angle away from an axis (x, y, z) set about the origin o.

EMBODIMENT OF THE INVENTION Hereinafter, the structure of this invention for simulating the above-mentioned phenomenon is demonstrated.

12 is a diagram for explaining an example of an image processing system in which an image processing apparatus according to an embodiment of the present invention may be used.

12, the image processing system 10 includes an image processing apparatus 3 according to an embodiment of the present invention. In addition, the image processing system 10 may include a first image display device 1 ', a first screen 2', a cover 4, a second image display device 11, a second screen 22, and a position sensor. (5), one or more of the temperature / humidity sensor 6, the image sensor 7 may be further included. In this case, the first image display device 1 'includes a first screen 2', a cover 4, a second image display device 11, a second screen 22, a position sensor 5, and a temperature / humidity. It may be configured and provided as an integral device with one or more of the sensor 6, the image sensor 7. In this document, the first image display device 1 'and the first screen 2' may have the same configuration and function as the image display device 1 and the screen 2 described in the above embodiments. An example of the second image display device 11 and the second screen 22 is shown in FIG. 13.

FIG. 13 is a diagram for describing an image processing system 10 according to an exemplary embodiment.

13A and 13B show an example in which the first image display device 1 'is provided as an integrated device with the first screen 2'. Alternatively, the first image display device 1 'may be provided as a separate device from the first screen 2', and the first image display device 1 'may be a projection type device. . An image processing apparatus 3 (not shown) may be connected to the first image display apparatus 1 ′.

In FIGS. 13A and 13B, the second screen 22 may be installed at the bottom 14. Alternatively, however, the second screen 22 may be installed on the side wall 12, the ceiling 13, and the wall 15. The second screen 22 may consist of a single large screen or may consist of multiple screens in which several small screens are adjacent.

13A illustrates an example in which the second video display device 11 is provided as an integrated device with the second screen 22. Alternatively, the second image display device 11 may be provided as a separate device from the second screen 22. An image processing apparatus 3 (not shown) may be connected to the second image display apparatus 11.

The second image display device 11 may display an image having a brightness lower than or equal to a predetermined brightness on a part of the second screen 22. For example, the second image display apparatus 11 may process an area except for any one of the area P1, the area P2, and the area P3 of the screen 22. The blackened area as described above may be, for example, a virtual implementation of shadows caused by sunlight. The position of the area P1, the area P2, and the position of the area P3 in the screen 22 and the boundary thereof shown in FIG. 12 are for illustration only, and the present invention is not limited thereto.

Referring to FIG. 13B, the second image display device 11 is provided as a separate device from the second screen 22. An image processing apparatus 3 (not shown) may be connected to the second image display apparatus 11. In FIG. 13B, the second image display device 11 is installed on the wall 15. Alternatively, the second image display device 11 may be installed on the side wall 12 or the ceiling 13.

In FIG. 13B, the second image display device 11 may display an image having a brightness equal to or less than a predetermined value only on a part of the screen 22 as in FIG. 13A. For example, the second image display device 11 may process an area except for any one of the area P1, the area P2, and the area P3 of the second screen 22. There are at least two ways to do this.

In the first method, first, the image processing apparatus 3 generates an image corresponding to the entire second screen 22. In this case, a portion of the image, for example, the region P1, the region P2, or the portion other than the portion corresponding to the region P3 may be blackened. In this case, the second image display apparatus 11 may always project an image on the entire area of the second screen 22.

In the second method, first, the image processing apparatus 3 generates an image of a smaller size than the second screen 22. In this case, the image processing apparatus 3 may determine the position in the second screen 22 of the image to generate position information. The second image display apparatus 11 may receive the position information from the image processing apparatus 3 and then project the image through an image projection lens provided therein. In this case, the second image display device 11 may rotate the image projection lens according to the position information. The rotation can be performed using any technique such as a servo motor. That is, the second image display apparatus 11 always projects the same size image, but the projection direction thereof may be changed.

Referring back to FIG. 11, when the sun is at position S1, position S2, and position S3, the shadows by window H1 are respectively P1, P2, and P ( It may be formed based on the boundary of P3). The second video display device 11 illustrated in FIG. 13 may virtually reproduce the situation of FIG. 11. For example, when the image processing apparatus 3 uses P _date , P _time , and P _latitude among the parameters listed in Table 1 to generate an image, the position of the sun may be determined. At this time, if the size of the first screen 2 corresponding to the window H1 and the height H from the bottom 14 are further known, the shadow corresponding to the window H1 is the second screen 22. You can see where it should be created. Or in which direction the image should be projected. If it is determined that the sun is present at position S1, a shadow corresponding to window H1 may be formed bordering on area P1 of second screen 22. Similarly, if it is determined that the sun is present at location S2 and location S3 respectively, the shadow corresponding to window H1 is bounded by area P2 and area P3 of second screen 22, respectively. Can be formed. In addition, the image processing apparatus 3 may process data so that the shape of the shadow as well as the position of the shadow by the window H1 can be displayed.

As shown in FIG. 13, the (x, y, z) axis is set around the origin o to define a specific location indoors or outdoors.

14 is a conceptual diagram illustrating a method of displaying a shadow on a second screen according to an embodiment of the present invention.

As described above, the shadow 14 may be cast on the floor 14 by the window H1 and the wall 15. In this case, a shadow of another object may be cast in whole or in part according to the external environment in the region P2 in which sunlight shines.

When the position of the sun O_4 is determined, the parallel light incident from the sun O_4 may shine through the window H1 to the specific area P2 of the bottom 14. In this case, the parallel light incident through the window H1 may be incident through the space SP defined by the dotted line L_1 and the dotted line L_2. When an opaque or translucent object such as the object O_x exists in the space SP, the shadow OS_x formed by the object O_x may be further formed in the region P2.

The space SP can be determined from the position of the sun and the height H from the bottom 14 of the window H1. The space SP may be defined by a formula, for example, a formula including o as the origin and including (x, y, z) coordinates. In addition, the center positions of the objects O_1, O_2, O_3, O_4 and O_x existing outside the window H1 may be given in (x, y, z) coordinates, respectively. Since the object O_x is included in the space SP, the shadow OS_x formed by the object O_x may be formed in the region P2.

In one embodiment according to the present invention, the above-described situation may be assumed, and an image formed in the area P2 may be virtually generated. For example, it is assumed that objects O_1, O_2, O_3, O_4, O_x and the like exist outdoors, as shown in FIG. 14, and the first screen 2 ′ is used instead of the window H1 at the position of the window H1. Can be installed. In this case, the outdoor environment may be virtually displayed on the first screen 2 ′ as described above. In addition, the second screen 22 may be installed on the bottom 14, and light may be emitted using the second image display device 11 in the area P2 on the second screen 22. In this case, the area P2 may display an image including the shadow image OS_x by the object O_x. The portion of the second screen 22 except for the region P2 may be processed to cast a shadow formed by the wall 15.

The image processing apparatus 3 can determine the position of the sun O_4 by, for example, P _date , P _time , and P _latitude among the parameters listed in Table 1. In addition, the space SP may be defined using the P _date , P _time , P _latitude and height H information from the bottom of the first screen 2 ′. In addition, the image processing apparatus 3 displays the shadow of the object O_x in the area P2 when the center position of the object O_x assumed to exist outdoors is included in the defined space SP. You can create an image if possible.

In FIG. 14, the object O_x is shown to be completely included in the space SP. On the other hand, if the object O_x is large enough not to be completely included in the space SP, the object O_x may be divided into several parts and redefined. Then, it can be determined whether each part is included in the space SP. In this case, only the shadow formed by each of the parts included in the space SP may appear in the area P2.

FIG. 15 is a diagram for describing a method of displaying an image on a first screen 2 ′ and a second screen 22 according to an embodiment of the present invention.

Usually the viewing angle of the observer 100 may be limited to a certain angle θ ° by the wall 15. Therefore, it is not possible to see the image of all the objects in the outdoor through the window H1.

Considering the above phenomenon and the contents according to the embodiments of the present invention described above, when the object O_x (reference numeral 150) is at the point A in the space SP, the object on the first screen 2 ' In addition to viewing the image of O_x, the shadow image OS_x of the object O_x may be viewed on the area P2 of the second screen 22. However, when the object O_x is at the point B in the space SP, since the object O_x is out of view of the observer 100, the image of the object O_x is displayed on the first screen 2 '. The image of the object O_x may be viewed only on the area P2 of the second screen 22.

So far, the relationship between the image displayed on the first screen 2 'and the image displayed on the second screen 22 has been described by introducing a spatial concept defined using the (x, y, z) axis. It is not limited to this. That is, irrespective of the spatial position of the object existing outdoors, some or all of the objects displayed on the first screen 2 ′ are arbitrarily selected, and then the image corresponding to the shadow of the selected object is displayed on the second screen 22. Can be marked on. In addition, even in the case of an object not displayed on the first screen 2 ′, an image corresponding to the shadow may be displayed on the second screen 22.

16 is a diagram for describing a method of forming a shadow image on a second screen according to an embodiment of the present invention.

The configuration of the cover 4 described in FIG. 6 or 7 can also be applied to the first screen 2 ′ of FIGS. 13 to 15. FIG. 16 exemplarily shows a configuration in which the first screen 2 'is covered by the covers 601 and 602 as shown in FIG.

When the covers 601 and 602 are completely opened as shown in FIG. 16A, the covers 601 and 602 are not included in the space SP described in FIGS. 14 and 15. In this case, an image in which sunlight shines may be displayed on the area P2 of the second screen 22. In addition, when the object O_x is set to be included in the space SP, the shadow image of the object O_x may be displayed in the area P2 as shown in FIG. 16B.

When the covers 601 and 602 are partially opened as shown in FIG. 16C, the covers 601 and 602 may be included in the space SP described with reference to FIGS. 14 and 15. In this case, as shown in (d) of FIG. 16, the area P2 of the second screen 22 may display an image in which sunlight is emitted and shadow images S_601 and S_602 formed by the covers 601 and 602. have. In addition, when the object O_x is set to be included in the space SP, the shadow image of the object O_x may be displayed in the area P2.

The image processing apparatus 3 according to an embodiment of the present invention includes a first image display apparatus 1 ′ configured to display a first image, and a second image configured to spatially project the second image toward a specific direction. An image display device 11 is included, and the specific direction may be determined by one or more parameters that determine a direction of a light source set for the first image. The parameter may be a parameter such as P _date , P _time , P _latitude , and P _direction listed in Table 1. The azimuth angle of the light source, for example the sun, can be determined by this parameter. If the azimuthal angle of the sun determined by _{(θ x, θ y, θ} z), wherein the specific direction may be set to _{(-θ x, -θ y, -θ} z).

The first image may include a first subimage, and the second image may include a second subimage corresponding to a shadow of the first subimage. The first sub-image and the second sub-image may be, for example, the object O_x and the shadow image OS_x described with reference to FIG. 16.

The second image may be a part of the entire image projected by the second image display device 11. The entire image may include an image of a shadow formed by the wall 15 as an image projected onto the entire second screen 22. The second image may be an image displayed in the area P2. In this case, the second image display device 11 may include a lens, and the lens may not be set to spatially rotate.

Alternatively, the second image may be projected through a lens provided in the second image display device 11. In this case, the second image may be an entire image projected by the lens. In this case, the optical axis of the lens may be rotatable according to the projection direction.

The image processing apparatus 3 according to another embodiment of the present invention may include a data processor 301. The data processor 301 generates a first image displayed on the first image display apparatus 1 ′ and generates a second image spatially projected on the second image display apparatus 11 in a specific direction. The specific direction may be determined by one or more parameters that determine the direction of the light source set for the first image.

In order to explain the above-described embodiments of the present invention, the screen 2 has been described as an example of replacing the function of the glass window, but the screen 2 according to the present invention may be replaced with the function of the mirror within the applicable range of the present invention. It may be configured.

The title of the present invention is not intended to limit the scope of the present invention, but may be corrected to cover the contents of the claims of the present invention.

The data acquisition unit, the data processing unit, and the like described in the embodiments of the present invention may be implemented by various known elements such as an electronic circuit, an integrated circuit, an application specific integrated circuit (ASIC), and each of them may be implemented separately or two or more. It can be integrated into one.

The detailed description of the invention is intended to describe embodiments of the invention and is not intended to represent the only embodiments that can be implemented in accordance with the invention. The detailed description of the invention may be described using specific terms for easy understanding of the invention. It is not intended, however, to be limited by this specific terminology of the invention. Accordingly, the above detailed description of the invention should not be construed as limiting in all aspects but considered as illustrative.

Each of the above-described embodiments is a combination of the components and features of the present invention in a predetermined form. Each component or feature may be implemented in a form that is not combined with other components or features. It is also possible to combine some of the components and / or features to form an embodiment of the invention. Some constructions or features of one embodiment may be included in another embodiment if not contrary to the spirit of the present invention, or may be replaced with corresponding constructions or features of another embodiment. It is obvious that the claims may be combined to form an embodiment by combining claims that do not have an explicit citation relationship in the claims or as new claims by post-application correction.

Those skilled in the art can change the material, size, etc. of each component described in the embodiments of the present invention according to the application field, or combine or replace the disclosed embodiments in a form that is not clearly disclosed in the embodiments of the present invention. This, too, does not depart from the scope of the present invention.

The scope of the present invention should be determined in consideration of the reasonable interpretation of the claims, and all modifications within the equivalent scope of the present invention are included in the scope of the present invention. Those skilled in the art will be able to easily understand the spirit of the present invention from the embodiments of the present invention and the claims.

1 is a view showing a state in which the image display device 1 according to an embodiment of the present invention is installed.

2 is a block diagram showing the configuration of an image display apparatus 1 and an image processing apparatus 3 according to an embodiment of the present invention.

3 and 4 are views for explaining a composite image generation process according to an embodiment of the present invention.

FIG. 5 is a diagram for describing a phenomenon in which an image mapped to an image layer is changed with time according to an embodiment of the present invention.

6 and 7 illustrate a positional relationship between a screen installed according to an embodiment of the present invention and a cover covering the screen.

8 illustrates a configuration of an image system including an image processing apparatus according to an embodiment of the present invention.

FIG. 9 illustrates a process of obtaining an indoor image from an image sensor and displaying the same on a screen according to an embodiment of the present invention.

10 is a diagram for describing a process of cropping an image observed by an image sensor according to an exemplary embodiment.

11 is a diagram for describing an image processing apparatus according to another exemplary embodiment.

12 is a diagram for explaining an example of an image processing system in which an image processing apparatus according to an embodiment of the present invention may be used.

13 is a diagram for describing an image processing system according to an exemplary embodiment.

14 is a conceptual diagram illustrating a method of displaying a shadow on a second screen according to an embodiment of the present invention.

FIG. 15 is a diagram for describing a method of displaying an image on a first screen and a second screen according to an embodiment of the present invention.

16 is a diagram for describing a method of forming a shadow image on a second screen according to an embodiment of the present invention.

Claims (10)

A first image display device adapted to display a first image depicting a window on a first screen; And A second image display device configured to display a second image having an edge corresponding to the edge of the first image on a second screen on a plane different from the first screen by spatially projecting a second image toward a specific direction; Including; The first image and the second image are different from each other, The particular direction is determined by one or more parameters that determine the direction of the light source set in the first image, Image processing device. The method of claim 1, And the at least one parameter comprises at least one of latitude, time of day, date, and direction angle. The method according to claim 1 or 2, And the first image includes a first sub-image, and the second image includes a second sub-image corresponding to a shadow of the first sub-image. The method according to claim 1 or 2, And the second image is part of an entire image projected by the second image display device. The method according to claim 1 or 2, And the second image is an entire image projected by the lens of the second image display device, and the lens is rotatable in accordance with the projection direction. A first image display device adapted to display a first image depicting a window on a first screen; And A second image display device configured to display an image including a second image having an edge corresponding to the edge of the first image on a second screen on a plane different from the first screen; Including; The first image and the second image are different from each other, The shape and position of the second image is determined by one or more parameters that determine the direction of the light source set for the first image, Image processing device. The method of claim 6, And the first image includes a first sub-image, and the second image includes a second sub-image corresponding to a shadow of the first sub-image. Displaying a first image depicting a window on a first screen in a first image display device; And In the second image display apparatus, spatially projecting a second image having an edge corresponding to the edge of the first image toward a specific direction and displaying the second image on a second screen on a plane different from the first screen; Including; The first image and the second image are different from each other, The particular direction is determined by one or more parameters that determine the direction of light represented in the first image, Image processing method. The method of claim 8, And the first image includes a first sub-image, and the second image includes a second sub-image corresponding to a shadow of the first sub-image. Including a data processing unit, The data processor generates a first image displayed on a first screen through a first image display device, and displays the image on a second screen on a plane different from the first screen through a second image display device. To create a second image that is spatially projected toward The first image depicts a window, the edge of the second image is determined according to the edge of the first image, the first image and the second image are different from each other, The particular direction is determined by one or more parameters that determine the direction of the light source set for the first image, Image processing device.

Images