JP2012138673A - Mobile electronic device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a user to easily edit data.SOLUTION: A mobile electronic device 1 comprises: a projector 34 to project an image; a display 32 which displays the image; an operation part 13 which receives operation; and a processing part 22. The processing part 22 causes the projector 34 to project a first image and causes the display 32 to display at least a part of the first image as a second image. Then, the processing part 22 receives, from the operation part 13, editing operation for editing a portion displayed as the second image, from in data corresponding to the first image.

Description

  The present invention relates to a portable electronic device having an image projection unit that projects an image onto a screen or a wall surface.

  2. Description of the Related Art In recent years, mobile electronic devices such as mobile phones have become highly functional and high-performance, and it has become possible to execute processes that could only be performed by a stationary electronic device such as a personal computer using a mobile electronic device. It is coming. For example, it is also possible to transmit data such as word processors and spreadsheets to a portable electronic device and edit the data with the portable electronic device (for example, Patent Document 1).

JP 2006-81213 A

  Meanwhile, portable electronic devices often have a smaller display area for displaying data than stationary electronic devices. For this reason, when editing data with a portable electronic device, it is difficult for a user to edit because information cannot be changed or added while referring to portions other than the edited portion.

  An object of the present invention is to provide a portable electronic device that allows a user to easily edit data.

  In order to solve the above-described problems and achieve the object, a portable electronic device according to the present invention includes a projection unit that projects an image, a display unit that displays an image, an operation unit that receives an operation, and the projection unit. Projecting the first image, causing the display unit to display at least a part of the first image as a second image, and displaying the second image among the data corresponding to the first image And a processing unit that receives an editing operation for editing the portion that is being processed from the operation unit.

  Here, the portable electronic device further includes a detection unit that detects a change in at least one of a posture or a position of the portable electronic device, and the processing unit is configured to detect the first based on a detection result of the detection unit. It is preferable to change at least one of a position or a range of a portion displayed on the display unit as the second image in the image.

  For example, the processing unit is configured to display the second information displayed on the display unit when the detection unit detects that the position of the mobile electronic device has approached a projection surface on which an image is projected by the projection unit. It is good also as narrowing the range of the part currently displayed as a said 2nd image among the data corresponding to a said 1st image so that an image of this may be expanded.

  For example, the processing unit reduces the second image displayed on the display unit when the detection unit detects that the position of the portable electronic device has moved away from the projection plane. Thus, the range of the portion displayed as the second image in the data corresponding to the first image may be expanded.

  In addition, for example, when the detection unit detects that the position of the mobile electronic device has moved in a direction parallel to the projection plane, the processing unit includes the data corresponding to the first image. The range of the portion displayed as the second image may be moved according to the moving direction of the portable electronic device.

  Further, it is preferable that the processing unit controls the projection unit based on a detection result of the detection unit so that the first image is projected in a certain size on a certain range of the projection target.

  In addition, the processing unit changes at least one of a position or a range of a portion displayed on the display unit as the second image of the first image based on an operation received by the operation unit. It is preferable.

  Moreover, it is preferable that the said process part shows the position and range of the part displayed on the said display part as said 2nd image among the said 1st images in the said 1st image.

  In addition, when the editing operation is accepted by the operation unit, the processing unit reflects the change based on the editing operation on the second image without reflecting the change on the first image, and the operation unit Preferably, after a predetermined saving operation is accepted, a change based on the editing operation is reflected in the first image.

  In addition, when the data is shared with another device, the processing unit reflects the change based on the editing content transmitted from the other device on the first image and the second image. Is preferred.

  The present invention has an effect that a user can easily edit data.

FIG. 1 is a front view illustrating a schematic configuration of an embodiment of a portable electronic device according to the embodiment. FIG. 2 is a side view of the portable electronic device shown in FIG. FIG. 3 is a block diagram illustrating a schematic configuration of functions of the portable electronic device illustrated in FIGS. 1 and 2. FIG. 4 is an explanatory diagram showing a state in which the projector of the portable electronic device shown in FIG. 1 is projecting an image. FIG. 5 is a flowchart illustrating an example of an image output operation of the portable electronic device. FIG. 6 is a flowchart showing an example of the data editing operation of the portable electronic device. FIG. 7 is an explanatory diagram for explaining the operation of the portable electronic device. FIG. 8 is an explanatory diagram for explaining the operation of the portable electronic device. FIG. 9 is an explanatory diagram for explaining the operation of the portable electronic device.

  Hereinafter, the present invention will be described in detail with reference to the drawings. The present invention is not limited to the following description. In addition, constituent elements in the following description include those that can be easily assumed by those skilled in the art, those that are substantially the same, and those in a so-called equivalent range. In the following, a mobile phone is taken up as an example of a portable electronic device, but the application target of the present invention is not limited to a mobile phone. The present invention can also be applied to game machines and the like.

  FIG. 1 is a front view showing a schematic configuration of an embodiment of a portable electronic device according to the embodiment, and FIG. 2 is a side view of the portable electronic device shown in FIG. A portable electronic device 1 shown in FIGS. 1 and 2 is a mobile phone having a wireless communication function, an output unit, a voice acquisition unit, and an imaging unit. In the portable electronic device 1, the housing 1C is composed of a plurality of housings. Specifically, the housing 1C is configured to be openable and closable by a first housing 1CA and a second housing 1CB. That is, the portable electronic device 1 has a foldable housing. In addition, the housing | casing of the portable electronic device 1 is not limited to such a structure. For example, the casing of the portable electronic device 1 may be a sliding casing that allows one casing and the other casing to slide from each other in a state where both casings are overlapped, It may be a rotary type in which one casing is rotated around an axis along the overlapping direction, or both casings are connected via a biaxial hinge.

  1st housing | casing 1CA and 2nd housing | casing 1CB are connected by the hinge mechanism 8 which is a connection part. By connecting the first casing 1CA and the second casing 1CB with the hinge mechanism 8, the first casing 1CA and the second casing 1CB rotate together around the hinge mechanism 8 and move away from each other. And it is comprised so that it can rotate in the direction (direction shown by arrow R of FIG. 2) which mutually approaches. When the first casing 1CA and the second casing 1CB rotate in a direction away from each other, the portable electronic device 1 opens, and when the first casing 1CA and the second casing 1CB rotate in a direction approaching each other, the portable electronic device 1 opens. The device 1 is closed and folded (a state indicated by a dotted line in FIG. 2).

  The first housing 1CA is provided with a display 2 shown in FIG. 1 as a display unit. The display 2 displays a standby image when the portable electronic device 1 is waiting for reception, or displays a menu image used for assisting the operation of the portable electronic device 1. In addition, the first housing 1CA is provided with a receiver 16 that is an output unit that outputs sound when the mobile electronic device 1 is in a call.

  On the side opposite to the display 2 of the first housing 1CA, a projector 34 that is an image projection unit, and a distance sensor 36 that is a distance measurement unit that measures the distance from the light emitting unit (objective lens) of the projector 34 to the image projection target. And a camera 40 that captures (acquires) an image of the surface on which the image is projected. With such a configuration, the projector 34 projects an image onto the projection target, or the distance between the exit surface of the projector 34 and the projection target is measured by the distance sensor 36, and the focus of the image projected by the projector 34 is automatically set. Can be adjusted. In addition, the light emission part of the projector 34 and the imaging | photography window of the camera 40 are exposed outside the 1st housing | casing 1CA.

  The second casing 1CB is provided with a plurality of operation keys 13A for inputting a telephone number of a call partner, a mail, etc., and selection and determination of a menu displayed on the display 2 and a screen. A direction and determination key 13B for easily executing scrolling and the like are provided. The operation key 13 </ b> A and the direction / decision key 13 </ b> B constitute the operation unit 13 of the mobile electronic device 1. In addition, the second casing 1CB is provided with a microphone 15 that is a voice acquisition unit that receives voice when the mobile electronic device 1 is in a call. The operation unit 13 is provided on the operation surface 1PC of the second housing 1CB shown in FIG. The surface opposite to the operation surface 1PC is the back surface 1PB of the portable electronic device 1. Note that the operation unit 13 may be a touch sensor disposed on the display unit instead of the key configuration described above.

  FIG. 3 is a block diagram illustrating a schematic configuration of functions of the portable electronic device illustrated in FIGS. 1 and 2. As shown in FIG. 3, the portable electronic device 1 includes a processing unit 22, a storage unit 24, a transmission / reception unit 26, an operation unit 13, an audio processing unit 30, a display unit 32, a projector 34, and a distance sensor. 36, an acceleration sensor 38 which is a motion detection means, and a camera 40. The processing unit 22 has a function of comprehensively controlling the overall operation of the mobile electronic device 1. In other words, the processing unit 22 transmits and receives various processes of the mobile electronic device 1 so as to be executed in an appropriate procedure according to the operation of the operation unit 13 and the software stored in the storage unit 24 of the mobile electronic device 1. The operations of the unit 26, the voice processing unit 30, the display unit 32, and the like are controlled.

  Various processes of the portable electronic device 1 include, for example, a voice call performed via a circuit switching network, creation and transmission / reception of an electronic mail, browsing of a Web (World Wide Web) site on the Internet, and the like. Examples of operations of the transmission / reception unit 26, the audio processing unit 30, and the display unit 32 include transmission / reception of signals by the transmission / reception unit 26, input / output of audio by the audio processing unit 30, display of images by the display unit 32, and the like. .

  The processing unit 22 executes processing based on a program (for example, an operating system program, application program, etc.) stored in the storage unit 24. The processing unit 22 is constituted by, for example, a microprocessor unit (MPU: Micro Processing Unit), and executes various processes of the portable electronic device 1 described above in accordance with procedures instructed by the software. That is, the processing unit 22 sequentially reads instruction codes from an operating system program, application program, or the like stored in the storage unit 24 and executes processing.

  The processing unit 22 has a function of executing a plurality of application programs. Examples of application programs executed by the processing unit 22 include an application program that controls driving of the projector 34 and the distance sensor 36, an application program that reads various image files (image information) from the storage unit 24, and decodes them. There are a plurality of application programs such as an application program for displaying an image obtained in this manner on the display unit 32 or projecting it on the projector 34.

  In the present embodiment, the processing unit 22 includes a projector control unit 22a, an image processing unit 22b, a condition determination unit 22c, an attitude / position calculation unit 22d, a projection correction unit 22e, a linkage output control unit 22f, and a data editing unit 22g.

  The projector control unit 22a controls the projector 34 to project an image onto an image projection target. The image processing unit 22b decodes the data stored in the storage unit 24 and the data received by the transmission / reception unit 26, and generates an image projected by the projector 34 and an image displayed on the display unit 32. Further, the image processing unit 22b generates an image to be displayed or projected as various screens for providing information to the user or receiving input of information from the user. The image processing unit 22b also executes processing for performing processing such as enlargement, reduction, and deformation on the image.

  The condition determination unit 22c determines whether or not a condition affecting the image projection by the projector control unit 22a has changed. Here, the condition affecting the projection of the image by the projector control unit 22a is, for example, a change in the attitude of the mobile electronic device 1 or a change in the distance to the image projection target. The posture / position calculation unit 22d calculates the posture and position of the portable electronic device 1 based on the detection results of the distance sensor 36 and the acceleration sensor 38 and the like.

  The projection correction unit 22e performs correction processing so that an image is projected at a certain size on a certain position of the image projection target. Specifically, the projection correction unit 22e determines the control contents of the projector 34 by the projector control unit 22a and the image processing unit according to the change in the posture and position of the portable electronic device 1 calculated by the posture / position calculation unit 22d. By changing the content of the image processing by 22b, the position and size of the projection image are kept constant.

  The linkage output control unit 22f causes the projector 34 to project the first image and causes the display unit 32 to display at least a part of the first image as the second image. Then, the linkage output control unit 22f projects the first image without changing, and changes the posture and position of the portable electronic device 1 calculated by the posture / position calculation unit 22d according to the change in the posture and position of the portable electronic device 1. The content of the second image to be displayed is changed.

  For example, in the initial state, the linkage output control unit 22f projects the entire image based on certain data from the projector 34 as a first image, and a predetermined range in the central portion of the image is displayed on the display unit 32 as a second image. Display. When the mobile electronic device 1 moves up and down, left and right in a direction parallel to the projection plane while maintaining the distance from the projection plane on the image projection target, the linkage output control unit 22f outputs the second of the first images. The part displayed on the display unit 32 as an image is scrolled up and down and left and right according to the moving direction and the moving distance. In addition, when the attitude of the mobile electronic device 1 changes, the linkage output control unit 22f determines a portion of the first image displayed on the display unit 32 as the second image according to the change direction and the change amount of the attitude. Scroll up / down / left / right.

  In addition, the linkage output control unit 22f includes a second output of the first image so that a portion displayed on the display unit 32 as the second image is enlarged when the portable electronic device 1 approaches the image projection target. The range of the portion displayed on the display unit 32 as an image of the image is narrowed according to the movement distance. In addition, the linkage output control unit 22f includes a second output of the first image so that the portion displayed on the display unit 32 as the second image is reduced when the portable electronic device 1 moves away from the image projection target. The range of the portion displayed on the display unit 32 as the image of is expanded according to the movement distance.

  The data editing unit 22g receives an editing operation for editing a portion of the data corresponding to the first image displayed on the display unit 32 as the second image from the operation unit 13 or the like. The editing process corresponding to is executed. In addition, the data editing unit 22g displays a menu or a pop-up screen for editing a part displayed on the display unit 32 as the second image of the data corresponding to the first image as necessary. 32. That is, the data editing unit 22g provides the user with a function of editing a portion of the data corresponding to the first image that is displayed on the display unit 32 as the second image. Editing here means addition of information to data, change of information included in data, deletion of information included in data, and the like.

  The functions of the projector control unit 22a, the image processing unit 22b, the condition determination unit 22c, the posture / position calculation unit 22d, the projection correction unit 22e, the linkage output control unit 22f, and the data editing unit 22g are the processing unit 22 and the storage unit 24, respectively. Is implemented by executing a task assigned by the control unit of the processing unit 22. Here, a task is a processing unit that cannot be executed at the same time among the entire processing performed by the application software or the processing performed by the same application software.

  The storage unit 24 stores software and data used for processing in the processing unit 22. The above-described task for operating the application program for controlling the driving of the projector 34 and the distance sensor 36, and image processing A task for operating the program is stored. In addition to these tasks, for example, communication, downloaded voice data, software used by the processing unit 22 to control the storage unit 24, the telephone number or mail address of the communication partner, etc. are described in the storage unit 24. The address book to be managed, voice files such as dial tone and ring tone, temporary data used in the process of software, and the like are stored.

  Note that computer programs and temporary data used in the software processing process are temporarily stored in the work area assigned to the storage unit 24 by the processing unit 22. The storage unit 24 includes, for example, a nonvolatile storage device (nonvolatile semiconductor memory such as ROM: Read Only Memory, a hard disk device, etc.), and a readable / writable storage device (for example, SRAM: Static Random Access Memory, DRAM: Dynamic Random Access Memory).

  The transmission / reception unit 26 has an antenna 26a, establishes a radio signal line by a CDMA (Code Division Multiple Access) method or the like with the base station via a channel assigned by the base station, and makes a telephone call with the base station. Perform communication and information communication. The operation unit 13 includes, for example, an operation key 13A to which various functions such as a power key, a call key, a numeric key, a character key, a direction key, a determination key, and a call key are assigned, and a direction and determination key 13B. The When these keys are input by a user operation, a signal corresponding to the operation content is generated. The generated signal is input to the processing unit 22 as a user instruction.

  The audio processing unit 30 executes processing of an audio signal input to the microphone 15 and an audio signal output from the receiver 16 and the speaker 17. That is, the sound processing unit 30 amplifies the sound input from the microphone 15 and executes AD conversion (Analog Digital conversion), and then performs signal processing such as encoding to convert the sound into digital sound data. Output to the processing unit 22. Further, the audio data sent from the processing unit 22 is subjected to processing such as decoding, DA conversion (Digital Analog conversion), and amplification to convert it into an analog audio signal, which is then output to the receiver 16 and the speaker 17. Here, the speaker 17 is disposed in the housing 1C of the portable electronic device 1, and outputs a ringtone, a mail transmission sound, and the like.

  The acceleration sensor 38 detects the direction and magnitude of acceleration applied to the mobile electronic device 1. The detection result of the acceleration sensor 38 is used to determine whether or not the mobile electronic device 1 has a posture change or movement, or to calculate a posture change amount or a movement distance. Note that an orientation sensor may be provided in the portable electronic device 1 in order to determine whether or not the posture of the portable electronic device 1 has changed, or to calculate the amount of change in posture.

  The display unit 32 includes the display 2 described above, and displays a video corresponding to the video data supplied from the processing unit 22 and an image corresponding to the image data on the display panel. The display 2 is configured by a display panel configured by, for example, a liquid crystal display (LCD) or an organic EL (Organic Electro-Luminescence) panel. The display unit 32 may include a sub display in addition to the display 2.

  The projector 34 includes a light source and an optical system that switches whether to project the light emitted from the light source based on image data. In the present embodiment, the projector 34 includes a visible light irradiation device (visible light irradiation means) 31 that is a light source, a drawing device 35 that is an optical system, and a focus adjustment device 39. The visible light irradiation device 31 emits visible laser light. The light in the visible light region is light with a short wavelength side of 360 nm to 400 nm or more and a long wavelength side of 760 nm to 830 nm or less. In the present embodiment, the visible light irradiation device 31 includes R (Red), G (Green), B Irradiate light of three colors (Blue).

  The drawing device 35 combines the three colors of light emitted from the visible light irradiation device 31 and irradiates the image projection target. The drawing device 35 includes a switching element that switches whether to transmit light emitted from the light source, and a mirror that performs raster scanning of the light that has passed through the switching element. The drawing device 35 changes the angle of the laser light emitted from the visible light irradiation device 31 by the mirror and causes the image projection target to scan the laser light, thereby projecting the image onto the image projection target.

  As the mirror, for example, a MEMS (Micro Electro Mechanical System) mirror is used. A MEMS mirror drives a mirror using a piezoelectric element, scans the visible light irradiated from the visible light irradiation apparatus 31, and produces | generates a visible image and an invisible image. In this case, by changing the angle of the light emitted from the light source by the mirror and scanning the light emitted from the light source over the entire surface of the image projection target, a visible image or an invisible image can be projected onto the image projection target. it can. Thus, the projector 34 is a scan-type projector. Note that the configuration of the projector 34 is not limited to that using the laser described above as a light source. For example, the projector 34 may be a projector having a configuration in which a halogen light, an LED light source, or an LD light source is used as a light source, and an LCD or a DMD (Digital Micro-mirror Device) is provided in an optical system.

  The focus adjustment device 39 has a function (focus adjustment function) for forming a visible image projected from the drawing device 35 on an image projection target in accordance with a command from the projector control unit 22a. The focus adjustment device 39 includes a focus adjustment mechanism including, for example, a movable lens, and realizes the focus adjustment function by moving the lens. Further, the focus adjustment device 39 may realize the focus adjustment function by performing predetermined image processing on the image data projected by the projector 34 by the image processing unit 22b. Further, the focus adjustment device 39 may realize the focus adjustment function by a focus adjustment function and image processing. The distance sensor 36 measures the distance between the light emitting unit of the projector 34 and the image projection target. Instead of the distance sensor 36, the function of adjusting the focus of the image projected from the projector 34 of the focus adjusting device 39 is used to measure the distance between the light emitting portion of the projector 34 and the image projection target. Also good.

  FIG. 4 is an explanatory diagram showing a state in which the projector of the portable electronic device shown in FIG. 1 is projecting an image. As described above, the projector 34 is an image projection unit that projects an image, and the image projection surface is exposed to the outside of the housing 1 </ b> C of the portable electronic device 1. As shown in FIG. 4, the portable electronic device 1 projects an image from the projector 34, and, as shown in FIG. 4, a predetermined number of image projection targets (for example, a wall surface or a screen) at a position facing the image projection surface of the projector 34. The image P can be projected onto the area (projection area) PA. The operation of the projector 34 is controlled by the processing unit 22, and various images sent from the processing unit 22, such as moving images and presentation materials, are projected and displayed on the projection area PA.

  As described above, the camera 40 is an imaging mechanism that is provided near the light emitting unit of the projector 34 and acquires an image of an area including a projection area. That is, the camera 40 acquires an image in the direction in which the projector 34 emits light. The camera 40 is a shooting mechanism that takes an image with a wider angle of view than the projection angle of the image projected by the projector 34, and takes an image of an area wider than the projection area onto which the image is projected by the projector 34. can do.

  Based on the image captured by the camera 40 in this manner, the processing unit 22 causes the image P to have a constant size in the projection area PA even if the posture or position of the mobile electronic device 1 changes within a predetermined allowable range. The projector 34 and the like are controlled so as to be projected. For example, even when the mobile electronic device 1 moves to the right within the allowable range, the processing unit 22 projects the image P on the projection area PA by changing the projection direction of the projector 34 or the like.

  In this way, the processing unit 22 projects the image P onto the projection area PA with a certain size even when the attitude or position of the portable electronic device 1 changes, while the content displayed on the display unit 32 is displayed on the portable electronic device. It changes according to the change of the posture and position of the device 1. For example, when the mobile electronic device 1 is positioned substantially in front of the projection area PA, the processing unit 22 displays the letter “E” drawn in the center of the image P projected on the projection area PA. It is displayed on the display unit 32. Further, when the portable electronic device 1 moves in the right direction, the processing unit 22 causes the display unit 32 to display the letter “F” drawn on the right side of the image P.

  Next, the image output operation of the projector of the portable electronic device will be described with reference to FIG. Here, FIG. 5 is a flowchart showing an example of the image output operation of the portable electronic device. First, in step S101, the processing unit 22 of the mobile electronic device 1 determines whether the projector 34 mounted on the mobile electronic device 1 is in use by the condition determination unit 22c. If the processing unit 22 determines in step S101 that the projector is not operating (No), that is, if the condition determination unit 22c determines that the projector 34 is not in use, the processing ends.

  Further, when the processing unit 22 determines in step S101 that the projector is operating (Yes), that is, the condition determination unit 22c determines that the projector 34 is in use, the processing unit 22 determines whether there has been a change in posture or movement in step S102. . That is, in step S102, the processing unit 22 determines whether the projector 34 mounted on the portable electronic device 1 has moved by the condition determining unit 22c, that is, whether the projector 34 (the portable electronic device 1) has changed or moved. Determine. Here, the condition determination unit 22c can determine whether or not the orientation of the projector 34 has changed or moved based on the image captured by the camera 40 and the focal length calculated by the autofocus function. The condition determination unit 22c can also determine whether the projector 34 has changed or moved by using the detection results of the distance sensor 36 and the acceleration sensor 38. In the present embodiment, the relative movement between the projection plane and the projector 34 is also determined as the movement of the projector 34. In other words, the condition determination unit 22c determines that it has moved when the distance between the projection surface and the projector 34 changes. Alternatively, it may be determined that the object has moved when a movement toward or away from the projection direction (that is, the projection plane along the projection direction) is detected. If the processing unit 22 determines that there is no change and no movement (No) in step S102, that is, if the condition determination unit 22c determines that the projector 34 has not moved, the control ends.

  Further, when the processing unit 22 determines in step S102 that the projector 34 has changed or moved (Yes), that is, the condition determining unit 22c has moved the projector 34, in step S103, the attitude / position calculation is performed. Based on the movement of the projector 34 (mobile electronic device 1), the posture change amount and the movement distance are calculated by the unit 22d. That is, changes in the angle and distance between the projector 34 and the projection surface on which the image is projected are calculated. Specifically, the processing unit 22 detects the posture of the projector 34 based on the detection result of the camera 40 or the acceleration sensor 38, and compares the reference posture or the previous posture to calculate the amount of change in posture. . In addition, the processing unit 22 detects the distance between the projection surface and the projector 34 based on the detection results of the camera 40 or the distance sensor 36 and the acceleration sensor 38, and compares it with the reference distance or the previous distance. The moving distance and moving direction are calculated.

  After calculating the posture change amount and the movement distance in step S103, the processing unit 22 calculates the projection direction of the projector 34 in step S104 according to the posture change amount and the movement distance calculated in step S103 by the projection correction unit 22e. Then, the projection angle is changed, and the image is projected at the same size at the same position as before the posture change or movement. Further, in step S105, the processing unit 22 changes a portion displayed on the display unit 32 in the image projected from the projector 34 in accordance with the calculated change amount and movement distance of the posture. When the processing of step S105 ends, the processing unit 22 ends this control. The processing unit 22 repeats the above processing while the projector 34 projects an image.

  Note that the change in the projection direction of the projector 34 (adjustment of the position of the projection image) may be realized, for example, by changing the direction of the projector 34 itself by making the projector 34 movable, or configuring the drawing device 35. You may implement | achieve by changing the scanning range (rotating range) of the mirror to perform. Alternatively, a movable lens may be disposed in the light emitting portion of the projector 34 and the direction of the lens may be changed. Alternatively, the image processing unit 22b may generate the image by combining the projection target image on the transparent layer, and change the position of the projection target image on the transparent layer. Moreover, you may combine these systems.

  Further, the change of the projection angle of the projector 34 (adjustment of the size of the projection image) may be realized by changing the size of the swing angle (rotation angle) of the mirror that constitutes the drawing device 35, for example. Good. Further, it may be realized by arranging a movable lens in the light emitting portion of the projector 34 and changing the distance between the lens and the light source. Alternatively, the image processing unit 22b may generate the image by combining the projection target image on the transparent layer, and change the size of the projection target image on the transparent layer. . Moreover, you may combine these systems.

  Next, an operation of editing data corresponding to an image projected by the mobile electronic device will be described with reference to FIG. Here, FIG. 6 is a flowchart showing an example of the data editing operation of the portable electronic device. The data editing operation shown in FIG. 6 is repeatedly executed in parallel with the image output operation shown in FIG. First, the data editing unit 22g of the processing unit 22 determines whether an editing operation has been detected in the operation unit 13 in step S201. The editing operation is an operation performed by the user to edit data corresponding to the projected image.

  If it is determined in step S201 that an editing operation has been detected (Yes), the data editing unit 22g updates the display content of the display unit 32 in accordance with the detected editing operation in step S202. For example, when the detected editing operation is to add information to the data, the data editing unit 22g updates the display content of the display unit 32 to a state in which the information is added to the data. If the detected editing operation is to change the information in the data, the data editing unit 22g updates the display content of the display unit 32 to a state in which the information in the data has been changed. When the detected editing operation is to delete information in the data, the data editing unit 22g updates the display content of the display unit 32 to a state in which the information in the data is deleted.

  After updating the display content of the display unit 32, the data editing unit 22g holds the edited content in a storage area such as a memory included in the processing unit 22 in step S203. Then, the data editing unit 22g ends this control.

  If it is determined in step S201 that no editing operation has been detected (No), the data editing unit 22g determines whether a storage operation has been detected in the operation unit 13 in step S204. The save operation is an operation performed by the user in order to save the data by reflecting the result of the editing operation performed so far in the data. If the data editing unit 22g determines in step S204 that a save operation has not been detected (No), the data editing unit 22g ends this control.

  If it is determined in step S204 that the save operation has been detected (Yes), the data editing unit 22g reflects the edited content stored in the memory or the like in the data corresponding to the projected image in step S205. The Here, the data itself is rewritten by adding, changing, or deleting information according to the editing content. Then, in step S206, the data editing unit 22g updates the image projected from the projector 34 so that the updated data content is reflected. Then, the data editing unit 22g ends this control.

  In FIG. 6, the editing content is reflected in the data after the save operation is detected. However, when the editing operation is performed, the editing content may be immediately reflected in the data. Whether the edited contents are immediately reflected in the data may be determined according to the type of data to be edited, or may be determined based on setting information preset by the user.

  Next, the portable electronic device 1 will be described in more detail using a specific example. Here, FIGS. 7 to 9 are explanatory diagrams for explaining the operation of the portable electronic device. 7 to 9 schematically illustrate the shape of the mobile electronic device 1.

  In step S11 illustrated in FIG. 7, the mobile electronic device 1 projects image data depicting a plurality of persons from the projector 34 as the first image P1. In addition, the mobile electronic device 1 displays one person included in the first image P1 on the display 2 as the second image P2. And the portable electronic device 1 has shown the flame | frame F in the 1st image P1, in order to represent the position and range of the 2nd image P2 in the 1st image P1.

  When the user changes the posture or position of the mobile electronic device 1 from this state, the mobile electronic device 1 detects it and changes the content to be displayed on the display 2 as the second image P2 according to the detection result. . For example, when the mobile electronic device 1 detects that the position has moved to the left with respect to the image projection target, the portion to be displayed on the display 2 as the second image P2 in the left direction according to the detected movement amount. Scroll. Further, when the portable electronic device 1 detects that the posture has changed downward, the portable electronic device 1 scrolls a portion to be displayed on the display 2 as the second image P2 in accordance with the detected amount of change in angle.

  Further, when the portable electronic device 1 detects that the position is close to the image projection target, the portable electronic device 1 enlarges the second image P2 according to the detected movement amount. In addition, when the mobile electronic device 1 detects that the position has moved away from the image projection target, the mobile electronic device 1 reduces the second image P2 according to the detected movement amount. When the portable electronic device 1 changes the portion to be displayed on the display 2 as the second image P2, the frame F is converted into the first image P1 so as to correspond to the position and range of the second image P2 after the change. Move up.

  In this state, the mobile electronic device 1 allows the user to edit the portion displayed on the display 2 as the second image P2. For example, the user can perform an editing operation on the operation unit 13 or the like to change the person displayed on the display 2 to a person wearing a hat as in step S12. At this stage, the edited content is held in a memory or the like and reflected in the second image P2, but not reflected in the image data. Therefore, the user can discard the edited contents so that the change is not reflected in the image data.

  When the user performs a save operation on the operation unit 13 or the like after performing an edit operation, the portable electronic device 1 reflects the held edit content in the image data, and further, as in step S13. In addition, the change in the image data is also reflected in the first image P1.

  In addition, when the user moves the mobile electronic device 1 to the right in the state of step S11, the mobile electronic device 1 scrolls the portion to be displayed on the display 2 as the second image P2 to the right, Move F to the right. Then, in a state where the plain portion is scrolled and displayed on the display 2 as the second image P2, the user performs an editing operation on the operation unit 13 or the like, and a new person is obtained as in step S14. Can be added. At this stage, the edited content is held in the memory and reflected in the second image P2, but not reflected in the image data. Thereafter, when the user performs a save operation, the portable electronic device 1 reflects the retained editing contents in the image data, and further adds a person to the image data in the first image as in step S15. Also reflected in P1.

  As described above, the mobile electronic device 1 projects an image corresponding to the data from the projector 34, displays at least a part of the image on the display 2, and allows the user to edit the portion displayed on the display 2. Let it be done. That is, the portable electronic device 1 can edit a detailed portion while referring to the display 2 while confirming the entire image by projecting a large image corresponding to the data.

  The projector 34 can project a large image, but may not have sufficient resolution to edit the details. On the other hand, the display 2 has a relatively high resolution and is suitable for editing detailed portions. However, since the area is small, it is difficult to display the whole image and the detailed portions simultaneously. By using the projector 34 and the display 2 in combination, the advantages of both can be utilized.

  Further, if an editing operation is accepted for the portion displayed on the display 2, the edited content is displayed near the operation unit 13, so that an image projected at a distant position by the projector 34 is edited. It is easier for the user to perform the editing operation than in the case of the target.

  As shown in FIG. 7, the method of editing data by combining the projector 34 and the display 2 is useful when creating a large image such as a poster, for example. According to this method, the user can edit the detailed portion on the display 2 while projecting the entire image being edited at the actual size to check the finished image.

  Next, FIG. 8 will be described. Although FIG. 7 shows an example of editing image data, FIG. 8 shows an example of editing document data. FIG. 9 shows an example in which the edited contents are immediately reflected in the data.

  In step S21 shown in FIG. 8, the portable electronic device 1 projects document data of the spreadsheet program from the projector 34 as the first image P1. Further, the mobile electronic device 1 displays the entire first image P1 on the display 2 as the second image P2.

  When the user moves the mobile electronic device 1 in the upper left direction while approaching the image projection target from this state, the mobile electronic device 1 enlarges the upper left portion of the first image P1 as in step S22. Then, it is displayed on the display 2 as the second image P2. In addition, the mobile electronic device 1 displays the frame F on the first image P1 so as to correspond to the position and range of the second image P2 after enlargement.

  In this state, the mobile electronic device 1 allows the user to edit the portion displayed on the display 2 as the second image P2. For example, the user can rewrite the contents of a certain cell as in step S23 by performing an editing operation on the operation unit 13 or the like. When the editing operation is performed, the mobile electronic device 1 reflects the edited contents in the second image P2 and also in the document data corresponding to the first image P1. As a result, the change in the cell contents is also reflected in the first image P1.

  As shown in FIG. 8, the method of editing data by combining the projector 34 and the display 2 is also useful for editing document data. According to this method, the user can edit the edited portion on the display 2 while projecting the document data largely and referring to the portion other than the edited portion.

  Next, FIG. 9 will be described. Although FIG. 8 shows an example in which one user edits data, FIG. 9 shows an example in which a plurality of users edit data. Note that the portable electronic devices 1a and 1b shown in FIG. 9 are devices having the same configuration as the portable electronic device 1, and are set to share the same data.

  In step S31 shown in FIG. 9, the portable electronic device 1a projects the document data of the spreadsheet program from the projector 34 as the first image P1a. Further, the portable electronic device 1a displays the entire first image P1a on the display 2 as the second image P2a.

  In step S41, the portable electronic device 1b simultaneously projects document data shared with the portable electronic device 1a from the projector 34 as the first image P1b in another place. Further, the portable electronic device 1b displays the entire first image P1b on the display 2 as the second image P2b.

  From this state, when the user of the portable electronic device 1a moves the portable electronic device 1a in the upper left direction while approaching the image projection target, the portable electronic device 1a moves the upper left of the first image P1a as in step S32. The close portion is enlarged and displayed on the display 2 as the second image P2a. Moreover, the portable electronic device 1a displays the frame F on the first image P1a so as to correspond to the position and range of the second image P2a after enlargement. At this stage, the portable electronic device 1b maintains the same state as step S41 as in step S42.

  In this state, the portable electronic device 1a enables the user to edit the portion displayed on the display 2 as the second image P2a. For example, the user of the portable electronic device 1a can edit the contents of a certain cell as in step S33 by performing an editing operation on the operation unit 13 or the like. When the editing operation is performed, the mobile electronic device 1a reflects the edited contents in the second image P2a and also in the document data corresponding to the first image P1a. As a result, the change in the cell contents is also reflected in the first image P1a.

  Further, when the mobile electronic device 1a reflects the edited contents in the document data corresponding to the first image P1a, the mobile electronic device 1a transmits the updated document data to the mobile electronic device 1b sharing the document data, and The document data held in the electronic device 1b is replaced. As a result, the portable electronic device 1b converts the contents of the replaced document data into the first image P1b projected from the projector 34 and the second image P2b displayed on the display 2 as in step S43. To reflect.

  Here, an example is shown in which the edited content in the portable electronic device 1a is reflected in the output of the portable electronic device 1b. Similarly, the edited content in the portable electronic device 1b is reflected in the output of the portable electronic device 1a. It can also be made. Here, the editing content is reflected on the remote electronic device by transmitting the data itself. However, the editing content may be reflected on the remote electronic device by transmitting the editing content or difference data. .

  Further, the shared data may be held in a third device such as a server device. In this case, for example, the mobile electronic devices 1a and 1b transmit the received edited content to the third device, and the third device reflects the received edited content in the data. Then, the portable electronic devices 1a and 1b periodically acquire the latest data from the third device, and reflect the contents of the acquired data on the image projected from the projector 34 and the image displayed on the display unit 32. .

  As shown in FIG. 9, the method of editing data by combining the projector 34 and the display 2 is also useful for editing shared data. According to this method, for example, when a conference is held between different sites such as a telephone conference, an image corresponding to the shared data is projected and viewed on each site, and editing on one site is performed. The content can be reflected in the projection content of the other site.

  In addition, the aspect of this invention shown by said embodiment can be arbitrarily changed in the range which does not deviate from the summary of this invention. For example, the projector 34 may project an image from a surface other than the opposite side of the display 2.

  In the above embodiment, image data and document data are shown as examples of data to be edited. However, data to be edited according to the present invention is not limited to this. In the present invention, for example, various data such as moving image data, audio data, and tag data in augmented reality space can be edited. Augmented reality space is a space that is constructed electronically by superimposing it on the real world.

  In the above-described embodiment, the operation unit 13 includes the operation key 13A and the direction and determination key 13B. However, the operation unit 13 may include a touch panel superimposed on the display 2. That is, the display unit 32 also functions as the operation unit 13, and the user performs an editing operation by touching the touch panel superimposed on the display 2 with a finger or the like while referring to the image displayed on the display 2. You may be able to do that.

  In the above-described embodiment, an example in which the mobile electronic device 1 scrolls or enlarges / reduces the second image displayed on the display 2 in accordance with a change in posture or position has been described. The device 1 may perform scrolling of the second image or the like according to the operation detected by the operation unit 13.

DESCRIPTION OF SYMBOLS 1 Portable electronic device 1C Case 2 Display 13 Operation part 13A Operation key 13B Direction and determination key 22 Processing part 22a Projector control part 22b Image processing part 22c Condition determination part 22d Posture / position calculation part 22e Projection correction part 22f Linkage output control part 22 g Data editing unit 24 Storage unit 30 Audio processing unit 31 Visible light irradiation device 32 Display unit 34 Projector 35 Drawing device 36 Distance sensor 38 Acceleration sensor 39 Focus adjustment device 40 Camera

Claims (10)

A projection unit for projecting an image;
A display for displaying an image;
An operation unit for receiving an operation;
The projection unit projects the first image, the display unit displays at least a part of the first image as a second image, and the second of the data corresponding to the first image. And a processing unit that receives from the operation unit an editing operation for editing a portion displayed as an image of the portable electronic device. A detection unit that detects a change in at least one of the posture or position of the portable electronic device;
The processing unit changes at least one of a position or a range of a portion displayed on the display unit as the second image of the first image based on a detection result of the detection unit. The portable electronic device according to claim 1.   The processing unit is configured to display the second image displayed on the display unit when the detection unit detects that the position of the portable electronic device has approached a projection surface on which an image is projected by the projection unit. 3. The portable electronic device according to claim 2, wherein a range of a portion displayed as the second image in the data corresponding to the first image is narrowed so as to be enlarged.   The processing unit is configured to reduce the second image displayed on the display unit when the detection unit detects that the position of the mobile electronic device has moved away from the projection plane. The portable electronic device according to claim 3, wherein a range of a portion displayed as the second image in the data corresponding to the first image is expanded.   When the detection unit detects that the position of the portable electronic device has moved in a direction parallel to the projection plane, the processing unit includes the second image among the data corresponding to the first image. 5. The portable electronic device according to claim 3, wherein a range of a portion displayed as is moved according to a moving direction of the portable electronic device.   The processing unit controls the projection unit based on a detection result of the detection unit so that the first image is projected in a certain size on a certain range of a projection target. Item 6. The portable electronic device according to any one of Items 2 to 5.   The processing unit changes at least one of a position or a range of a portion displayed on the display unit as the second image of the first image based on an operation received by the operation unit. The portable electronic device according to any one of claims 1 to 6, characterized in that   The said processing part shows the position and range of the part displayed on the said display part as said 2nd image among said 1st images in said 1st image, The said 1st image is characterized by the above-mentioned. The portable electronic device according to any one of the above.   When the editing operation is received by the operation unit, the processing unit reflects the change based on the editing operation on the second image without reflecting the change on the first image, and the operation unit 9. The portable electronic device according to claim 1, wherein a change based on the editing operation is reflected in the first image after a storage operation is received.   When the data is shared with another device, the processing unit reflects a change based on the editing content transmitted from the other device on the first image and the second image. The portable electronic device according to any one of claims 1 to 9.

Images