CN119883048A - Portable braille image interaction induction device and method - Google Patents
Portable braille image interaction induction device and method Download PDFInfo
- Publication number
- CN119883048A CN119883048A CN202510352565.4A CN202510352565A CN119883048A CN 119883048 A CN119883048 A CN 119883048A CN 202510352565 A CN202510352565 A CN 202510352565A CN 119883048 A CN119883048 A CN 119883048A
- Authority
- CN
- China
- Prior art keywords
- image
- text
- module
- braille
- array
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/046—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by electromagnetic means
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/40—Processing or translation of natural language
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/40—Image enhancement or restoration using histogram techniques
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B21/00—Teaching, or communicating with, the blind, deaf or mute
- G09B21/001—Teaching or communicating with blind persons
- G09B21/003—Teaching or communicating with blind persons using tactile presentation of the information, e.g. Braille displays
- G09B21/005—Details of specially-adapted software to access information, e.g. to browse through hyperlinked information
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Educational Technology (AREA)
- Business, Economics & Management (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Artificial Intelligence (AREA)
- Computational Linguistics (AREA)
- Educational Administration (AREA)
- Electromagnetism (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
本发明提供一种便携式盲文图像交互感应装置、方法，采用电磁脉冲驱动点阵方法代替传统物理凸凹盲文显示方式和点状触摸屏方式，降低了制造复杂度和成本，提高盲人感受盲文的精度，通过调整电磁脉冲强度，可以让用户触感发生变化，提高信息传输效率和盲读趣味性；采用平面化设计，给视障及听障用户提供了更加丰富的信息交互体验；模块化设计，能够兼容多语种盲文翻译显示，满足不同语种用户的需求；轻量化设计可适用于视障及听障人士在各类信息获取场景，使用场景更加广泛；采用图形转化模块，可以提取图形特征和轮廓信息，生成匹配的点阵阵列代码，实现了高质量的图形转换和显示，方便视障及听障人士获取整个装置的状态信息。
The present invention provides a portable Braille image interactive sensing device and method, which adopts an electromagnetic pulse driven dot matrix method to replace the traditional physical convex and concave Braille display method and dot touch screen method, thereby reducing manufacturing complexity and cost and improving the accuracy of blind people's perception of Braille. By adjusting the intensity of the electromagnetic pulse, the user's tactile sense can be changed, thereby improving the efficiency of information transmission and the interest of blind reading. The planar design is adopted to provide visually impaired and hearing-impaired users with a richer information interaction experience. The modular design is compatible with multi-language Braille translation display to meet the needs of users of different languages. The lightweight design can be applied to various information acquisition scenarios for the visually impaired and hearing-impaired, and the usage scenarios are more extensive. The graphic conversion module is adopted to extract graphic features and contour information, generate matching dot matrix array codes, realize high-quality graphic conversion and display, and facilitate the visually impaired and hearing-impaired to obtain the status information of the entire device.
Description
Technical Field
The invention relates to the technical field of braille reading, in particular to a portable braille image interaction induction device and method.
Background
The prior Braille display device mostly adopts a physical convex-concave lattice display mode, the manufacturing process is complex, the cost is higher, meanwhile, the information transmission efficiency of the display mode is lower, the display mode lacks interestingness, the requirements of visually impaired people and hearing impaired people for acquiring information under various scenes cannot be met, and the problems that the Braille reader with a point-shaped touch screen has higher Braille coding and system complexity in the prior Braille reader based on the point-shaped touch screen are also present recently.
For example, CN114913745A discloses a braille reader comprising a punctual touch screen, a communication module, a central processor, a braille display module and a voice recognition module. According to the device, text information on each website is acquired through the communication module, a user displays corresponding braille through the punctuation touch screen and then the braille display module, but the problem of high complexity of a braille coding method and system still exists in the patent, and the punctuation touch screen cannot enable handicapped people to accurately feel the braille.
CN113327489a discloses a layered mechanical braille reader based on machine vision, which comprises a machine vision part and a braille display part. The device adopts the working principle of screw drive, can show one or more lines of braille characters, and structural design is simple ingenious, and the cost is lower, but it can only support the braille translation display of single chinese, can't compatible multilingual braille translation demand.
In addition, most braille display devices lack the connection capability with external information equipment, have single use scene, and are difficult to adapt to the requirements of visually impaired people and hearing impaired people for acquiring information in various scenes such as markets, classrooms, subways, airports, families and the like.
Therefore, there is a need for a portable braille image interaction sensing device and method that can reduce manufacturing complexity and cost, improve information transmission efficiency and interest, support multi-language braille translation display, and connect with various external information devices, thereby meeting the requirements of visually impaired people and hearing impaired people for obtaining information in various scenes, and improving visual braille sensibility.
Disclosure of Invention
In view of the above problems, the present invention is to provide a portable braille image interaction sensing device, so as to solve the following technical problems of the conventional braille display device:
The braille display device is characterized by 1) a physical convex-concave lattice display mode which is generally adopted by the braille display device, the manufacturing process is complex, the cost is high, the punctiform touch screen mode cannot enable a disabled person to accurately feel braille, 2) the transmission efficiency is low, interestingness is lacking, the requirement of obtaining information by visually impaired persons and hearing impaired persons in various scenes cannot be met, 3) only single-language braille translation display is generally supported, the requirement of multi-language braille translation cannot be met, 4) the connection capability with external information equipment is lacked, the use scene is single, 5) the image recognition accuracy and efficiency are low, and high-quality image conversion and display are difficult to realize.
The invention provides a portable braille image interaction sensing device which comprises a starting control module, an image conversion module, a multi-language translation conversion module, an interaction module and a state feedback module, wherein,
The starting control module is used for adaptively adjusting the frequency and the intensity of the interaction module based on the user requirement to determine a target mode for the interaction module, receiving data to be interacted, judging a document of the data to be interacted to distinguish an image file and a text file in the data to be interacted, transmitting the image file to the image conversion module, and transmitting the text file to the multilingual translation conversion module;
The image conversion module is used for acquiring graphic features and contour features of the image file based on a preset feature extraction model and generating image electromagnetic pulse array codes for the graphic features and the contour features according to a preset electromagnetic pulse generation rule;
the multi-language translation conversion module is used for translating the text file into a target language text according to a target language set by a user and generating a text electromagnetic pulse array code of the target language text according to a preset electromagnetic pulse matching rule;
The interaction module is used for generating an image electromagnetic array in a preset image display area according to the image electromagnetic pulse array code, generating a text electromagnetic array in the preset text display area according to the text electromagnetic pulse array code, refreshing the image electromagnetic array or the text electromagnetic array through the frequency in the target mode, and enabling the image electromagnetic array or the text electromagnetic array to emit pulse stimulation through the intensity in the target mode so as to enable a user to read the data to be interacted;
The state feedback module comprises a voice unit and a vibration feedback unit, wherein the voice unit is used for playing an interaction process related to the user demand based on a preset loudspeaker or earphone interface module, and the vibration feedback unit is used for carrying out self-defined reminding according to the user setting.
Optionally, the voice unit is connected with the starting control module and the multilingual translation conversion module;
The voice unit comprises a self-input key, the self-input key is started, and the voice unit is used for receiving a self-voice signal of the user and performing voice control on the starting control module according to the self-voice signal;
The voice unit comprises a listening key and a preset text extraction module, the listening key is started, the voice unit is used for listening to voice signals of other parties of a user talking party, text extraction is carried out on the voice signals of the other parties through the text extraction module to generate a text file, and the text file is transmitted to the multi-language translation conversion module to generate text electromagnetic pulse array codes related to the text file.
Optionally, the system also comprises an input/output module in signal connection with the start control module, wherein the input/output module comprises a wireless network module, a wireless connection module and a data transmission module,
The wireless network module is used for connecting a wireless network to download the document and taking the downloaded document as data to be interacted;
The wireless connection module is used for being connected with target equipment based on Bluetooth and a local area network, and transmitting a target document of the target equipment to the starting control module through a file transmission channel based on a preset document transmission protocol, so that the target document is used as data to be interacted.
Optionally, the feature extraction model is pre-trained generated, wherein,
The feature extraction model obtains the graphic features and the outline features of the image file, and the feature extraction model comprises the following steps:
Preprocessing the image file to obtain a standardized image, wherein the preprocessing comprises gray level conversion processing, median filtering denoising processing and histogram averaging processing;
Performing edge detection extraction on the standardized image by using a preset Canny operator to obtain contour data, and extracting graphic feature data of the standardized image by using a preset OpenCV algorithm;
scaling the contour data and the graphical feature data to form contour information and graphical information according to a size of the unused electronic array in the image display area;
And carrying out binarization processing on the contour information and the graphic information to generate contour features and graphic features.
Optionally, the interaction module comprises an electronic array panel;
The electronic array panel comprises four rows of arrays, each row of arrays is provided with 12 square arrays, and each square array is provided with 6 electronic lattices.
Optionally, the electromagnetic pulse generation rule is:
the pixels with the binarized data of 1 in the outline feature and the graphic feature are corresponding to the electronic lattice of the image display area in the electronic array panel;
the electromagnetic pulse matching rule is as follows:
And the three-party arrays in each row of arrays form a Chinese character, a first party in the three-party arrays represents initials according to a preset Chinese character braille coding mode, a second party in the three-party arrays represents finals, and a third party in the three-party arrays represents tones, wherein if the whole electronic array panel only displays a target language text, the electronic array panel refreshes and senses 16 characters once.
Optionally, the braille input module is in signal connection with the starting control module;
The braille input module is used for inputting dotting braille through a preset dotting key so as to edit the data to be interacted based on the starting control module or control the voice unit to play the voice corresponding to the dotting braille based on the starting control module, wherein when the braille input module is started, an up page turning key used by a user for reading the data to be interacted is changed into an editing space key, and a down page turning key used by the user for reading the data to be interacted is changed into an editing enter key.
The electronic array panel comprises an image display area, a text display area, a left image and a right image, a text display area and a display control module, wherein the image display area and the text display area are generated by self-setting after the starting control module receives the data to be interacted, the whole area of the electronic array panel is the image display area if the data to be interacted only comprises an image file, the whole area of the electronic array panel is the text display area if the data to be interacted comprises a text file, and the electronic array panel adopts a left image and a right image to divide the data to be interacted by a preset proportion or adopts a left image and a right image to divide the data to be interacted by a preset proportion.
The invention also provides a portable braille image interaction induction method, wherein the braille image interaction is realized based on the portable braille image interaction induction device, and the method comprises the following steps:
Receiving data to be interacted, and judging a document of the data to be interacted to distinguish an image file and a text file in the data to be interacted;
the method comprises the steps of obtaining graphic features and outline features of an image file based on a preset feature extraction model, generating image electromagnetic pulse array codes for the graphic features and the outline features according to a preset electromagnetic pulse generation rule, translating the text file into a target language text according to a target language set by a user, and generating text electromagnetic pulse array codes of the target language text according to a preset electromagnetic pulse matching rule;
Generating an image electromagnetic array in a preset image display area according to the image electromagnetic pulse array code, generating a text electromagnetic array in the preset text display area according to the text electromagnetic pulse array code, refreshing the image electromagnetic array or the text electromagnetic array through frequency in a target mode, and enabling the image electromagnetic array or the text electromagnetic array to emit pulse stimulation through intensity in the target mode so as to enable a user to read the data to be interacted, wherein the target mode is formed by adaptively adjusting frequency and intensity based on user requirements.
Optionally, the method further comprises:
And inputting dotting braille through a preset dotting key so as to edit the data to be interacted or play the voice corresponding to the dotting braille.
According to the technical scheme, the portable braille image interaction induction device and the portable braille image interaction induction method are characterized in that an electromagnetic pulse driving lattice method is adopted to replace a traditional physical convex-concave braille display mode and a point-like touch screen mode, manufacturing complexity and cost are reduced, braille feeling precision of the blind is improved, touch feeling of a user can be changed by adjusting electromagnetic pulse intensity, information transmission efficiency and touch reading interestingness are improved, a planarization design is adopted, braille and graphics are induced by a planar lattice array of 12-row and 48-row in each row, richer information interaction experience is provided for vision-impaired and hearing-impaired users, a modularized design can be used for meeting requirements of users with different languages such as foreign language, and the like, bluetooth, wireless networks and USB interfaces can be used for connecting various external information equipment, the portable braille image interaction induction device is applicable to various information acquisition scenes of vision-impaired people and hearing impaired people in markets, classes, subways, airports and families, the graphic conversion module is adopted, graphic feature and outline information can be extracted, the matched lattice array is generated, high-quality graphic conversion and graphic interaction experience is realized, various touch-impaired users can be enabled to input various touch-impaired images, and full-impaired users can be enabled to touch information by the aid of the left-impaired users, and the left-impaired users, the requirements of the requirements are met by inputting various braille images and the left-impaired users, and the left-impaired users can conveniently touch information, and the left-impaired users can conveniently touch the touch device can input the touch images and the braille image interaction induction device.
Drawings
Other objects and attainments together with a more complete understanding of the invention will become apparent and appreciated by referring to the following description taken in conjunction with the accompanying drawings. In the drawings:
FIG. 1 is a schematic diagram of a portable braille image interaction sensor according to an embodiment of the invention;
FIG. 2 is a schematic workflow diagram of a portable braille image interaction sensor according to an embodiment of the invention;
FIG. 3 is a schematic front view of a portable braille image interaction sensor according to an embodiment of the invention;
FIG. 4 is a schematic side view of a portable braille image interaction sensor according to an embodiment of the invention;
fig. 5 is a flowchart of a portable braille image interaction sensing method according to an embodiment of the invention.
Detailed Description
The following technical problems exist in the existing Braille display device:
The braille display device is characterized by 1) a physical convex-concave lattice display mode which is generally adopted by the braille display device, the manufacturing process is complex, the cost is high, the punctiform touch screen mode cannot enable a disabled person to accurately feel braille, 2) the transmission efficiency is low, interestingness is lacking, the requirement of obtaining information by visually impaired persons and hearing impaired persons in various scenes cannot be met, 3) only single-language braille translation display is generally supported, the requirement of multi-language braille translation cannot be met, 4) the connection capability with external information equipment is lacked, the use scene is single, 5) the image recognition accuracy and efficiency are low, and high-quality image conversion and display are difficult to realize.
In view of the foregoing, the present invention provides a portable braille image interaction sensing device and method, and detailed description will be given below of specific embodiments of the present invention with reference to the accompanying drawings.
In order to illustrate the portable braille image interaction sensing device and method provided by the invention, fig. 1 to 5 show exemplary labeling of the embodiments of the invention.
The following description of the exemplary embodiment(s) is merely exemplary in nature and is in no way intended to limit the invention, its application, or uses. Techniques and equipment known to those of ordinary skill in the relevant art may not be discussed in detail, but should be considered part of the specification where appropriate.
As shown in fig. 1-4 together, the portable braille image interaction sensing device 100 provided by the invention comprises a start control module 110, an image conversion module 120, a multi-language translation conversion module 130, an interaction module 140 and a state feedback module 150, wherein,
The start control module 110 is configured to adaptively adjust frequency and intensity of the interaction module based on a user requirement to determine a target mode for the interaction module, and further configured to receive data to be interacted, perform document judgment on the data to be interacted to distinguish an image file and a text file in the data to be interacted, transmit the image file to the image conversion module, and transmit the text file to the multilingual translation conversion module;
The image conversion module 120 is configured to obtain a graphic feature and a contour feature of the image file based on a preset feature extraction model, and generate an image electromagnetic pulse array code for the graphic feature and the contour feature according to a preset electromagnetic pulse generation rule;
The multilingual translation conversion module 130 is configured to translate the text file into a target language text according to a target language set by a user, and generate a text electromagnetic pulse array code of the target language text according to a preset electromagnetic pulse matching rule;
The interaction module 140, which may also be referred to as a voice and vibration feedback module, is configured to generate an image electromagnetic array in a preset image display area according to the image electromagnetic pulse array code, generate a text electromagnetic array in a preset text display area according to the text electromagnetic pulse array code, refresh the image electromagnetic array or the text electromagnetic array by using the frequency in the target mode, and make the image electromagnetic array or the text electromagnetic array emit pulse stimulation by using the intensity in the target mode so as to enable a user to read the data to be interacted;
The state feedback 150 module includes a voice unit 151 and a vibration feedback unit 152, where the voice unit is configured to play an interaction process related to the user requirement based on a preset speaker or earphone interface module, and the vibration feedback unit is configured to perform a custom reminder according to a user setting.
The voice unit 151 is connected to the start control module 110 and the multilingual translation conversion module 130;
the voice unit 151 includes a self-input key 1511, which is turned on, and the voice unit is configured to answer a self-voice signal of the user, and perform voice control on the start control module according to the self-voice signal;
The voice unit comprises a listening key 1512 and a preset text extraction module 1513, the listening key is started, the voice unit is used for listening to voice signals of other parties of a user talking party, text extraction is carried out on the voice signals of other parties through the text extraction module to generate a text file, the text file is transmitted to the multi-language translation conversion module to generate text electromagnetic pulse array codes related to the text file, when a blind person losing hearing communicates with external personnel, the external personnel can convert sound into the text electromagnetic pulse array codes through the voice unit, so that the user can know communication information of the external personnel based on the electromagnetic array, then the user can play voices corresponding to the dotting braille through the subsequent braille input module, and therefore barrier-free communication between the blind person and the external is achieved. In one embodiment the self-input key 1511 may be configured to hold for more than 10 seconds the adjust pulse intensity key shown in fig. 4 and the listen key 1512 may be configured to hold for more than 10 seconds the adjust refresh frequency key shown in fig. 4.
The portable braille image interaction sensing device further comprises an input/output module 160 in signal connection with the starting control module, wherein the input/output module comprises a wireless network module 161, a wireless connection module 162 and a data transmission module 163;
The wireless network module 161 is used for connecting a wireless network to download a document and taking the downloaded document as data to be interacted;
The wireless connection module 162 is configured to connect to a target device based on bluetooth or a local area network, and transmit a target document of the target device to the start control module through a file transmission channel based on a preset document transmission protocol, so as to use the target document as data to be interacted;
The data transmission module 163 is configured to download a document through an effective transmission channel, and take the downloaded document as data to be interacted.
In this embodiment, after the switch button of the portable braille image interaction sensing device shown in fig. 4 is turned on, the connection selection mode may be first entered by clicking the connection switching button shown in fig. 4, and a connection mode needs to be selected by the user to establish connection with an external device. If no external equipment can be connected or connection is attempted to be established in the Bluetooth communication range at present, the voice and vibration modes are used for prompting the user that the connection mode needs to be changed, and the connection can be realized by long-time pressing of a connection switching key.
The external device information can be loaded into the device in four ways based on the input/output module 160, the first is a file mode, the device supports common text file formats such as TXT and word, the second is a stream input mainly comprising push information, screen reading information and the like, the third is a connection screen reading software such as NVDA (NonVisual Desktop Access) and the like, the input information is controlled by the screen reading software at this time, and the fourth is a connection device matching software, which can generate graphics and input the graphic information.
In the image conversion module 120, which may also be called a graphic conversion module, obtains graphic features and contour features of the image file based on a preset feature extraction model, and generates an image electromagnetic pulse array code for the graphic features and the contour features according to a preset electromagnetic pulse generation rule, the feature extraction model is generated by training in advance, wherein,
The step of obtaining the graphic features and the outline features of the image file by the feature extraction model comprises the following steps:
Preprocessing the image file to obtain a standardized image, wherein the preprocessing comprises gray level conversion processing, median filtering denoising processing and histogram averaging processing;
performing edge detection extraction on the standardized image by using a preset Canny operator to obtain contour data, and extracting graphic feature data of the standardized image by using a preset OpenCV algorithm;
scaling the contour data and the graphical feature data to form contour information and graphical information according to a size of the unused electronic array in the image display area;
And carrying out binarization processing on the contour information and the graphic information to generate contour features and graphic features.
The specific training process of the feature extraction model is not described herein, the original feature extraction frame can be adopted for training and generating the self-input data, and the trained mature feature extraction model can be directly adopted, so long as the requirement of high-precision feature extraction can be met, and the method is not limited.
In the multi-language translation conversion module 130, which may also be called a multi-language braille translation module, in the process of translating the text file into a target language text according to a target language set by a user and generating a text electromagnetic pulse array code of the target language text according to a preset electromagnetic pulse matching rule, the translation may support a multi-language manner, in one embodiment, all text information in data to be interacted received from an external device may be converted into a braille lattice display format by a built-in algorithm in the multi-language translation conversion module 130, in one embodiment, a braille translation algorithm of chinese, english, japanese, french, korean, german and latin is built in, and in another embodiment, an android translation software or microsoft translation software that may be directly installed in a portable braille image interaction sensing device of the embodiment may be directly downloaded, but in order to ensure the stability of the translation, in the multi-language translation conversion module 130 in the embodiment, the multi-language translation module 130 in the embodiment may be directly converted into a braille lattice display format, that is directly translated into a chinese lattice, i.e., a braille translation algorithm with a more compact, and more compatible braille translation algorithm. When the portable braille image interaction induction device of the embodiment is used, a user can load different translation algorithms by pressing language switching keys for a long time, voice and vibration prompts are used for switching successfully, the language information supported at present is displayed on the braille and graphic induction module, and the language switching keys are arranged on the side face of the portable braille image interaction induction device of the embodiment.
The interaction module 140 is configured to generate an image electromagnetic array in a preset image display area according to the image electromagnetic pulse array code, generate a text electromagnetic array in a preset text display area according to the text electromagnetic pulse array code, refresh the image electromagnetic array or the text electromagnetic array by using a frequency in the target mode, and send pulse stimulation to the image electromagnetic array or the text electromagnetic array by using an intensity in the target mode so as to enable a user to read the data to be interacted, where the interaction module includes an electronic array panel 141, and the electronic array panel may also be referred to as a braille and a graphic induction module;
The electronic array panel 141 comprises four rows of arrays, each row of arrays has 12 square arrays, each square array has 6 electronic lattices, and the electromagnetic pulse generation rules are as follows:
the pixels with the binarized data of 1 in the outline feature and the graphic feature are corresponding to the electronic lattice of the image display area in the electronic array panel;
the electromagnetic pulse matching rule is as follows:
And the three-party arrays in each row of arrays form a Chinese character, a first party in the three-party arrays represents initials according to a preset Chinese character braille coding mode, a second party in the three-party arrays represents finals, and a third party in the three-party arrays represents tones, wherein if the whole electronic array panel only displays a target language text, the electronic array panel refreshes and senses 16 characters once.
In general, that is, for a loaded graphic file, an image conversion module may extract graphic features and contour features through an algorithm, and automatically generate a matched lattice array code according to the number of lattices of a graphic sensing module of the device, that is, firstly, gray conversion, median filtering denoising and histogram equalization are performed on the graphic file, edge detection is performed by using a Canny operator to extract contour data of the graphic, secondly, after graphic main body data (graphic information) is extracted through an OpenCV algorithm, binarization processing is performed on the image, for example, a threshold value may be set, pixels above the threshold value are set to 1 (white), pixels below the threshold value are set to 0 (black), and finally, the size of the graphic main body is adjusted to n rows and m columns by scaling and clipping the graphic main body according to the size of an electronic lattice, and each pixel value of the adjusted image is mapped to one element of the lattice. The braille and graphic sensing module (the electronic array panel 141) receives the codes of the matched software, and has three graphic sensing modes, namely, the first mode is left-hand and right-hand area sensing graphics, the right-hand area sensing corresponds to braille, the second mode is left-hand and right-hand area sensing, the second mode is opposite to the first mode, and the third mode is full-image sensing, namely, the left-hand area and the right-hand area sensing graphics.
For the loaded text file, all text information received from the external equipment converts the text file into a Braille lattice display format through a built-in algorithm of a Braille translation module, the device is internally provided with the Braille translation algorithms of Chinese, english, japanese, french, korean, german and Latin (the mobile phone or the installation software of a computer can be used), and other small language algorithms can be compatible through a download updating algorithm package. Different translation algorithms can be loaded by long-pressing the language switching key, voice and vibration prompts are used for switching successfully, and the currently supported language information is displayed on the braille and graphic induction module. The braille and graphic sensing module (electronic array panel 141) receives the text electromagnetic pulse array code, and the lattice can be flexibly configured, for example 288 electronic lattices are realized by utilizing electromagnetic pulses, and every 6 electronic lattices are one, and the total number of the electronic lattices is 12 from left to right. There are 4 rows from top to bottom, 48 squares in total. When the Chinese braille is sensed, three parties form a Chinese character, for example, a first party represents initials, a second party represents finals, a third party represents tones, 16 characters are sensed once, each party represents a letter when the alphabetic characters (English, french, german and the like) are sensed, and as the number of letters of the words is not uniform, when the words cross the border, the device prompts the user that the words are not finished by voice and vibration, and the words are continuously represented at the left side after the refreshing. In one embodiment, braille sensing may use an auto-refresh mode or a manual refresh mode. The Chinese information efficiency is higher than that of alphabetic writing, so that the device refreshing frequency is set according to the alphabetic writing investigation result, the English word touch-reading speed of a common user is 60 words per minute according to the English investigation, the maximum speed of 300 words per minute can be reached after professional training, the average number of letters of the English word is 5 letters, the automatic refreshing is carried out according to the speed of 30-300 words per minute, namely 150-1500 parties per minute, and the device refreshing frequency can be set to 0.5-5S. The refresh frequency of the device can be automatically adjusted by a user through the refresh frequency adjusting roller, the refresh frequency is increased or decreased by taking 0.5S as a step length, and after the device is successfully set, the refresh frequency is also prompted by voice and vibration. The manual refreshing can finish the refreshing of the upper line or the lower line up and down through the roller, and the page-by-page refreshing can also be realized through page up-turning and page down-turning, and the content of one page is just 48 sides. Braille can be sensed through electromagnetic pulse intensity enhancement, a user can automatically adjust the intensity suitable for own touch through the pulse intensity adjusting roller, and the pulse intensity is set to be 1-10 levels.
In this embodiment, the image display area and the text display area are generated by self-setting after the start control module receives the data to be interacted, wherein if the data to be interacted only includes an image file, the whole area of the electronic array panel is the image display area, if the data to be interacted includes a text file, the whole area of the electronic array panel is the text display area, if the data to be interacted includes both the image file and the text file, the electronic array panel adopts a left image and a right image to divide the image or adopts a left image and a right image to divide the image and the right image to the predetermined proportion, that is, the start control module receives the data to be interacted, and then invokes the image conversion module and the multilingual translation conversion module according to the original typesetting time of the data (file), that is, generates array codes (image electromagnetic pulse array codes and text electromagnetic pulse array codes) according to the original typesetting time of the data to be interacted, so that the image and the image sensing module (electronic array panel 141) receives array codes, and if the image and the text file are simultaneously included in the data to be interacted, the image and the text sensing area can be sensed by the left and right image sensing area or the left sensing area and the right sensing area can be correspondingly arranged by the left and right image or the right sensing area only by the left sensing area or the right sensing area.
The state feedback 150 module includes a voice unit 151 and a vibration feedback unit 152, where the voice unit is configured to play an interaction process related to the user requirement based on a preset speaker or earphone interface module, and the vibration feedback unit is configured to perform a custom reminder according to a user setting. The vibration feedback unit expresses different information for visually impaired people and hearing impaired people through different vibration modes, and the vibration is successful once, failed continuous vibration is twice, and continuous vibration is performed when the battery power is low. Taking bluetooth connection as an example, if a successful connection device vibrates once, no external devices can be connected or the connection fails to vibrate twice. The hearing person can turn off the vibration and only use voice feedback, so that a headset jack is provided for protecting personal privacy.
In addition, the portable braille image interaction sensing device further comprises a braille input module 170 in signal connection with the starting control module, wherein the braille input module 170 is used for inputting dotting braille through a preset dotting key, six dotting points are arranged in each dotting area based on the starting control module, or the voice unit is controlled to play voice corresponding to the dotting braille based on the starting control module, when the braille input module is started, an up page turning key used by a user for reading the data to be interacted is changed into an editing space key, a down page turning key used by the user for reading the data to be interacted is changed into an editing enter key, the dotting keys are divided into a left-hand dotting area and a right-hand dotting area, each dotting area is provided with six dotting points, the three dotting points on the left side are respectively recorded as a left 1 (corresponding key 1), a left 2 (corresponding key 2), a left 3 (corresponding key 3), and the three right dotting points can be respectively recorded as a right 1 (corresponding key 4), a right 2 (corresponding key 3), and a right key (corresponding to 6) simultaneously, and the braille is required to be input by the user. For example:
The letter "a" (point 1 bump) is entered by simply pressing key 1.
The letter "B" is entered (point 1 and point 2 raised) by pressing both key 1 and key 2 simultaneously.
The letter "C" (point 1 and point 4 raised) is entered by pressing both key 1 and key 4.
The user has to press the corresponding key simultaneously and the typewriter will punch the corresponding bump combination on the paper. And the key sequence does not affect the result, as long as the correct key combination is pressed.
Such as the letter "D" (points 1, 4, 5 raised) pressing key 1, key 4 and key 5 simultaneously, and the letter "F" (points 1, 2, 4 raised) pressing key 1, key 2 and key 4 simultaneously.
That is, the 6 dotting points correspond to 6 braille points, and the user inputs characters by simultaneously pressing the required key combination, so that the mode is efficient and visual, is suitable for visually impaired people, and improves interaction efficiency of disabled people.
In addition, as shown in fig. 3 and 4 together, the front side of the portable braille image interaction induction device of the embodiment is provided with a save up page turning button (space button), a down page turning button (carriage return button) and a roller so as to facilitate document editing and document reading, and the side of the portable braille image interaction induction device is provided with a switch button, a connection switching button, a language switching button, a USB interface, an earphone interface, a pulse intensity adjusting button and a refresh frequency adjusting button, and the form and the shape of each button are different so as to facilitate the operation of the whole portable braille image interaction induction device.
More specifically, the implementation parameters of the embodiment are as follows, electromagnetic pulse lattice response time is less than or equal to 10ms, electromagnetic pulse lattice refreshing time is 0.5S-5S, 0.5S is used as step length for adjustment, electromagnetic pulse lattice strength is 1-10 levels, endurance time is more than or equal to 15 hours, and communication range is stable within 10 meters of wireless or Bluetooth connection.
As described above, the portable braille image interaction induction device provided by the invention is characterized in that a control module 110 is started to adaptively adjust the frequency and intensity of the interaction module based on user requirements to determine a target mode for the interaction module, data to be interacted is received, document judgment is carried out on the data to be interacted to distinguish an image file and a text file in the data to be interacted, the image file is transmitted to an image conversion module, the text file is transmitted to a multi-language translation conversion module, the image characteristics and outline characteristics of the image file are obtained through the image conversion module 120 based on a preset characteristic extraction model, image electromagnetic pulse array codes are generated for the image characteristics and the outline characteristics according to a preset electromagnetic pulse generation rule, the text file is translated into target language text according to a target language set by a user through the multi-language translation conversion module 130, a text electromagnetic pulse array code of the target language is generated according to a preset electromagnetic pulse matching rule, an image electromagnetic array is generated in a preset image display area according to the image electromagnetic pulse array code, the text electromagnetic array code is generated in the preset text display area, the image electromagnetic array is refreshed according to the image electromagnetic pulse array code, the image electromagnetic array is generated in the preset text electromagnetic array display area, the image electromagnetic array code is refreshed by the preset electromagnetic array, the image electromagnetic array is read by the user requirements or the user requirements of the user requirements, and the user requirements are read by the user requirements or the user requirements of the user interface.
The electromagnetic pulse driving lattice method is adopted to replace the traditional physical convex-concave braille display mode and the dot-shaped touch screen mode, the manufacturing complexity and cost are reduced, the braille feeling precision of the blind is improved, the touch feeling of the user can be changed through adjusting the electromagnetic pulse intensity, the information transmission efficiency and the blind reading interestingness are improved, the planar design is adopted, the planar lattice array of 12 rows and 48 rows is used for sensing braille and graphics, richer information interaction experience is provided for vision-impaired users and hearing-impaired users, the modularized design can be compatible with the translation display of multiple braille, such as foreign language and the like, to meet the requirements of users in different languages, bluetooth, wireless networks and USB interfaces can be used for connecting various external information equipment, the braille-impaired users and hearing-impaired users can acquire scenes in various information acquisition modes such as shopping malls, classrooms, subways, airports and families, the graphic feature and outline information can be extracted, matched lattice array codes are generated, high-quality graphic conversion and display are realized, various braille sensing modes are supported, such as left and right images, the touch-impaired users can meet the requirements, the requirements of users and hearing-impaired users can be met, the user can input the information by playing state information through the vibration-impaired users, and the vibration state is convenient, and the device is convenient to input.
In addition, as shown in fig. 4, the invention further provides a portable braille image interaction induction method, which realizes braille image interaction based on the portable braille image interaction induction device, and comprises the following steps:
S1, receiving data to be interacted, and judging a document of the data to be interacted to distinguish an image file and a text file in the data to be interacted;
s2, acquiring graphic features and outline features of the image file based on a preset feature extraction model, and generating image electromagnetic pulse array codes for the graphic features and the outline features according to a preset electromagnetic pulse generation rule;
S3, generating an image electromagnetic array in a preset image display area according to the image electromagnetic pulse array code, generating a text electromagnetic array in the preset text display area according to the text electromagnetic pulse array code, refreshing the image electromagnetic array or the text electromagnetic array through frequency in a target mode, and enabling the image electromagnetic array or the text electromagnetic array to emit pulse stimulation through intensity in the target mode so as to enable a user to read the data to be interacted, wherein the target mode is formed by adaptively adjusting frequency and intensity based on user requirements.
In one embodiment, the method further comprises the step S4 of inputting dotting braille through a preset dotting key so as to edit the data to be interacted or play the voice corresponding to the dotting braille, so that the handicapped can read, edit, voice and other interactions without barriers.
Specific embodiments may refer to a specific implementation manner of the portable braille image interaction sensing device, and will not be described again.
As shown in the above, the portable braille image interaction induction method provided by the invention adopts an electromagnetic pulse driving dot matrix method, and the electromagnetic pulse is used for stimulating the finger skin of a user to replace the traditional physical convex-concave braille display mode, so that the manufacturing complexity and cost are reduced, richer information interaction experience is provided for visually impaired users and hearing impaired users, graphic features and contour information can be extracted, matched dot matrix array codes are generated, high-quality graphic conversion and display are realized, and the portable braille image interaction induction method is suitable for visually impaired people and hearing impaired people in various information acquisition scenes such as markets, classrooms, subways, airports, families and the like, has wider use scenes, and improves the information transmission efficiency and blind reading interestingness.
The portable braille image interaction sensing device and method according to the present invention are described above by way of example with reference to the accompanying drawings. It will be appreciated by those skilled in the art that various modifications may be made to the portable braille image interaction sensing device and method of the present invention as set forth above without departing from the spirit of the invention. Accordingly, the scope of the invention should be determined from the following claims.
Claims (10)
1. A portable braille image interaction induction device is characterized by comprising a starting control module, an image conversion module, a multi-language translation conversion module, an interaction module and a state feedback module, wherein,
The starting control module is used for adaptively adjusting the frequency and the intensity of the interaction module based on the user requirement to determine a target mode for the interaction module, receiving data to be interacted, judging a document of the data to be interacted to distinguish an image file and a text file in the data to be interacted, transmitting the image file to the image conversion module, and transmitting the text file to the multilingual translation conversion module;
The image conversion module is used for acquiring graphic features and contour features of the image file based on a preset feature extraction model and generating image electromagnetic pulse array codes for the graphic features and the contour features according to a preset electromagnetic pulse generation rule;
the multi-language translation conversion module is used for translating the text file into a target language text according to a target language set by a user and generating a text electromagnetic pulse array code of the target language text according to a preset electromagnetic pulse matching rule;
The interaction module is used for generating an image electromagnetic array in a preset image display area according to the image electromagnetic pulse array code, generating a text electromagnetic array in the preset text display area according to the text electromagnetic pulse array code, refreshing the image electromagnetic array or the text electromagnetic array through the frequency in the target mode, and enabling the image electromagnetic array or the text electromagnetic array to emit pulse stimulation through the intensity in the target mode so as to enable a user to read the data to be interacted;
The state feedback module comprises a voice unit and a vibration feedback unit, wherein the voice unit is used for playing an interaction process related to the user demand based on a preset loudspeaker or earphone interface module, and the vibration feedback unit is used for carrying out self-defined reminding according to the user setting.
2. The portable braille image interaction sensing device according to claim 1, wherein the voice unit is connected to the start control module and the multilingual translation conversion module;
The voice unit comprises a self-input key, the self-input key is started, and the voice unit is used for receiving a self-voice signal of the user and performing voice control on the starting control module according to the self-voice signal;
The voice unit comprises a listening key and a preset text extraction module, the listening key is started, the voice unit is used for listening to voice signals of other parties of a user talking party, text extraction is carried out on the voice signals of the other parties through the text extraction module to generate a text file, and the text file is transmitted to the multi-language translation conversion module to generate text electromagnetic pulse array codes related to the text file.
3. The portable braille image interaction sensing device according to claim 1, further comprising an input/output module in signal connection with the start control module, wherein the input/output module comprises a wireless network module, a wireless connection module and a data transmission module, wherein,
The wireless network module is used for connecting a wireless network to download the document and taking the downloaded document as data to be interacted;
The wireless connection module is used for being connected with target equipment based on Bluetooth and a local area network, and transmitting a target document of the target equipment to the starting control module through a file transmission channel based on a preset document transmission protocol, so that the target document is used as data to be interacted.
4. The portable braille image interaction sensing device according to claim 1, wherein the feature extraction model is pre-trained and generated, wherein,
The feature extraction model obtains the graphic features and the outline features of the image file, and the feature extraction model comprises the following steps:
Preprocessing the image file to obtain a standardized image, wherein the preprocessing comprises gray level conversion processing, median filtering denoising processing and histogram averaging processing;
Performing edge detection extraction on the standardized image by using a preset Canny operator to obtain contour data, and extracting graphic feature data of the standardized image by using a preset OpenCV algorithm;
scaling the contour data and the graphical feature data to form contour information and graphical information according to a size of the unused electronic array in the image display area;
And carrying out binarization processing on the contour information and the graphic information to generate contour features and graphic features.
5. The portable braille image interaction sensing device of claim 4, wherein the interaction module includes an electronic array panel;
The electronic array panel comprises four rows of arrays, each row of arrays is provided with 12 square arrays, and each square array is provided with 6 electronic lattices.
6. The portable braille image interaction sensor of claim 5, characterized in that,
The electromagnetic pulse generation rule is as follows:
the pixels with the binarized data of 1 in the outline feature and the graphic feature are corresponding to the electronic lattice of the image display area in the electronic array panel;
the electromagnetic pulse matching rule is as follows:
And the three-party arrays in each row of arrays form a Chinese character, a first party in the three-party arrays represents initials according to a preset Chinese character braille coding mode, a second party in the three-party arrays represents finals, and a third party in the three-party arrays represents tones, wherein if the whole electronic array panel only displays a target language text, the electronic array panel refreshes and senses 16 characters once.
7. The portable braille image interaction sensing device of claim 5, further comprising a braille input module in signal connection with said start control module;
The braille input module is used for inputting dotting braille through a preset dotting key so as to edit the data to be interacted based on the starting control module or control the voice unit to play the voice corresponding to the dotting braille based on the starting control module, wherein when the braille input module is started, an up page turning key used by a user for reading the data to be interacted is changed into an editing space key, and a down page turning key used by the user for reading the data to be interacted is changed into an editing enter key.
8. The portable braille image interaction sensor of claim 7, wherein,
The image display area and the text display area are generated by self-setting after the starting control module receives the data to be interacted, wherein if the data to be interacted only comprises image files, the whole area of the electronic array panel is the image display area, if the data to be interacted comprises text files, the whole area of the electronic array panel is the text display area, and if the data to be interacted comprises the image files and the text files, the electronic array panel adopts left and right images to divide the left and right images in a preset proportion or adopts left and right images to divide the left and right images in a preset proportion.
9. A portable braille image interaction induction method, characterized in that the braille image interaction is realized based on the portable braille image interaction induction device according to any of claims 1-8, comprising:
Receiving data to be interacted, and judging a document of the data to be interacted to distinguish an image file and a text file in the data to be interacted;
the method comprises the steps of obtaining graphic features and outline features of an image file based on a preset feature extraction model, generating image electromagnetic pulse array codes for the graphic features and the outline features according to a preset electromagnetic pulse generation rule, translating the text file into a target language text according to a target language set by a user, and generating text electromagnetic pulse array codes of the target language text according to a preset electromagnetic pulse matching rule;
Generating an image electromagnetic array in a preset image display area according to the image electromagnetic pulse array code, generating a text electromagnetic array in the preset text display area according to the text electromagnetic pulse array code, refreshing the image electromagnetic array or the text electromagnetic array through frequency in a target mode, and enabling the image electromagnetic array or the text electromagnetic array to emit pulse stimulation through intensity in the target mode so as to enable a user to read the data to be interacted, wherein the target mode is formed by adaptively adjusting frequency and intensity based on user requirements.
10. The portable braille image interaction sensing method of claim 9, further comprising:
And inputting dotting braille through a preset dotting key so as to edit the data to be interacted or play the voice corresponding to the dotting braille.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202510352565.4A CN119883048A (en) | 2025-03-25 | 2025-03-25 | Portable braille image interaction induction device and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202510352565.4A CN119883048A (en) | 2025-03-25 | 2025-03-25 | Portable braille image interaction induction device and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN119883048A true CN119883048A (en) | 2025-04-25 |
Family
ID=95430092
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202510352565.4A Pending CN119883048A (en) | 2025-03-25 | 2025-03-25 | Portable braille image interaction induction device and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN119883048A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003099260A (en) * | 2001-09-26 | 2003-04-04 | Seiko Epson Corp | Interactive expert systems and programs |
| CN101098526A (en) * | 2006-06-29 | 2008-01-02 | 北京三星通信技术研究有限公司 | Braille communication terminal |
| US20080058894A1 (en) * | 2006-08-29 | 2008-03-06 | David Charles Dewhurst | Audiotactile Vision Substitution System |
| CN107111343A (en) * | 2015-01-13 | 2017-08-29 | Ck高新材料有限公司 | Tactile Information Provider |
| CN109903300A (en) * | 2019-01-15 | 2019-06-18 | 浙江工业大学 | An intelligent touch point display method and device suitable for congenitally blind people to learn to recognize pictures |
| CN113706976A (en) * | 2020-05-22 | 2021-11-26 | 闽南师范大学 | Reading and writing learning instrument for vision-impaired students |
| CN215527008U (en) * | 2021-08-18 | 2022-01-14 | 东北大学秦皇岛分校 | Braille electronic product reading device |
| CN114913745A (en) * | 2022-05-26 | 2022-08-16 | 深圳大学 | Braille reader, Braille coding method and system |
-
2025
- 2025-03-25 CN CN202510352565.4A patent/CN119883048A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003099260A (en) * | 2001-09-26 | 2003-04-04 | Seiko Epson Corp | Interactive expert systems and programs |
| CN101098526A (en) * | 2006-06-29 | 2008-01-02 | 北京三星通信技术研究有限公司 | Braille communication terminal |
| US20080058894A1 (en) * | 2006-08-29 | 2008-03-06 | David Charles Dewhurst | Audiotactile Vision Substitution System |
| CN107111343A (en) * | 2015-01-13 | 2017-08-29 | Ck高新材料有限公司 | Tactile Information Provider |
| CN109903300A (en) * | 2019-01-15 | 2019-06-18 | 浙江工业大学 | An intelligent touch point display method and device suitable for congenitally blind people to learn to recognize pictures |
| CN113706976A (en) * | 2020-05-22 | 2021-11-26 | 闽南师范大学 | Reading and writing learning instrument for vision-impaired students |
| CN215527008U (en) * | 2021-08-18 | 2022-01-14 | 东北大学秦皇岛分校 | Braille electronic product reading device |
| CN114913745A (en) * | 2022-05-26 | 2022-08-16 | 深圳大学 | Braille reader, Braille coding method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10437337B2 (en) | Wearable haptic pattern display device for blind person | |
| Rantala et al. | Methods for presenting braille characters on a mobile device with a touchscreen and tactile feedback | |
| US9183759B2 (en) | Braille display system and method for operating a refreshable Braille display | |
| US20110216006A1 (en) | Method for inputting data | |
| CN103534676A (en) | Touchscreen keyboard with correction of previously input text | |
| CN111144367B (en) | Auxiliary semantic recognition method based on gesture recognition | |
| CN106341549A (en) | Mobile terminal audio reading apparatus and method | |
| US11189183B2 (en) | Intelligent voice interaction method, device and computer readable storage medium | |
| KR20140010756A (en) | Mobile device for visual-handicapped persons with text/image/video presentation | |
| JP4972011B2 (en) | Tactile presentation device and tactile presentation method | |
| JPS5896382A (en) | Device for recognition and display of handwritten character | |
| US6140913A (en) | Apparatus and method of assisting visually impaired persons to generate graphical data in a computer | |
| CN114283422A (en) | A method, device, electronic device and storage medium for generating handwritten fonts | |
| CN101493951A (en) | Skin design system and method in input tool | |
| Ladner | Communication technologies for people with sensory disabilities | |
| CN101098526A (en) | Braille communication terminal | |
| CN119883048A (en) | Portable braille image interaction induction device and method | |
| CN101599265B (en) | Information display device and information display method | |
| CN111067708B (en) | Display method and display system for tactile perception of images | |
| KR101865251B1 (en) | Intelligent braille translation device | |
| Gopinath et al. | Development of Speech and Text to Braille Script Converter for Blind and Deaf People | |
| US11033187B2 (en) | Text to braille converter | |
| CN114120334A (en) | Braille processing method, device, storage medium and electronic device | |
| WO2020124457A1 (en) | Personalized font display method and related product | |
| CN101098357A (en) | Communication terminal supporting braille input and method for sending braille on the terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |