What is BlindPAD for?

Till today blind children at school did not have enough solutions to learn crucial disciplines such as geometry and science. We built a tactile tablet made of hundreds ‘taxels’, that are the tactile equivalent of the pixels. Images are transformed into tactile representations. We have also developed a set of games, to be used within rehabilitation procedures. We tested our prototypes with people with visual disability. We found that BlindPAD improves their sense of space and their knowledge about unknown places. It is an interactive technology that can display in real time maps, graphics, and symbols, which is what is needed at school age and beyond. If Braille is used for text, BlindPAD can now be used for graphics. We plan to make it a real product, to be used in schools, rehabilitation centers and ultimately at home.

Final review meeting

The consortium has met in Genoa, Italy, for the final Review Meeting. We discussed the final project goals and had a demo session together with our Project Office, the Reviewers from the European Commission, involving also end users.

Left-to-right: Diego Torazza (IIT), Giulio Sandini (IIT), Piotr Witek (FIRR), Aleksander Waskielewicz (FIRR), Davide Dellepiane (IIT), Luca Brayda (IIT, coordinator), Elena Cocchi (Chiossone), Attila Agoston (Ateknea), Franco Bertora (IIT), Elisabetta Capris (Chiossone), Herbert Shea (EPFL), Claudia Vigini (Chiossone), Fabrizio Leo (IIT), Elisabetta Ferrari (IIT), Michael Gerhard (Geomobile), Caterina Baccelliere (IIT), Mariacarla Memeo (IIT), Maria Carmela Fierro (IIT).

Electromagnetic taxels

(extract from EPFL’s LMTS webpage on haptic displays and from the project final report)

We have developed a scalable and manufacturable fast haptic display with 192 taxels on an 8 mm pitch with a 10 ms refresh time per taxel. The device consists of an array of 12×16 latching electromagnetic actuators using a novel magnetic shield concept, that enables high fill factor, and eliminates cross-talk.
Key parameters of our portable EM haptic display:

  • 12 x 16 independently controlled taxels
  • 10 milliseconds refresh time per taxel (enables vibration and rapid update of static images)
  • 8 mm pitch between taxels
  • 0.8 mm vertical travel
  • 200 mN holding force (ie, easy to feel)
  • latches in both up and down states

The user explores the pattern on the haptic display using his fingertips. Our goal is not oriented to Braille reading, but to provide graphical information such as geometrical figures, maps or even artwork.

Diagram and key elements assembly of the 4×4 haptic display. a) Schematic view of a single taxel and the main actuation components. b) Photo of the 6-layer PCB containing the array of planar coils. The PCB is placed on an aluminium plate supported by four standoffs. c) Top view of the magnetic layer. It is formed by the 16 moving pot-magnets, a perimeter line of fixed pot-magnets, the top and bottom elastomer membranes (not visible) and an acrylic holder. d) A 3D printed pin interface completes the device as a final layer, and is what the user touches.

 

Load force vs. displacement curve for one taxel, for the two studied configurations. In the pulling configuration (blue lines (1) and (2)), the up-taxel state is dominated by the spring effective constant of the membranes. In the pushing configuration (red lines (3) and (4)), up-taxel state reflects the magnet/coil repulsion force. The colored zone around each experimental curve indicates the measured dispersion for the 16 taxels of the array.

 

Image of the six symbols used for the perception test. The images correspond to the device set to the pushing configuration, meaning that non-actuated taxels are in their down state, while actuated taxels are in the up state.

References:

Zarate and H. Shea, “Using pot-magnets to enable stable and scalable electromagnetic tactile displays”, IEEE Transactions on Haptics (2016) doi: 10.1109/TOH.2016.2591951

Shape Memory Polymer taxels

Working principle of Shape Memory Polymers:

(extract from EPFL’s LMTS webpage on haptic displays and from the project final report)

Here you find a Movie showing the flexible version of our 24×32 element active skin: i) displaying different patterns, ii) device operating principle, and iii) dynamic thermal imaging showing selective taxel heating. Published in Advanced Materials Technologies 2017.

Operating principle for a single SMPs taxel. Synchronizing the global pneumatic actuation and the Joule heating switches the taxel from up to down, or vice versa.

Photo and exploded view of the 4×4 SMP haptic display

 

24×32 haptic display with 768 independent SMP actuators, showing the BlindPad logo. The SMP actuators were made at EPFL, the control electronics and firmware by BlindPad partner IIT, and control software by BlindPad partner Geomobile.

Pictures of each separated parts used to drive in the 32×24 SMP prototype. The hardware (actuators + pumps), the driver board and the software are shown.

Picture of the 32×24 SMP prototype with the pin interface (from IIT) and the copper plate  to speed up the refresh time.