Sensory Technology...The Next Steps for special needs.

Welcome
Intro +Aims
---------------------------

Background
Objectives
---------------------------

Evaluations
products +soundbeam+music box + marketplace
---------------------------

Technologies
camera vision+cctv+sensors +
---------------------------

Future
blue skies +sensors +robots +scanners
---------------------------

Suggestions
ideas +recommendations
---------------------------

My Work
soundtoys +touchscreen+software +
---------------------------

Whats Next
funding + How

---------------------------

Links +Contact
contribute +
---------------------------------

 

Evaluations

products +soundbeam+music box + marketplace

R&D – Sensory Technology

Most stuff at The Betts Show in the sensory technology area  involved a hardware product  and spend packaged as content. You get computer, speakers, cameras, set up, and its 7k for these 'sensory rooms'. It was interesting they where all set at the same price. £6995. One way to look at this is that these products are driven my market need.

But what makes them 'sensory', when all they do is use camera tracking.( I will talk about the technology of called computer vision later)

The three main companies.(All very  similar products) and all had fixed systems. 


Whats the experience…ie it has to be more than oxygen in the blood more than getting a bit hyper.

For Visuals

1. Sensory Surface

The “Sensory Surface” is an interactive floor and wall projection system, providing a wealth of interactive experience for all individuals regardless of their abilities.

http://www.sensoryscientia.co.uk/sensory_surface.php

2. A Sensory Environment from OM Interactive is based around the ground breaking interactive systems OMi-Beam (interactive sensory lighting) and OMi-Vista (interactive projection)...OK what does that mean. Anyway it offers a series of fixed patches, think of it like an effects bank which means that you use it by uploading your content into a folder that is affected by the system.

http://www.om-interactive.com/

I tried to evaluate the tech differences but I couldn't really they are all so similar. Having met them visited the websites and had a go and read all printed literature.

The weakest was sensory surface because it had so little actually content.

These systems appear versatile but none really are. Another way to think of these systems is as VJ desks that are manipulated via movement. ( but one could buy a VJ desk)

The industry will move away from the fixed lighting rigs which are stage props and one will see much more of these camera vision based systems.

Or ...if the APIS had better interfaces this would be a move forward for these companies.

For Sounds.

Soundbeam.

Cost of soundbeam. This is expensive for a music device but in the educational sector they can charge 100 percent more.

I have written a little bit more on this since Beaumont now have eight of these and its has become standard issue equipment in lost of schools.

"Soundbeam develops, manufactures and sells music technology that turns physical movement into sound and visuals. Soundbeam technology enables anyone, whatever their ability and range of movement to engage in making music. Soundbeam is all inclusive, can be used in one to one situations or in groups, it can be used cross curriculum and is also used in many science museums.

Soundbeam  have sold over 3000 units about £9,000,000 pounds worth, the majority of UK special schools now own one or more Soundbeams.

They have various products from a stand alone unit, to computer software that is used extensively throughout the special needs sector and also mainstream schools.

Soundbeam was originally developed for dancers to interact with the music while performing.

The fact that it was built and designed for dancers is key to understanding its limitations It is for physical reaction in a space ie the body in the data space using simple sensors. Working with proximity sensors, distance and speed of movement creates data that affects the sound banks or pre recorded samples.

The best use might come from understanding these limitations for special needs. I  recommend someone creates a sets up user map for it. Most of the sounds  for it are rubbish so listen to these and make a note…and never use them.  Then categorize the other sounds into  groups, ambient, percussion, atonal…ie find voices that are ok.
Next, set it up so it  can be used in fairly close proximity for just small movement this is when it works best….so for anyone with lots of soundbeams it is  worth setting one up for this short distance use for very  special needs. This would allow someone with very limited movement ( providing they can control this movement ) the possibility to play and arrange sound like a instrument. Where controlled movement is not possible die involuntary movement then these devices should have voices setting for more ambient atonal ( systems basic music). This will allow some notion of composition construction and the sounds wont jar, and sound like a "burglar alarm".

All in all, this is actually a very simple piece of kit and if adapted would be a great tool used in certain ways.

One final comment on price this equipment appears good value in the education sector ( ie using state money) but if it where retailed at as a musical instrument it would have to market at a much lower price maybe £1000.

There are some other midi instrument and drum pads that one could easily hack ( ie utilize ) and then put ones own proximity sensors in them. ( which might make a good arts project.) And build a selections of instruments around this sort of brief. Hacking speak n spells , casio and putting sensors in them.

Skoog Box music.

They identified music as a tool for improving learning engagement in children with profound physical and learning challenges. In collaboration with NESTA and The University of Edinburgh the decision was taken to design and create a new musical instrument with 3 main objectives, entirely new to music and lifelong learning:

  1. a universal interface to sense fine or limited movements of the body, to make the instrument available to people with a wide range of abilities and disabilities.
  2. a way of understanding and interpreting the musical meaning and expressively of movement.
  3. a way of communicating this meaning and expressivity to a new, flexible and beautiful source of musical sound, offering the opportunity for learning, progression and profound creativity.

This is a reasonably priced (1000) systems that initially doesn't seem to offer much. However for those that can squeeze and push and how some physical control it is quite e versatile and possible expressive interface to play sounds via a software ie sound banks. If they make a wireles version of this then this would be great. Infact I have another idea for Skoog....

Also at this price its worth trying out.

 

Other stuff....

There are cheap low cost sequencers, toys,  gadgets ….( stuff you can do to create experiences….its probably about the delivery in the classroom and some lateral thinking). But there has to be the desire to adapt such systems and experiment in house. Or bring in outside practitioners to attempt this. The technology will not do all the work, you have to do some and understand  the limitations within which the technology operates and adapt to get the best out of it.

Quality of content becomes all important and essentially because these are locked down systems ( the API is locked and its not open source) then  you are restricted and this content is fairly superficial given the level of investment. Moving balls, moving fish, moving leaves. But one has to learn how to  use the gear and realize that no technology has a fixed use (  ie mobile phone now used as typewriter for texting).

Moving towards a new design brief for special needs at Beaumont and beyond..

What’s the experience, what’s the objective, ie exercise, learning ( learning what), developing new skills, having fun. The  objective  is “ independence and autonomy” which is too much of a challenge since they are early month impaired with low IQ and brain liaisons how can this be a realistic possibility.

Towards blue skies thinking.

What is the interaction within the data space. ?

What sort of changes in the data are mapped to the sensor space when there is limited uncontrolled movement.?

Sensory spaces…what do they  do….is it about the content or the technology ?

However these young adults we are targeting or focusing on are very 'special needs'….mental ages of three  and very limited movement so what can be done and why do they need a curriculum.? 

For single users and as a reference point from The Irish Times. This article shows what possible when one identifies the needs of the users first.

An imaginative use of technology has allowed James Brosnan to use his laptop to jam with musicians – despite having cerebral palsy and being in a wheelchair, writes James Brosnan, journalist, activist and music fanatic muses about the pros and cons of finding himself immersed in technology. Having cerebral palsy, being a wheelchair user and being unable to speak have done little to halt his gallop through the world of assistive technology: everything from communication devices to countless computers and the odd power wheelchair.A graduate of DCU with a first class honours degree in communications. Having worked on a range of projects over the past six years with SmartLab, a coalition of academics based at the University of East London, Brosnan jumped at the chance to explore his own musical creativity by using solely his eye movements to jam with a gaggle of musicians.James controls the computer, called My Tobii, using his eyes, and jams using a software programme called Grid 2, designed by UK company, Sensory Software. A sensor follows his eye-movement, via which he picks out pre-recorded sequences of music. “I don’t see myself as an artist per se, but I like to dabble in things and move things forward,”

Lizbeth Goodman has done work in this area and has a track record of performances with special needs and recently......" are testing a range of related assistive technology systems with a view to creating an integrated accessible tech Playbox or toolkit including GPS sensor, bluetooth, gyro-control and click-ogo systems integrated with Mytobii, litewriter and our own customised content boards." http://smartlab.uel.ac.uk/new2010/?page_id=347 . I have written to see what has been developed and if there any reports available to read..