Tuesday, June 06, 2006
Divya Bijur's First Training Session:
Note that these are magnified pictures and the original size of pictures is 7x7 pixels.
Although the size of square appears different.. basically, each square represents one pixel!
Also note that Miss Divya Bijur is a lovely 19 year old girl who was born visually challenged! She can not see anything at all. She has not seen any light or colours so far through her eyes.
Using AUXEL software, she has been able to 'SEE' these 22 images though her ears !
Meaning, the AUXEL software converts these digital images to sound in particular fashion which she has been trained to identify!
She used her finger to draw on her hand..
first the border of image and then the image details.. as a feedback of her understanding the image. Some times she needed correction and some times she needed to be shown (heard) the image, but most of the times she was correctly able to percieve the image perfectly in the first time.
We moved to the next image ONLY after the current image was correctly identified and given feedback of.
To start with, each and every pixel was played (sounded) for 1000 milliseconds (i.e. one second)
and by the time we reached 22nd picture.. each pixel was played for only 250 milliseconds.
The whole session was of 4 hours.
It included introduction of the concept, introduction of the marker sounds, and ofcouse some tiny 4x4 pixel images , as well as 5x5 and 6x6 pixel images too.
Hey there of course was lots of cake, pastries, (which she had got! YUMMY!) and laughter, fun and giggles! What is life with out it! Heheheheheheh!
Her parents got her to my home in Pune, all the way from Mumbai! Divya's Mother is an anesthetist and her father is an Eye Surgeon! They too are happy about this project!
Here are the images 'SEEN' by Divya:
Right top to left bottom diagonal...
Picture divided in two colors by right top to left bottom diagonal.
Two lines from top corners to bottom center making 3 triangles.
( V Shaped)
Above image flipped vertically
(180 degrees)
above image rotated anti clockwise by 90 degrees
Above image flipped horizontically
(180 degrees)
PLUS sign surrounded by right angles
BIG plus sign
:)
Hmmm...
As of for now we are waiting to have another session with Divya soon! And as we wait, we are making a website which can be accessed by visually challenged people independently with out any one's help and learn this language by themselves.
(They might need assistance in first few lessons.. which any sighted person can provide without any training!)
:)
There are more than 270 MILLION visually challenge people on our beautiful Earth.
I am sure you can help us reach to some of them at least!
Cheers
Omee
Please feel absolutely free to contact us on :
omkar.nisal@gmail.com
Note that these are magnified pictures and the original size of pictures is 7x7 pixels.
Although the size of square appears different.. basically, each square represents one pixel!
Also note that Miss Divya Bijur is a lovely 19 year old girl who was born visually challenged! She can not see anything at all. She has not seen any light or colours so far through her eyes.
Using AUXEL software, she has been able to 'SEE' these 22 images though her ears !
Meaning, the AUXEL software converts these digital images to sound in particular fashion which she has been trained to identify!
She used her finger to draw on her hand..
first the border of image and then the image details.. as a feedback of her understanding the image. Some times she needed correction and some times she needed to be shown (heard) the image, but most of the times she was correctly able to percieve the image perfectly in the first time.
We moved to the next image ONLY after the current image was correctly identified and given feedback of.
To start with, each and every pixel was played (sounded) for 1000 milliseconds (i.e. one second)
and by the time we reached 22nd picture.. each pixel was played for only 250 milliseconds.
The whole session was of 4 hours.
It included introduction of the concept, introduction of the marker sounds, and ofcouse some tiny 4x4 pixel images , as well as 5x5 and 6x6 pixel images too.
Hey there of course was lots of cake, pastries, (which she had got! YUMMY!) and laughter, fun and giggles! What is life with out it! Heheheheheheh!
Her parents got her to my home in Pune, all the way from Mumbai! Divya's Mother is an anesthetist and her father is an Eye Surgeon! They too are happy about this project!
Here are the images 'SEEN' by Divya:
left top to bottom right diagonal...
Right top to left bottom diagonal...
Two lines from left top to bottom right..
(earlier image rotated)
(earlier image rotated)
Two lines from right top to left bottom ..
(earlier image rotated)
(earlier image rotated)
Two diagonals crossing each other at centers
(aplhabet X)
(aplhabet X)
Picture divided in two colors by left top to right bottom diagonal.
Picture divided in two colors by right top to left bottom diagonal.
picture divided into four squares by central horizontal and central vertical line
diagonally opposite sqaures are of same color.
diagonally opposite sqaures are of same color.
Two lines from top corners to bottom center making 3 triangles.
( V Shaped)
Above image flipped vertically
(180 degrees)
above image rotated anti clockwise by 90 degrees
Above image flipped horizontically
(180 degrees)
three concentric squares of three different colours
above image with color sequence change
Window
Four squares
Four squares
PLUS sign surrounded by right anglesBIG plus sign
Alphabet N
Alphabet H
Horizontal Bar Graph with 3 bars of different values
above image flipped and rotated by 90 degrees,
bars have three different colors
bars have three different colors
Next image was first TOLD to her what it is..
and then it was shown to her!
"Swastik"
"Swastik"
She had little difficulty reading this complex image.
but later on was able to correctly give us the feedback.
It was not an examination you seee! It was her training session!
and that to FIRST ONE of her life!!!
but later on was able to correctly give us the feedback.
It was not an examination you seee! It was her training session!
and that to FIRST ONE of her life!!!
:)
Hmmm...
As of for now we are waiting to have another session with Divya soon! And as we wait, we are making a website which can be accessed by visually challenged people independently with out any one's help and learn this language by themselves.
(They might need assistance in first few lessons.. which any sighted person can provide without any training!)
:)
There are more than 270 MILLION visually challenge people on our beautiful Earth.
I am sure you can help us reach to some of them at least!
Cheers
Omee
Please feel absolutely free to contact us on :
omkar.nisal@gmail.com
Comments:
<< Home
Hi Omee,
I am not fully able to comprehend how the system works. This is what I have understood so far [correct me if I'm wrong]
1)An image is captured[via a digcam/cellfone camera]. It is in RGB format
2)Its coverted into HLC or HLS format, for which a sound is created.
Q1-A picture is made of a no. of pixels, so each pixel must have a fixed RGB value.Does this value depend upon the colour?
[dont know much about all this so see me through :)]
Q2-If each pixel has a definite value, then so must the HLC/HLS, right?
3)The sound is then memorized by the subject.
Q3-How do you tell the subject the colour of the sound? If they are blind from birth then they will not know the colours.
Q4-How does the subject make the image in his/her mind? Does he imagine it, while you describe it? But this does not mean that the subject infer the image correctly always.
Q5-Say an image is of 3 rows of pixels, each row having 50 pixels. So the device [camera/goggle] converts the image to sound and is tranmitted to the subject, pixel by pixel. This will take a lot of time for interpretaion[by the subject] & also to remember the previous sounds[This question is based on the asumption that the subject imagines the colour/shape of the pixel form the learning program]
Basically as the image gets bigger it will be difficlut to reproduce the image via sound by the subject. How do you solve this?
Thats all that I've understood. & much of it may be wrong, so clear them up for me. thanks!!
Post a Comment
I am not fully able to comprehend how the system works. This is what I have understood so far [correct me if I'm wrong]
1)An image is captured[via a digcam/cellfone camera]. It is in RGB format
2)Its coverted into HLC or HLS format, for which a sound is created.
Q1-A picture is made of a no. of pixels, so each pixel must have a fixed RGB value.Does this value depend upon the colour?
[dont know much about all this so see me through :)]
Q2-If each pixel has a definite value, then so must the HLC/HLS, right?
3)The sound is then memorized by the subject.
Q3-How do you tell the subject the colour of the sound? If they are blind from birth then they will not know the colours.
Q4-How does the subject make the image in his/her mind? Does he imagine it, while you describe it? But this does not mean that the subject infer the image correctly always.
Q5-Say an image is of 3 rows of pixels, each row having 50 pixels. So the device [camera/goggle] converts the image to sound and is tranmitted to the subject, pixel by pixel. This will take a lot of time for interpretaion[by the subject] & also to remember the previous sounds[This question is based on the asumption that the subject imagines the colour/shape of the pixel form the learning program]
Basically as the image gets bigger it will be difficlut to reproduce the image via sound by the subject. How do you solve this?
Thats all that I've understood. & much of it may be wrong, so clear them up for me. thanks!!
<< Home
