Society of Robots - Robot Forum

General Misc => Misc => Topic started by: Ai-bot on July 20, 2008, 12:17:11 AM

Title: BRAINS software of Aiko Demo Video Face, 3-D object
Post by: Ai-bot on July 20, 2008, 12:17:11 AM

It has been awhile since I did any video of Aiko.
I have promised to demo the BRAINS software of Aiko.


B.R.A.I.N.S =  Biometric Robot Artificial Intelligence Neural System

There are many application that can be use with the BRAINS software.
One of the application is Project Aiko


Language Program: Basic & C
Bits: 32 Bits
Resolution: 1200x 740

Control up to 8 camera
Control Micro controller,including gyro, accelerometer etc...
Control special sensors inside silicone skin.
Control human behaviour, mimic pain, tickle, touch gently.
Access info. Hwy, for Temperature and Weather
Vision: Reading, Colour, Math.
AI: Learning from the environment and interact with the software
Automation, self control
Speech: English & Japanese
Voice Recognition: Work with most people (No training require)
AI Conversational:13,000 sentences
Access Background from foreground.
Face recognition 250faces /sec including multiply people in the same room
3-d object - recognize in 3-d
Trace mouth, shoulder and heart.
Trace human motion such as arms and hands

1) Voice recognition (No training voice require)
2) Easy to understand voice speech
3) Reading, anything the software can not read, it will spell it out.
4) Face fast detection and accurate, 250/sec
5) Detect mouth, shoulder, and heart (can be use for future arm robotic to feed handicap)
6) 3-D object recognize, and trace object movement.
7) Trace human motion such as arms and hands
8) Can recognize a face with or without the hat.

Robotics,Multimedia, Airport, Military, Information desk, Security, Medical-hospital, Adult Companions and much more

Please watch the video and see what you like about it and what you don't like about it.
The software can always be improved. The software and hardware was done by me alone, there
are some limitation one person can do. But I still believed that it can be better in the future.

If you would like me to post anymore information about the software, let me know...

P.S. in case you are wondering... Aiko: Cosplay of Chii from Chobits in a Sexy Maid costume.

Sorry, the video is too long for youtube, you going to have to get it from my site. (



Title: Re: BRAINS software of Aiko Demo Video Face, 3-D object
Post by: Admin on July 20, 2008, 07:44:49 AM
nice job!

(nice costume too)

Can you link us to a high res screenshot of the software? I can't really make it out and I'm curious.

I noticed your motors hum when they are used. If you increase the PWM frequency, the sound will go away.

and for a ref to your older stuff:
Title: Re: BRAINS software of Aiko Demo Video Face, 3-D object
Post by: airman00 on July 20, 2008, 05:45:38 PM
Ai-bot , did you make the speech recognition engine yourself? or did you use an existing engine?
Title: Re: BRAINS software of Aiko Demo Video Face, 3-D object
Post by: Ai-bot on July 22, 2008, 12:10:16 AM

to: airman
Voice Recognition, many endless night to have it the way I want.

to: admin
Yes, I can take a larger picture with higher resolution.
I will do it tomorrow.

I manage to re-edit the demo video into 10 minutes, and upload to youtube.
Here is the same video with cut and edit to fit onto youtube.

Title: Re: BRAINS software of Aiko Demo Video Face, 3-D object
Post by: Ai-bot on July 23, 2008, 12:30:45 AM

Here are larger pictures of the software.

1) Tracing motion,such as Hand

2) Face Recognition with glasses and hat.

3) Face Recognition: No hat, No glasses

4) Object recognition, notice the top left on the screen, it recognize as Toyota car key

5) More picture.... option at the bottom  for manual control.

Title: Re: BRAINS software of Aiko Demo Video Face, 3-D object
Post by: Kitsune on July 24, 2008, 10:45:21 AM
To AI-Bot
I am doing almost the exact same project as you but I cant get the software just right
Do you think you could send me some copies of the programs you made?
Title: Re: BRAINS software of Aiko Demo Video Face, 3-D object
Post by: popayseaman on July 30, 2008, 05:33:58 PM
To AI-Bot

This all looks really, really amazing stuff, indeed.

But this thing just keeps bothering me, well, I am not trying to be disrespectful or something,
you see my university thesis was on speech recognition and I still remember it took me more than 6 manmonths
to get a simple 20 words vocabulary single speaker system going from scratch, and that after a degree in signal processing.
And your speech recognition engine looks really good and the OCR and object recognition and natural language processing too.
Well, it might be just me.

So, my question really is, in the block diagramme of your software, did you do all the blocks yourself,
or did you just write the central block which connects them all together (the BRAINS block)?

The other thing is, as far as I understood, you are saying Aiko runs on a C7 board,
if that is a VIA C7 board the top possible speed of the CPU is 2GHz and it's not a very efficient CPU,
so that is equal to about a Pentium M running at 1.5GHz-1.6GHz max according to official figures from VIA.
And from the high-res snap shot of the BRAINS software screen it seems you are using a Logitech Quick Cam webcam.
These webcams do all their signal processing on the main computer, so that will eat immediately about 20-40% of your
CPU time.
So my other question is if you are doing all the processing in Aiko or are you offloading to a server?

Sorry for all the disbelieve, but it just all looks unbelievable.

Title: Re: BRAINS software of Aiko Demo Video Face, 3-D object
Post by: Ai-bot on July 31, 2008, 09:03:50 AM
Hi Popayseaman

C7 is VIA cpu. In my personal opionion I think it is equal to pentium M 900Mhz.
It is very slow, I only  use it to process micro controller to control the motors and sensors.

I use LS372 (which is 10cm), it is core2 2.2Ghz. I use that for AI, vision, speach, voice recognition.
As you can see from the video, core2 is still too slow, you see the frame freeze, when it is trying to process
everything all at once.  Maybe in the future core16  will be fast enough.
3-D object recognition is too much for core2 to handle on the fly.

Brains software takes two cameras for Aiko anyway. Sony DV firewire and webcam.
The main camera window you see is Sony DV, and the smaller camera window uses webcam.
The webcam is a backup in case the main camera is broken. Idealy, I prefer using another Sony DV
as a backup, but I don't have the money to buy both good camera.

Aiko runs on C7 and LS372, if the memory is over limit, then I offload/transfer to the server.

Some of the Brains software I program and other are SDK you can download from microsoft.
It's a lot of work, but I think the software can be improve more. Especially, the vision.

As for the voice recognition. vision, speach.
Part of the Brains software was used in Intel's Robot.
(I never seen the robot live, but I did the programing for the intel's robot. I put the Brains engine inside the Intel's Robot.)
Intel's seem to be happy. The down fall, is that the engine does not work with anyone who is over 80 years old, because
they speak slowly with deeper voice. Therefore, the engine does not recogize their voice.

Title: Re: BRAINS software of Aiko Demo Video Face, 3-D object
Post by: popayseaman on July 31, 2008, 04:23:59 PM
OK, thanks for the explanation, it sounds much more realistic now.

By the way, I very much liked this Intel's robot, especially the part where they ask him
"How can you run?"
and he says
"Come on, I am bolted in here"
very witty  :D

Good luck with your project and hopefully you find a sponsor