Interesting concept - on the one hand, I can see times when this would be extremely handy in work.
On the other, there's no way I'd let anything remotely sensitive be discussed or worked on by going through google, who you'll probably find are recording everything so they can pelt you with ads on the subject.