I once took a butterfly knife away from someone. He was showing off, and was genuinely surprised when I simply reached down and took it from his hand. It was an El Cheapo, but looked rather nice. I handed it back to him, and we continued to hang out. Friends now, but back then just very mild acquaintances.
Determination to use a knife plays a huge role as to whether or not someone can hold onto it.