This paper explores the difference between Smartphone’s gesture control and users’ cognitive by similarity measurement. Gesture recognition is a topic in computer science and programming language with the goal of interpreting human gestures via mathematical algorithms. Now it is highly used in mobile phone. Metaphor is defined as the substitution of one idea or object with another, used to assist expression or understanding. Interactive designers usually use symbols of hand gesture (i.e., metaphor) to imply behavior about their thoughts and feelings and implement these concepts as a human-computer interface. However, this user interface may be not easy to operate for different users because of different cognitions. The conclusions are as follows: a) if the gesture control is more similar to personal behavior, the users’ cognition load will be minimized; b) Designers should avoid the metaphor of different functions with the same gesture when they design devices. It can avoid users to be confused.