Wearable device sensor innovation leap

The motion capture software on the computer calculates the physical posture of the actor in real time based on the sensor data, and uses the motion data to drive a virtual character model that has been previously set.

In this way, the avatar will move in exactly the same way as the actor moves. These avatars are not only realistic, but also perform various warm-up moves, beckon to the audience, and cheer.

If you watch the World Cup this summer, you will certainly have a deep impression on the virtual players in CCTV's "I Love World Cup" program. These virtual players are not only vivid but they also perform various warm-up moves, beckoning to the audience, cheering and so on. The key to achieving this is the open, wearable sensor-based motion capture system (also known as Perception Neuron) developed by Noliton.

From bridge to human body In fact, these virtual players are all played by an actor. The PerceptionNeuron motion capture sensor is worn on the actor. Every action is faithfully captured by the sensor and transmitted to the computer via wireless transmission.

The motion capture software on the computer calculates the actor's body posture in real-time based on the sensor data, and uses the motion data to drive a previously-set virtual character model so that the avatar moves in exactly the same way as the actor moves.

Can anyone think of a lifelike virtual character designed by a bridge safety engineer?

Liu Yiyang, the CEO of Nuoyi Teng Company, began his studies in civil engineering. From 2005 to 2008, Liu Xiaoyang’s main job abroad was to test bridges. “At that time, sensors were placed on the bridge to measure the vibration of the bridge. The vibration of the bridge was used to assess the health of the bridge and whether or not the bridge was to be repaired and reinforced.” Liu Xiaoyang explained.

Such a professional counterpart and promising work did not allow Liu Xiaoyang to feel at ease. After 2008, he turned his attention to the study of human motion capture.

"Although the bridge is a large-scale mechanical structure, humans are human body dynamics structures, but the motion capture work is also measured by sensors. This is the same as measuring the vibration principle of the bridge. Both sensors measure the motion of the mechanical structure." Liu Xiaoyang said when talking about this change.

The two-pronged market technology has a common theoretical basis and needs market support. In 2011, with the advancement of sensor technology, its volume has gradually shrunk, and prices have become closer to the people. Liu Xiaoyan keenly grasped that the next wave of technology should be the application of sensors. He said, "A person's actions are very important information on the human body, but it is very regrettable that it cannot be digitized. The video can only convey two-dimensional information and no action information." Thus, he chose to use a sensor to record human motion.

At that time, in the field of motion capture, the more mature technology was optical sensing. The technology has been around for a long time. Observers need to paste reflective dots on the body. Observers use the lens to track the trajectory of the light spot. The venue is limited, and expensive, troublesome and obstructed. The biggest obstacle lies in this movement. The catching equipment is huge and requires a truck to hold it.

Liu Xiaoyang does not intend to compromise on past technology because he knows what is the key to success. “In the early days of the wave of science and technology, we should not pursue the innovation of the model, but we must pursue the precipitation of technology. Whoever can make a breakthrough in technology can succeed.”

Innovation has made a leap, but technological development has not been easy. Like all entrepreneurs, Liu Xiaoyang’s sensor technology has encountered difficulties in the beginning: “The most difficult time is in the first year. On the one hand, it is capital, the second is that there is no confidence in the future technological achievements, and the third is It's not sure about the future."

He and his team used mechanical knowledge background and sensor experience to overcome many difficulties, and finally developed Perception technology in 2013 that is not afraid of occlusion, no site restrictions, no light effects, and portability. The previous "truck" equipment can be installed in a suitcase, and the price is much lower than the optical capture.

It is cheap and convenient, and the wish of Liu Xiaoyang to "sense the sensors into the lives of ordinary people" has finally come true. Major equipment manufacturers have started to cooperate with Noortyen to use their core mobile capture technology to develop third-party products. The application areas include wearable devices, somatosensory games, virtual interactions, sports training, and medical research.

"As long as confidence is strong enough and rational judgments are made, difficulties can all be overcome. When it is difficult to maintain confidence, it is most difficult." Looking back at this experience, Liu Xiaoyang concluded.

Noitom, the reversed spelling of the word "Motion" in English, we look forward to Liu Xiaoyang and his Perception to once again subvert the world motion capture industry.