NEXT-SYSTEM Globally Releases Markerless Single Camera AI Pose Estimation Engine “VisionPose Single3D”

Markerless Human Pose Estimation using AI technology.

3D Skeleton Detection With Only One Camera.

FUKUOKA CITY, FUKUOKA PREFECTURE, JAPAN, April 12, 2022

AI/xR development company NEXT-SYSTEM Co., Ltd. globally launches their AI Pose Estimation Engine VisionPose Single3D for Windows Unity. The SDK includes ready-to-use Sample Apps “BodyAndColor with MICHICO”, a full-body real-time motion capture application that captures and reflects motion data on a 3DCG character, and “VP Analyzer for Single3D”, a video and still image analysis application. Sales outside of Japan will start April 12, 2022, via their VisionPose e-commerce website.

What is “VisionPose”?

VisionPose is an AI pose estimation engine that detects human skeleton information on real-time videostream, still images and videos, without the need for markers or special equipment. The AI detects skeletal information of up to 30 keypoints of the human body, such as the knees, shoulders or nose. The SDK is bundled with two ready-to-use applications, and there are no usage restrictions. VisionPose Standard has been released for Windows C#, Windows C++ and Linux, and VisionPose Single3D for Windows Unity as of today.

Here is a short video of what VisionPose looks like and how it can be used.

And here is a free demo website for testing out pose estimation with VisionPose for images: Free VisionPose AI Pose Estimation Demo

What is “VisionPose Single3D for Windows Unity”?

This SDK is part of the VisionPose series and makes it possible to perform human pose estimation in 2D and 3D by using only one camera. This makes it easier to utilize the system for game development and VR/AR development. The AI is capable of detecting up to 30 keypoints of the human body in 2D, and up to 17 keypoints in 3D. The SDK comes bundled with a sample application for full-body real-time motion capture, “BodyAndColor with MICHICO”, and an analysis tool for video and still image, “VP Analyzer for Single3D”, both for immediate use after activation of the SDK.

Find more detailed information on the VisionPose Single3D Product Website.

VisionPose detects up to 30 keypoints of the human body in 2D, and 17 keypoints in 3D.

Real-time Motion Capture Sample Application “BodyAndColor with MICHICO” 

It is usually necessary to use multiple cameras, devices or markers attached to the human body to perform motion capture, but with this app, body movements can be easily reflected onto a 3DCG character without any special equipment. But this sample application automatically detects and tracks a person’s skeletal structure in real-time from camera images and transfers the movements onto an original 3DCG character named “MICHICO”.

Here is a short video showing what “BodyAndColor with MICHICO” looks like.

File Analysis Sample Application “VP Analyzer for Single3D”

With VP Analyzer for Single3D, the user can easily perform accurate skeletal analysis for pre-recorded data, thus can obtain skeletal information from video and still image files.

Here is a short video showing what “VP Analyzer for Single3D” looks like:

Comment from the NEXT-SYSTEM CEO, Yoshio Fujita

“We are delighted to finally announce the global launch of VisionPose Single3D for Windows Unity. Included in the SDK is the sample application “BodyAndColor with MICHICO”, which makes Unity-based application development utilizing VisionPose possible. Our VisionPose SDK is in use by more than 250 clients and companies inside of Japan, including Toyota Motor Corporation and Honda Motor Co., Ltd. We hope that it will be utilized by various clients around the world, and that it will be of great use to them.”

VisionPose Functions and Merits

• Detecting 30 keypoints of the human body at max 60 FPS in real time
• 3D inference with 2 cameras (Standard),
  3D inference with a single camera (Single3D)
• Two ready-to-use apps:
  1) Real-time pose estimation displayed on the video (source code included)
  2) Pose estimation using electronic files of videos or still images
• No usage restrictions, including commercial use

VisionPose Single3D for Windows Unity Product Information?

Product Name: VisionPose Single3D for Windows Unity

Platform: Windows Unity

Supported OS: Windows 10 (64bit) / Unity (C#)

Product Breakdown:

• VisionPose Single3D for Windows Unity Software
• BodyAndColor with MICHICO (with source code)
• VP Analyzer for Single3D
• Manuals (including API reference)
• Other attached files, including 3D model data

Price:

Development License: US$4,500 per license  –> US$3,825 with 15%OFF discount coupon

Distribution License: US$450 dollar per license  –> US$382.50  with 15%OFF discount coupon

*The Development license includes a free trial for 30 days.

Required Specifications for PC:

OS: Windows 10 (64bit)

CPU: Core i7-6700, or equivalent or higher

Memory: 8GB or more

GPU: NVIDIA GeForce series VRAM 6GB or more

(More detailed information at Specifications)

Who is using VisionPose?

With a wide range of application fields, such as motion analysis in sports and fitness, workflow analysis and hazard detection in factories, safety surveillance in child- and nursing care, motion caption in entertainment and gaming, VisionPose is currently used by a total of 250 clients, including several major Japanese companies.
Representative examples are Toyota Motor Corporation’s robot “Welwalk WW-2000”, which utilizes VisionPose to assist rehabilitation of lower limbs that were paralyzed by strokes or other injuries, the “Avex Street Dance Exam” App of Avex Management Inc., which performs score evaluation of dance skills through video analysis with the help of VisionPose, and NEC Solution Innovators, Ltd.’s face recognition packaged software “NeoFace KAOATO”, for which VisionPose improved accuracy of authentication and anti-spoofing functions.

About NEXT-SYSTEM Co., Ltd.

NEXT-SYSTEM is a technology company founded in Japan, Fukuoka City in 2002, and since then has been focused on the research of behavior analysis through AI technology, ergonomic system development and development of cutting-edge systems, such as xR (AR/VR/MR), and the development and sales of their Pose Estimation AI Engine “VisionPose” and AR Signage System “Kinesys”.
For more information, see NEXT-SYSTEM’s official website.

Tags: metaverse, VisionPose, NEXT-SYSTEM, Motion Recognition, Motion Capture, Ai, technology, Computer Vision, pose estimation