This is the first part of my graduate research: Creativity-based Design Innovation Environment in Support of Robust Product Development.
The object of the whole project is creating a new design environment to encourage a hybrid work flow that makes product development simpler and faster.
Graphic abstraction
As an important input, 3D user interface is designed to help users intuitionally and effectively manipulate 3D objects in CAD system. The 3D user interface is a real world 3D sensor system. It implement Kinect sensor to track the orientation and position of a specially modified wii remote. The output data are used to control virtual 3D objects in CAD environment, which is Solidworks in our case.
Video demo for 3D user interface
3D user interface components
Redesign the Wii remote
The color Ping-Pong balls help Kinect sensor to recognize on the Wii remote and identify the position and orientation. We merged the output from wii remote accelerometer and gyroscope Kinect sensor output to greate a fast and accurate data flow.
Modified Wii remote motion range
3D user interface software architecture.
Data analysis and processing
1. Filter out noises when calculating mouse position
2. Correct the accumulate errors of Wii Remote output data by combining with data from Kinect Sensor.
Control cursor with modified Wii remote
Control model view in Solidworks by Wii remote
Translate 3D object in Solidworks by modified Wii remote
Rotate 3D object by modified Wii remote
