3D Sketch-Based System for Conceptual Design

This project is supported by the National Science Foundation
IIS Division of Information & Intelligent Systems
CSE Directorate for Computer & Information Science &Engineering
[NSF Award Page]

Abstract
The goal of this research project is to empower users to retrieve, modify and reuse 3D data reliably to create assemblies simply by drawing a freehand sketch. This will serve as the foundation for a new "sketching computing" paradigm. The approach consists of

  1. Allowing users to express design ideas in the form of freehand sketches while detecting 2D sketch and 3D assembly constraints. 2D and 3D constraints are detected from the freehand drawing using relative shape histogram and 3D pose determination. This allows the system to capture the user's design intentions without explicit user specifications.
  2. A 3D model segmentation method is used to facilitate partial shape replacement and search through operations such as "cutting," and "pasting" partial shapes.
  3. A 3D assembly technique using 2D and 3D constraint mapping is then used to enable model construction from search results.
The research goals will make design more accessible for people who are not trained in using complex Computer-Aided Design (CAD) tools. The results of this project will lead to a workable sketch-based system that could be more intuitive for designers than conventional CAD systems. This will promote better creativity during the design process and reduce the need for user training. It will also demonstrate new useful ways to integrate pen-based computing into many existing computer-application paradigms. The project Web site (http://www.purdue.edu/sketchlab and http://www.purdue.edu/shapelab) will be used for dissemination of results and providing access to the experimental system.

Sketch Based Retrieval System

Project Publications

Journal

  • Pu,J. , and Ramani, K.
    An Integrated 2D and 3D Shape-based Search Framework and Applications
    Computer Aided Design and Applications, vol 4, no. 6, pp 817-826
    more details
  • Kalyanaraman, Y. Pu, J., Jayanti, S. , Ramani, K. , and Pizlo, Z.
     “Navigation and Discovery of 3D models in a CAD Repository,” IEEE Computer Graphics and Applications, Vol. 27, No.4, pp. 38-47, 2007
    more details
  • Classifier combination for sketch-based 3D part retrieval. Computers & Graphics 31(4): 598-609 (2007)
    more details
  • Structure-oriented Contour Representation and Matching for Engineering Shapes
    accepted for Journal of Computer Aided Design, Special Issue: Constraint Design on Curves and Surfaces (CDCS), 2007
    more details
  • Jayanti, S. , Kalyanaraman, Y. , Iyer, N. , and Ramani, K.
    Developing An Engineering Shape Benchmark For CAD Models
    Computer-Aided Design, Volume 38, Issue 9, Shape Similarity Detection and Search for CAD/CAE Applications, September 2006, Pages 939-953.
    more details
  • Jiantao P. , and Ramani K.
    On Visual Similarity Based 2D Drawing Retrieval
    Journal of Computer Aided Design, 38(3): 249-259, 2006.
    more details
  • Pu,J. , and Ramani, K.
    Review of a Paradigm for Freehand Sketch driven Search and Design
    Kikai no Kenkyu. (Kikai no Kenkyu is the title of the journal in Japanese. Literally translated, it is Researches in Mechanical Engineering) Volume 59 No.1, January 2006. (Invited Paper in Japanese)

High Impact Conferences

  • A Probability-based Unified 3D Shape Search
    European Commission International Conference on Semantic and Digital Media Technologies, Lecture notes in computer science Vol 4306 pp 124-137 2006.
    [25% Acceptance Rate]
    more details
  • Hou, S. , Jiantao, P. , and Ramani, K.
    Sketch-based 3D Engineering Part Class Browsing and Retrieval
    EuroGraphics Symposium Proceedings on Sketch-Based Interfaces & Modeling, (2006), 131-138.
    [30% Acceptance Rate]
    more details
  • Jiantao, P. , Jayanti, S. , Hou, S. , and Ramani, K.
    Similar 3D Model Retrieval Based on Multiple Level of Detail
    The 14th Pacific Conference on Computer Graphics and Applications, October 2006, Taipei, Taiwan.pp. 103-112.
    [40 papers for the conference, 20 accepted, Revised and expanded versions of 5 selected workshop papers were featured in a special issue of the Computers and Graphics Journal (Elsevier) in 2007 (paper [4] in 2007 Journals)
    more details

Papers in Review

  •                   Jiantao, P. , and Ramani, K.
    Toward Freehand Sketch Beautification Driven by Geometric Constraints
    submitted to Eurographics Symposium on Sketch-based Interfaces and Modeling, 2007.
  • Mani, S., Raman, M., Hoffmann, C.M., and Ramani, K.
    Decomposition and Representation of Swept Mesh Models
    in Review, Pacific Graphics, 2007.