saved
Request for Proposal
Status: RFP is Open

Face Capturing Technology to Create Virtual Humans

Request Number
RFP_2019_0185
Due Date
Nov 28
Program Manager

Opportunity

Joint/contract development, licensing, product supply

 

Timeline

Phase 1- Determination of development policy: Mar. 2020

Phase 2- Verification based on test production/demo version: Sep. 2020

 

Financials

Details open to negotiation based on proposals.

 

How to  Apply
  • Click "Respond", complete the form to the extent possible, and submit along with other attachment files available. 
  • After creating your account for NineSights, your draft will be automatically saved and you can resume later from "Control Center". Please note you do not submit confidential information at this process.
  • This request for proposals in PDF format is available here.

 

SOLUTION PROVIDER HELP DESK
If you have any questions or request, please feel free to contact us at: phd2@ninesigma.com 

RFP Title

 

Face Capturing Technology to Create Virtual Humans
RFP Description

NineSigma, representing a global leading manufacturer, seeks a partner who develops technology to capture texture of human face and skin. Specifically, the client expects a capturing technology focusing on a human face to create photorealistic expressions of a virtual human beyond “the uncanny valley”.

Key Success Criteria

Technology Requirements

To create the above-mentioned virtual human, technologies to capture the textures and material properties of the skin and hair are required:

  • Capture devices or capturing algorithms:
    • Should be realized by using proposer’s own or partner’s technology
    • Capable of showing photorealistic images of a virtual human by rendering information captured
  • Target objects to be captured: human face, skin, hair
  • Properties to be captured:
    • Diffuse albedo, Specular Albedo, Roughness, Gloss, Subsurface scattering parameters, Surface normal, Cavity
  • Finally aiming at high-speed data capture/ processing with a small number of lightweight devices:
    • Desired number of cameras: within around 10
    • Desired time for acquiring images and property data: ≤16 msec
    • Desired data processing time: ≤1 min
      • The requirements for the number of cameras, image acquisition time, and data processing time need not be met at present. Proposals on future improvement plans are also welcome.
  • Other considerations : This project focuses on the expressing ability for texture and material properties, rather than precision in shape of the objects:
    • LightStage (see the following URL), for example, is known as a promising technology in this field. Technology capable of high-speed response with simpler compositions are anticipated to be developed.

LightStage by UC Berkeley and USC ICT: 
http: //vgl.ict.usc.edu/LightStages/

 

Anticipated collaboration partner(s)

The client expects collaboration with the following organizations:

  • University or research institution that aim to license out their results
  • Start-up company at the seed stage based on research results of a university/research institution
  • Start-up company that needs development/marketing assistance
  • Start-up company at the early to middle stage that has already developed devices
    Approaches not of Interest

    Approaches Not of Interest

    The following approaches are not of interest:

    • Proposals only on capturing a shape of an object
    • Proposals only on rendering technology
    Items to be Submitted

    Background

    Recent significant progress in information processing technology and the advent of the ray tracing method have brought virtual (digital) human generated by realistic computer graphics closer to fulfillment. To create photorealistic expressions of a virtual human beyond the so-called “uncanny valley,” however, it is extremely important to acquire and reproduce data on the textures of the human face and skin on top of their precise shapes.

    The client considers that useful technologies to solve the current challenges have been developed not only in the conventional information processing field but in a wide range of fields such as image/entertainment and healthcare, and therefore decided to make this RFP to gain a collaborative partner.

     

    Notes on Response

    Proposal shall have clear points and should not include confidential information. Supplemental files may be submitted in addition to the proposal.

     

    Response evaluation

    The client will evaluate all responses with the following criteria.

    • Overall scientific and technical merit
    • Demo videos (Focused on first screening)
    • Approach to proof of concept or performance
    • Economic potential of concept
    • Realism of the proposed plan (action items, timeline, roles, deliverables, cost estimation)
    • Potential for proprietary position
    • Respondents’ capability and related experiences

     

    Anticipated Project Process

    After the submission due date, the client will review all submitted proposals and demo videos. NineSigma will send the review results to each proposer 6-8 weeks after the due date. The client possibly asks clarifying questions before selecting the most suitable candidates for collaboration. The client will select best candidates through evaluations. During the selection process, the client may execute NDA with selected respondents, seek further information disclosure, and discuss specific development targets or potential opportunities.

    The client will execute necessary agreements with the selected respondents and move to the advanced development phase. Specifics of any collaboration will be determined through consultation with the concerned parties.

    Preferred Collaboration Types
    Area of Interest