saved
Request for Proposal
Status: RFP is Closed

Free Viewpoint Video Synthesis Using Multi-camera for Industrial Vehicles

Request Number
RFP_2018_3913
Due Date
Jan 16
Program Manager

Opportunity
Joint/contract development, licensing

 

Timeline
Phase 1 – Evaluation based on experiments: Within 1 year
Phase 2 – Evaluation on production version: Within 3 years

 

Financials
Budget for joint development already secured
(Details open to negotiation based on proposals)

 

How to  Apply
  • Click on "Respond", complete the form to the extent possible, and submit along with other attachment files available. 
  • After creating your account for NineSights, your draft will be automatically saved and you can resume later from "Control Center". Please note you do not submit confidential information at this process.

 

SOLUTION PROVIDER HELP DESK
If you have any questions or request, please feel free to contact us at: phd2@ninesigma.com 
RFP was closed on
Feb 2019

RFP Title

 

Free Viewpoint Video Synthesis Using Multi-camera for Industrial Vehicles
RFP Description

NineSigma, representing a major industrial vehicle manufacturer, seeks free viewpoint video synthesis technology using multi-camera. Specifically, the Client aims to develop free viewpoint display system that improve the workability and safety of industrial vehicles through technology for seamless, real-time synthesis of videos from multiple cameras.

Background

The Client is engaged in the development of free viewpoint video synthesis technology to improve the operation efficiency and safety of industrial vehicles. Computing cost is generally high for the synthesis of videos from multiple cameras, however, which presents challenges on two fronts: real-time processing and seamless synthesis. Meanwhile, recent advancements in information and communication technology has built a momentum in the development of related technologies that may help solve challenges faced by the Client, such as multi-view 3D video streaming and virtual reality free space creation technologies, intended for applications such as watching sports and entertainment. The Client has therefore decided to make this RFP to further accelerate the development of their research and development endeavors.

Key Success Criteria

Prerequisites

  • Target vehicles: industrial vehicles such as forklifts
  • Cameras to be used and how they are expected to be placed:
    • Camera resolution: VGA
    • Expected uses: cargo handling operation assistance and perimeter monitoring
    • Positions of the cameras will be restricted to areas that do not interfere with the functions of the industrial vehicle

 

Technology requirements

The Client seeks technology for synthesizing videos from the specified angles and viewpoints using videos taken by multiple cameras mounted on a target vehicle specified above

  • Can display free-viewpoint video in real-time
    • Processing delays: ≤100 ms
    • Frame rate: 30 fps
  • Seamless synthesis of videos from 2 cameras or more
    • Number of cameras placed for different types of uses expected
      • Cargo handling operation assistance: 2–4
      • Perimeter monitoring: 4–6
    • No image discontinuity between videos
  • It is preferable that the components required to realize the technology (such as servers and other hardware) can be mounted on industrial vehicles

Virtual camera positions for cargo handling operation

It is not necessary for all requirements to be met at this point; proposals are welcome if there is a good chance of meeting them through further development within the next year or so.

Possible Approaches

Possible Approaches

The Client expects technologies such as the following approaches, but is open to others:

  • Seamless synthesis of videos from multiple cameras
    • Frame interpolation
  • Application of 3D video streaming and virtual reality free space creation technologies
  • Improved processing speed of free viewpoint video synthesis technology
    • Optimization of server architecture
Approaches not of Interest

Approaches Not of Interest

The following approaches are not of interest:

  • Technologies that require for a large-size server infrastructure to be built, such as cloud-based systems
Items to be Submitted

Please include the following items in your proposal:

  • Characteristics, principle, and uniqueness of the proposed technology
  • Development stage: performance verified at a lab level, technology currently being established, or implemented for practical use
  • Current performance
    • Number of cameras and frame rate covered by the technology
    • Delay time
    • System configuration (hardware, OS)
    • Specific examples of application
    • Samples of processed videos (if available)
  • Current challenges and future development plans
  • Past results (e.g. research papers, patents)

 

Notes on Response

Proposal shall have clear points and should not include confidential information. Supplemental files may be submitted in addition to the proposal.

 

Response evaluation

The client will evaluate all responses with the following criteria.

  • Overall scientific and technical merit
  • Approach to proof of concept or performance
  • Economic potential of concept
  • Realism of the proposed plan (action items, timeline, roles, deliverables, cost estimation)
  • Potential for proprietary position
  • Respondents’ capability and related experiences

 

Anticipated Project Process

After the submission due date, the client will review all submitted proposals. NineSigma will send the review results to each proposer 6-8 weeks after the due date. The client possibly asks clarifying questions before selecting the most suitable candidates for collaboration. The client will select best candidates through evaluations. During the selection process, the client may execute NDA with selected respondents, seek further information disclosure, and discuss specific development targets or potential opportunities.

The client will execute necessary agreements with the selected respondents and move to the advanced development phase. Specifics of any collaboration will be determined through consultation with the concerned parties.

Preferred Collaboration Types
Area of Interest