Timeline Phase 1 – Evaluation based on experiments: Within 1 year Phase 2 – Evaluation on production version: Within 3 years
Financials Budget for joint development already secured (Details open to negotiation based on proposals)
How to Apply
Click on "Respond", complete the form to the extent possible, and submit along with other attachment files available.
After creating your account for NineSights, your draft will be automatically saved and you can resume later from "Control Center". Please note you do not submit confidential information at this process.
Free Viewpoint Video Synthesis Using Multi-camera for Industrial Vehicles
NineSigma, representing a major industrial vehicle manufacturer, seeks free viewpoint video synthesis technology using multi-camera. Specifically, the Client aims to develop free viewpoint display system that improve the workability and safety of industrial vehicles through technology for seamless, real-time synthesis of videos from multiple cameras.
The Client is engaged in the development of free viewpoint video synthesis technology to improve the operation efficiency and safety of industrial vehicles. Computing cost is generally high for the synthesis of videos from multiple cameras, however, which presents challenges on two fronts: real-time processing and seamless synthesis. Meanwhile, recent advancements in information and communication technology has built a momentum in the development of related technologies that may help solve challenges faced by the Client, such as multi-view 3D video streaming and virtual reality free space creation technologies, intended for applications such as watching sports and entertainment. The Client has therefore decided to make this RFP to further accelerate the development of their research and development endeavors.
Key Success Criteria
Target vehicles: industrial vehicles such as forklifts
Cameras to be used and how they are expected to be placed:
Camera resolution: VGA
Expected uses: cargo handling operation assistance and perimeter monitoring
Positions of the cameras will be restricted to areas that do not interfere with the functions of the industrial vehicle
The Client seeks technology for synthesizing videos from the specified angles and viewpoints using videos taken by multiple cameras mounted on a target vehicle specified above
Can display free-viewpoint video in real-time
Processing delays: ≤100 ms
Frame rate: 30 fps
Seamless synthesis of videos from 2 cameras or more
Number of cameras placed for different types of uses expected
Cargo handling operation assistance: 2–4
Perimeter monitoring: 4–6
No image discontinuity between videos
It is preferable that the components required to realize the technology (such as servers and other hardware) can be mounted on industrial vehicles
Virtual camera positions for cargo handling operation
It is not necessary for all requirements to be met at this point; proposals are welcome if there is a good chance of meeting them through further development within the next year or so.
The Client expects technologies such as the following approaches, but is open to others:
Seamless synthesis of videos from multiple cameras
Application of 3D video streaming and virtual reality free space creation technologies
Improved processing speed of free viewpoint video synthesis technology
Optimization of server architecture
Approaches not of Interest
Approaches Not of Interest
The following approaches are not of interest:
Technologies that require for a large-size server infrastructure to be built, such as cloud-based systems
Items to be Submitted
Please include the following items in your proposal:
Characteristics, principle, and uniqueness of the proposed technology
Development stage: performance verified at a lab level, technology currently being established, or implemented for practical use
Number of cameras and frame rate covered by the technology
System configuration (hardware, OS)
Specific examples of application
Samples of processed videos (if available)
Current challenges and future development plans
Past results (e.g. research papers, patents)
Notes on Response
Proposal shall have clear points and should not include confidential information. Supplemental files may be submitted in addition to the proposal.
The client will evaluate all responses with the following criteria.
Overall scientific and technical merit
Approach to proof of concept or performance
Economic potential of concept
Realism of the proposed plan (action items, timeline, roles, deliverables, cost estimation)
Potential for proprietary position
Respondents’ capability and related experiences
Anticipated Project Process
After the submission due date, the client will review all submitted proposals. NineSigma will send the review results to each proposer 6-8 weeks after the due date. The client possibly asks clarifying questions before selecting the most suitable candidates for collaboration. The client will select best candidates through evaluations. During the selection process, the client may execute NDA with selected respondents, seek further information disclosure, and discuss specific development targets or potential opportunities.
The client will execute necessary agreements with the selected respondents and move to the advanced development phase. Specifics of any collaboration will be determined through consultation with the concerned parties.