PrimeSense
TypeSubsidiary of Apple Inc.
IndustryFabless semiconductor
Founded2005
Defunct2013
FateAcquired by Apple Inc.
HeadquartersIsrael
Key people
  • Aviad Maizels (president and founder)
  • Alexander Shpunt (chief technology officer and cofounder)
  • Inon Beracha (CEO)
Products
  • PrimeSense 3D sensor
  • Carmine 1.08
  • Carmine 1.09 (short range)
  • Capri 1.25 (not yet available)
  • Carmine 1080 SoC
  • Capri 1200 SoC (not yet available)
  • NiTE middleware
ParentApple Inc.
Websiteprimesense.com Edit this on Wikidata

PrimeSense was an Israeli 3D sensing company based in Tel Aviv. PrimeSense had offices in Israel, North America, Japan, Singapore, Korea, China and Taiwan. PrimeSense was bought by Apple Inc. for $360 million on November 24, 2013.

History

PrimeSense was a fabless semiconductor company and provided products in the area of sensory inputs for consumer and commercial markets.

PrimeSense's technology had been originally applied to gaming but was later applied in other fields.[1] PrimeSense was best known for licensing the hardware design and chip used in Microsoft's Kinect motion-sensing system for the Xbox 360 in 2010.[2] The company had been founded in 2005 to explore depth-sensing cameras which they had demonstrated to developers at the 2006 Game Developers Conference. Microsoft had been looking on its own at 3D camera technology applications to its Xbox line of consoles, and engaged with PrimeSense after the conference to help establish the direction the technology needed to go to make it into consumer-grade products, while Microsoft improved on additional software aspects and incorporated machine learning to help with motion detection.[3]

On November 24, 2013, Apple Inc. confirmed the purchase of PrimeSense for $360 million.[4]

Technology

Light coding technology

PrimeSense's depth acquisition was enabled by "light coding" technology. The process coded the scene with near-IR light, light that returns distorted depending upon where things are (Structured light). The solution then used a standard off-the-shelf CMOS image sensor to read the coded light back from the scene using various algorithms to triangulate and extract the 3D data. The product analysed scenery in 3 dimensions with software, so that devices could interact with users.[5][6]

Products

PrimeSense system on a chip (SoC)

The CMOS image sensor worked with the visible video sensor to enable the depth map provided by PrimeSense SoC's Carmine (PS1080) and Capri (PS1200) to be merged with the color image. The SoCs performed a registration process so the color image (RGB) and depth (D) information was aligned properly.[7] The light coding infrared patterns were deciphered in order to produce a VGA size depth image of a scene. It delivered visible video, depth, and audio information in a synchronized fashion via the USB 2.0 interface. The SoC had minimal CPU requirements as all depth acquisition algorithms ran on the SoC itself.

PrimeSense sensors

PrimeSense embedded its technology in its own sensors, the Carmine 1.08 and Carmine 1.09. Capri 1.25, touted by the company as the world's smallest 3D sensor, debuted at International CES 2013.[8]

PrimeSense middleware

PrimeSense developed NiTE middleware which analyzed the data from hardware and modules for OpenNI providing gesture and skeleton tracking. They were released only as binaries.[9] According to the NiTE LinkedIn page: "Including computer vision algorithims, NiTE identifies users and tracks their movements, and provides the framework API for implementing natural-interaction UI controls based on gestures."[10] The system could then interpret specific gestures, making completely hands-free control of electronic devices a reality.[1] Including:

Markets

PrimeSense's original focus was on the gaming and living room markets,[11] but expanded to include:

Television

PC and mobile

Interactive displays

Retail

Robotics

Healthcare

Timeline

Partners

PrimeSense was a founding member of OpenNI, an industry-led, non-profit organization formed to certify and promote the compatibility and interoperability of Natural Interaction (NI) devices, applications and middleware. The original OpenNI project was shut down by Apple when they bought the open source software, but Occipital kept a forked version of OpenNI 2 active as an open source software for the SDK for their Structure Product.[citation needed]

The company provided the 3D sensing technology for the first Kinect, previously known as Project Natal.[25][26]

Awards

The company was selected by MIT Technology Review magazine as one of world's 50 most innovative companies for 2011.[27]

PrimeSense won Design Team of the Year in EE Times 2011 Annual Creativity in Electronics (ACE)[28]

PrimeSense was honored as a World Economic Forum Technology Pioneer in 2013.[29]

References

  1. ^ a b "PrimeSense - MIT Technology Review". 2.technologyreview.com. Retrieved 3 August 2018.
  2. ^ "Beyond Kinect, PrimeSense wants to drive 3D sensing into more everyday consumer gear". Venturebeat.com. 20 January 2013. Retrieved 3 August 2018.
  3. ^ Hester, Blake (January 14, 2020). "All the money in the world couldn't make Kinect happen". Polygon. Retrieved January 16, 2020.
  4. ^ "Apple Confirms Acquisition of 3-D Sensor Startup PrimeSense". Allthingsd.com. Retrieved 3 August 2018.
  5. ^ "PrimeSense: Motion Control Beyond the Kinect". Forwardthinking.pcmag.com. Retrieved 3 August 2018.
  6. ^ a b "Archived copy". Archived from the original on 2013-11-02. Retrieved 2013-02-26.((cite web)): CS1 maint: archived copy as title (link)
  7. ^ "How Microsoft's PrimeSense-based Kinect Really Works". Electronicdesign.com. 16 March 2011. Retrieved 3 August 2018.
  8. ^ "PrimeSense shows off tiny Capri sensor, yearns for 3D-sensing future (hands-on)". Engadget.com. Retrieved 3 August 2018.
  9. ^ "PrimeSenseNite - Debian Wiki". Wiki.debian.org. Retrieved 3 August 2018.
  10. ^ "NiTE Middleware | LinkedIn". Archived from the original on 2013-04-08.
  11. ^ Perlroth, Nicole. "For PrimeSense, Microsoft's Kinect Is Just the Beginning". Forbes.com. Retrieved 3 August 2018.
  12. ^ "Asus, PrimeSense Reveals Motion Sensing for PC". Tomshardware.com. 3 January 2011. Retrieved 3 August 2018.
  13. ^ "Official Structure Sensor Store - Give Your iPad 3D Vision". structure.io. Retrieved 3 August 2018.
  14. ^ www.firecube-multimedia.com/lang/en Archived 2015-01-08 at the Wayback Machine
  15. ^ "BEAM By EyeClick - Interactive Gaming Projector System". BEAM By EyeClick. Retrieved 3 August 2018.
  16. ^ "ViiMotion - Interactive Software Device by Covii". Vimeo. Retrieved 3 August 2018.
  17. ^ "Archived copy". Archived from the original on 2016-03-07. Retrieved 2013-02-26.((cite web)): CS1 maint: archived copy as title (link)
  18. ^ "Finger-precise hand gesture tracking - Remote Presence Magazine". Remotepresence.org. 18 October 2012. Retrieved 3 August 2018.
  19. ^ "Bodymetrics pods scan customers' bodies to get their clothing measurements". Gizmag.com. 26 October 2011. Retrieved 3 August 2018.
  20. ^ "Matterport". Angel.co. Retrieved 3 August 2018.
  21. ^ "Archived copy". Archived from the original on 2015-04-14. Retrieved 2013-02-26.((cite web)): CS1 maint: archived copy as title (link)
  22. ^ "iRobot reorganizes, forms new unit focused on Ava and other emerging technologies". Engadget.com. Retrieved 3 August 2018.
  23. ^ "Microsoft names Israel's PrimeSense as Project Natal partner - Globes". Globes. 31 March 2010. Retrieved 3 August 2018.
  24. ^ Takahashi, Dean (13 January 2011). "PrimeSense raises round for motion-control chips". Reuters.com. Retrieved 3 August 2018.
  25. ^ Gohring, Nancy (29 July 2010). "Mundie: Microsoft's Research Depth Enabled Kinect". PC World. Retrieved 2 August 2010.
  26. ^ Corp., Microsoft (10 March 2010). "PrimeSense Supplies 3-D-Sensing Technology to "Project Natal" for Xbox 360". Retrieved 2 August 2010.
  27. ^ "The 50 Smartest Companies of 2017 might not be what you think". Technologyreview.com. Retrieved 3 August 2018.
  28. ^ "Archived copy". Archived from the original on 2012-10-14. Retrieved 2013-02-26.((cite web)): CS1 maint: archived copy as title (link)
  29. ^ "Technology Pioneers 2013". Reports.weforum.org. Retrieved 3 August 2018.