Intel RealSense

Intel RealSense Technology, formerly known as Intel Perceptual Computing, was a product range of depth and tracking technologies designed to give machines and devices depth perception capabilities. The technologies, owned by Intel were used in autonomous drones, robots, AR/VR, smart home devices amongst many others broad market products.

Intel RealSense
TypeProduct Line
IndustryArtificial intelligence, Camera, Depth perception, 3D reconstruction
Founded2015 (2015)
HeadquartersSanta Clara, California
ProductsIntel RealSense
ParentIntel
Websitewww.intelrealsense.com
RealSense Depth Camera
DeveloperIntel RealSense
ManufacturerIntel
TypeCameras, Technology

The RealSense products were made of Vision Processors, Depth and Tracking Modules, and Depth Cameras, supported by an open source, cross-platform SDK in an attempt to simplify supporting cameras for third party software developers, system integrators, ODMs and OEMs.[1]

History

Intel began producing hardware and software that utilized depth tracking, gestures, facial recognition, eye tracking, and other technologies under the branding Perceptual Computing in 2013.[2][3] According to Intel, much of their research into the technologies was focused around "sensory inputs that make [computers] more human like". They initially hoped to begin including 3D cameras that could support their Perceptual Computing as opposed to traditional 2D cameras by late 2014.[4]

In 2013, Intel ran a competition among seven teams to create software highlighting the capabilities of its Perceptual Computing technology entitled "Intel Ultimate Coder Challenge: Going Perceptual".[3][5]

In 2014, Intel rebranded their Perceptual Computing line of technology as Intel RealSense.[2][6]

Intel RealSense Group supported multiple depth and tracking technologies including Coded Light Depth, Stereo Depth and Positional Tracking.[7]

To address the lack of applications built on the RealSense platform and to promote the platform among software developers, in 2014 Intel organized the "Intel RealSense App Challenge". The winners were awarded large sums of money.[8]

Current Product range

In August 2021 Intel announced it was "winding down" its RealSense computer vision division to focus on its core businesses.[9] Specifically the End of Life (EOL) of LiDAR L515, Facial Authentication (F455) and Tracking (T265) product lines were announced. The majority of the Stereo Product Line were still available and new products were released in the meantime.[10][11][12]

Product series

Intel RealSense D400 Product Family

As of January 2018, new Intel RealSense D400 Product Family was launched with the Intel RealSense Vision Processor D4, Intel RealSense Depth Module D400 Series, and 2 ready to use depth cameras: Intel RealSense Depth Cameras D435 and D415.

Intel RealSense Vision Processor D4 Series

The Intel RealSense Vision Processor D4 series are vision processors based on 28 nanometer (nm) process technology to compute real-time stereo depth data. They utilise a depth algorithm that enables more accurate and longer range depth perception than previously available. There are two products in this family: RealSense Vision processor D4 and RealSense Vision Processor D4m.

Other products

The Intel RealSense Depth Module D400 Series is designed for easy integration to bring 3D into devices and machines. Intel also released the D415 and D435 in 2018. Both cameras feature the RealSense Vision processor D4 and camera sensors. They are supported by the cross-platform and open source Intel RealSense SDK 2.0. The Intel D415 is designed for more precise measurements.

Intel RealSense Depth Camera D435

The Intel RealSense Depth Camera D435 is ideal for capturing stereo depth in a variety of applications that help perceive the world in 3D.[13][14][15][16][17][18][19][20][21][22][23][24][25][26]

Previous Generations

Previous generations of Intel RealSense depth cameras (F200, R200 and SR300) were implemented in multiple laptop and tablet computers by Asus, HP, Dell, Lenovo, and Acer.[27] Additionally, Razer and Creative offered consumer ready standalone webcams with the Intel RealSense camera built into the design.:[28] Razer Stargazer and the Creative BlasterX Senz3D.[29]

Intel RealSense 3D Camera (Front F200)

This is a stand-alone camera that can be attached to a desktop or laptop computer.[30] It is intended to be used for natural gesture-based interaction, face recognition, immersive, video conferencing and collaboration, gaming and learning and 3D scanning.[31] There was also version of this camera to be embedded into laptop computers.[27]

Intel RealSense Snapshot

Snapshot is a camera system intended to be built into tablet computers and possibly smartphones. Its intended uses include taking photographs and performing after the fact refocusing, distance measurements, and applying depth photo filters.[32] The refocus feature differs from a plenoptic camera in that RealSense Snapshot takes pictures with large depth of field so that initially the whole picture is in focus and then in software it selectively blurs parts of the image depending on their distance. The Dell Venue 8 and 10 7000 Series Android tablets are equipped with this camera.[33]

Intel RealSense 3D Camera (Rear R200)

Rear-mounted camera for Microsoft Surface or a similar tablet, like the HP Spectre X2.[34] This camera is intended for augmented reality applications, content creation, and object scanning. Its depth accuracy is on the order of millimeters and its range is up to 6.0 meters. The R200 is a stereo camera and is able to obtain accurate depth outdoors as well as indoors.[35]

Reception

In an early preview article in 2015, PC World's Mark Hachman concluded that RealSense is an enabling technology that will be largely defined by the software that will take advantage of its features. He noted that as of the time the article was written, the technology was new and there was no such software.[36]

Product Technical Specifications

Specifications: Intel RealSense Depth Camera D415, D435 and D455 [37][38][39][40]

D415 D435 D455
Use Environment Indoor/Outdoor
Depth Technology Active infrared (IR) stereo
IR Projector & Left/Right Camera Type Standard Wide
Shutter Type Rolling Global
Image Sensor Module OV2740 (OV02740-H34A-Z)[41] OV9782 (OV09782-GA4A)[42]
Image Sensor Technology PureCel HDR[41] OmniPixel3-GS[42]
Image Sensor Size 1⁄6 inch, 3855 µm × 2919 µm[41] 1⁄4 inch, 3896 µm × 2453 µm[42]
Image Sensor Pixel Size 1.4 µm × 1.4 µm[41] 3 µm × 3 µm[42]
Vision Processor Board RealSense Vision Processor D4
Depth Sensor Module RealSense Module D415 RealSense Module D430 + RGB Camera RealSense Module D450
Depth Field of View for HD H:65°±2 V:40°±1 D:72°±2 H:87°±3 V:58°±1 D:95°±3
Depth Field of View for VGA H:50°±2 V:40°±1 D:61°±2 H:75°±3 V:62°±1 D:89°±3
Depth Resolution and Framerate Up to 1280px × 720px @ 90fps
Minimum Depth Distance at Maximum Resolution 45 cm / 17.7" 28 cm / 11.0" 52 cm / 20.5"
Depth Accuracy <2% at 2.0m / 2.2yd <2% at 4.0m / 4.4yd
Ideal and Maximum Range 0.5m to 3m / 0.6yd to 3.3yd 0.3m to 3m / 0.3yd to 3.3yd 0.6m to 6m / 0.3yd to 6.6yd
RGB Resolution, Framerate and Aspect Ratio 1920px × 1080px @ 30fps (16:9) 1280px × 800px @ 30fps (8:5)
RGB Field of View H:69.4° V:42.5° D:77.0° H:91.2° V:65.5° D:100.6°
RGB Lens Distortion ≤1.5%
Device Dimensions 99mm × 20mm × 23mm 90mm × 25mm × 25mm 124mm × 26mm × 29mm
Connector USB Type-C 3.1 Gen 1
Mounting Mechanisms One 1/4-20UNC thread mounting point
Two M3 thread mounting points Two M4 thread mounting points

Specifications: Intel RealSense Vision Processor D4 Series[43]
(Not available separately as these are just the bare PCB Vision Processor boards, only used as basis for the RealSense Depth Camera series)

RealSense Vision Processor D4 RealSense Vision Processor D4M
Depth Technology Stereo Stereo
Form Factor ASIC BGA ASIC BGA
Package Size 6.4mm x 6.4mm x 1mm 4.7mm x 3.8mm x 0.55mm
Process Technology 28 nm 28 nm
Depth Max Throughput 36.6 MP/sec (848×480@90fps)
Depth Stream Output Resolution Up to 1280×720 Up to 720×720
Depth Stream Output Frame Rate Up to 90fps
RGB Sensor Max Resolution & Max Frame Rate 1920×1080, Up to 60fps 720×720, Up to 30 fps
IR Projector Controls Yes Yes
Host Interface USB 3.0 2x MIPI
Multi Camera Support Yes, up to 5 Up to 30fps
I/O 5x MIPI CSI-2, 5x I2C, 1x SPI, GPIO, Timer 2x MIPI 1x I2C, 1x SPI, GPIO, Timer

Specifications: Intel Stereo DepthModule SKUs[44]
(Not available separately as these are just the bare PCB Depth Sensor Modules, only used as basis for the RealSense Depth Camera series)

D400 D410 D415 D420 D430
Depth technology Passive IR Stereo Active IR Stereo Active IR Stereo Passive IR Stereo Active IR Stereo
Image Sensor technology Rolling Shutter Rolling Shutter Rolling Shutter Global Shutter Global Shutter
Depth FOV (HxV for HD 16:9) 63.4degx 40.4deg 63.4degx 40.4deg 63.4degx 40.4deg 85.2degx 58deg 85.2degx 58deg
RGB Frame Rate and Resolution - - Up to 60FPS - -
Depth Resolution Up to 1280x720 Up to 1280x720 Up to 1280x720 Up to 1280x720 Up to 1280x720
Depth Frame Rate Up to 90fps Up to 90fps Up to 90fps Up to 90fps Up to 90fps
Range 0.16-10m+ 0.16-10m+ 0.16-10m+ 0.11-10m+ 0.11-10m+

See also

References
  1. "Intel RealSense". Intel RealSense. Retrieved April 14, 2018.
  2. "Intel And Qualcomm Battle To Bring Computer Vision Into Phones And Drones". Forbes. August 10, 2023. Archived from the original on August 10, 2023. Retrieved August 10, 2023.
  3. Owano, Nancy; Phys.org (January 14, 2013). "Intel's Perceptual Computing marks neo-desktop era". phys.org. Archived from the original on January 15, 2013. Retrieved August 10, 2023.
  4. "Inside Intel's perceptual computing lab (pictures)". CNET. November 29, 2013. Archived from the original on August 10, 2023. Retrieved August 10, 2023.
  5. "The Ultimate Coder Has Been Named - Final Results of Ultimate Coder Challenge: Going Perceptual". Intel® Developer Zone. July 31, 2013. Archived from the original on July 31, 2013. Retrieved August 10, 2023.
  6. tony2 (October 8, 2014). "Old Perceptual Computing SDK download". Intel Community Developer Software Forums. Archived from the original on August 10, 2023. Retrieved August 10, 2023.
  7. "Intel RealSense". Intel RealSense. Retrieved April 14, 2018.
  8. Healey, Nic (June 3, 2014). "Intel issues $1m challenge for devs to make RealSense apps". CNET. Archived from the original on October 6, 2022. Retrieved August 10, 2023.
  9. "Intel Says It's 'Winding Down' RealSense Camera Business". CRN. August 17, 2021.
  10. "Intel Will Keep Selling RealSense Stereo Cameras". IEEE Spectrum. August 19, 2021. Archived from the original on August 20, 2021. Retrieved September 7, 2022.
  11. "L515 EOL". Intel RealSense Help Center. August 30, 2021. Retrieved September 7, 2022.
  12. "FRAMOS Introduces New Intel® RealSense™ Depth Camera D405". FRAMOS. Retrieved September 7, 2022.
  13. "$399 Intel Euclid Robotics Devkit Runs Ubuntu & ROS on Intel Atom x7-Z8700 Processor - CNX Software". May 22, 2017.
  14. http://roscon.ros.org/2016/presentations/ROSCon2016_Intel_RealSense.pdf
  15. "EUCLID1 Intel Euclid Developer Kit RF Exposure Info SA170103W003_CCS-G003_FCC SAR_Report_WLAN&BT Intel".
  16. "Intel Announces Tools for RealSense Technology Development".
  17. https://www.patreon.com/posts/intel-euclid-022-12444963
  18. Archived at Ghostarchive and the Wayback Machine: Mail incoming, trying out and tearing down the Intel Euclid @scanlime-in-progress. YouTube.
  19. "Intel | Data Center Solutions, IoT, and PC Innovation".
  20. "Home". euclidcommunity.intel.com. Archived from the original on May 23, 2018. Retrieved May 23, 2018.
  21. https://www.mouser.de/new/Intel/intel-euclid-dev-kit/%5B%5D
  22. "IntelEuclid - ROS Wiki".
  23. https://imvc.co.il/Portals/38/Amit%20Moran.pdf
  24. "Intel Euclid". GitHub.
  25. "Support for Intel Euclid Development Kit".
  26. https://www.intel.com/content/dam/support/us/en/documents/emerging-technologies/Euclid_User_Guide.pdf
  27. "Devices with Intel RealSense Technology". Intel.
  28. "At a Glance: Razer Stargazer | RZ20-01800". mysupport.razer.com. Retrieved October 18, 2022.
  29. "Razer and Creative want you to wave at your webcam". September 15, 2016.
  30. "Take Interaction to the Next Level – Intel RealSense Camera F200". Intel.
  31. "Developing for the Intel RealSense Camera (F200)". Intel.
  32. "Developing for the Intel RealSense Snapshot". Intel. Archived from the original on May 14, 2015.
  33. "Intel RealSense Snapshot". Intel. Archived from the original on May 3, 2015.
  34. "HP Spectre X2". HP.
  35. Keselman, Leonid; Woodfill, John Iselin; Grunnet-Jepsen, Anders; Bhowmik, Achintya (May 16, 2017). "Intel RealSense Stereoscopic Depth Cameras". arXiv:1705.05548 [cs.CV].
  36. "Hands on: Without apps, Intel's RealSense camera is a puzzle". PC World. March 5, 2015. Retrieved March 25, 2015.
  37. "RealSense Depth Camera D415 Technical Specifications". Intel Store. Retrieved May 20, 2021.
  38. "RealSense Depth Camera D435 Technical Specifications". Intel Store. Retrieved May 20, 2021.
  39. "RealSense Depth Camera D455 Technical Specifications". Intel Store. Retrieved May 20, 2021.
  40. "Intel RealSense Product Family D400 Series Datasheet" (Datasheet). Intel RealSense. pp. 36, 37, 52. Retrieved May 20, 2021.
  41. "OV2740 Color CMOS 1080p (1920x1080) HD PureCel Image Sensor". OmniVision. Retrieved May 20, 2021.
  42. "OV9782 Color CMOS 1-Megapixel (1280x800) Image Sensor with OmniPixel3-GS Technology". Retrieved May 20, 2021.
  43. "Intel RealSense Product Family D400 Series Datasheet" (Datasheet). Intel RealSense. Table 3-11. p. 36. Retrieved May 20, 2021.{{cite web}}: CS1 maint: location (link)
  44. "Intel RealSense Product Family D400 Series Datasheet" (Datasheet). Intel RealSense. Table 3-42. p. 55. Retrieved May 20, 2021.{{cite web}}: CS1 maint: location (link)
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.