AirPlay
Logos of AirPlay 2
AirPlay video (left) and AirPlay audio (right)
DeveloperApple Inc.
TypeWireless media streaming
Release date
  • June 7, 2004 (as AirTunes)[1]
  • September 1, 2010 (AirPlay)
  • November 22, 2010 (for iOS)
  • June 6, 2011 (mirroring)
  • May 29, 2018 (AirPlay 2)
Websiteapple.com/airplay

AirPlay is a proprietary wireless communication protocol stack/suite developed by Apple Inc. that allows streaming between devices of audio, video, device screens, and photos, together with related metadata. Originally implemented only in Apple's software and devices, it was called AirTunes and used for audio only.[2] Apple has since licensed the AirPlay protocol stack as a third-party software component technology to manufacturers that build products compatible with Apple's devices.

History

In 2004, Apple introduced AirTunes as a new feature of iTunes 4.6. It allowed music streaming over a network to an AirPort Express, which was equipped with a 3.5 mm analog-digital audio jack for speakers or other audio devices. In 2010, Apple introduced a new iteration of the AirTunes technology, now called AirPlay, as part of iOS 4.2. It supported audio and now video streaming to the Apple TV, and later added screen-mirroring and eventually support for a broad range of 3rd-party AirPlay-compatible speakers and AV equipment.

Apple announced AirPlay 2 at its annual WWDC conference on June 5, 2017. It was scheduled for release along with iOS 11 in the third quarter of 2017, but was delayed until June 2018.[3][4] Compared to the original version, AirPlay 2 improves buffering; adds streaming audio to stereo speakers;[5] allows audio to be sent to multiple devices in different rooms;[6] and control by Control Center, the Home app, or Siri,[7] functionality that was only available previously using iTunes under macOS or Windows.[8]

History of AirPlay
2004 Launch as AirTunes for iTunes and AirPort Express
2010 Launch on iOS 4 as AirPlay
2018 AirPlay 2 launch on iOS 11.4
2021 macOS Monterey (12) includes receiver capability on compatible Macs

Senders

AirPlay sender devices include computers running iTunes, and iOS devices such as iPhones, iPods, and iPads running iOS 4.2 or greater, and devices can send AirPlay over Wi-Fi or ethernet. OS X Mountain Lion supports display mirroring via AirPlay on systems containing 2nd generation Intel Core processors or later.[9]

In 2016, HTC released the "10", also known as "One M10", an Android phone with Apple AirPlay streaming.[10]

As of iOS 4.3, third-party apps like ApowerMirror,[11] AirServer, and Reflector may send compatible audio and video streams over AirPlay.[12] The iTunes Remote app on iOS can be used to control media playback and select AirPlay streaming receivers for iTunes running on a Mac or PC.[13]

As of macOS 10.14, there is no public API for third-party developers to integrate AirPlay 2 into their macOS apps. However, there are third-party streamers such as Airfoil. In May 2019, a third-party developer released a macOS app that can stream audio using AirPlay 2.[14] The app includes a helper tool called "AirPlay Enabler" that uses code injection to bypass restrictions to the AirPlay 2 private API on macOS.[15]

Receivers

AirPlay receiver devices include Apple TV, HomePod, third-party speakers and the discontinued AirPort Express, which included a combined analog and optical S/PDIF audio output connector. Compatible devices can receive AirPlay over wi-fi or ethernet. Some open-source projects have reverse-engineered the audio part of the protocol, enabling any computer to be turned into an AirPlay receiver for audio.[16]

However, because not all third-party receivers implement Apple's DRM encryption, some media, such as iTunes Store's own rights-protected music (Apple's own "FairPlay" encryption), YouTube, and Netflix, cannot stream to those devices or software. On Apple TV, starting with firmware 6.0, the DRM scheme is enforced: devices without it cannot be used.[17]

AirPlay wireless technology is integrated into speaker docks, AV receivers, and stereo systems from companies such as Naim, Bose, Yamaha, Philips, Marantz, Onkyo, Bowers & Wilkins, Pioneer, Sony, Sonos, McIntosh, Denon,[18] and Bang & Olufsen.[19] Song titles, artists, album names, elapsed and remaining time, and album artwork can appear on AirPlay-enabled speakers with graphical displays. Often these receivers are built to only support the audio component of AirPlay, much like AirTunes.

Bluetooth devices (headsets, speakers) that support the A2DP profile also appear as AirPlay receivers when paired with an iOS device, although Bluetooth is a device-to-device protocol that does not rely on a wireless network access point.

During the January 2019 Consumer Electronics Show (CES) in Las Vegas, television makers Samsung, LG, Vizio, and Sony announced they would be producing sets with built-in AirPlay 2 receiving capability.[20] LG announced that television models that are AirPlay 2-enabled will include the 2019 OLED, NanoCell SM9X, UHD UM7X, and LG NanoCell SM8X models.[21]

In September 2020, Roku added AirPlay 2 support as part of the 9.4 update on select 4K Roku devices. In April 2021, the 10.0 update added support for more Roku TVs and Players.[22]

During WWDC 2021, Apple announced that macOS Monterey would include AirPlay receiver compatibility for compatible Macs.

Protocols

AirPlay and AirTunes work over a local network, through either Wi-Fi or Ethernet. Originally, devices had to be connected to the same network, but since late 2017 devices can opt to use Wi-Fi Direct allowing devices to connect without a LAN.[23]

The AirTunes part of the AirPlay protocol stack uses UDP for streaming audio and is based on the Real Time Streaming Protocol.[24] The streams are transcoded using the Apple Lossless codec with 44100 Hz and 2 channels symmetrically encrypted with AES, requiring the receiver to have access to the appropriate key to decrypt the streams.[25] The stream is buffered for approximately 2 seconds before playback begins, resulting in a small delay before audio is output after starting an AirPlay stream.[26]

The protocol supports metadata packets that determine the final output volume on the receiving end. This makes it possible to always send audio data unprocessed at its original full volume, preventing sound quality deterioration due to reduction in bit depth and thus sound quality which would otherwise occur if changes in volume were made to the source stream before transmitting. It also makes possible the streaming of one source to multiple targets each with its own volume control. The AirPort Express' streaming media capabilities use Apple's Remote Audio Output Protocol (RAOP), a proprietary variant of RTSP/RTP. Using WDS-bridging,[27] the AirPort Express can allow AirPlay functionality (as well as Internet access, file and print sharing, etc.) across a larger distance in a mixed environment of wired and up to 10 wireless clients.

AirPlay Mirroring

At WWDC 2011, Steve Jobs, then CEO of Apple Inc., announced AirPlay Mirroring as a feature in iOS 5 where the user can stream the screen from an iPad 2 to an HDTV wirelessly and securely without the need for cables.[28][29]

AirPlay is a different technology from AirPlay Mirroring, as the former allows specific content formats to be streamed, while the latter allows the whole screen to be broadcast from a variety of iOS devices and iTunes to an Apple TV (2nd Gen or later). The exact composition of the protocols that AirPlay Mirroring uses have not yet fully been discovered, or reverse-engineered.[29] However, an unofficial AirPlay protocol specification is available.[30] Supported hardware (when using OS X Mountain Lion or later) includes any 2011 or later iMac, Mac mini, MacBook Air, MacBook Pro, or the Mac Pro (late 2013 or newer).[31]

Reverse engineering

When the protocol was known as AirTunes, it was reverse-engineered by Jon Lech Johansen in 2008.[25]

On April 8, 2011, James Laird reverse-engineered and released the private key used by the Apple AirPort Express to decrypt incoming audio streams.[32] The release of this key means that third-party software and devices modified to use the key will be able to decrypt and play back or store AirPlay streams.[33] Laird released ShairPort as an example of an audio-only software receiver implementation of AirPlay.[34] Soon more followed and in 2012 the first AirPlay audio and video receiver for PC came with a product called AirServer.[35][36]

An open-source AirPlay mirroring server (receiver) known as RPiPlay is available for the Raspberry Pi and Desktop Linux operating systems. The author describes it as being based on dsafa22's Android mirroring server, which was in turn based on Juho Vähä-Herttua's ShairPlay.[37]

With Shairport Sync,[38] there is an implementation that supports AirPlay and parts of AirPlay 2 that runs on Linux and FreeBSD and works well on embedded devices such as Raspberry Pis or OpenWrt-powered routers.

See also

Notes

  1. ^ "Apple Unveils AirPort Express for Mac & PC Users". Apple.com. June 7, 2005. Archived from the original on March 29, 2011. Retrieved April 12, 2012.
  2. ^ Brownlee, John (September 1, 2010). "September iPod Event: In iOS 4.2, AirTunes Becomes AirPlay". Cult of Mac. Retrieved April 11, 2011.
  3. ^ "Apple unveils iOS 11 with P2P Apple Pay transfers, a new sound for Siri, AirPlay 2, more". AppleInsider. June 5, 2017. Retrieved June 6, 2017.
  4. ^ "iOS 11.4 brings stereo pairs and multi-room audio with AirPlay 2". Apple.com. May 29, 2018. Retrieved May 29, 2018.
  5. ^ "iOS 11.4 brings stereo pairs and multi-room audio with AirPlay 2". Apple Newsroom. Retrieved May 9, 2019.
  6. ^ "AirPlay 2 FAQ: What it is, how it works, and which devices support it". Macworld. Retrieved June 22, 2018.
  7. ^ "iOS 11 brings new features to iPhone and iPad this fall". Apple.com. Retrieved June 6, 2017.
  8. ^ "Use AirPlay to stream content from iTunes on your computer". Apple Support. Retrieved June 30, 2017.
  9. ^ "About AirPlay Mirroring in OS X Mountain Lion". Apple.com. Retrieved August 6, 2012.
  10. ^ "HTC's 10 is the first Android phone with Apple AirPlay streaming". Engadget. April 12, 2016.
  11. ^ "ApowerMirror". Apowersoft. Retrieved September 10, 2017.
  12. ^ Rose, Michael. "iOS 4.3 spotlight: AirPlay improvements and 720p playback". TUAW. AOL. Retrieved May 5, 2011.
  13. ^ "iTunes Remote". Apple.com. Archived from the original on September 13, 2010.
  14. ^ "Optimus Player". Optimus Player. May 7, 2019. Retrieved May 8, 2019.
  15. ^ Mo, Darren (May 7, 2019). "A helper tool that enables Optimus Player to stream audio using AirPlay 2". GitHub. Retrieved May 9, 2019.
  16. ^ "How-To: Turn your Raspberry Pi into a AirPlay receiver to stream music from your iPhone". Raspberry Pi HQ. July 27, 2013. Retrieved September 4, 2013.
  17. ^ Kafasis, Paul (September 20, 2013). "Warning on Apple TV version 6.0". Under the Microsope. Rogue Amoeba. Retrieved September 20, 2013.
  18. ^ Grobart, Sam (November 22, 2010). "Understanding AirPlay in Apple's iOS 4.2". The New York Times. Retrieved April 11, 2011.
  19. ^ "Bang & Olufsen unveils Playmaker wireless audio bridge, makes sure AirPlay and DLNA speak Danish". Engadget. Retrieved June 12, 2019.
  20. ^ "At CES 2019, Apple finally sets iTunes, AirPlay loose". CNET. Retrieved January 12, 2019.
  21. ^ Rossignol, Joe (March 5, 2019). "LG's Latest Smart TVs Will Receive AirPlay 2 Update in Mid 2019". Mac Rumors. Retrieved April 2, 2019.
  22. ^ "How do I use AirPlay and HomeKit with my Roku streaming device?". Roku website. Retrieved November 2, 2020.
  23. ^ "AirPlay no longer requires a Wi-Fi network in iOS 8". Retrieved November 16, 2017.
  24. ^ Donenfeld, Jason A. "AirTunes 2 Protocol". ZX2C4. Retrieved April 11, 2011.
  25. ^ a b Hanselmann, Michael (December 16, 2008). "Add Remote Audio Output Protocol stream output plugin" (Mailing list).
  26. ^ "Preventing audio delays while watching videos with Airfoil". Rogue Amoeba. Retrieved August 18, 2012.
  27. ^ "Apple WDS Setup". Apple.com. February 11, 2011. Retrieved April 12, 2012.
  28. ^ "iOS5 – AirPlay Mirroring for iPad 2". Apple.com. Archived from the original on September 23, 2011. Retrieved April 12, 2012.
  29. ^ a b "Exploring Airplay Mirroring Internals". aorensoftare.com. August 20, 2011.
  30. ^ "Unofficial AirPlay Protocol Specification". nto.github.com. May 29, 2012. Retrieved May 29, 2012.
  31. ^ "About AirPlay Mirroring in OS X". Apple.com. Retrieved January 13, 2015.
  32. ^ Laird, James (April 8, 2011). "RAOP/Airtunes". vlc-devel (Mailing list).
  33. ^ Cheng, Jacqui (April 11, 2011). "ShairPort emulates AirPort Express to receive AirPlay streams". Ars Technica. Retrieved April 11, 2011.
  34. ^ Laird, James (April 11, 2011). "ShairPort 0.02 released". Archived from the original on April 27, 2011. Retrieved April 11, 2011.
  35. ^ "Wireless Mirroring from iPad to PC Now a Reality with AirServer". LearningInHand.com. May 5, 2012.
  36. ^ "History ‹ AirServer". AirServer.
  37. ^ "RPiPlay: Authors". GitHub. March 30, 2023.
  38. ^ "Shairport Sync". GitHub. May 6, 2023.

External links

Wi-Fi base stations by Apple
iOS and iOS-based products
Apple Inc.
Categories