NEW

Meet Dolby Millicast at IBC | 3.B60 Learn more

Streaming

The Real-time Streaming Ecosystem: Capturing Video Content

Real-time streaming ecosystem chart with capture emphasized depicting icons of various cameras and capture methods
SUMMARY

Mastering real-time streaming is crucial for content creators. Understanding camera options, video-streaming protocols, and the first mile’s significance ensures top-notch broadcasts. Addressing encoder settings and network issues early prevents playback problems.


In today’s digital world, the demand for real-time streaming has skyrocketed. From live sports  to interactive iGaming, the ability to stream high-quality video in real-time opens up endless possibilities for viewer interactivity. But to make the most of this technology, it’s essential to have the right tools and know-how.

As we continue our ecosystem blog series, we will delve into what’s known as the “first mile” or video capture. This comprehensive guide will walk you through the essentials of capturing high-quality video and audio, covering everything from camera types and streaming protocols to expert tips on achieving seamless broadcasts.

Table of Contents

Capturing content is the first step in live streaming. The key here is to ensure that your content is clear, engaging, and ready for broadcast. Ultra-low latency streaming technology, with sub-500ms latency, delivers seamless and interactive viewer experiences and is critical for boosting audience engagement and streaming revenue.

When considering optimal content capture methods, a diverse range of cameras is at your disposal for video streaming, spanning from professional camcorders to compact webcams.

Types of Cameras

Web cameras

Web cameras are a popular choice for many content creators because of their affordability and ease of use. Most laptops come with built-in webcams, but there are also high-quality external webcams available. These cameras are perfect for webinars, live chats, and casual streaming.

Professional cameras

For those looking to deliver a more polished and professional stream, investing in a high-quality camera is a must. Professional cameras offer superior image quality and come with features like adjustable lenses and better light sensitivity. These cameras are ideal for professional video broadcasting solutions.

Screensharing

Screensharing is a powerful tool for tutorials, webinars, and gaming. By sharing your screen, you can walk your audience through processes, showcase a presentation, and provide a more interactive iGaming experience. Tools like OBS (Open Broadcaster Software) make screensharing easy and effective.

Virtual cameras

Virtual cameras, such as those within Unity and Unreal engines, allow content creators to stream from within virtual environments. This is particularly useful for gaming and simulation broadcasts. Virtual cameras can be controlled like physical ones, offering flexibility and creative freedom.

360 VR cameras

360 VR cameras capture immersive content that can be viewed in virtual reality. With more budget-friendly cameras  available in 2024, these are perfect for creating engaging and interactive content that allows viewers to experience events from every angle.

Action cameras

Action cameras, like GoPro, are designed to capture fast-paced and high-energy activities. Because GoPro cameras are extremely durable and portable, they’re ideal for capturing sports events, adventures, and action-packed content.

Camera drones

Camera drones offer unique aerial perspectives and are increasingly popular for capturing dynamic footage. Drones like those from DJI can stream directly using RTMP or WHIP, providing stunning visuals from above.

Streaming protocols

When it comes to video streaming, the protocol you choose for stream ingest can make a significant difference in performance and quality. Not familiar with protocols? Streaming protocols are standards for sending video over the internet, ensuring they play smoothly without delays or interruptions. These standards manage how video data travels to minimize buffering and maintain quality. Different protocols are used for various types of broadcasts and can differ in compatibility and speed.

Here are some common protocols:
WebRTC (Web Real-time Communication)

WebRTC is a one-to-many streaming protocol for ultra-low latency live streams that can scale for large audiences. It’s ideal for real-time interactive experiences.

RTMP/S (Real-time Messaging Protocol)

RTMP has long been a reliable method for streaming audio, video, and data over the internet, particularly favored for its stability in live streaming ingest. While it continues to be a solid option for video ingest, it’s now considered outdated for playback and is not natively supported by modern HTML5 browsers.

SRT (Secure Reliable Transport)

SRT is an ultra-low latency protocol specifically engineered for secure streaming over unpredictable networks, making it ideal for real-time streaming. By employing advanced  correction techniques, SRT ensures stable and consistent video streams.

WHIP (WebRTC-HTTP Ingest Protocol)

WebRTC HTTP Ingestion Protocol (WHIP) was developed by Millicast to standardize WebRTC ingestion. It simplifies media ingestion for WebRTC, making it easier for encoders to support this protocol and is now directly supported and integrated with OBS.

RTSP (Real-time Streaming Protocol)

RTSP is commonly used by IP cameras, security cameras, and webcams for streaming video over the internet or local networks. You can use RTSP with Dolby Millicast by selecting your IP camera as an input in OBS.

Choosing the right streaming protocol

With so many streaming protocols to choose from, how can you decide which one is best for your use case? Factors like latency tolerance, network reliability, and compatibility with your streaming platform play crucial roles.

Selecting the right protocol ultimately depends on your specific needs:
Latency Requirements For ultra-low latency, sub-500ms latency and real-time interactivity, WebRTC is the best choice and is automatically encrypted.
Network Conditions: If you’re concerned about network reliability, SRT offers the best performance. It’s an excellent choice for high-quality video transmission.
Compatibility: RTMP and RTMPS is widely supported across various encoders and platforms as an ingest protocol.
Ease of Use: The WHIP streaming protocol is a strong choice of use in ingest and video capture, offering a simple and efficient solution for quickly setting up WebRTC streams.

Why the First Mile is Critical

The “first mile” refers to the initial transmission of your live video content from the camera to an encoder and then to a media server. Encoders play a crucial role in video streaming by converting raw video data into a digital format that can be transmitted over the internet. These devices compress and encode video content, optimizing it for efficient delivery while maintaining quality. Encoders help reduce file sizes, making streaming smoother and less bandwidth-intensive for viewers. They also ensure compatibility with various devices and platforms, enabling seamless playback across different screens.

Whether you’re using a physical camera, a virtual camera, or a screen sharing tool, it’s clear that capturing high-quality video and audio is essential. However, capturing great footage is just the beginning. To deliver an exceptional streaming experience, optimal encoder settings like bitrate and frame rate are essential. Additionally, a strong network connection is vital to prevent disruptions and maintain consistent streaming quality.

Overall, encoders are essential components in the video capture process, and are critical for ensuring smooth playback and minimal latency.

Encoder settings

4K Streaming

The Dolby.io CDN for WebRTC Real-time Streaming supports streaming up to 4K 60fps video with 4:4:4 color encoded into H.264, H.265, VP8, VP9, and AV1. Additionally, Dolby.io also fully supports transporting audio via the opus codec, allowing for bitrates from 6 kb/s to 510 kb/s and sampling rates from 8 kHz (narrowband) to 48 kHz (full band). RTMP, RTMPs, and SRT streams can also be ingested and will be transmuxed into a WebRTC stream via the Dolby.io CDN, though their codec support may vary.

Video playback issues often stem from problems in the first mile, specifically related to encoder settings or a faulty capture network. Inadequate encoder settings, such as an incorrect bitrate or frame rate, can lead to poor video quality, buffering, and lag. Likewise, a weak or unstable capture network can disrupt the transmission of video data, resulting in choppy playback and interruptions. Ensuring optimal encoder settings and a robust capture network is crucial for delivering a reliable and enjoyable streaming experience for the viewer.

Pro tips:
Balance Quality and Latency
  • Minimizing latency without compromising quality is key. Use high-quality encoders and optimize your network settings to achieve the best results.
Lower Latency from the Start
  • Every millisecond counts. Reducing latency at the capture stage can significantly improve the overall streaming experience.
Optimize Encoder Settings
  • Proper encoder settings are essential for managing bitrate, resolution, and frame rate. Aim for a balance that suits your network and device capabilities.

To review Dolby Millicast examples for optimal encoder settings, explore our documentation here.

Conclusion

Mastering the real-time streaming ecosystem is essential for any content creator or media professional. By understanding the different camera options, streaming protocols, and the importance of the first mile, you can ensure high-quality, engaging broadcasts. For those looking to elevate their streaming game, remember that capturing and streaming content is just the beginning. In our upcoming blog within the real-time streaming ecosystem series, we will explore Broadcast and provide essential insights for your understanding.

Ready to take your streaming to the next level? Sign up for a free trial of Dolby.io and experience the future of real-time streaming today.

Rose Power

Senior Product Marketing Manager

Rose Power is the Senior Product Marketing Manager for Dolby Millicast. She is driven to build authentic relationships and craft simple solutions in the video-streaming sector. In her downtime, Rose enjoys strumming on her ukulele, tending to her garden, or embarking on hiking adventures with her backpack and pup.

Get Started

Drive real-time interactions and engagement with sub-second latency

We are more than just a streaming solutions provider; we are a technology partner helping you build a streaming ecosystem that meets your goals. Get started for free and as you grow, we offer aggressive volume discounts protecting your margins.

Developer Resources

Explore learning paths and helpful resources as you begin development with Dolby.io.

Copy link
Powered by Social Snap