Android端Kinesis Video Stream消费播放功能开发咨询

Hey there! Great job getting the Android push-to-Kinesis Video Streams working already—let's walk through how to implement the playback side for cross-device streaming step by step.

1. Set Up Dependencies & Client Initialization #

First, make sure your project has the necessary AWS SDK components for consuming video streams, plus Android media processing libraries:

• Add the AWS Kinesis Video Consumer SDK dependency to your build.gradle (match the version you used for the producer SDK to avoid compatibility issues)
• Initialize the Kinesis Video client with the same AWS region and valid credentials as your producer app (credentials should have permissions for GetMedia and DescribeStream actions)

// Initialize the Kinesis Video client
KinesisVideoClient kinesisVideoClient = KinesisVideoClient.builder()
        .region(Region.of("your-stream-region"))
        .credentialsProvider(DefaultCredentialsProvider.create())
        .build();

2. Fetch Media Fragments from the Stream #

To consume the stream, you'll use the GetMedia API to pull MKV-encapsulated media fragments. You can choose to start playback from the earliest available footage, the latest live frame, or a specific timestamp:

// Build a request to fetch live media
GetMediaRequest getMediaRequest = GetMediaRequest.builder()
        .streamName("your-stream-name")
        .startSelector(StartSelector.builder()
                .startSelectorType(StartSelectorType.NOW) // Use EARLIEST for full history
                .build())
        .build();

// Get the media stream input
GetMediaResponse response = kinesisVideoClient.getMedia(getMediaRequest);
InputStream mediaInputStream = response.payload();

3. Parse MKV & Render Video #

Kinesis Video streams use MKV packaging, so you'll need to parse the stream to extract raw H.264/H.265 video frames, then decode and render them using Android's MediaCodec and a SurfaceView/TextureView:

Key Steps: #

• Parse the MKV stream to extract SPS/PPS metadata (required for decoder initialization) and individual NAL units
• Configure a MediaCodec instance for the video codec type (e.g., video/avc for H.264)
• Feed decoded frames to your view's surface for playback

// Example codec initialization (replace with your stream's actual video params)
MediaCodec videoCodec = MediaCodec.createDecoderByType("video/avc");
MediaFormat videoFormat = MediaFormat.createVideoFormat("video/avc", streamWidth, streamHeight);

// Set SPS/PPS from MKV metadata
videoFormat.setByteBuffer("csd-0", spsByteBuffer);
videoFormat.setByteBuffer("csd-1", ppsByteBuffer);

videoCodec.configure(videoFormat, yourSurfaceView.getHolder().getSurface(), null, 0);
videoCodec.start();

// Process media stream in a background thread
while (isPlaybackActive) {
    // Extract NAL unit from MKV input stream
    ByteBuffer nalUnit = extractNalUnitFromMkv(mediaInputStream);
    if (nalUnit == null) continue;

    // Feed NAL unit to decoder
    int inputBufferIdx = videoCodec.dequeueInputBuffer(1000);
    if (inputBufferIdx >= 0) {
        ByteBuffer inputBuffer = videoCodec.getInputBuffer(inputBufferIdx);
        inputBuffer.clear();
        inputBuffer.put(nalUnit);
        videoCodec.queueInputBuffer(inputBufferIdx, 0, nalUnit.limit(), presentationTimestampUs, 0);
    }

    // Render decoded frame
    MediaCodec.BufferInfo bufferInfo = new MediaCodec.BufferInfo();
    int outputBufferIdx = videoCodec.dequeueOutputBuffer(bufferInfo, 1000);
    if (outputBufferIdx >= 0) {
        videoCodec.releaseOutputBuffer(outputBufferIdx, true); // Render to surface
    }
}

4. Cross-Device Playback Tips #

• Consistent Region & Permissions: All playback devices must use the same AWS region as the producer, and their credentials must have the necessary Kinesis Video permissions
• Network Resilience: Add reconnection logic for network drops—check for stream disconnections and re-initiate the GetMedia request when needed
• Low-Latency Tuning: Use StartSelectorType.NOW to pull the latest live frames, and adjust decoder buffer settings to minimize delay

5. Troubleshooting Common Issues #

• MKV Parsing Errors: Use AWS's built-in MKV parsing utilities (included in the consumer SDK) to handle the stream's specific MKV structure
• Decoder Failures: Double-check that SPS/PPS metadata is correctly passed to MediaFormat—this is critical for decoder initialization
• Permission Denied: Verify your IAM policy includes kinesisvideo:GetMedia and kinesisvideo:DescribeStream actions for the target stream

内容的提问来源于stack exchange，提问作者Abdh-Allah