Android平台AR Core增强图像播放YouTube视频故障求助：仅音频播放无画面显示

Hey there, let's figure out why your YouTube video is only playing audio without any visual on your AR Core augmented image. I’ve worked through similar AR + YouTube integrations before, so here are targeted fixes and checks to get your video displaying properly:

Common Issues & Solutions #

1. Verify ViewRenderable Setup & Visibility #

Your YouTubePlayerView is wrapped in a Sceneform ViewRenderable—if this renderable isn’t initialized correctly, the video view might be hidden or unrendered:

• Double-check that ArResources.youTubeRenderable is built properly with your YouTube layout:

  // Example of correct ViewRenderable initialization (should be in your resources setup)
  ArResources.youTubeRenderable = ViewRenderable.builder()
      .setView(context, R.layout.your_youtube_player_layout)
      .build()
      .also { it.handle { renderable -> /* Confirm no build errors */ } }
  

• Ensure the YouTubePlayerView is explicitly set to visible in your node’s initLayout method:

  override fun initLayout() {
      super.initLayout()
      val youTubePlayer = ArResources.youTubeRenderable.get().view.findViewById<YouTubePlayerView>(R.id.youTubePlayer)
      youTubePlayer.visibility = View.VISIBLE // Critical for ensuring the view renders
      youTubePlayer.setBackgroundColor(Color.TRANSPARENT) // Prevent background from blocking AR content
  }
  

2. Fix SurfaceView/TextureView Compatibility #

YouTube Player uses SurfaceView or TextureView under the hood, which can have quirks with Sceneform’s view rendering:

• Bind the YouTube Player’s lifecycle to your host Activity/Fragment to ensure the surface is properly created and maintained:

  override fun initLayout() {
      super.initLayout()
      val youTubePlayer = ArResources.youTubeRenderable.get().view.findViewById<YouTubePlayerView>(R.id.youTubePlayer)
      
      youTubePlayer.addYouTubePlayerListener(object : AbstractYouTubePlayerListener() {
          override fun onReady(youTubePlayer: YouTubePlayer) {
              // Load your video here (override XML's videoId if needed)
              youTubePlayer.loadVideo(arItemData?.videoId ?: "pIAQV0u72iI", 0f)
          }
      })
      
      // If using the official API, initialize with your YouTube API key
      // youTubePlayer.initialize(YOUR_YOUTUBE_API_KEY, this)
  }
  

• Make sure your Activity has hardware acceleration enabled (required for video rendering):

  <!-- Add this to your Activity declaration in AndroidManifest.xml -->
  <activity android:name=".YourARActivity" android:hardwareAccelerated="true" />
  

3. Adjust AR Node Position & Scaling #

The video view might be hidden behind the augmented image or scaled incorrectly:

• Reposition the node to sit in front of the augmented image to avoid occlusion:

  override fun modifyLayout() {
      super.modifyLayout()
      localRotation = ArResources.youTubeRenderableRotation
      localPosition = Vector3(0f, 0f, 0.1f) // Push the video slightly in front of the image
      
      // Match the video size to the augmented image's dimensions
      image?.let { augImage ->
          val imageExtent = augImage.extent
          localScale = Vector3(imageExtent.x, imageExtent.y, 1f)
      }
  }
  

4. Check Permissions & Logcat for Errors #

• Ensure your app has the INTERNET permission (required to stream YouTube videos):

  <!-- Add to AndroidManifest.xml -->
  <uses-permission android:name="android.permission.INTERNET" />
  

• Check Logcat for YouTube-related errors (search for "YouTubePlayer" or "Surface")—common issues include failed surface creation or network errors that can block video rendering.

Modified Code Example #

Here’s how your YouTubeVideoNode might look after implementing these fixes:

class YouTubeVideoNode : AugmentedImageNode(ArResources.youTubeRenderable) {
    override fun initLayout() {
        super.initLayout()
        val youTubePlayer = ArResources.youTubeRenderable.get().view.findViewById<YouTubePlayerView>(R.id.youTubePlayer)
        
        youTubePlayer.visibility = View.VISIBLE
        youTubePlayer.setBackgroundColor(Color.TRANSPARENT)
        
        youTubePlayer.addYouTubePlayerListener(object : AbstractYouTubePlayerListener() {
            override fun onReady(youTubePlayer: YouTubePlayer) {
                val targetVideoId = arItemData?.videoId ?: "pIAQV0u72iI"
                youTubePlayer.loadVideo(targetVideoId, 0f)
            }
        })
    }

    override fun modifyLayout() {
        super.modifyLayout()
        localRotation = ArResources.youTubeRenderableRotation
        localPosition = Vector3(0f, 0f, 0.1f)
        
        image?.let { augImage ->
            val imageExtent = augImage.extent
            localScale = Vector3(imageExtent.x, imageExtent.y, 1f)
        }
    }
}

内容的提问来源于stack exchange，提问作者Rajesh