如何用OpenCV读取Orbbec Astra Mini的RGB图与深度图？报错求助

Hey there! Let's work through your Orbbec Astra Mini + OpenCV runtime issue. Since your code compiles fine but throws errors when running (and you suspect it's a device access problem), here are some practical, targeted fixes to try out:

• Confirm OpenCV was built with OpenNI2 support
  Most pre-built OpenCV binaries don't include OpenNI2 bindings by default. If you used a pre-packaged version, double-check if it has OpenNI2 integration. If not, you'll need to recompile OpenCV from source—enable the WITH_OPENNI2 flag in CMake during the build process to ensure the two libraries can communicate.

• Set up OpenNI2 environment variables correctly
  Windows needs to locate OpenNI2's libraries at runtime. Add these system environment variables:

  • OPENNI2_INCLUDE: Path to your OpenNI2 header files (e.g., C:\Program Files\OpenNI2\Include)
  • OPENNI2_REDIST: Path to the OpenNI2 Redist folder (e.g., C:\Program Files\OpenNI2\Redist)
    Also, copy the core OpenNI2 DLLs (like OpenNI2.dll) into your project's output directory, or add their folder to your system PATH variable.

• Rule out USB and permission issues
  Even if Device Manager recognizes the sensor, small hardware/permission quirks can block access:

  • Switch to a USB 3.0 port (Astra Mini performs better and has more reliable connectivity with USB 3.0)
  • Disable USB selective suspend in Power Options: Go to Control Panel > Power Options > Change plan settings > Change advanced power settings > USB settings > USB selective suspend setting > Disabled
  • Run Visual Studio as Administrator—device access sometimes requires elevated privileges.

• Test OpenNI2 device detection first
  Before diving into OpenCV, confirm OpenNI2 can see your sensor on its own. Create a quick test program:

  #include <OpenNI.h>
  #include <iostream>
  
  using namespace openni;
  
  int main() {
      Status initStatus = OpenNI::initialize();
      if (initStatus != STATUS_OK) {
          std::cout << "OpenNI init failed: " << OpenNI::getExtendedError() << std::endl;
          return 1;
      }
  
      Array<DeviceInfo> deviceList;
      OpenNI::enumerateDevices(&deviceList);
      std::cout << "Detected " << deviceList.getSize() << " devices:\n";
      for (int i = 0; i < deviceList.getSize(); ++i) {
          std::cout << "- " << deviceList[i].getName() << "\n";
      }
  
      OpenNI::shutdown();
      return 0;
  }
  

  If this doesn't find your Astra Mini, the problem lies with OpenNI2 setup—not OpenCV. Fix that first before moving forward.

• Adjust your OpenCV VideoCapture initialization
  When accessing the sensor via OpenCV, you need to explicitly use the OpenNI2 backend. Replace generic device initialization with:

  // Explicitly use OpenNI2 backend
  cv::VideoCapture cap(cv::CAP_OPENNI2);
  // Or target a specific device index if multiple are connected:
  // cv::VideoCapture cap(cv::CAP_OPENNI2 + 0);
  

  Also, make sure you're retrieving frames with the correct flags:

  cv::Mat rgbFrame, depthFrame;
  if (cap.isOpened()) {
      while (true) {
          cap.grab();
          // Retrieve RGB in BGR format (OpenCV's default)
          cap.retrieve(rgbFrame, cv::CAP_OPENNI_BGR_IMAGE);
          // Retrieve depth map
          cap.retrieve(depthFrame, cv::CAP_OPENNI_DEPTH_MAP);
  
          if (!rgbFrame.empty() && !depthFrame.empty()) {
              cv::imshow("RGB Feed", rgbFrame);
              cv::imshow("Depth Map", depthFrame);
          }
  
          // Exit on ESC key press
          if (cv::waitKey(1) == 27) break;
      }
      cap.release();
      cv::destroyAllWindows();
  } else {
      std::cerr << "Failed to open device via OpenNI2!\n";
      return 1;
  }
  

• Update your Astra driver
  Outdated drivers can cause conflicts with OpenNI2 and OpenCV. Uninstall your current Astra driver, download the latest compatible version for Windows 10 from Orbbec's official resources, and reinstall it—follow their setup instructions closely, including restarting your system after installation.

内容的提问来源于stack exchange，提问作者salocinx