音频元数据提取算子
包含以下字段的结构化数组:
输入列名 | 说明 |
|---|---|
input_col | 输入文件路径的数组 |
包含元数据的结构化数组
如参数没有默认值,则为必填参数
参数名称 | 类型 | 默认值 | 描述 |
|---|---|---|---|
timeout | int or None | None | ffprobe 命令执行超时时间(秒) 默认值:None (无超时) |
下面的代码展示了如何使用 Daft(适用于分布式)运行算子提取音频文件的元数据信息。
from __future__ import annotations import os import daft from daft import col from daft.las.functions.audio import AudioMetadataExtract from daft.las.functions.udf import las_udf if __name__ == "__main__": TOS_TEST_DIR_URL = os.getenv("TOS_TEST_DIR_URL", "las-cn-beijing-public-online.tos-cn-beijing.volces.com") if os.getenv("DAFT_RUNNER", "native") == "ray": import logging import ray def configure_logging(): logging.basicConfig( level=logging.INFO, format="%(asctime)s - %(name)s - %(levelname)s - %(message)s", datefmt="%Y-%m-%d %H:%M:%S", ) logging.getLogger("tracing.span").setLevel(logging.WARNING) logging.getLogger("daft_io.stats").setLevel(logging.WARNING) logging.getLogger("DaftStatisticsManager").setLevel(logging.WARNING) logging.getLogger("DaftFlotillaScheduler").setLevel(logging.WARNING) logging.getLogger("DaftFlotillaDispatcher").setLevel(logging.WARNING) ray.init(dashboard_host="0.0.0.0", runtime_env={"worker_process_setup_hook": configure_logging}) daft.context.set_runner_ray() daft.set_execution_config(actor_udf_ready_timeout=600) daft.set_execution_config(min_cpu_per_task=0) samples = { "input_path": [ f"https://{TOS_TEST_DIR_URL}/public/archive/audio_metadata_extract/sample.wav", ], } ds = daft.from_pydict(samples) # Using Daft to extract audio metadata constructor_kwargs = { "timeout": 600, } ds = ds.with_column( "metadata", las_udf( AudioMetadataExtract, construct_args=constructor_kwargs, num_cpus=1, concurrency=1, batch_size=1, )(col("input_path")), ) ds.show() # ╭────────────────────────────────┬──────────────────────────────────────────────────────────────────────────────╮ # │ input_path ┆ metadata │ # │ --- ┆ --- │ # │ String ┆ Struct[duration: Float64, format_name: String, bit_rate: Int64, audio_codec: │ # │ ┆ String, audio_sample_rate: Int32, audio_channels: Int32] │ # ╞════════════════════════════════╪══════════════════════════════════════════════════════════════════════════════╡ # │ https://las-public-data-qa.to… ┆ {duration: 49.71102, │ # │ ┆ format_n… │ # ╰────────────────────────────────┴──────────────────────────────────────────────────────────────────────────────╯