图像美学评分处理器,智能评估图像的审美质量和构图效果
输入列名 | 说明 |
|---|---|
image_inputs | 包含输入图像的数组 |
包含美学评分的浮点数组,评分范围0.0-1.0,
无法解码或处理失败的图像返回null值
如参数没有默认值,则为必填参数
参数名称 | 类型 | 默认值 | 描述 |
|---|---|---|---|
batch_size | int | 32 | 批处理大小,控制单次推理处理的图像数量 默认值:32 |
model_path | str | /data00/tiger/las/models | 模型文件存储路径 默认值:'/data00/tiger/las/models' |
clip_model_name | str | openai/clip-vit-large-patch14 | CLIP视觉模型名称 默认值:'openai/clip-vit-large-patch14' |
mlp_model_name | str | laion_aesthetic_v2/sac+logos+ava1-l14-linearMSE.pth | MLP评分模型名称 默认值:'laion_aesthetic_v2/sac+logos+ava1-l14-linearMSE.pth' |
device | str | cpu | 设备类型,支持CPU和GPU设备 默认值:"cpu" 可选值:"cpu", "cuda", "cuda:0", "cuda:1"等 |
下面的代码展示了如何使用 Daft(适用于分布式)运行算子对图像进行美学质量评分。
from __future__ import annotations import os import daft from daft import col from daft.las.functions.image import ImageAestheticScore from daft.las.functions.udf import las_udf if __name__ == "__main__": TOS_TEST_DIR_URL = os.getenv("TOS_TEST_DIR_URL", "las-cn-beijing-public-online.tos-cn-beijing.volces.com") model_path = os.getenv("MODEL_PATH", "./models") if os.getenv("DAFT_RUNNER", "native") == "ray": import logging import ray def configure_logging(): logging.basicConfig( level=logging.INFO, format="%(asctime)s - %(name)s - %(levelname)s - %(message)s", datefmt="%Y-%m-%d %H:%M:%S", ) logging.getLogger("tracing.span").setLevel(logging.WARNING) logging.getLogger("daft_io.stats").setLevel(logging.WARNING) logging.getLogger("DaftStatisticsManager").setLevel(logging.WARNING) logging.getLogger("DaftFlotillaScheduler").setLevel(logging.WARNING) logging.getLogger("DaftFlotillaDispatcher").setLevel(logging.WARNING) ray.init(dashboard_host="0.0.0.0", runtime_env={"worker_process_setup_hook": configure_logging}) daft.context.set_runner_ray() daft.set_execution_config(actor_udf_ready_timeout=600) daft.set_execution_config(min_cpu_per_task=0) samples = { "input_path": [f"https://{TOS_TEST_DIR_URL}/public/archive/image_aesthetic_score/forest.jpg"], } ds = daft.from_pydict(samples) # Using Daft to calculate aesthetic scores for images constructor_kwargs = { "model_path": model_path, "image_src_type": "image_url", "batch_size": 1, } ds = ds.with_column( "aesthetic_score", las_udf( ImageAestheticScore, construct_args=constructor_kwargs, num_cpus=1, concurrency=1, batch_size=1, )(col("input_path")), ) ds.show() # ╭────────────────────────────────┬────────────────────╮ # │ input_path ┆ aesthetic_score │ # │ --- ┆ --- │ # │ Utf8 ┆ Float64 │ # ╞════════════════════════════════╪════════════════════╡ # │ https://las-public-data-qa.to… ┆ 0.5603389739990234 │ # ╰────────────────────────────────┴────────────────────╯