一. 简介
- 本文是基于RK3568平台，HDMI-IN调试总结。
- 视频桥接芯片：双RK628D
- 驱动代码："kernel\drivers\media\i2c\rk628"(驱动用的是rk628-for-all-v21版本)
- 本次调试的方案功能：HDMI-IN信号通过RK628D转换成MIPI-CSI传到主控SOC
- 参考文档："RKDocs\common\RK628\Rockchip_RK628D_For_All_Porting_Guide_CN_V21.pdf"
- 场景描述： ① RK3568 不直接支持HDMI-IN接口，SOC有MIPI-CSI功能。需将HDMI-IN转换成MIPI-CSI才能获取视频信息。
②此文章使用场景是HDMI-IN通过龙讯switch芯片：LT8641UXE从四个HDMI-IN信号中通过上层应用选择一个HDMI-IN信号输出到RK628D芯片，RK628D再将HDMI-IN信号转换成MIPI-CSI信号输出到RK3588 SOC。通过软件抓取输入进SOC的视频信息。
③ 板上有8个HDMI-IN接口；两个龙讯LT8641UXE芯片；两个RK628D芯片。 因为四个HDMI-IN对应一个龙讯LT8641UXE芯片，对应一个RK628D芯片。
二. 视频桥接芯片RK628D调试
2.1 RK628驱动介绍
- RK628驱动有两个版本，一个是SDK系统自带的版本，一个是RK628-for-all版本。
- RK628 分为 Display 通路和 HDMI IN 通路，SDK 版本 Display 通路基于DRM框架，HDMI IN 通路基于V4L2框架。
- RK628-For-All 版本驱动一样也分为Display 通路和 HDMI IN 通路，Display 通路的驱动于drivers/misc/rk628/ 下，HDMI IN 通路的驱动于drivers/media/i2c/rk628/下。本文采用RK628-For-All 版本HDMI IN 通路：media
- Media 为 RK628 HDMI IN 通路的驱动代码，将RK628D作为类camera设备使用，实现如下功能。
2.2 调试总览，调试步骤分析
调试思路：先把四个HDMI-IN对应一个龙讯LT8641UXE芯片,对应一个RK628D芯片调好。再调另一组。
- 步骤 ① 移植驱动
- 步骤 ② dts编写
- 步骤 ③ 编译烧录
2.3 移植驱动：
① config配置：Rockchip_defconfig:
CONFIG_VIDEO_RK628=y (这是RK628-for-all media驱动开关配置) CONFIG_DRM=y
2.4 dts编写
链接关系 1： sensor1->csi2_dphy1->mipi_csi2->rkcif_mipi_lvds ( vicap 链路 )
链接关系 2： sensor2->csi2_dphy2->rkisp_vir0 ( isp 链路 )
// 链接关系 1： sensor1->csi2_dphy1->mipi_csi2->rkcif_mipi_lvds,第一路index为0，facing配置为back
&i2c2 {
//clock-frequency = <400000>;
status = "okay";
pinctrl-names = "default";
pinctrl-0 = <&i2c2m1_xfer>;
rk628_csi_v4l2: rk628_csi_v4l2@50 {
status = "okay";
reg = <0x50>;
compatible = "rockchip,rk628-csi-v4l2";
interrupt-parent = <&gpio0>;
interrupts = <RK_PB0 IRQ_TYPE_LEVEL_HIGH>;
enable-gpios = <&gpio3 RK_PA5 GPIO_ACTIVE_HIGH>;
reset-gpios = <&gpio4 RK_PD2 GPIO_ACTIVE_LOW>;
//hdcp-enable = <1>;
scaler-en = <1>;
assigned-clocks = <&pmucru CLK_WIFI>;
assigned-clock-rates = <24000000>;
clocks = <&pmucru CLK_WIFI>;
clock-names = "soc_24M";
plugin-det-gpios = <&gpio0 15 GPIO_ACTIVE_LOW>;
rockchip,camera-module-index = <0>;
rockchip,camera-module-facing = "back";
rockchip,camera-module-name = "RK628-CSI";
rockchip,camera-module-lens-name = "NC";
port {
hdmiin_out0: endpoint {
remote-endpoint = <&hdmi_to_mipi_in>;
data-lanes = <1 2>;
};
};
};
};
&csi2_dphy_hw {
status = "okay";
};
&csi2_dphy1 {
status = "okay";
ports {
#address-cells = <1>;
#size-cells = <0>;
port@0 {
reg = <0>;
#address-cells = <1>;
#size-cells = <0>;
hdmi_to_mipi_in: endpoint@1 {
reg = <1>;
remote-endpoint = <&hdmiin_out0>;
data-lanes = <1 2>;
};
};
port@1 {
reg = <1>;
#address-cells = <1>;
#size-cells = <0>;
csidphy_out: endpoint@1 {
reg = <1>;
remote-endpoint = <&mipi_csi2_input>;
data-lanes = <1 2>;
};
};
};
};
&mipi_csi2 {
status = "okay";
ports {
#address-cells = <1>;
#size-cells = <0>;
port@0 {
reg = <0>;
#address-cells = <1>;
#size-cells = <0>;
mipi_csi2_input: endpoint@1 {
reg = <1>;
remote-endpoint = <&csidphy_out>;
data-lanes = <1 2>;
};
};
port@1 {
reg = <1>;
#address-cells = <1>;
#size-cells = <0>;
mipi_csi2_output: endpoint@0 {
reg = <0>;
remote-endpoint = <&cif_mipi_in>;
data-lanes = <1 2>;
};
};
};
};
&rkcif {
status = "okay";
};
&rkcif_mipi_lvds {
status = "okay";
port {
cif_mipi_in: endpoint {
remote-endpoint = <&mipi_csi2_output>;
data-lanes = <1 2>;
};
};
};
&rkcif_mmu {
status = "okay";
};
//链接关系 2： sensor2->csi2_dphy2->rkisp_vir0,第二路index为1，facing配置为front
&i2c2 {
//clock-frequency = <400000>;
status = "okay";
pinctrl-names = "default";
pinctrl-0 = <&i2c2m1_xfer>;
rk628_csi_v4l2_1: rk628_csi_v4l2_1@51 {
status = "okay";
reg = <0x51>;
compatible = "rockchip,rk628-csi-v4l2";
interrupt-parent = <&gpio3>;
interrupts = <RK_PC4 IRQ_TYPE_LEVEL_HIGH>;
//enable-gpios = <&gpio3 RK_PA5 GPIO_ACTIVE_HIGH>;
reset-gpios = <&gpio3 RK_PC5 GPIO_ACTIVE_LOW>;
//hdcp-enable = <1>;
scaler-en = <1>;
assigned-clocks = <&pmucru CLK_WIFI>;
assigned-clock-rates = <24000000>;
clocks = <&pmucru CLK_WIFI>;
clock-names = "soc_24M";
plugin-det-gpios = <&gpio3 0 GPIO_ACTIVE_LOW>;
rockchip,camera-module-index = <1>;
rockchip,camera-module-facing = "front";
rockchip,camera-module-name = "RK628-CSI";
rockchip,camera-module-lens-name = "NC";
port {
hdmiin_out1: endpoint {
remote-endpoint = <&mipi_in_ucam0>;
data-lanes = <1 2>;
};
};
};
};
&csi2_dphy_hw {
status = "okay";
};
&csi2_dphy0 {
status = "disabled";
/delete-node/ ports;
};
&csi2_dphy2 {
status = "okay";
ports {
#address-cells = <1>;
#size-cells = <0>;
port@0 {
reg = <0>;
#address-cells = <1>;
#size-cells = <0>;
mipi_in_ucam0: endpoint@0 {
reg = <0>;
remote-endpoint = <&hdmiin_out1>;
data-lanes = <1 2>;
};
};
port@1 {
reg = <1>;
#address-cells = <1>;
#size-cells = <0>;
csidphy_out1: endpoint@0 {
reg = <0>;
remote-endpoint = <&isp0_in>;
};
};
};
};
&rkisp {
status = "okay";
};
&rkisp_mmu {
status = "okay";
};
&rkisp_vir0 {
status = "okay";
port {
#address-cells = <1>;
#size-cells = <0>;
isp0_in: endpoint@0 {
reg = <0>;
remote-endpoint = <&csidphy_out1>;
};
};
};三. 调试命令：
- 查看media设备：
ls /dev/media*/dev/media0 /dev/media1- i2c设备的通用调试命令：查看设备是否挂载到i2c总线下：
i2cdetect -y 2- 查看media节点的拓扑结构命令：
media-ctl -d /dev/media0 -p
media-ctl -d /dev/media1 -p
media-ctl -p- 抓图命令：
v4l2-ctl -d /dev/video0 --set-fmt-video=width=1920,height=1080,pixelformat=NV12 --stream-mmap=3 --stream-skip=100 --stream-to=/oem/NV12.yuv --stream-count=1 --stream-poll