Changes

CS-MIPI-IMX307 for Jetson Nano/zh (view source)

Revision as of 09:19, 30 March 2020

1,240 bytes added , 09:19, 30 March 2020

Line 1: Line 1:

[[CS-MIPI-IMX307 for Jetson Nano|English]]

−

~~[[VEYE MIPI 290/327 for Jetson Nano/zh|~~<big><big><big><big>如何在英伟达Jetson Nano平台使用CS-MIPI-IMX307摄像头模组</big></big></big></big>]]

+

<big><big><big><big>如何在英伟达Jetson Nano平台使用CS-MIPI-IMX307摄像头模组</big></big></big></big>

===概述===

本文讲述怎样将CS-MIPI-IMX307 模组接入到英伟达公司的Jetson Nano开发板上。采用的Jetson Nano软件版本为r32.2.1，我们提供了编译好的固件和源代码两种方式来方便用户的使用。

CS-MIPI-IMX307是星光级内置ISP的摄像头模组，输出为MIPI-CSI2接口UYVY流模式，支持1080p@30fps和720pcrop@60模式。对于图像效果参数，我们并没有采用V4L2接口实现，而是采用了Shell脚本直接控制摄像头模组寄存器来实现。

+

已支持Jetson Nano B01新版本。

===硬件准备及安装===

Jetson Nano的CSI2接口可以直接与CS-MIPI-IMX307连接。此外，需要额外的5V供电。

Line 11: Line 13:

−

+

[[File:Jetson Nano B01 001.jpg|center|thumb|600x600px|CS-MIPI-307 dual cameras connect to Jetson Nano B01 ]]

===使用编译好的整体镜像更新Jetson nano系统===

Line 36: Line 38:

*NVIDIA® provided L4T release and corresponding sample rootfs for Jetson Nano™ development kit.

−

*A kernel image , device tree blob (DTB) file and module drivers for the ~~VEYE~~-MIPI-~~290/327~~ camera. The release package contains a kernel binary (Image),DTB files and module drivers, which you can download and rebuild from source.

+

*A kernel image , device tree blob (DTB) file and module drivers for the CS-MIPI-IMX307 camera. The release package contains a kernel binary (Image),DTB files and module drivers, which you can download and rebuild from source.

*A jumper pin connected across J48 button header to enable DC power.

Line 43: Line 45:

*Power cable (5V-4A) to power the Jetson Nano™ board.

*Micro SD card must be connected to the J501 slot.

−

*A jumper pin must be connected to the pin 3 and pin 4 of J40 button header.

====Host PC开发环境准备====

Line 62: Line 63:

<code>export L4T_DIR=$TOP_DIR/Linux_for_Tegra</code>

+

<code>export LOCALVERSION=-tegra</code>

<code>export LDK_ROOTFS_DIR=$TOP_DIR/Linux_for_Tegra/rootfs</code>

Line 77: Line 80:

<code>export NVIDIA_PATH=$L4T_DIR/sources/kernel/nvidia</code>

−

<code>export NANO_DTS_PATH=$L4T_DIR/sources/hardware/nvidia/platform/t210/~~porg/kernel-dts~~</code>

+

<code>export NANO_DTS_PATH=$L4T_DIR/sources/hardware/nvidia/platform/t210/</code>

*生成默认版本烧写镜像，准备好L4T环境

Line 89: Line 92:

−

<code>git clone [https://github.com/veyeimaging/~~jetson_nano https://github~~.~~com~~/~~veyeimaging/cs-mipi-imx307_jetson_nano].git~~</code>

+

<code>git clone <nowiki>https://github.com/veyeimaging/nvidia_jetson_veye_bsp.git</nowiki></code>

−

<code>export RELEASE_PACK_DIR=$L4T_DIR/~~cs-mipi-imx307_jetson_nano~~</code>

+

<code>export RELEASE_PACK_DIR=$L4T_DIR/nvidia_jetson_veye_bsp</code>

====使用编译好的Image和DTB====

=====Installing the Kernel and DTS=====

−

<code>cd $RELEASE_PACK_DIR/~~binaries~~</code>

+

<code>cd $RELEASE_PACK_DIR/kernel_image</code>

−

<code>tar -xzvf ~~Image~~.tar.gz</code>

+

<code>tar -xzvf Image_l4t_r32.2.1_veyecam.tar.gz</code>

<code>sudo cp Image $L4T_DIR/kernel/ -f</code>

−

<code>sudo cp $RELEASE_PACK_DIR/~~binaries~~/tegra210-p3448-0000-p3449-0000-a02.dtb $L4T_DIR/kernel/dtb/tegra210-p3448-0000-p3449-0000-~~a02~~.dtb -f</code>

+

<code>sudo cp $RELEASE_PACK_DIR/Nano/JetPack_4.2.2_Linux_GA_P3448/dts\ dtb/CS-MIPI-IMX307/tegra210-p3448-0000-p3449-0000-a02.dtb $L4T_DIR/kernel/dtb/ -f</code>

+

<code>sudo cp $RELEASE_PACK_DIR/Nano/JetPack_4.2.2_Linux_GA_P3448/dts\ dtb/CS-MIPI-IMX307/tegra210-p3448-0000-p3449-0000-b00.dtb $L4T_DIR/kernel/dtb/ -f</code>

Line 112: Line 117:

a. Power OFF the board.

−

b. Connect the jumper pin to the pin 3 and pin 4 of the J40 button header.

+

b. For Jetson Nano A02: Connect the jumper pin to the pin 3 and pin 4 of the J40 button header. For Jetson Nano B01: Connect the jumper pin to the pin 9 and pin 10 of the J50 button header.

c. Power ON the Jetson Nano™ development kit.

Line 142: Line 147:

*patch代码

−

<code>cp $RELEASE_PACK_DIR/~~sources/kernel~~/cs_imx307/* $NVIDIA_PATH/drivers/media/i2c/</code>

+

<code>cp $RELEASE_PACK_DIR/drivers_source/cs_imx307\ veye327/* $NVIDIA_PATH/drivers/media/i2c/</code>

−

<code>cp $RELEASE_PACK_DIR/~~sources/kernel~~/~~kernel_csimx307_config~~ $L4T_DIR/sources/kernel/kernel-4.9/arch/arm64/configs/~~tegra_csimx307_defconfig~~</code>

+

<code>cp $RELEASE_PACK_DIR/drivers_source/kernel_csimx307veye327_config $L4T_DIR/sources/kernel/kernel-4.9/arch/arm64/configs/tegra_csimx307veye327_defconfig</code>

*编译

Line 150: Line 155:

<code>cd $L4T_DIR/sources/kernel/kernel-4.9/</code>

−

<code>make ARCH=arm64 O=$TEGRA_KERNEL_OUT ~~tegra_csimx307_defconfig~~</code>

+

<code>make ARCH=arm64 O=$TEGRA_KERNEL_OUT tegra_csimx307veye327_defconfig</code>

<code>make ARCH=arm64 O=$TEGRA_KERNEL_OUT Image -j4</code>

Line 163: Line 168:

*patch代码

−

<code>cp $RELEASE_PACK_DIR/~~sources~~/dts/~~kernel-dts~~/* $NANO_DTS_PATH/</code>

+

<code>cp $RELEASE_PACK_DIR/Nano/JetPack_4.2.2_Linux_GA_P3448/dts\ dtb/common/t210/* -r $NANO_DTS_PATH/</code>

−

<code>cp $RELEASE_PACK_DIR/~~sources~~/dts/~~kernel~~-~~dts~~/porg-platforms/* $NANO_DTS_PATH/porg~~-platforms/</code>~~

+

<code>cp $RELEASE_PACK_DIR/Nano/JetPack_4.2.2_Linux_GA_P3448/dts\ dtb/CS-MIPI-IMX307/tegra210-porg-plugin-manager.dtsi -r $NANO_DTS_PATH/porg/kernel-dts/porg-plugin-manager</code>

−

~~<code>cp $RELEASE_PACK_DIR/sources/dts~~/kernel-dts/porg-plugin-manager~~/* $NANO_DTS_PATH/porg-plugin-manager/~~</code>

*编译

Line 174: Line 177:

<code>cp $TEGRA_KERNEL_OUT/arch/arm64/boot/dts/tegra210-p3448-0000-p3449-0000-a02.dtb $L4T_DIR/kernel/dtb/</code>

+

<code>cp $TEGRA_KERNEL_OUT/arch/arm64/boot/dts/tegra210-p3448-0000-p3449-0000-b00.dtb $L4T_DIR/kernel/dtb/</code>

编译完成后，可以进行整体烧写或者动态升级。

Line 201: Line 206:

应当有如下提示：

−

<code>subdev csx307 6-003b bound</code>

+

<code>subdev csx307 6/7/8-003b bound</code>

−

此外，检查/dev/~~video0设备节点，应当是存在的。~~

+

此外，检查/dev/video0(1)设备节点，应当是存在的。

====视频流软件包和测试====

=====Gstreamer Usage=====

Line 214: Line 219:

<code>gst-launch-1.0 v4l2src ! "video/x-raw,format=(string)UYVY, width=(int)1280, height=(int)720, framerate=(fraction)60/1" ! nvvidconv ! "video/x-raw(memory:NVMM),format=(string)I420" ! nvoverlaysink sync=false</code>

+

*并列预览两路视频 1080p HD(硬件加速)

+

<code>WIDTH=960</code>

+

<code>HEIGHT=540</code>

+

<code>CAPS="video/x-raw,format=(string)UYVY, width=1920, height=1080"</code>

+

<code>gst-launch-1.0 nvcompositor name=comp sink_0::xpos=0 sink_0::ypos=0 sink_0::width=$WIDTH sink_0::height=$HEIGHT sink_1::xpos=$WIDTH sink_1::ypos=0 sink_1::width=$WIDTH sink_1::height=$HEIGHT ! nvoverlaysink v4l2src device=/dev/video0 ! $CAPS ! nvvidconv ! "video/x-raw(memory:NVMM),format=(string)I420"! comp. v4l2src device=/dev/video1 ! $CAPS ! nvvidconv ! "video/x-raw(memory:NVMM),format=(string)I420"! comp.</code>

*视频录像1080p HD（硬件加速）

−

<code>gst-launch-1.0 v4l2src ! "video/x-raw,format=(string)UYVY, width=(int)1920, height=(int)1080" ! nvvidconv ! "video/x-raw(memory:NVMM),format=(string)I420" ! omxh264enc qp-range=20,20:20,20:-1,-1 ! matroskamux ! queue ! filesink location=videoname.mkv</code>

+

<code>gst-launch-1.0 v4l2src num-buffers=300 ! "video/x-raw,format=(string)UYVY, width=(int)1920, height=(int)1080" ! nvvidconv ! "video/x-raw(memory:NVMM),format=(string)I420" ! omxh264enc qp-range=20,20:20,20:-1,-1 ! matroskamux ! queue ! filesink location=videoname.mkv</code>

*录像回放（硬件加速）

Line 231: Line 246:

<code>gst-launch-1.0 v4l2src num-buffers=1 ! "video/x-raw,format=(string)UYVY, width=(int)1280, height=(int)720" ! jpegenc ! filesink location=jpgname.jpg</code>

====视频控制软件包的使用====

−

Jetson ~~Nano使用i2c~~-~~6作为摄像头的控制总线。~~

+

Jetson Nano A02使用i2c-6作为摄像头的控制总线。Jetson Nano B01使用i2c-7和i2c-8作为摄像头的控制总线。

+

执行i2c控制脚本时，需使用-b选项来指明控制的对应摄像头。

−

<code>cd $~~L4T_DIR/jetson_nano~~/i2c_cmd/bin</code>

+

<code>cd $RELEASE_PACK_DIR/i2c_cmd/bin</code>

具体使用说明请见：[[CS-MIPI-X i2c/zh|I2C脚本使用说明]]。

===其他说明===

有任何的改进意见，欢迎您发邮件到xumm#csoneplus.com。

Xumm

Administrators

2,020

edits

Changes

CS-MIPI-IMX307 for Jetson Nano/zh (view source)

Revision as of 09:19, 30 March 2020

Navigation menu

Search