VEYE CS Camera on Radxa Boards - Revision history

Xumm: /* Compile drivers and dtb from source code */

2025-01-09T01:33:34Z

Compile drivers and dtb from source code

Xumm: /* Introduction to github repositories */

2024-11-26T02:30:21Z

Introduction to github repositories

Xumm: /* Introduction to github repositories */

2024-04-25T06:47:22Z

Introduction to github repositories

Xumm: /* Upgrade Radxa Debain system */

2024-04-25T06:46:19Z

Upgrade Radxa Debain system

Xumm: /* kernel version 4.19 */

2024-04-24T09:30:54Z

kernel version 4.19

Xumm: /* Connection of Camera and Radxa ZERO 3W Board */

2024-04-24T09:28:47Z

Connection of Camera and Radxa ZERO 3W Board

Xumm at 09:24, 24 April 2024

2024-04-24T09:24:54Z

Show changes

Xumm: Created page with "'''How to use VEYE and CS series cameras on Radxa's RK35XX board''' 查看中文 ===Overview=== VEYE series cameras are the v..."

2024-04-24T07:19:49Z

Created page with "'''<big>How to use VEYE and CS series cameras on Radxa's RK35XX board</big>''' 查看中文 ===Overview=== VEYE series cameras are the v..."

New page

'''<big>How to use VEYE and CS series cameras on Radxa's RK35XX board</big>'''

[[VEYE CS Camera on Radxa Boards/zh|查看中文]]
===Overview===
VEYE series cameras are the video streaming mode MIPI cameras we designed. This article takes Radxa's ZERO 3W board as an example to introduce how to connect VEYE series cameras to RK3566/RK3568/RK3588 system.

We provide drivers for Linux.
====Camera Module List====
{| class="wikitable"
!Series
!Model
!Status
|-
|VEYE Series
|VEYE-MIPI-IMX327S
|Done
|-
|VEYE Series
|VEYE-MIPI-IMX462
|Done
|-
|VEYE Series
|VEYE-MIPI-IMX385
|Done
|}In addition, the driver for the Fpdlink connection mode has been finished on the Linux system.
===Hardware Setup===
Radxa ZERO 3W provides a 22-pin connector compatible with Raspberry Pi, allowing our camera to be installed on its motherboard without the need for an adapter board.
====Connection of camera and ADP-TRadxa====
The two are connected using 1.0 mm pitch*15P FFC cable with opposite direction. The cable must be inserted with the silver contacts facing outside.[[File:VEYE-MIPI-327S-ADP-Tfirefly 06.jpg|link=http://wiki.veye.cc/index.php/File:VEYE-MIPI-327S-ADP-Tfirefly%2006.jpg|center|thumb|800x800px|VEYE camera connect to ADP-TRadxa]]
====Connection of ADP-TRadxa and Radxa Board====
The two are connected using 0.5 mm pitch*30P FFC cable with same direction. The cable must be inserted with the silver contacts facing inside.[[File:VEYE-MIPI-327S-ADP-Tfirefly 05.jpg|link=http://wiki.veye.cc/index.php/File:VEYE-MIPI-327S-ADP-Tfirefly%2005.jpg|center|thumb|800x800px|ADP-TRadxa connect to Radxa board]]
====Overall connection====
[[File:VEYE-MIPI-327S-ADP-Tfirefly 04.jpg|link=http://wiki.veye.cc/index.php/File:VEYE-MIPI-327S-ADP-Tfirefly%2004.jpg|center|thumb|800x800px|Radxa Board and VEYE camera overall]]
====FPD-Link III Camera Connection Diagram====
[[File:FPDLINK Camera to RK3588S.png|center|thumb|800x800px|FPDLINK Camera to RK3588S|link=http://wiki.veye.cc/index.php/File:FPDLINK_Camera_to_RK3588S.png]]<br />
===Introduction to github repositories===
[https://github.com/veyeimaging/rk35xx_firefly https://github.com/veyeimaging/rk35xx_Radxa]

includes：

*driver source code
*i2c toolkits
*application demo

In addition, a compiled linux kernel installation package and Android image is provided in the [https://github.com/veyeimaging/rk356x_firefly/releases releases].
===Ubuntu===
====Upgrade Radxa Ubuntu system（RK356x）====
=====Overview=====
This section describes how to update the RK35xx system to support our camera modules.

For the kernel version 4.19, we provide a deb installation package that can be installed directly.

For the kernel version 5.10, we provide a burning image.

For versions where no installer is provided, you will need to refer to later chapters to compile from the driver source code.

Although we are now using Ubuntu system as an example to introduce, other Linux distributions can also refer to this article.
=====kernel version 5.10=====
For the ROC-RK3588S-PC, we have provided an image of the release system.

Download the latest released image file corresponding to the camera model you are using from [https://github.com/veyeimaging/rk35xx_firefly/releases/ https://github.com/veyeimaging/rk35xx_Radxa/releases/] .

Refer to the [https://wiki.t-firefly.com/en/ROC-RK3566-PC/03-upgrade_firmware.html Radxa documentation] to burn in a standard system.
=====kernel version 4.19=====
======Burn Radxa standard system======
Refer to the [https://wiki.t-firefly.com/en/ROC-RK3566-PC/01-bootmode.html Radxa documentation] to burn in a standard system.
======Using prebuilt Image and dtb file======
Using the compiled debain installation package

On the RK35xx board,

Download the latest rk356x_Radxa_ubuntu.tar.gz from [https://github.com/veyeimaging/rk35xx_firefly/releases/ https://github.com/veyeimaging/rk35xx_Radxa/releases/] .

<code>tar -xavf rk356x_Radxa.tar.gz</code>

<code>cd rk356x_Radxa/released_images/ROC-RK3566-PC/ubuntu/</code>

<code>sudo dpkg -i linux-image-4.19.232_4.19.232-21_arm64.deb</code>

If the version does not match, it needs to be compiled from the source code.
====Upgrade Radxa Ubuntu system（RK358x）====
For the ROC-RK3588S-PC, we have provided an image of the release system.

Download the latest released image file corresponding to the camera model you are using from [https://github.com/veyeimaging/rk35xx_firefly/releases/ https://github.com/veyeimaging/rk35xx_Radxa/releases/] .

Refer to the [https://wiki.t-firefly.com/en/ROC-RK3588S-PC/upgrade_bootmode.html Radxa documentation] to burn in a standard system.
====Check system status====
Run the following command to confirm whether the camera is probed.

*VEYE-MIPI-XXX

<code>dmesg | grep veye</code>

The output message appears as shown below：

<code>veyecam2m 4-003b: camera id is veyecam2m</code>

<code>veyecam2m 4-003b: sensor is IMX327</code>

*Run the following command to check the presence of video node.

<code>ls /dev/video0</code>

The output message appears as shown below.

<code>video0</code>

For ROC-RK3566-PC, the camera is connected to i2c-4, for ROC-RK3588S-PC to i2c-7.
====Application examples====
=====v4l2-ctl=====
======Install v4l2-utils======
<code>sudo apt-get install v4l-utils</code>
======List the data formats supported by the camera======
<code>v4l2-ctl --list-formats-ext</code>
======Snap YUV picture======
<code>v4l2-ctl --set-fmt-video=width=1920,height=1080,pixelformat='NV12' --stream-mmap --stream-count=100 --stream-to=nv12-1920x1080.yuv</code>

For RK3566, also:

<code>v4l2-ctl --set-fmt-video=width=1920,height=1080,pixelformat=UYVY --stream-mmap --stream-count=1 --stream-to=uyvy-1920x1080.yuv</code>

Play YUV picture

<code>ffplay -f rawvideo -video_size 1920x1080 -pix_fmt nv12 nv12-1920x1080.yuv</code>
======Check frame rate======
<code>v4l2-ctl --set-fmt-video=width=1920,height=1080,pixelformat=UYVY --stream-mmap --stream-count=-1 --stream-to=/dev/null</code>
=====yavta=====
<code>git clone <nowiki>https://github.com/veyeimaging/yavta.git</nowiki></code>

<code>cd yavta;make</code>

<code>./yavta -c1 -Fnv12-1920x1080.yuv --skip 0 -f NV12 -s 1920x1080 /dev/video0</code>
=====gstreamer=====
We provide several gstreamer routines that implement the preview, capture, and video recording functions. See the [https://github.com/veyeimaging/rk356x_firefly/tree/main/linux/samples samples] directory on github for details.
=====Import to OpenCV=====
First install OpenCV:

<code>sudo apt install python3-opencv</code>

We provide several routines to import camera data into opencv. See the [https://github.com/veyeimaging/rk356x_firefly/tree/main/linux/samples samples] directory on github for details.

In addition, this [https://wiki.t-firefly.com/en/Firefly-Linux-Guide/demo_OpenCV_support.html page] from Radxa has some reference value.
====Compile drivers and dtb from source code====

*RK356x

[https://github.com/veyeimaging/rk35xx_firefly/tree/main/linux/drivers/rk356x https://github.com/veyeimaging/rk35xx_Radxa/tree/main/linux/drivers/rk356x]

*RK358x

[https://github.com/veyeimaging/rk35xx_firefly/tree/main/linux/drivers/rk358x https://github.com/veyeimaging/rk35xx_Radxa/tree/main/linux/drivers/rk358x]
===i2c script for parameter configuration===
Because of the high degree of freedom of our camera parameters, we do not use V4L2 parameters to control, but use scripts to configure parameters.

[https://github.com/veyeimaging/rk35xx_firefly/tree/main/i2c_cmd https://github.com/veyeimaging/rk35xx_Radxa/tree/main/i2c_cmd]

using -b option to identify which bus you want to use.

*VEYE series

Video Control Toolkits Manual ：[[VEYE-MIPI-290/327 i2c/|VEYE-MIPI-327 I2C]]

*CS series

Video Control Toolkits Manual ：[[CS-MIPI-X i2c|CS-MIPI-X I2C]]
===Android===
====Update Android system====

*ROC-RK3566-PC

Download the latest rk356x_Radxa_android.tar.gz from [https://github.com/veyeimaging/rk35xx_firefly/releases/ https://github.com/veyeimaging/rk35xx_Radxa/releases/]

*ROC-RK3588S-PC

Download the latest rk358x_Radxa_android.tar.gz from [https://github.com/veyeimaging/rk35xx_firefly/releases/ https://github.com/veyeimaging/rk35xx_Radxa/releases/]

Burn the system refer to Radxa's documentation.
====Check system status====
Login system via ADB, then run the following command to confirm whether the camera is probed.

*VEYE-MIPI-XXX

<code>dmesg | grep veye</code>

The output message appears as shown below：

<code>veyecam2m 4-003b: camera id is veyecam2m</code>

<code>veyecam2m 4-003b: sensor is IMX327</code>

*Run the following command to check the presence of video node.

<code>ls /dev/video0</code>

The output message appears as shown below.

<code>video0</code>

The camera can be seen connected to the i2c-4.
====Application example====
The camera can be opened using the camera program that comes with the system.
====Compile system from source code====

*RK356x

[https://github.com/veyeimaging/rk35xx_firefly/tree/main/android/rk356x/drivers https://github.com/veyeimaging/rk35xx_Radxa/tree/main/android/rk356x/drivers]

*RK358x

[https://github.com/veyeimaging/rk35xx_firefly/tree/main/android/rk358x/drivers https://github.com/veyeimaging/rk35xx_Radxa/tree/main/android/rk358x/drivers]
===Known issues===

#The VICAP module of RK3588 does not support outputting the UYVY format, so please use the NV12 format instead.

===References===

*ROC-RK3566-PC Manual

[https://wiki.t-firefly.com/en/ROC-RK3566-PC/ https://wiki.t-Radxa.com/en/ROC-RK3566-PC/]

*ROC-RK3588S-PC Manual

[https://wiki.t-firefly.com/en/ROC-RK3588S-PC/ https://wiki.t-Radxa.com/en/ROC-RK3588S-PC/]

*Radxa Linux User Guide

[https://wiki.t-firefly.com/en/Firefly-Linux-Guide/index.html https://wiki.t-Radxa.com/en/Radxa-Linux-Guide/index.html]
===Document History===

*2024-04-17

Support kernel v5.10 on RK3566.

*2023-05-22

Support Fpdlink-III on ubuntu system.

*2022-12-28

Add support for RK358x.

*2022-12-06

Support Android system.

*2022-10-22

Release 1st version.

@@ Line 32: / Line 32: @@
 <br />
 ===Introduction to github repositories===
 https://github.com/veyeimaging/rk35xx_radxa

@@ Line 53: / Line 53: @@
 On the RK35xx board,
-Download the latest rk356x_Radxa_ubuntu.tar.gz from [https://github.com/veyeimaging/rk35xx_firefly/releases/ https://github.com/veyeimaging/rk35xx_Radxa/releases/] .
+Download the latest rk356x_Radxa_ubuntu.tar.gz from [https://github.com/veyeimaging/rk35xx_radxa/releases/ https://github.com/veyeimaging/rk35xx_Radxa/releases/] .
 <code>tar -xavf rk356x_radxa_zero3w.tar.gz</code>

@@ Line 27: / Line 27: @@
 Radxa ZERO 3W provides a 22-pin connector compatible with Raspberry Pi, allowing our camera to be installed on its motherboard without the need for an adapter board.
 ====Connection of Camera and Radxa ZERO 3W Board====
 Both use a 15-to-22-pin FFC cable for connection, ensuring that the silver contact surface faces outward.

@@ Line 113: / Line 113: @@
 <code>./yavta -c1 -Fnv12-1920x1080.yuv --skip 0 -f NV12 -s 1920x1080 /dev/video0</code>
 ====gstreamer====
-We provide several gstreamer routines that implement the preview, capture, and video recording functions. See the [https://github.com/veyeimaging/rk356x_firefly/tree/main/linux/samples samples] directory on github for details.
+We provide several gstreamer routines that implement the preview, capture, and video recording functions. See the [https://github.com/veyeimaging/rk35xx_veye_bsp/tree/main/samples samples] directory on github for details.
 ====Import to OpenCV====
 First install OpenCV:
@@ Line 119: / Line 119: @@
 <code>sudo apt install python3-opencv</code>
-We provide several routines to import camera data into opencv. See the [https://github.com/veyeimaging/rk356x_firefly/tree/main/linux/samples samples] directory on github for details.
+We provide several routines to import camera data into opencv. See the [https://github.com/veyeimaging/rk35xx_veye_bsp/tree/main/samples samples] directory on github for details.
 ===Compile drivers and dtb from source code===
@@ Line 128: / Line 128: @@
 Because of the high degree of freedom of our camera parameters, we do not use V4L2 parameters to control, but use scripts to configure parameters.
-https://github.com/veyeimaging/rk35xx_radxa/tree/main/i2c_cmd
+https://github.com/veyeimaging/rk35xx_veye_bsp/tree/main/i2c_cmd
 using -b option to identify which bus you want to use.

@@ Line 41: / Line 41: @@
 In addition, a compiled linux kernel installation package  is provided in the [https://github.com/veyeimaging/rk356x_radxa/releases releases].
-====Upgrade Radxa Debain system====
+===Upgrade Radxa Debain system===
-=====Overview=====
+====Overview====
 This section describes how to update the RK35xx system to support our camera modules.
 We provide a deb installation package that can be installed directly.
-=====Burn Radxa standard system=====
+====Burn Radxa standard system====
 Refer to the [https://wiki.t-firefly.com/en/ROC-RK3566-PC/01-bootmode.html Radxa documentation] to burn in a standard system.
-=====Using prebuilt Image and dtb file=====
+====Using prebuilt Image and dtb file====
 Using the compiled debain installation package
@@ Line 66: / Line 66: @@
 If the version does not match, it needs to be compiled from the source code.
-====Check system status====
+===Check system status===
 Run the following command to confirm whether the camera is probed.
@@ Line 88: / Line 88: @@
 For Radxa Zero 3W, the camera is connected to i2c-2.
-====Application examples====
+===Application examples===
-=====v4l2-ctl=====
+====v4l2-ctl====
-======Install v4l2-utils======
+=====Install v4l2-utils=====
 <code>sudo apt-get install v4l-utils</code>
-======List the data formats supported by the camera======
+=====List the data formats supported by the camera=====
 <code>v4l2-ctl --list-formats-ext</code>
-======Snap YUV picture======
+=====Snap YUV picture=====
 <code>v4l2-ctl --set-fmt-video=width=1920,height=1080,pixelformat='NV12' --stream-mmap --stream-count=100 --stream-to=nv12-1920x1080.yuv</code>
@@ Line 102: / Line 102: @@
 You can use software like YUV Player or Vooya to play the images.
-======Check frame rate======
+=====Check frame rate=====
 <code>v4l2-ctl --set-fmt-video=width=1920,height=1080,pixelformat=UYVY --stream-mmap --stream-count=-1 --stream-to=/dev/null</code>
-=====yavta=====
+====yavta====
 <code>git clone <nowiki>https://github.com/veyeimaging/yavta.git</nowiki></code>
@@ Line 110: / Line 110: @@
 <code>./yavta -c1 -Fnv12-1920x1080.yuv --skip 0 -f NV12 -s 1920x1080 /dev/video0</code>
-=====gstreamer=====
+====gstreamer====
 We provide several gstreamer routines that implement the preview, capture, and video recording functions. See the [https://github.com/veyeimaging/rk356x_firefly/tree/main/linux/samples samples] directory on github for details.
-=====Import to OpenCV=====
+====Import to OpenCV====
 First install OpenCV:
@@ Line 118: / Line 118: @@
 We provide several routines to import camera data into opencv. See the [https://github.com/veyeimaging/rk356x_firefly/tree/main/linux/samples samples] directory on github for details.
-====Compile drivers and dtb from source code====
+===Compile drivers and dtb from source code===
 *RK356x