VEYE MIPI 327 for KHADAS EDGE ubuntu - Revision history

Ezcam: /* Hardware Setup */

2020-06-12T01:22:09Z

Hardware Setup

Xumm: /* References */

2020-03-10T05:39:07Z

References

Xumm: /* Hardware Setup */

2020-01-14T08:28:00Z

Hardware Setup

Xumm at 09:01, 13 January 2020

2020-01-13T09:01:21Z

Xumm: Created blank page

2020-01-13T06:57:54Z

Created blank page

New page

@@ Line 8: / Line 8: @@
 VEYE-MIPI-290/327 is STARVIS camera module with ISP functions build in. It output UYVY data using MIPI-CSI2. We provide '''V4L2 interface''' for video streaming apps , and '''Video Control Toolkits (which is Shell Script)''' to control the camera module directly.
 ===Hardware Setup===
-The system installation is shown as follows in the figure. We have a special Edge adapter board.For Details：（TODO）.[[File:KHADAS EDGE VEYE327.jpg|alt=|center|thumb|602x602px|VEYE-MIPI-327 connect to Khadas Edge-V|link=http://wiki.veye.cc/index.php/File:KHADAS_EDGE_VEYE327.jpg]][[File:KHADAS EDGE FFC.jpg|alt=|center|thumb|602x602px|Khadas Edge-V FFC cable details（Contact facing outward）|link=http://wiki.veye.cc/index.php/File:KHADAS_EDGE_FFC.jpg]][[File:VEYE-MIPI-327KH FFC.jpg|alt=|center|thumb|596x596px|VEYE-MIPI-327  FFC cable details（Contact facing outward）|link=http://wiki.veye.cc/index.php/File:VEYE-MIPI-327KH_FFC.jpg]]
+The system installation is shown as follows in the figure. We have a special Edge adapter board.For Details：（TODO）.
 Note：Khadas Edge-V board use i2c-6 for both CAM0 and CAM1,We just support CAM0 now.
 ===Download bsp package we provide===
 Download source code and bsp form link below：https://github.com/veyeimaging/rk3399_veye_dimaging_bsp

← Older revision		Revision as of 05:39, 10 March 2020
Line 120:		Line 120:

	Video Control Toolkits Manual : [[VEYE-MIPI-290/327 i2c/\|VEYE-MIPI-290/327 i2c]]		Video Control Toolkits Manual : [[VEYE-MIPI-290/327 i2c/\|VEYE-MIPI-290/327 i2c]]
		+	===Exsiting bugs===
		+	====Bug description====
		+
		+	*Can not encode to H.264 stream at full framerate
		+
		+	Using the gstreamer instructions used in the previous section to encode the video, the full frame cannot be reached. It can only reach about 17 frames. Limiting all CPU speeds to 600MHz which gives a stable 25FPS in PAL mode.
		+	====Bug Analysis====
		+	Although rockchip's rk3399 supports camera module input in yuv format, there is a serious bug in the gstreamer plug-in they provide.
	===References===		===References===

@@ Line 8: / Line 8: @@
 VEYE-MIPI-290/327 is STARVIS camera module with ISP functions build in. It output UYVY data using MIPI-CSI2. We provide '''V4L2 interface''' for video streaming apps , and '''Video Control Toolkits (which is Shell Script)''' to control the camera module directly.
 ===Hardware Setup===
-The system installation is shown as follows in the figure. We have a special Edge adapter board.For Details：（TODO）.[[File:Veye nano pi OverAll.jpg|center|thumb|602x602px|Connect VEYE-MIPI-327 to Khadas Edge-V|link=http://wiki.veye.cc/index.php/File:Veye_nano_pi_OverAll.jpg]][[File:VEYEWiring scheme00 副本12.jpg|center|thumb|602x602px|Khadas Edge-V FFC cable details (TODO)|link=http://wiki.veye.cc/index.php/File:VEYEWiring_scheme00_%E5%89%AF%E6%9C%AC12.jpg]][[File:Veye nano piWiring scheme01.jpg|center|thumb|596x596px|VEYE-MIPI-327 adapter board details (TODO)|link=http://wiki.veye.cc/index.php/File:Veye_nano_piWiring_scheme01.jpg]]
+The system installation is shown as follows in the figure. We have a special Edge adapter board.For Details：（TODO）.[[File:KHADAS EDGE VEYE327.jpg|alt=|center|thumb|602x602px|VEYE-MIPI-327 connect to Khadas Edge-V|link=http://wiki.veye.cc/index.php/File:KHADAS_EDGE_VEYE327.jpg]][[File:KHADAS EDGE FFC.jpg|alt=|center|thumb|602x602px|Khadas Edge-V FFC cable details（Contact facing outward）|link=http://wiki.veye.cc/index.php/File:KHADAS_EDGE_FFC.jpg]][[File:VEYE-MIPI-327KH FFC.jpg|alt=|center|thumb|596x596px|VEYE-MIPI-327  FFC cable details（Contact facing outward）|link=http://wiki.veye.cc/index.php/File:VEYE-MIPI-327KH_FFC.jpg]]
@@ Line 122: / Line 122: @@
 ===References===
-==== From Khadas ====
+====From Khadas====
 [https://docs.khadas.com/ docs]
-====From Rockchip ====
+====From Rockchip====
 [http://opensource.rock-chips.com/wiki_Main_Page wiki]

← Older revision	Revision as of 09:01, 13 January 2020
Line 1:	Line 1:
	+	[[VEYE MIPI 327 for KHADAS EDGE ubuntu/zh\|查看中文]]

	+	[[VEYE MIPI 327 for KHADAS EDGE ubuntu\|<big>How to use VEYE-MIPI-327 camera module on KHADAS EDGE(RK3399 ubuntu)</big>]]
	+
	+	===Overview===
	+	This guide shows how to use VEYE-MIPI-290/327 on [https://www.khadas.com/ KHADAS Edge Board]. We use fenix_0.8.2(20200110) version source code.
	+
	+	VEYE-MIPI-290/327 is STARVIS camera module with ISP functions build in. It output UYVY data using MIPI-CSI2. We provide '''V4L2 interface''' for video streaming apps , and '''Video Control Toolkits (which is Shell Script)''' to control the camera module directly.
	+	===Hardware Setup===
	+	The system installation is shown as follows in the figure. We have a special Edge adapter board.For Details：（TODO）.[[File:Veye nano pi OverAll.jpg\|center\|thumb\|602x602px\|Connect VEYE-MIPI-327 to Khadas Edge-V\|link=http://wiki.veye.cc/index.php/File:Veye_nano_pi_OverAll.jpg]][[File:VEYEWiring scheme00 副本12.jpg\|center\|thumb\|602x602px\|Khadas Edge-V FFC cable details (TODO)\|link=http://wiki.veye.cc/index.php/File:VEYEWiring_scheme00_%E5%89%AF%E6%9C%AC12.jpg]][[File:Veye nano piWiring scheme01.jpg\|center\|thumb\|596x596px\|VEYE-MIPI-327 adapter board details (TODO)\|link=http://wiki.veye.cc/index.php/File:Veye_nano_piWiring_scheme01.jpg]]
	+
	+
	+	Note：Khadas Edge-V board use i2c-6 for both CAM0 and CAM1,We just support CAM0 now.
	+	===Download bsp package we provide===
	+	Download source code and bsp form link below：https://github.com/veyeimaging/rk3399_veye_dimaging_bsp
	+
	+	<code>git clone [https://github.com/veyeimaging/rk3399_veye_dimaging_bsp https://github.com/veyeimaging/rk3399_veye_dimaging_bsp.git]</code>
	+	===Using the prebuilt Image to upgrade Khadas Edge===
	+
	+	*Install Official Image first
	+
	+	Download Offical Image：https://docs.khadas.com/edge/FirmwareUbuntu.html<nowiki/>，We use Edge_Ubuntu-lxde-bionic_Linux-4.4_arm64_EMMC_V20190830 as an example.
	+
	+	Flashing the Edge Board follow manual：https://docs.khadas.com/edge/HowtoBootIntoUpgradeMode.html<nowiki/>。
	+
	+	*Upgrading kernel and dtb
	+
	+	The upgrade package path is:
	+
	+	<code>~/rk3399_veye_dimaging_bsp/ubuntu/platform/khadas_edge-v</code>
	+
	+	copy kernel-debs.tgz and rkisp-engine-2.0.1_arm64.tgz to Edge Board.
	+
	+	*Installing kernel and dtb
	+
	+	<code>tar -xzvf kernel-debs.tgz</code>
	+
	+	<code>cd kernel-debs</code>
	+
	+	<code>sudo dpkg -i linux-dtb-rockchip-4.4_0.8.2_arm64.deb</code>
	+
	+	<code>sudo dpkg -i linux-headers-rockchip-4.4_0.8.2_arm64.deb</code>
	+
	+	<code>sudo dpkg -i linux-image-rockchip-4.4_0.8.2_arm64.deb</code>
	+
	+	*Installing rkisp librarys(as needed)
	+
	+	<code>tar -xzvf rkisp-engine-2.0.1_arm64.tgz</code>
	+
	+	<code>sudo cp -arf rkisp-engine-2.0.1_arm64/* /</code>
	+	===Using the source code to upgrade Khadas Edge===
	+	====Setting Up the Environment====
	+
	+	*Installing Fenix and download source code
	+
	+	According to the steps of Khadas：https://docs.khadas.com/zh-cn/edge/FenixScript.html<nowiki/>，The latest code is automatically downloaded.
	+
	+	<code>make kernel</code>
	+	====Building from Source====
	+
	+	*patch code
	+
	+	<code>cp rk3399_veye_dimaging_bsp/ubuntu/drivers_source/VEYE-MIPI-327/veye327.c ~/project/fenix/linux/drivers/media/i2c/</code>
	+
	+	<code>cp rk3399_veye_dimaging_bsp/ubuntu/drivers_source/Makefile ~/project/fenix/linux/drivers/media/i2c/</code>
	+
	+	<code>cp rk3399_veye_dimaging_bsp/ubuntu/drivers_source/Kconfig ~/project/fenix/linux//drivers/media/i2c/</code>
	+
	+	*add compile option
	+
	+	<code>cd ~/project/fenix/linux/</code>
	+
	+	<code>make ARCH=arm64 kedge_defconfig</code>
	+
	+	<code>make ARCH=arm64 menuconfig</code>
	+
	+	add CONFIG_VIDEO_VEYE327 option.
	+
	+	or you can edit .config to add CONFIG_VIDEO_VEYE327 option.
	+
	+	*build
	+
	+	<code>make kernel && make kernel-deb</code>
	+
	+	the output debs is in ./build/images/debs/0.8.2/ directory.
	+	===Applications and Test===
	+	====Check system status====
	+	Run the following command to confirm whether the camera is correctly connected.
	+
	+	<code>dmesg \| grep veye327</code>
	+
	+	The output message appears as shown below：
	+
	+	<code>Detected VEYE06 sensor</code>
	+	====Video Stream Toolkits Manual====
	+	=====gst-launch-1.0=====
	+
	+	*Preview 1080p HD
	+
	+	*Record 1080p HD in H.264 format to a video file
	+
	+	<code>gst-launch-1.0 rkv4l2src num-buffers=512 ! video/x-raw,format=YUY2,width=1920,height=1080,framerate=30/1 ! queue ! mpph264enc ! queue ! h264parse ! mpegtsmux ! filesink location=/tmp/veye_video.ts</code>
	+
	+	*Capturing FHD still image
	+
	+	====Video Control Toolkits Manual====
	+	We use DRA(Directly Register Access) mode to set camera paramters. And we provide shell script for using. Location：
	+
	+	<code>rk3399_veye_dimaging_bsp/ubuntu/i2c_cmd</code>
	+
	+	*Check hardware connection
	+
	+	<code>i2cdetect 6</code>
	+
	+	VEYE327camera i2c address is 0x3b.
	+
	+	*use veye_mipi_i2c_rk.sh to setting paramters,-b is i2c bus：
	+
	+	<code>veye_mipi_i2c_rk.sh -b 6</code>
	+
	+	Video Control Toolkits Manual : [[VEYE-MIPI-290/327 i2c/\|VEYE-MIPI-290/327 i2c]]
	+	===References===
	+
	+	==== From Khadas ====
	+	[https://docs.khadas.com/ docs]
	+
	+	====From Rockchip ====
	+	[http://opensource.rock-chips.com/wiki_Main_Page wiki]
	+
	+	[https://github.com/rockchip-linux/ github]
	+
	+	[https://github.com/rockchip-linux/docs docs]
	+	<br />