Skip to content

Latest commit

 

History

History

xilinx_xck26

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
v1.0
v1.0
 
 
v1.1
v1.1
 
 
v1.2
v1.2
 
 
v1.3_cvpr2024
v1.3_cvpr2024
 
 
v1.4
v1.4
 
 
v1.5
v1.5
 
 
README.md
README.md
 
 

README.md

How to use the Kria™ KV260 Binary Files

v1.5

For IMX219 image sensor module:

(Raspberry Pi Camera Module v2 or other compatible IMX219 image sensor module)

  1. Connect the IMX219 image sensor module to the RPi port on the Kria KV260 AI Starter Kit.
  2. Insert an SD Card (2GB or above) into the Kria KV260 board.
  3. Connect the Kria KV260 board with a monitor screen using an HDMI cable.
  4. Power up the Kria KV260 board and follow the steps for loading the on-board Xilinx Image Recovery Tool.
  5. Upload the desired binary file (e.g. Infinite-ISP_v1.5-IMX219.bin) provided in the release on the Kria KV260 AI Starter Kit.
  6. Reset the Kria KV260 board and visualize the Infinite-ISP output on your monitor screen.
  7. Connect the USB cable with the JTAG/USB port on Kria to read the messages over the serial interface (baud rate 115200).
  8. A configuration menu as shown below will appear. Details of the user menu are provided in the user guide:

status before dumping

  1. If you want to dump frame(s), do so by going to option 2, and then you can remove the SD card from the Kria board.

  2. Extract the dumped frame(s) from the SD card and visualize them using the provided scripts.

For AR1335 IAS module:

  1. Connect AR1335 IAS image sensor module to the IAS1 port on Kria KV260 AI Starter Kit.
  2. Insert SD Card (2GB or above) into the Kria KV260 board.
  3. Connect the Kria KV260 board with a monitor screen using an HDMI cable.
  4. Power up the Kria KV260 board and follow the steps for loading the on-board Xilinx Image Recovery Tool.
  5. Upload the desired binary file (e.g. Infinite-ISP_v1.5-AR1335.bin) provided in the release on the Kria KV260 AI Starter Kit.
  6. Reset the Kria KV260 board and visualize the Infinite-ISP output on your monitor screen.
  7. Connect the USB cable with the JTAG/USB port on Kria to read the messages over the serial interface (baud rate 115200).
  8. A configuration menu as shown below will appear. Details of the user menu are provided in the user guide:

status before dumping

  1. If you want to dump frame(s), do so by going to option 2, and then you can remove the SD card from the Kria board.

  2. Extract the dumped frame(s) from the SD card and visualize them using the provided scripts.

For OV5647 image sensor module:

(Raspberry Pi Camera Module v1 or other compatible OV5647 image sensor module)

  1. Connect the OV5647 image sensor module to the RPi port on the Kria KV260 AI Starter Kit.
  2. Insert an SD Card (2GB or above) into the Kria KV260 board.
  3. Connect the Kria KV260 board with a monitor screen using an HDMI cable.
  4. Power up the Kria KV260 board and follow the steps for loading the on-board Xilinx Image Recovery Tool.
  5. Upload the desired binary file (e.g. Infinite-ISP_v1.5-OV5647.bin) provided in the release on the Kria KV260 AI Starter Kit.
  6. Reset the Kria KV260 board and visualize the Infinite-ISP output on your monitor screen.
  7. Connect the USB cable with the JTAG/USB port on Kria to read the messages over the serial interface (baud rate 115200).
  8. A configuration menu as shown below will appear. Details of the user menu are provided in the user guide:

status before dumping

  1. If you want to dump frame(s), do so by going to option 2, and then you can remove the SD card from the Kria board.

  2. Extract the dumped frame(s) from the SD card and visualize them using the provided scripts.

v1.4

For IMX219 image sensor module:

(Raspberry Pi Camera Module v2 or other compatible IMX219 image sensor module)

  1. Connect the IMX219 image sensor module to the RPi port on the Kria KV260 AI Starter Kit.
  2. Insert an SD Card (2GB or above) into the Kria KV260 board.
  3. Connect the Kria KV260 board with a monitor screen using an HDMI cable.
  4. Power up the Kria KV260 board and follow the steps for loading the on-board Xilinx Image Recovery Tool.
  5. Upload the desired binary file (e.g. Infinite-ISP_v1.4-IMX219.bin) provided in the release on the Kria KV260 AI Starter Kit.
  6. Reset the Kria KV260 board and visualize the Infinite-ISP output on your monitor screen.
  7. Connect the USB cable with the JTAG/USB port on Kria to read the messages over the serial interface (baud rate 115200).
  8. A configuration menu as shown below will appear. Details of the user menu are provided in the user guide:

status before dumping

  1. If you want to dump frame(s), do so by going to option 2, and then you can remove the SD card from the Kria board.

  2. Extract the dumped frame(s) from the SD card and visualize them using the provided scripts.

For AR1335 IAS module:

  1. Connect AR1335 IAS image sensor module to the IAS1 port on Kria KV260 AI Starter Kit.
  2. Insert SD Card (2GB or above) into the Kria KV260 board.
  3. Connect the Kria KV260 board with a monitor screen using an HDMI cable.
  4. Power up the Kria KV260 board and follow the steps for loading the on-board Xilinx Image Recovery Tool.
  5. Upload the desired binary file (e.g. Infinite-ISP_v1.4-AR1335.bin) provided in the release on the Kria KV260 AI Starter Kit.
  6. Reset the Kria KV260 board and visualize the Infinite-ISP output on your monitor screen.
  7. Connect the USB cable with the JTAG/USB port on Kria to read the messages over the serial interface (baud rate 115200).
  8. A configuration menu as shown below will appear. Details of the user menu are provided in the user guide:

status before dumping

  1. If you want to dump frame(s), do so by going to option 2, and then you can remove the SD card from the Kria board.

  2. Extract the dumped frame(s) from the SD card and visualize them using the provided scripts.

For OV5647 image sensor module:

(Raspberry Pi Camera Module v1 or other compatible OV5647 image sensor module)

  1. Connect the OV5647 image sensor module to the RPi port on the Kria KV260 AI Starter Kit.
  2. Insert an SD Card (2GB or above) into the Kria KV260 board.
  3. Connect the Kria KV260 board with a monitor screen using an HDMI cable.
  4. Power up the Kria KV260 board and follow the steps for loading the on-board Xilinx Image Recovery Tool.
  5. Upload the desired binary file (e.g. Infinite-ISP_v1.4-OV5647.bin) provided in the release on the Kria KV260 AI Starter Kit.
  6. Reset the Kria KV260 board and visualize the Infinite-ISP output on your monitor screen.
  7. Connect the USB cable with the JTAG/USB port on Kria to read the messages over the serial interface (baud rate 115200).
  8. A configuration menu as shown below will appear. Details of the user menu are provided in the user guide:

status before dumping

  1. If you want to dump frame(s), do so by going to option 2, and then you can remove the SD card from the Kria board.

  2. Extract the dumped frame(s) from the SD card and visualize them using the provided scripts.

v1.3 (CVPR2024 Demo)

For IMX219 image sensor module:

(Raspberry Pi Camera Module v2 or other compatible IMX219 image sensor module)

  1. Connect the IMX219 image sensor module to the RPi port on the Kria KV260 AI Starter Kit.
  2. Insert an SD Card (2GB or above) into the Kria KV260 board.
  3. Connect the Kria KV260 board with a monitor screen using an HDMI cable.
  4. Power up the Kria KV260 board and follow the steps for loading the on-board Xilinx Image Recovery Tool.
  5. Upload the desired binary file (e.g. Infinite-ISP_v1.3-IMX219.bin) provided in the release on the Kria KV260 AI Starter Kit.
  6. Reset the Kria KV260 board and visualize the Infinite-ISP output on your monitor screen.
  7. Connect the USB cable with the JTAG/USB port on Kria to read the messages over the serial interface (baud rate 115200).
  8. A configuration menu as shown below will appear. Details of the user menu are provided in the user guide:

status before dumping

  1. If you want to dump frame(s), do so by going to option 2, and then you can remove the SD card from the Kria board.

  2. Extract the dumped frame(s) from the SD card and visualize them using the provided scripts.

For AR1335 IAS module:

  1. Connect AR1335 IAS image sensor module to the IAS1 port on Kria KV260 AI Starter Kit.
  2. Insert SD Card (2GB or above) into the Kria KV260 board.
  3. Connect the Kria KV260 board with a monitor screen using an HDMI cable.
  4. Power up the Kria KV260 board and follow the steps for loading the on-board Xilinx Image Recovery Tool.
  5. Upload the desired binary file (e.g. Infinite-ISP_v1.3-AR1335.bin) provided in the release on the Kria KV260 AI Starter Kit.
  6. Reset the Kria KV260 board and visualize the Infinite-ISP output on your monitor screen.
  7. Connect the USB cable with the JTAG/USB port on Kria to read the messages over the serial interface (baud rate 115200).
  8. A configuration menu as shown below will appear. Details of the user menu are provided in the user guide:

status before dumping

  1. If you want to dump frame(s), do so by going to option 2, and then you can remove the SD card from the Kria board.

  2. Extract the dumped frame(s) from the SD card and visualize them using the provided scripts.

For OV5647 image sensor module:

(Raspberry Pi Camera Module v1 or other compatible OV5647 image sensor module)

  1. Connect the OV5647 image sensor module to the RPi port on the Kria KV260 AI Starter Kit.
  2. Insert an SD Card (2GB or above) into the Kria KV260 board.
  3. Connect the Kria KV260 board with a monitor screen using an HDMI cable.
  4. Power up the Kria KV260 board and follow the steps for loading the on-board Xilinx Image Recovery Tool.
  5. Upload the desired binary file (e.g. Infinite-ISP_v1.3-OV5647.bin) provided in the release on the Kria KV260 AI Starter Kit.
  6. Reset the Kria KV260 board and visualize the Infinite-ISP output on your monitor screen.
  7. Connect the USB cable with the JTAG/USB port on Kria to read the messages over the serial interface (baud rate 115200).
  8. A configuration menu as shown below will appear. Details of the user menu are provided in the user guide:

status before dumping

  1. If you want to dump frame(s), do so by going to option 2, and then you can remove the SD card from the Kria board.

  2. Extract the dumped frame(s) from the SD card and visualize them using the provided scripts.

v1.2

For AR1335 IAS module:

  1. Connect AR1335 IAS image sensor module to the IAS1 port on Kria KV260 AI Starter Kit.
  2. Insert SD Card (2GB or above) into the Kria KV260 board.
  3. Connect the Kria KV260 board with a monitor screen using an HDMI cable.
  4. Power up the Kria KV260 board and follow the steps for loading the on-board Xilinx Image Recovery Tool.
  5. Upload the desired binary file (e.g. Infinite-ISP_v1.2-AR1335.bin) provided in the release on the Kria KV260 AI Starter Kit.
  6. Reset the Kria KV260 board and visualize the Infinite-ISP output on your monitor screen.
  7. Connect the USB cable with the JTAG/USB port on Kria to read the messages over the serial interface (baud rate 115200).
  8. A configuration menu as shown below will appear. Details of the user menu are provided in the user guide:

status before dumping

  1. If you want to dump frame(s), do so by going to option 2, and then you can remove the SD card from the Kria board.

  2. Extract the dumped frame(s) from the SD card and visualize them using the provided scripts.

For OV5647 image sensor module:

  1. Connect the OV5647 image sensor module to the RPi port on the Kria KV260 AI Starter Kit.
  2. Insert an SD Card (2GB or above) into the Kria KV260 board.
  3. Connect the Kria KV260 board with a monitor screen using an HDMI cable.
  4. Power up the Kria KV260 board and follow the steps for loading the on-board Xilinx Image Recovery Tool.
  5. Upload the desired binary file (e.g. Infinite-ISP_v1.2-OV5647.bin) provided in the release on the Kria KV260 AI Starter Kit.
  6. Reset the Kria KV260 board and visualize the Infinite-ISP output on your monitor screen.
  7. Connect the USB cable with the JTAG/USB port on Kria to read the messages over the serial interface (baud rate 115200).
  8. RAW-ISPout image pair and Burst Capture frames dump in SD Card status will be displayed over serial interface:

status before dumping

  1. If you want to dump frame(s), do so by going to option 2, and then you can remove the SD card from the Kria board.

  2. Extract the dumped frame(s) from the SD card and visualize them using the provided scripts.

v1.1

For AR1335 IAS module:

  1. Connect AR1335 IAS image sensor module to the IAS1 port on Kria KV260 AI Starter Kit.
  2. Insert SD Card (2GB or above) into the Kria KV260 board.
  3. Connect the Kria KV260 board with a monitor screen using HDMI cable.
  4. Power up the Kria KV260 board and follow the steps for loading the on-board Xilinx Image Recovery Tool.
  5. Upload the desired binary file (e.g. Infinite-ISP_v1.1-AR1335-1080p.bin) provided in the release on the Kria KV260 AI Starter Kit.
  6. Reset the Kria KV260 board and visualize the Infinite-ISP output on your monitor screen.
  7. Connect the USB cable with the JTAG/USB port on Kria to read the messages over serial interface (baud rate 115200).
  8. RAW-ISPout image pair and Burst Capture frames dump in SD Card status will be displayed over serial interface:

status before dumping

  1. Once SD Card dumps are complete, you can remove the SD card from the Kria board.

status after dumping

  1. Extract the dumped single RAW-ISPout pair and Burst Capture frames from the SD card and visualize them using provided scripts.

For OV5647 image sensor module:

  1. Connect OV5647 image sensor module to the RPi port on Kria KV260 AI Starter Kit.
  2. Insert SD Card (2GB or above) into the Kria KV260 board.
  3. Connect the Kria KV260 board with a monitor screen using HDMI cable.
  4. Power up the Kria KV260 board and follow the steps for loading the on-board Xilinx Image Recovery Tool.
  5. Upload the desired binary file (e.g. Infinite-ISP_v1.1-OV5647-1080p.bin) provided in the release on the Kria KV260 AI Starter Kit.
  6. Reset the Kria KV260 board and visualize the Infinite-ISP output on your monitor screen.
  7. Connect the USB cable with the JTAG/USB port on Kria to read the messages over serial interface (baud rate 115200).
  8. RAW-ISPout image pair and Burst Capture frames dump in SD Card status will be displayed over serial interface:

status before dumping

  1. Once SD Card dumps are complete, you can remove the SD card from the Kria board.

status before dumping

  1. Extract the dumped single RAW-ISPout pair and Burst Capture frames from the SD card and visualize them using provided scripts.

v1.0

  1. Connect the AR1335 IAS image sensor module (included in Xilinx Kria KV260 Accessory Pack) to the IAS1 port on the Kria KV260 AI Starter Kit.
  2. Insert an SD Card (2GB or above) into the Kria KV260 board.
  3. Connect the Kria KV260 board with a monitor screen using an HDMI cable.
  4. Power up the Kria KV260 board and follow the steps for loading the on-board Xilinx Image Recovery Tool.
  5. Upload the desired binary file (e.g. 'Infinite-ISP_v1.0-1080p.bin') on the Kria KV260 AI Starter Kit.
  6. Reset the Kria KV260 board and visualize the Infinite-ISP output on your monitor screen.
  7. Connect the USB cable with the JTAG/USB port on Kria to read the messages over serial interface (baud rate 115200).
  8. You can remove the SD card from the Kria board, extract the dumped single RGB-RAW pair and 300 RGB frames (if applicable), and visualize them using the provided scripts.

Scripts for visualization of FPGA outputs in SD Card

Name Description
sensor_bin_to_sensor_raw.py converts the image sensor memory dump (.bin) data from the FPGA Platform to Bayer RAW frame (.raw) containing valid pixel data.
isp_output_bin_to_isp_output_png.py converts the ISP output memory dump (.bin) data from the FPGA Platform to output image frame (.png) as well as output pixel data frame (.bin) for verification.
sensor_bin_to_sensor_raw_burst_capture.py converts the image sensor memory dumps (.bin) of RAW Burst Capture from the FPGA Platform to Bayer RAW frames (.raw) containing valid pixel data. It also converts the Bayer RAW frames to equivalent grayscale .png for visualization.
video_creation.py converts multiple ISP output memory dumps (.bin) from the FPGA Platform to corresponding output image frames (.png) and stitches them together into a .mp4 video.