CMUcam4 programmable computer vision sensor

CMUcam project

The CMUcam4 is a fully programmable embedded computer vision sensor. The main processor is the Parallax P8X32A (Propeller Chip) connected to an OmniVision 9665 CMOS camera sensor module.

Features

• Fully open source and re-programmable using the Propeller Tool
• Arduino Shield Compatible
  • w/ Supporting Interface Libraries and Demo Applications for the Arduino and BASIC Stamp
• VGA resolution (640x480) RGB565/YUV655 color sensor
  • Image processing rate of 30 frames per second
  • Raw image dumps over serial or to flash card
    • (640:320:160:80)x(480:240:120:60) image resolution
    • RGB565/YUV655 color space
• Onboard Image Processing (QQVGA 160x120)
  • Track user defined color blobs in the RGB/YUV color space
  • Mean, median, mode and standard deviation data collection – sampled from a 40x120 resolution
  • Segmented (thresholded) image capture for tracking visualization (over serial or to flash card)
    • 80x60 image resolution
    • Monochrome color space
  • Histogram generation (up to 128 Bins) – sampled from a 40x120 resolution
  • Arbitrary image clipping (windowing)
• µSD/µSDHC flash card slot with FAT16/32 full file system driver support
  • w/ Directory and File manipulation
• I/O Interfaces
  • Two-port servo controller (pan and tilt w/ 1us resolution at a 50 Hz refresh rate)
    • Pan and/or Tilt servo channels can be configured as GPIOs
  • Indicator user controllable LED (red) and power LED (green)
  • TTL UART (up to 250,000 baud – 19,200 baud by default)
• Monochrome baseband analog video output (NTSC/PAL) of 160x120 resolution for tracking visualization (segmented (thresholded) image w/ color centroid and bounding box overlay at 30 FPS)
• CMUcam4 GUI for viewing images on the PC

Cool-Projects

• Multi-Shot Cannon - By: Wesley Myers
• Autonomous Vehicle Control - By: Haim Baruh, Joshua Metersky, Richard Quan, and David Wu
• Low Power Motion Detection - By: Kwabena Agyeman
• Mobot - By: Cosku Acay, Edwin Cho, Kenneth Li, Nishant Pol

Typical-Uses

The CMUcam4 can be used to track colors or collect basic image statistics. The best performance can be achieved when there are highly contrasting and intense colors. For instance, it can easily track a red ball on a white background, but it would be hard to differentiate between different shades of brown in changing light. Tracking colorful objects can be used to localize landmarks, follow lines, or chase moving beacons. Using color statistics, it is possible for the CMUcam4 to monitor a scene, detect a specific color, or do primitive motion detection. If the CMUcam4 detects a drastic color change, then chances are something in the scene changed. Using “line mode”, the CMUcam4 can generate low resolution binary images of colorful objects. This can be used to do more sophisticated image processing that includes line following with branch detection, or even simple shape recognition. These more advanced operations require custom algorithms to post process the binary images sent from the CMUcam4. As is the case with a normal digital camera, this type of processing might require a computer or at least a fast microcontroller.

Typical-Configuration

The most common configuration for the CMUcam4 is to have it communicate to a master processor via a standard TTL serial port. This “master processor” could be a computer (through USB or RS232), Arduino, Basic Stamp, PIC, or similar microcontroller. The CMUcam4 is small enough to add simple vision to embedded systems that can not afford the size or power of a standard computer based vision system. Its communication protocol is designed to accommodate even the slowest of processors. The CMUcam4 supports various baud rates to accommodate slower processors. For even slower processors, the CMUcam4 can operate in “poll mode”. In this mode, the host processor can ask the CMUcam4 for just a single packet of data. This gives slower processors the ability to more easily stay synchronized with the data. It is also possible to add a delay between individual serial data characters using the “delay mode” command. Due to communication delays, both poll mode and delay mode will lower the total number of frames that can be processed in one second.

Project data

CMUcam4 Project Website
CMUcam4 Documents
CMUcam4 Wiki

Product information for: CMUcam4 programmable computer vision sensor

Publishing date (date of last technical specification): 2014-06-11
Weight: 25 g
Shipping weight: 50 g
Manufacturer: Devantech
Brand: CMUcam project
Article number: DEV-CMUCAM4
Manufacturer's part number: CMUCAM4