UnitV

Motion Detect

Example

Detects changes in the current screen and determines whether or not there is movement of objects in the detection area.

from m5stack import *
from m5ui import *
from uiflow import *
import unit


setScreenColor(0x222222)
V_0 = unit.get(unit.V_FUNCTION, unit.PORTB)

motion = V_0.init(V_0.MOTION)
motion.setMotionDetectThreshold(0)
motion.setDetectMode(0)
while True:
  if (motion.getMaxDiff()) >= 50:
    print('Moved')
  else:
    print('Not Move')
  wait_ms(2)

API

import unit
V_0 = unit.get(unit.V_FUNCTION, unit.PORTB)
motion = V_0.init(V_0.MOTION)

• Initialization

motion.setMotionDetectThreshold(0)

• Setting the rate of change threshold.
  • Pixels with a change smaller than this value are not considered to have changed, and their change is not included in the screen variable rate.

motion.setDetectMode(0)

• Setting the detection mode:
  • dynamic(0): Dynamic Detection Mode, when configured, will continuously take pictures and compare the changes between the two frames before and after.
  • static(1): In static detection mode, a reference picture will be taken and saved after execution, and subsequent images will be compared with this picture continuously. If you need to take a new reference picture, you need to switch back to the dynamic detection mode first, and then execute the static detection mode setting again.

motion.getRateOfDiff()

• Getting the rate of change of the screen:
  • Frame rate of change: Detects the amount of change in the pixels that have changed between the two frames before and after the comparison. Assuming that two pixels have changed, pixel A has changed by 27 and pixel B has changed by 10, the change value is 27+10=37. The difference between the R.G.B components of the two pixels is summed up as the amount of change.

motion.getMaxDiff()

• Getting the highest rate of change:
  • Highest rate of change:The amount of change in the pixel with the most dramatic change.

motion.setScanInterval(0, 0)

• Sets the scanning interval on the x-axis as well as the y-axis.

print(motion.getBoxNumber())

• Gets the number of bounding box counts generated by pixel changes.

print(motion.getBoxDetail(1))

• Get x bounding box information.
  • The details of the x bounding box are returned in a list, including the number of pixels that have changed within the bounding box, the x-axis coordinates of the bounding box, the y-axis coordinates of the bounding box, the width of the bounding box, and the height of the bounding box.
• Return
  • list[0] number of pixels changed
  • list[1] x
  • list[2] y
  • list[3] width
  • list[4] height

Target Track

Example

Set the tracking target and get the position information of the target object in the screen in real time.

from m5stack import *
from m5ui import *
from uiflow import *
import time
import unit

setScreenColor(0x222222)
V_0 = unit.get(unit.V_FUNCTION, unit.PORTB)

target = V_0.init(V_0.TARGET_TRACK)
target.setTrackAreaCoordinate(50, 50, 30, 30)
while True:
  print((str('X :') + str(((str((target.getBoxDetail())[0]) + str(((str('Y :') + str((target.getBoxDetail())[2])))))))))
  wait(1)
  wait_ms(2)

API

import unit
V_0 = unit.get(unit.V_FUNCTION, unit.PORTB)
target = V_0.init(V_0.TARGET_TRACK)

• Initialization

target.setTrackAreaCoordinate(50, 50, 30, 30)

• Set tracking frame coordinates x y Tracking frame, width, height
  • Set the target box, the parameter is the position of the current target on the image (as far as possible to select the target with significant color characteristics)

target.getBoxDetail()

• Get tracking frame track details
  • Retrieve the coordinates of the image where the target box is located, Return is a list containing the coordinates of the upper-left corner of the box, x, y, as well as the width and height of the box.
• Return:
  • list[0] x
  • list[1] y
  • list[2] width
  • list[3] height

Color Track

Example

Set the LAB color threshold, track the target that meets the threshold in the screen, and obtain the position information of the target object in the screen in real time.

from m5stack import *
from m5ui import *
from uiflow import *
import unit


setScreenColor(0x222222)
V_0 = unit.get(unit.V_FUNCTION, unit.PORTB)

box_detail = None

color_track = V_0.init(V_0.COLOR_TRACK)
while True:
  box_detail = color_track.getBoxDetail(1)
  print((str('Box number: ') + str((color_track.getBoxNumber()))))
  print((str('Box1 pixels changed: ') + str(box_detail[0])))
  print((str('Box1 x: ') + str(box_detail[1])))
  print((str('Box1 y: ') + str(box_detail[2])))
  print((str('Box1 w: ') + str(box_detail[3])))
  print((str('Box1 h: ') + str(box_detail[4])))
  wait_ms(2)

API

import unit
V_0 = unit.get(unit.V_FUNCTION, unit.PORTB)
color_track = V_0.init(V_0.COLOR_TRACK)

• Initialization

color_track.setTrackColorByLAB(0, 0, 0, 0, 0, 0)

• Set the LAB threshold for tracking (the value of a color in the LAB color space, out of which colors will be filtered).

color_track.setScanInterval(0, 0)

• Set the scanning interval on the x-axis and y-axis, [0, 40], set to 0 to turn off bounding box detection.

color_track.setBoxMergeThreshold(0)

• Sets the bounding box merge threshold.

color_track.setBoxWidthThreshold(0, 0)

• Set border width threshold 0 height threshold 0

print(color_track.getBoxNumber())

• Get the number of borders

print(color_track.getBoxDetail(1))

• Get the details of the bounding box, including the number of changing pixels in the bounding box, the coordinates of the x-axis of the bounding box, the coordinates of the y-axis of the bounding box, the width of the bounding box, and the height of the bounding box.
• Return：
  • list[0] number of pixels changed
  • list[1] x
  • list[2] y
  • list[3] width
  • list[4] height

Face Detect

Example

Recognize the face information in the screen, and return the number of recognition, object coordinates, confidence rate.

from m5stack import *
from m5ui import *
from uiflow import *
import unit


setScreenColor(0x222222)
V_0 = unit.get(unit.V_FUNCTION, unit.PORTB)

data_detail = None

face = V_0.init(V_0.FACE_DETECT)
while True:
  print((str('FaceNumber: ') + str((face.getFaceNumber()))))
  data_detail = face.getFaceDetail(1)
  print((str('Face1 value: ') + str(((str(("%.2f"%((data_detail[0] * 100)))) + str('%'))))))
  print((str('Face1 X: ') + str(data_detail[1])))
  print((str('Face1 Y: ') + str(data_detail[2])))
  print((str('Face1 W: ') + str(data_detail[3])))
  print((str('Face1 H: ') + str(data_detail[4])))
  wait_ms(2)

API

import unit
V_0 = unit.get(unit.V_FUNCTION, unit.PORTB)
face = V_0.init(V_0.FACE_DETECT)

• Initialization

face.getFaceNumber()

• Read the number of recognized faces

face.getFaceDetail(1)

• Retrieve the details of the face with the specified number, and return a list containing the coordinates, length, width, and confidence rate of the face.
• Return:
  • list[0] face probability
  • list[1] x
  • list[2] y
  • list[3] width
  • list[4] height

QR Code

Example

Recognizes the QR code on the screen, and returns the result, as well as the version. Use firmware Find code

from m5stack import *
from m5ui import *
from uiflow import *
import unit


setScreenColor(0x222222)
V_1 = unit.get(unit.V_FUNCTION, unit.PORTB)
qr = V_1.init(V_1.QR_CODE)
while True:
  print((str('QRcode version: ') + str((qr.getQRversion()))))
  print((str('Code text: ') + str((qr.getQRtext()))))
  wait_ms(2)

API

import unit
V_1 = unit.get(unit.V_FUNCTION, unit.PORTB)
qr = V_1.init(V_1.QR_CODE)

• Initialization

qr.getQRtext()

• Read the content of the recognized QR code

qr.getQRversion()

• Read the recognized version of the QR code

Apriltag Code

Example

Identify the Apriltag code in the screen (only Tag36H11 type is supported), and get the offset of its position. Use firmware Find code

from m5stack import *
from m5ui import *
from uiflow import *
import unit


setScreenColor(0x222222)
V_1 = unit.get(unit.V_FUNCTION, unit.PORTB)

tag = V_1.init(V_1.APRILTAG)
while True:
  print((str('AprilTag location: ') + str((tag.getAprilTagcodeLocation()))))
  print((str('AprilTag rotation: ') + str((tag.getAprilTagcodeRotation()))))
  print((str('AprilTag translation: ') + str((tag.getAprilTagcodeTranslation()))))
  wait_ms(2)

API

import unit
V_1 = unit.get(unit.V_FUNCTION, unit.PORTB)
tag = V_1.init(V_1.APRILTAG)

• Initialization

tag.getAprilTagcodeLocation()

• Read the boxed coordinates, center coordinates, length and width of the recognized AprilTag code, Return as a list.

tag.getAprilTagcodeRotation()

• Returns the spin of AprilTag in radians (int)

tag.getAprilTagcodeTranslation()

• Read the positional offset of the Apriltag code

Bar Code

Example

Recognizes barcodes on the screen and returns the result, as well as the version. Using firmware Find code

from m5stack import *
from m5ui import *
from uiflow import *
import unit


setScreenColor(0x222222)
V_1 = unit.get(unit.V_FUNCTION, unit.PORTB)

bar = V_1.init(V_1.BARCODE)
while True:
  print((str('Code text: ') + str((bar.getBARcodeText()))))
  print((str('Code type: ') + str((bar.getBARcodeRotation()))))
  print((str('Code rotation: ') + str((bar.getBARcodeType()))))
  print((str('Code location: ') + str((bar.getBARcodeLocation()))))
  wait_ms(2)

API

import unit
V_1 = unit.get(unit.V_FUNCTION, unit.PORTB)
bar = V_1.init(V_1.BARCODE)

• Initialization

bar.getBARcodeLocation()

• Read the boxed coordinates of the recognized barcode, the length and width of the barcode, and Return as a list.

bar.getBARcodeRotation()

• Read the rotation angle of the recognized barcode

bar.getBARcodeText()

• Read the contents of the recognized bar code

bar.getBARcodeType()

• Read recognized barcode categories

Datamatrix Code

Example

Recognizes the Datamatrix code in the screen, and returns the recognition result, as well as the code rotation angle and coordinate data. Use firmware Find code.

from m5stack import *
from m5ui import *
from uiflow import *
import unit


setScreenColor(0x222222)
V_1 = unit.get(unit.V_FUNCTION, unit.PORTB)

dm = V_1.init(V_1.DATAMATRIX)
while True:
  print((str('DM code rotation: ') + str((dm.getDMcodeRotation()))))
  print((str('DM code location: ') + str((dm.getDMcodeLocation()))))
  print((str('DM code text: ') + str((dm.getDMcodeText()))))
  wait_ms(2)

API

import unit
V_1 = unit.get(unit.V_FUNCTION, unit.PORTB)
dm = V_1.init(V_1.DATAMATRIX)

• Initialization

dm.getDMcodeLocation()

• Read the boxed coordinates of the recognized Datamatrix code, length width, Return as a list of

dm.getDMcodeRotation()

• Read the recognized Datamatrix code rotation angle

dm.getDMcodeText()

• Read the contents of the recognized Datamatrix code

Line Tracker

Example

Detects a line of the specified color in the screen and returns the offset angle.

from m5stack import *
from m5ui import *
from uiflow import *
import unit


setScreenColor(0x222222)
V_1 = unit.get(unit.V_FUNCTION, unit.PORTB)

line_tracker = V_1.init(V_1.LINE_TRACKER)
while True:
  print((str('Line angle') + str((line_tracker.getAngle()))))
  wait_ms(2)

API

import unit
V_1 = unit.get(unit.V_FUNCTION, unit.PORTB)
line_tracker = V_1.init(V_1.LINE_TRACKER)

• Initialization

line_tracker.getAngle()

• Get line offset angle

line_tracker.setLineAreaWeight(0, 0, 0)

• Setting the weights of the line areas: the three weights correspond to the contribution of each of the three areas of the figure to the angle. For example, if the value of weight_2 is set to a larger value, the angle will change more drastically when turning.

line_tracker.setLineColorByLAB(0, 0, 0, 0, 0, 0)

• Set the LAB threshold for tracking (the value of a color in the LAB color space, out of which colors will be filtered).

Tag Reader

Example

Detects the tag card in the screen and returns the binary sequence. Note: Only the fixed label card format is recognized.

from m5stack import *
from m5ui import *
from uiflow import *
import unit


setScreenColor(0x222222)
V_1 = unit.get(unit.V_FUNCTION, unit.PORTB)

tag_reader = V_1.init(V_1.TAG_READER)
while True:
  print((str('Total number: ') + str((tag_reader.getTotalNumber()))))
  print((str('Tag location: ') + str((tag_reader.getTagLocation(number=0)))))
  print((str('Code: ') + str((tag_reader.getCode(number=0)))))
  print((str('Binstr: ') + str((tag_reader.getBinstr(number=0)))))
  wait_ms(2)

API

import unit
V_1 = unit.get(unit.V_FUNCTION, unit.PORTB)
tag_reader = V_1.init(V_1.TAG_READER)

• Initialization

tag_reader.getTotalNumber()

• Number of tag cards recognized on the current screen

tag_reader.getBinstr(number=0)

• A string of binary data that recognizes the result. When there are multiple cards, pass in a subscript to select different card contents.

tag_reader.getCode(number=0)

• uint64_t type content binary code, this key value maximum code 64 bits (8 x 8) TAG.

tag_reader.getTagLocation(number=0)

• Coordinates and aspect information of the tab card

Tools

• Download LAB Color Tool