Gravity: HUSKYLENS PRO, an AI Machine Vision Sensor - DFRobot Wiki

Note: This document only describes the unique functions of SEN0336 HUSKYLENS PRO. For general functions, please refer to the SEN0305 HUSKYLENS Wiki.

1. Version Comparison

1.1 Appearance Comparison

SKU Product Name Appearance
SEN0305 Gravity: HUSKYLENS
SEN0336 Gravity: HUSKYLENS PRO

1.2 Parameters Comparison

SKU Product Name Image Sensor Build-in Function Mind+ Online Mode
SEN0305 Gravity: HUSKYLENS OV2640
2.0MegaPixel
7 Functions:
Face Recognition, Object Tracking, Object Recognition, Line Tracking, Color Recognition, Tag Recognition, Object Classification
×
SEN0336 Gravity: HUSKYLENS PRO OV5640
5.0MegaPixel
9 Functions:
Face Recognition, Object Tracking, Object Recognition, Line Tracking, Color Recognition, Tag Recognition, Object Classification, QR Recognition, Barcode recognition

2. Unique Functions Introduction

2.1 QR Recognition

This function can detect QR code, and learn, recognize, and track specified QR code. You can use a QR code generator to generate the QR code you want. This function is only available on the PRO version.

The default setting is to learn a single QR code. This chapter uses learning, recognizing, and tracking multiple QR codes as an example to demonstrate.

Operation and Setting

  1. Dial the function button to the right or left until the words "QR Recognition" is displayed at the top of the screen.

  2. Long press the function button to enter the parameter setting of the QR recognition function.

  3. Dial the function button until "Learn Multiple" is displayed, then short press the function button, and dial to the right to turn on the "Learn Multiple" switch, that is, progress bar turns blue and the square icon on the progress bar moves to the right. Then short press the function button to confirm this parameter.

  4. Using the same method as above, enable "Show QR Code Data".

  5. Dial the function button to the left until "Save & Return" shows. And the screen prompts "Do you want to save the data?" Select "Yes" in default, now short-press the function button to save the parameters and return automatically.

Learning and Detection

You can use the following QR codes to test this function.

1. QR Code Detection: When Huskylens detects the QR code, the QR code will be automatically selected by the orange frame on the screen.

2. QR Code Learning: Point the “+” symbol at the first QR code, and press the “learning button”. A yellow frame with words "Tag:ID1" will be displayed on the screen, indicating that HuskyLens is learning the QR code now. Then, release the "learning button" to complete learning the first QR code, meanwhile, a message "Click again to continue! Click other button to finish" will be displayed. Please short press the "learning button" before the countdown ends if you want to learn other QR codes. If not, short press the "function button" before the countdown ends, or do not press any button to let the countdown ends.

3. QR Code Recognition When encountering the learned QR codes, some color frames with IDs and color words with QR code data will be automatically displayed on the screen. The size of the frames changes with the size of the QR code, and the frames automatically track these QR codes.

2.2 Barcode Recognition

This function can detect barcode, and learn, recognize, and track specified barcode.

This function is only available on the PRO version.

The default setting is to learn a single barcode. This chapter uses learning, recognizing, and tracking one barcode as an example to demonstrate.

Operation and Setting

  1. Dial the function button to the right or left until the words "Barcode Recognition" is displayed at the top of the screen.

  2. Long press the function button to enter the parameter setting of the barcode recognition function.

  3. Dial the function button until "Show Bar Code Data" is displayed, then short press the function button, and dial to the right to turn on the "Show Bar Code Data" switch, that is, progress bar turns blue and the square icon on the progress bar moves to the right. Then short press the function button to confirm this parameter.

  4. Dial the function button to the left until "Save & Return" shows. And the screen prompts "Do you want to save the data?" Select "Yes" in default, now short-press the function button to save the parameters and return automatically.

Learning and Detection

You can use the following Barcode to test this function.

1. Barcode Detection: When Huskylens detects the barcode, the barcode will be automatically selected by the orange frame on the screen.

2. Barcode Learning: Point the “+” symbol at the barcode, and press the “learning button”. A yellow frame with words "Tag:ID1" will be displayed on the screen, indicating that HuskyLens is learning the barcode now. Then, release the "learning button" to complete learning the barcode.

3. Barcode Recognition When encountering the learned barcode, the color frame with ID and color words with barcode data will be automatically displayed on the screen. The size of the frames changes with the size of the barcode, and the frames automatically track the barcode.

2.3 Mind+ Online Mode

In online mode, HuskyLens PRO can directly interact with Mind+ when connected to Mind+ by a USB cable. To facilitate AI teaching in school, there is a visual AI tool in Mind+ specially developed for HuskyLens, which allows teachers to introduce machine learning principle in visual form on PC first, and deploy functions onto HuskyLens to build up projects.

Note: Mind+1.6.4 RC1.0 is a public beta version, and some block descriptions of will be adjusted in RC2.0 official version. Any suggestions are welcome.

Load HuskyLens Extension

In online mode, click Extensions-> Function -> HUSKYLENS EDU

Note: There is no need to add any mainboard, just connect HuskyLens to PC via USB.

Connect to HuskyLens

Different from the way for connecting to a mainboard, users need to click the orange exclamation mark next to HUSKYLENS EDU to connect HuskyLens to PC instead of clicking the “Connect Device”. The exclamation mark turns to a green tick when the device is connected, and now click “Return to editor” to start controlling HuskyLens.

Test Display Function

Find the block below at Display, and drag it out. Then click to run.

Now the word “Mind+” will be displayed on the HuskyLens screen.

AI Learning Process

Example: Garbage Sorting

Preparation

Train Model

Deploy Model

Block Description (Advanced Function)