Fruit Recognition Using ESP32-S3 AI CAM and Edge Impulse

• EdgeImpulse Official Website: https://edgeimpulse.com/
• EdgeImpulse Project Link: [https://studio.edgeimpulse.com/public/571380/live

Data Collection

1. Burn the "CameraWebServer" example code to the ESP32-S3 AI CAM module.
2. Open the serial monitor to check the IP address.
3. Access the IP address through a browser on a device within the same local network. Click the “Start” button to view the camera feed.
4. Save images to your computer by clicking the upper-right corner of the video frame. (It is recommended to save images of different objects in separate folders for easier data labeling during training.)

Collect as much image data as possible to improve model accuracy. For this project, around 50 images of apples and oranges were used.

Collected image dataset:

Data Labeling

1. Create a new project in Edge Impulse.

   

2. Click “Add existing data” to upload collected images.

   

3. Select “Upload data” and upload image files. Enter corresponding labels for the images.

   

4. In “Data acquisition → Labeling queue”, mark the object of interest in the images and save.

   

   Example: Labeling oranges

   

Training the Model

1. Once all data is labeled, navigate to “Impulse design -> Create impulse” to create and save your impulse.
   Processing blocks explanation: EdgeImpulse Documentation
   

2. Go to the “image” page and click “Save parameters”.
   

3. Navigate to the “Generate features” page and click “Generate features” to extract image features.
   

4. Go to “Object detection”, then click “Save & train” to train the model.
   

5. Once training is complete, review model performance. Adjust parameters and retrain if necessary.
   

6. Go to the "Retrain model" page and click "Train model"
   

Deploying the Model

Here's the English translation of the steps:

1. Extract the trained model files into the "libraries" folder of your Arduino installation directory.

2. Download the files: conv.cpp, depthwise_conv.cpp, and the edge_camera folder.

3. Copy the downloaded conv.cpp and depthwise_conv.cpp files into your trained model's folder, replacing existing files if prompted.

   • Path: Your_Trained_Model_Folder\src\edge-impulse-sdk\tensorflow\lite\micro\kernels

   

4. Copy the entire edge_camera folder and paste it into your trained model's directory.

   • Path: Your_Trained_Model_Folder\examples

   

5. Open Arduino IDE, locate the edge_camera example sketch. Replace the header file with your model's header and enter your WiFi credentials (SSID and password).

   

6. Compile and upload the sketch. Open the Serial Monitor to view the IP address and classification results. Access the IP address in a web browser to view the camera feed.