# Sixth Lichuang Electric Competition #ESP_MASTER ESP32 multi-function development board

Note: * is required

Please fill it out during the registration stage↓

* 1. Introduction to project functions

This project is based on ESP32 as the core, trying to squeeze out the capabilities of its MCU as much as possible to create a multi-functional collection of highly comprehensive small modules. The functions include:

1. Voice recognition. Connect the digital microphone to ESP32 through I2S, and through esp-skainet offline speech recognition, the maximum number of custom voice command words is 100

2. Object recognition, text recognition (license plate recognition). Based on Baidu Smart Cloud, the RGB image obtained by the camera is converted into JPG, and the recognition result is obtained and displayed after being uploaded to Baidu Cloud through base64 and urlcode encoding.

3. Color recognition. The image acquired by the camera can be converted from RGB to HSL to determine each pixel, identify the color block, and obtain the coordinates of the color block.

4. Home appliance control. The air conditioner type can be set by voice, or the air conditioner type can be set in the setting interface. Currently, Gree, Midea, and Haier air conditioners are supported. The air conditioner code library is provided by IREXT, and the code library is stored in the spiffs partition of flash.

5.LVGL. Based on LVGL 7.6.0, more than 10 interface switches.

6. ADC button. When the ESP32 pins are extremely insufficient, an IO port is used, and the status of the three buttons can be read through resistor voltage division.

7. FFT spectrum, connect the digital microphone to ESP32 through I2S, and obtain the spectrum through software FFT and display it through lvgl img.

8. Mini games. Port of 2048 and Snake games.

9. Chicken soup every day. After entering the Daily Chicken Soup interface, HTTP randomly obtains a sentence and displays it.

*2. Project attributes

Publicly available for the first time, both hardware and software are original.

Note: Please indicate whether the project has been made public for the first time; whether the project is original; whether the project has won awards in other competitions; if so, describe the details of the award; whether the project has participated in a defense in school.

* 3. Open source agreement

CC-BY-NC-SA 3.0

It is prohibited to sell this item on Taobao or Xianyu! !

Note: Altruism means self-interest, please read the following content carefully.

1. Embrace open source and give projects unlimited value. It is recommended that more than 80% of the core functions of the project be open source;
2. If a certain part of the function is irreplaceable and the project cannot solve the corresponding problem after deletion, then the function implemented by this part is the core function of the project; for example, if an electronic load is designed and a host computer software is designed to monitor power changes, the electronic The load is the core function, and the host computer software is the auxiliary function; for example, an isolated 485 module is used in the electronic load to communicate with the host computer, then the communication function implemented by this 485 module is an auxiliary function;
3. Projects should choose an open source agreement that suits them . If the project references other open source projects, the source should be indicated and follow the original author's open source agreement. It is recommended that original projects use the GPL3.0 open source agreement;
4. Functions implemented by directly quoting the original circuits or original codes of open source projects cannot be used as the core functions of one's own projects, and functions directly implemented using common modules on the market cannot be used as core functions of one's own projects.

Please fill in during the competition stage↓

*4. Hardware part

The hardware part uses the ESP32-WROVER module with built-in 16Mb Flash + 4Mb PSRAM.

Two 3528 infrared tubes

four buttons

A digital microphone MSM261S4030H0 high-sensitivity digital silicon microphone chip

A display screen can be 1.3-inch ST7789 240*240 or 1.54-inch ST7789 240*240

The power supply uses AP3410 which can provide 1.2A current

24P FPC camera socket can use OV7725 OV2640 OV5640

Serial to TTL using CP2104

A gyroscope MPU6050

Schematic:

1.3 inch PCB:

1.5 inch PCB:

Note: It is recommended to use Lichuang EDA . If you choose other EDA tools, please upload schematics in PDF format, PCB drawings in PDF format, and PCB files in Gerber format in the attachments. Here you can explain in detail your project implementation principles and mechanisms, precautions, debugging methods, testing methods, etc. It is recommended to introduce your ideas to others in the form of pictures and texts.

*5. Software part

The software part is developed using IDF 4.4

The main interface displays time, weather, temperature, date, astronaut animation, Bilibili fans and wifi connection status.

Long press the middle button to enter the menu selection button. The menus are

The software block diagram is as follows:

Speech recognition and face recognition use Espressif’s open source libraries

How to display LVGL external flash font on ESP32

Use LvglFontTool to generate font files . Select XBF font as the generation type and external BIN file.

Two files will be generated, a myFont.c and a bin file

Then put the bin file into the spiffs partition and it will be automatically burned into flash during compilation.

Modify myFont.c to obtain the bin file data and initialize the external font when entering it for the first time. Read the spiffs file into memory.

#include "lvgl.h"
#include "stdio.h"
#include <stdlib.h>
#include <string.h>
#include "esp_system.h"

#include "esp_vfs.h"
#include "esp_spiffs.h"

typedef struct
{
    uint16_t min;
    uint16_t max;     uint8_t
    bpp;
    uint8_t reserved[3];
} x_header_t;
typedef struct
{
    uint32_t pos;
} x_table_t;
typedef struct
{
    uint8_t
    adv_w     ;     int8_t     r ; } glyph_dsc_t;

static x_header_t __g_xbf_hd = {
    .min = 0x0020,
    .max = 0xff1a,
    .bpp = 4,
};
char *Font_buff = NULL;
// static uint8_t __g_font_buf[240]; //如bin文件存在SPI FLASH可使用此buff
static void init_font(void)
{
    FILE *ff = fopen("/spiffs/myFont.bin", "r");
    if (ff == NULL)
    {
        printf("Failed to open file for reading");
        return;
    }
    fseek(ff, 0, SEEK_END);
    long lSize = ftell(ff);
    rewind(ff);
    printf("Lsize %ld", lSize);
    static uint8_t first_in = 1;
    if (first_in == 1)
    {
        first_in = 0;
        Font_buff = (char *)malloc(sizeof(char) * lSize);
    }
    int br = fread(Font_buff, 1, lSize, ff);
    printf("Bytes read %d", br);
    fclose(ff);
}
static uint8_t *__user_font_getdata(int offset, int size)
{
    //如字模保存在SPI FLASH, SPIFLASH_Read(__g_font_buf,offset,size);
    //如字模已加载到SDRAM,直接返回偏移地址即可如:return (uint8_t*)(sdram_fontddr+offset);
    static uint8_t first_in = 1;
    if (first_in == 1)//第一次进入的时候初始化外部字体
    {
        first_in = 0;
        init_font();
    }
    return (uint8_t*)(Font_buff+offset);
    // return __g_font_buf;
}

static const uint8_t *__user_font_get_bitmap(const lv_font_t *font, uint32_t unicode_letter)
{
    if (unicode_letter > __g_xbf_hd.max || unicode_letter < __g_xbf_hd.min)
    {
        return NULL;
    }
    uint32_t unicode_offset = sizeof(x_header_t) + (unicode_letter - __g_xbf_hd.min) * 4;
    uint32_t *p_pos = (uint32_t *)__user_font_getdata(unicode_offset, 4);
    if (p_pos[0] != 0)
    {
        uint32_t pos = p_pos[0];
        glyph_dsc_t *gdsc = (glyph_dsc_t *)__user_font_getdata(pos, sizeof(glyph_dsc_t));
        return __user_font_getdata(pos + sizeof(glyph_dsc_t), gdsc->box_w * gdsc->box_h * __g_xbf_hd.bpp / 8);
    }
    return NULL;
}

static bool __user_font_get_glyph_dsc(const lv_font_t *font, lv_font_glyph_dsc_t *dsc_out, uint32_t unicode_letter, uint32_t unicode_letter_next)
{
    if (unicode_letter > __g_xbf_hd.max || unicode_letter < __g_xbf_hd.min)
    {
        return NULL;
    }
    uint32_t unicode_offset = sizeof(x_header_t) + (unicode_letter - __g_xbf_hd.min) * 4;
    uint32_t *p_pos = (uint32_t *)__user_font_getdata(unicode_offset, 4);
    if (p_pos[0] != 0)
    {
        glyph_dsc_t *gdsc = (glyph_dsc_t *)__user_font_getdata(p_pos[0], sizeof (glyph_dsc_t));
        dsc_out->adv_w = gdsc->adv_w;
        dsc_out->box_h = gdsc->box_h;
        dsc_out->box_w = gdsc->box_w;
        dsc_out->ofs_x = gdsc->ofs_x;
        dsc_out->ofs_y = gdsc->ofs_y;
        dsc_out->bpp = __g_xbf_hd.bpp;
        return true;
    }
    return false;
}

//AliHYAiHei-Beta,,-1
//Font height: 24
//XBF font, external bin file
lv_font_t myFont = {
    .get_glyph_bitmap = __user_font_get_bitmap,
    .get_glyph_dsc = __user_font_get_glyph_dsc,
    .line_height = 24,
    .base_line = 0,
};

    LV_FONT_DECLARE(myFont);
    lv_obj_t *label = lv_label_create(obj, NULL);
    lv_obj_set_style_local_text_font(label, LV_LABEL_PART_MAIN, LV_STATE_DEFAULT, &myFont);

For object and text recognition:

First, you need to obtain the token on Baidu Smart Cloud, then convert the obtained image into JPG format, and then upload the data obtained through base64 encoding and urlcode encoding to Baidu in the form of post for identification. After the result is identified, the json data is obtained for analysis. and display.

For color recognition:

Convert each pixel of the acquired image to HSL and corrode it, search for the corrosion center, and then corrode outward from the corrosion center to obtain a new corrosion center.

Note: If your project involves software development, please upload the corresponding project source code in the attachment. Here you can describe in detail your software flow chart, functional module block diagram, explanation or popular science of related algorithms, source code structure, construction and configuration of compilation environment, source code compilation method, program burning method, etc. It is recommended to introduce your ideas to others in the form of pictures and texts.

*6. BOM list

Note: BOM list involved in the project. Please upload a screenshot of the BOM at this location. Please upload the list details in PDF format to the attachment. Suggestions include model, brand, name, packaging, procurement channels, usage, etc. The specific content and form should be based on clearly expressing the project composition.

*7. Contest LOGO verification

Please upload a project picture containing the competition logo. The logo will be printed on the PCB in the form of silk screen printing.

Click the zip to download the competition logo! (Contest logo).zip

* 8. Demonstrate your project and record it as a video for uploading

Video requirements: Please shoot horizontally, with a resolution of no less than 1280×720, in Mp4/Mov format, and the size of a single video is limited to 100M;

Video title: Lichuang Electric Competition: {Project Name}-{Video Module Name}; such as Lichuang Electric Competition: "Autonomous Driving" - Team Introduction.

More details: https://diy.szlcsc.com/posts/06c94d90c2c447dfbd9ed7339ff4a5b1