Support for SC2356@2MP (1600×1200) via MIPI/CSI interface camera

[lboue]

Component name

esp32_camera

Link to component documentation on our website

https://esphome.io/components/esp32_camera/

Describe the enhancement

Support for SC2356@2MP (1600×1200) via MIPI/CSI interface camera

• 8/10-bit Raw RGB data

Use cases

M5stack Tab5.

Anything else?

https://docs.m5stack.com/en/core/Tab5
https://components.espressif.com/components/espressif/esp_cam_sensor/versions/1.5.1/readme

[github-actions[bot]]

🏷️ I've automatically added the component: esp32_camera label to help categorize this feature request.

[DT-art1]

Hi there,

I’ve been working on adding MIPI-CSI camera support for ESP32-P4 devices in ESPHome.
The implementation is available in this pull request:
👉 Modular Camera Framework with MIPI-CSI support · Pull Request #7639

This framework introduces a new camera pipeline and supports CSI-based sensors such as the SC2356 (2MP RAW) and others that use the ESP-IDF MIPI interface.

If you have a M5Stack Tab5 or similar board, I’d really appreciate it if you could test the branch and share your results.
Community feedback will help ensure the integration meets everyone’s needs and speeds up merging into ESPHome.

Thanks a lot for your help!

[lboue]

I tried last night, but the compiler crashed because it must have required too much memory.
I'll try again tonight on my PC.

[lboue]

Do you know how to fix this CONFIC_CAMERA_ issue for M5Tab?

[18:18:21][W][component:298]: api set Warning flag: unspecified
[18:18:21][C][component:173]: Setup api took 1ms
[18:18:21][E][camera_sensor:071]: No driver compiled (missing CONFIC_CAMERA_* option)!
[18:18:21][E][camera_pipeline:015]: Camera Sensor configure failed!
[18:18:21][E][pipeline:080]: camera_pipeline_id: Processor configure failed!
[18:18:21][E][component:211]: camera was marked as failed
[18:18:21][E][component:315]: camera set Error flag: unspecified
[18:18:21][C][component:173]: Setup camera took 4ms
[18:18:21][C][component:173]: Setup mdns took 2ms
[18:18:21][E][component:211]: esp32_camera_web_server was marked as failed
[18:18:21][E][component:315]: esp32_camera_web_server set Error flag: unspecified
[18:18:21][C][component:173]: Setup esp32_camera_web_server took 1ms
[18:18:21][E][component:211]: esp32_camera_web_server was marked as failed
[18:18:21][E][component:315]: esp32_camera_web_server set Error flag: unspecified
[18:18:21][C][component:173]: Setup esp32_camera_web_server took 1ms
[18:18:21][I][app:120]: setup() finished successfully!

[DT-art1]

This error is triggered when no camera sensor is detected. There are several possible causes, for example:

• The sensor is not powered (reset pin)
• Missing esp-ldo configuration)
• Sensor requires external clock (missing or incorrect XCLK)
• Missing or incorrect I2C pin configuration
• The sensor driver has not been enabled in the configuration (CONFIG_CAMERA_*)

Each sensor requires a corresponding CONFIG_CAMERA_* option to be enabled. For the SC2356, the required option is:

CONFIG_CAMERA_SC202CS: y

esp32:
  board: esp32-p4-evboard  
  flash_size: 16MB  
  framework:  
    type: esp-idf  
    sdkconfig_options:  
      CONFIG_CAMERA_SC202CS: y  

Other available sensor options can be found here:

https://github.com/espressif/esp-video-components/tree/master/esp_cam_sensor/sensors

[lboue]

Thanks. Actually, I was missing that part. Good point!
Now it works correctly.

[22:53:13][C][camera:182]: Camera:
[22:53:13][C][camera:182]:  Name: Camera
[22:53:13][C][camera:182]:  Idle update: 0 ms
[22:53:13][C][camera:182]:  Max update: 100 ms
[22:53:13][C][camera:034]:   Task:
[22:53:13][C][camera:034]:    Core: 1
[22:53:13][C][camera:034]:    Stack Size: 4096
[22:53:13][C][camera:034]:    Priority: 1
[22:53:13][C][camera:034]:    Delay: 5
[22:53:13][C][camera_pipeline:041]: Inputer: input
[22:53:13][C][camera_pipeline:041]:  IMAGE_FORMAT_RAW
[22:53:13][C][camera_pipeline:041]:  Retry Limit: 10
[22:53:13][C][camera_pipeline:041]:  Job: NO
[22:53:13][C][camera_sensor:226]: Camera Sensor: SC202CS
[22:53:13][C][camera_sensor:226]:  MIPI_1lane_24Minput_RAW8_1280x720_30fps
[22:53:13][C][camera_sensor:226]:  PIXEL_FORMAT_RGB565
[22:53:13][C][camera_sensor:226]:  Flip X: NO, Y: NO, Factory X: YES
[22:53:13][C][camera_sensor:226]:  Buffers: 2
[22:53:13][C][camera_sensor:226]:  Test Pattern: NO
[22:53:13][C][camera_sensor:226]:  MIPI-CSI:
[22:53:13][C][camera_sensor:226]:    Clock: 576 MHz
[22:53:13][C][camera_sensor:226]:    Lanes: 1
[22:53:13][C][camera_sensor:226]:    Line Sync: NO
[22:53:13][C][camera_sensor:241]:   Address: 0x36
[22:53:13][C][camera_sensor:101]: ISP:
[22:53:13][C][camera_sensor:101]:  Bayer Pattern:
[22:53:13][C][camera_sensor:101]:    Reported: BGGR
[22:53:13][C][camera_sensor:101]:    In Use: AUTO
[22:53:13][C][camera_pipeline:016]: Outputer: encode
[22:53:13][C][camera_pipeline:016]:  Buffers: 2
[22:53:13][C][camera_pipeline:016]:  Size: 207360
[22:53:13][C][camera_pipeline:016]:  Requester: IDLE, API, WEB
[22:53:13][C][camera_pipeline:016]:  Encoder: YES
[22:53:13][C][camera_pipeline:016]:  Job: NO
[22:53:13][C][camera_encoder:067]: Accelerated JPEG Encoder:
[22:53:13][C][camera_encoder:067]:  Size: 1048576
[22:53:13][C][camera_encoder:067]:  Quality: 40
[22:53:13][C][camera_encoder:067]:  Timeout: 100
[22:53:13][C][camera_encoder:067]:  SUBSAMPLING_444
[22:53:13][C][pipeline:149]: Pipeline:
[22:53:13][C][pipeline:154]:   input -> encode
[22:53:13][C][mdns:179]: mDNS:
[22:53:13][C][mdns:179]:  Hostname: m5stack-tab5
[22:53:13][C][esp32_camera_web_server:088]: ESP32 Camera Web Server:
[22:53:13][C][esp32_camera_web_server:088]:  Port: 8080
[22:53:13][C][esp32_camera_web_server:093]:   Mode: stream
[22:53:13][C][esp32_camera_web_server:088]: ESP32 Camera Web Server:
[22:53:13][C][esp32_camera_web_server:088]:  Port: 8081
[22:53:13][C][esp32_camera_web_server:095]:   Mode: snapshot