esp-idf/components
Ivan Grokhotkov 47659be5b8
build system: remove lwip from common requirements
lwip was added to common requirements list to provide "sys/socket.h"
header to all components without additional requirements specified.

However, lwip pulls in a lot of dependencies on other components.
This commit removes lwip from common requirements to reduce the number
of components in G1-only apps.

To compensate for this removal, the following changes are made:
- newlib (which is a common requirement) has a public dependency on
  lwip if lwip is present in the build. This ensures that sys/socket.h
  is available as long as lwip component is included into the build.
- lwip is now a public requirement of esp-tls since esp_tls.h includes
  sys/socket.h header.
- lwip is now a public requirement o esp_http_client because
  sys/socket.h is included from esp_http_client.h
- lwip is now a private requirement of esp_wifi for "smartconfig_ack"
- lwip is now a private requirement of mqtt for socket functions
- lwip is now a public requirement of tcp_transport because
  esp_transport_tcp.h includes sys/socket.h header.
- mbedtls checks if lwip component is present in the build. If yes,
  net_sockets.c is added to the build, along with the dependency on
  lwip. Previously lwip was a public requirement of mbedtls
  unconditionally.

system/g1_components test app is updated to reflect the changes

Default public dependencies of a component before and after this
change, except common requirements:

- esp_timer (public dependency of freertos)
- bootloader_support (public dependency of esp_hw_support)
- vfs (public dependency of lwip)
- esp_wifi (public dependency of lwip)
- esp_event (public dependency of esp_wifi)
- esp_netif (public dependency of esp_event)
- esp_eth (public dependency of esp_netif)
- esp_phy (public dependency of esp_wifi)

After:

- esp_timer (public dependency of freertos)
- bootloader_support (public dependency of esp_hw_support)

Altogether, the following components have been always added as
public requirements to all other components, and are not added now
([breaking-change]):

- lwip
- vfs
- esp_wifi
- esp_event
- esp_netif
- esp_eth
- esp_phy

Application components now need to explicitly declare dependencies on
these components.
2022-05-02 20:47:17 +02:00
..
app_trace global: add dependency on esp_timer component and include esp_timer.h 2022-04-25 18:39:23 +02:00
app_update G0: target component (components/esp32*) doesn't depend on driver anymore 2022-03-02 04:21:00 +00:00
asio mbedtls: Remove certs.c and certs.h from port directory 2022-03-15 17:16:07 +05:30
bootloader soc: moved kconfig options out of the target component. 2022-04-21 12:09:43 +08:00
bootloader_support Merge branch 'bugfix/bootloader_support_public_req' into 'master' 2022-04-27 17:04:07 +08:00
bt Merge branch 'bufix/esp32c3_s3_build_err' into 'master' 2022-05-01 17:48:18 +08:00
cmock Build & config: Remove leftover files from the unsupported "make" build system 2021-11-11 15:32:36 +01:00
console console: argtable3: sync arg_end argument name 2022-04-11 19:42:53 +02:00
cxx cxx: suppress -Warray-bounds warning for a test 2022-03-31 15:10:28 +07:00
driver Add high speed mode switch validation check for MMC. 2022-04-28 15:23:21 +02:00
efuse Merge branch 'bugfix/freertos_esp_timer_deps' into 'master' 2022-04-27 04:13:25 +08:00
esp32 soc: moved kconfig options out of the target component. 2022-04-21 12:09:43 +08:00
esp32c2 soc: moved kconfig options out of the target component. 2022-04-21 12:09:43 +08:00
esp32c3 soc: moved kconfig options out of the target component. 2022-04-21 12:09:43 +08:00
esp32h2 soc: moved kconfig options out of the target component. 2022-04-21 12:09:43 +08:00
esp32s2 Merge branch 'feature/move_target_kconfig_2' into 'master' 2022-04-24 13:29:43 +08:00
esp32s3 soc: moved kconfig options out of the target component. 2022-04-21 12:09:43 +08:00
esp_adc_cal adc: unify adc_ll_num_t and adc_unit_t 2022-03-18 11:36:50 +08:00
esp_common esp_common: rename EXT_RAM_ATTR to EXT_RAM_BSS_ATTR to make it clearer 2022-04-19 19:48:00 +08:00
esp_eth Merge branch 'feature/ksz8863rll_support' into 'master' 2022-04-14 10:51:27 +08:00
esp_event global: add dependency on esp_timer component and include esp_timer.h 2022-04-25 18:39:23 +02:00
esp_gdbstub Merge branch 'feature/gdbstub_rt_multicore' into 'master' 2022-03-17 19:59:29 +08:00
esp_hid freertos: Remove legacy data types 2022-02-09 23:05:45 +08:00
esp_http_client build system: remove lwip from common requirements 2022-05-02 20:47:17 +02:00
esp_http_server esp_http_server: Minor updates in error messages 2022-03-09 14:43:10 +05:30
esp_https_ota Check FW version at start of ota for encrypted binary 2022-03-23 11:09:48 +05:30
esp_https_server https_server: Add provision for callback at session close 2022-03-30 11:25:11 +05:30
esp_hw_support Merge branch 'bugfix/fix_esp32c3_brownout_under_deepsleep' into 'master' 2022-05-01 17:28:54 +08:00
esp_lcd i2s: fix only right case 2022-04-23 07:38:45 +00:00
esp_local_ctrl Build & config: Remove leftover files from the unsupported "make" build system 2021-11-11 15:32:36 +01:00
esp_netif Doc:update wifi api docs 2022-04-24 21:20:54 +08:00
esp_phy Merge branch 'bugfix/fix_build_warring' into 'master' 2022-04-27 18:19:13 +08:00
esp_pm Merge branch 'bugfix/idle_task_skipped_light_sleep' into 'master' 2022-04-28 16:11:29 +08:00
esp_ringbuf clk_tree: added default clock source for peripheral 2022-04-14 15:44:56 +08:00
esp_rom Merge branch 'refactor/gpio_unit_test' into 'master' 2022-04-01 18:38:19 +08:00
esp_serial_slave_link spi: support spi on h2 2022-03-29 11:54:08 +08:00
esp_system esp_system: make dependencies on vfs and esp_wifi optional 2022-05-02 20:47:17 +02:00
esp_timer global: add dependency on esp_timer component and include esp_timer.h 2022-04-25 18:39:23 +02:00
esp_wifi build system: remove lwip from common requirements 2022-05-02 20:47:17 +02:00
esp-tls build system: remove lwip from common requirements 2022-05-02 20:47:17 +02:00
espcoredump tools: add GDB v11.1 as a tool 2022-04-25 11:21:48 +07:00
esptool_py Merge branch 'feature/spi_flash_esp8684_support' into 'master' 2022-04-27 11:05:45 +08:00
fatfs Merge branch 'feature/vfs_fat_info' into 'master' 2022-04-27 17:01:33 +08:00
freertos freertos: Move IDF API additions to seperate files 2022-04-27 20:31:39 +08:00
hal Merge branch 'feature/spi_flash_esp8684_support' into 'master' 2022-04-27 11:05:45 +08:00
heap rmt: add more clock source caps 2022-04-21 13:59:47 +00:00
http_parser docs/en: Add entry for http_parser in copyrights page 2022-01-11 10:26:25 +05:30
idf_test test_rsa.c: remove 'use_blinding' variable. 2022-04-20 01:07:01 +00:00
ieee802154 openthread: Update OpenThread submodule 2022-03-07 15:45:16 +08:00
json Build & config: Remove leftover files from the unsupported "make" build system 2021-11-11 15:32:36 +01:00
linux linux: add dummy sys/lock.h implementation (single threaded only) 2022-01-24 18:51:40 +01:00
log log: support ESP_LOG_BUFFER* functions for Linux target 2022-04-11 13:29:01 +02:00
lwip add option to route LWIP logs through ESP_LOG interface 2022-04-25 16:35:04 +08:00
mbedtls build system: remove lwip from common requirements 2022-05-02 20:47:17 +02:00
mdns soc: moved kconfig options out of the target component. 2022-04-21 12:09:43 +08:00
mqtt build system: remove lwip from common requirements 2022-05-02 20:47:17 +02:00
newlib build system: remove lwip from common requirements 2022-05-02 20:47:17 +02:00
nvs_flash Merge branch 'bugfix/nvs_coverity_issues' into 'master' 2022-01-29 21:52:18 +00:00
openthread openthread: Update OpenThread submodule 2022-03-07 15:45:16 +08:00
partition_table change: misaligned partitions now raise an exception 2022-03-15 12:54:59 +01:00
perfmon perfmon: add SDPX headers 2022-02-07 08:02:13 +00:00
protobuf-c Build & config: Remove leftover files from the unsupported "make" build system 2021-11-11 15:32:36 +01:00
protocomm Merge branch 'bugfix/wifi_prov_mgr_conn_issue' into 'master' 2022-03-24 15:35:49 +05:30
pthread global: add dependency on esp_timer component and include esp_timer.h 2022-04-25 18:39:23 +02:00
riscv riscv: Use semihosting to set breakpoint and watchpoint when running under debugger 2022-02-24 08:55:40 +00:00
sdmmc Add high speed mode switch validation check for MMC. 2022-04-28 15:23:21 +02:00
soc Merge branch 'feature/support_esp32s3_bbpll_fix' into 'master' 2022-04-27 22:52:21 +08:00
spi_flash Merge branch 'feature/spi_flash_esp8684_support' into 'master' 2022-04-27 11:05:45 +08:00
spiffs spiffs: add esp_spiffs_gc function to force garbage collection 2022-04-11 11:19:10 +02:00
tcp_transport build system: remove lwip from common requirements 2022-05-02 20:47:17 +02:00
tinyusb tinyusb: Allow dynamic configuration descriptor 2022-03-21 18:34:25 +01:00
touch_element global: add dependency on esp_timer component and include esp_timer.h 2022-04-25 18:39:23 +02:00
ulp soc: moved kconfig options out of the target component. 2022-04-21 12:09:43 +08:00
unity ci: add TEST_CASE_CI_IGNORE macro to allow pytest test cases to be ignored in ci 2022-03-30 15:11:08 +08:00
usb global: add dependency on esp_timer component and include esp_timer.h 2022-04-25 18:39:23 +02:00
vfs global: add dependency on esp_timer component and include esp_timer.h 2022-04-25 18:39:23 +02:00
wear_levelling esp_hw_support/esp_system: Re-evaluate header inclusions and include directories 2022-03-07 11:18:08 +05:30
wifi_provisioning provisioning: replace <lwip/inet.h> by <lwip/ip4_addr.h> in wifi_provisioning/wifi_config.h 2022-04-26 17:42:29 +08:00
wpa_supplicant Merge branch 'bugfix/tkip_countermeasure_changes' into 'master' 2022-04-28 18:50:44 +08:00
xtensa system: fix SET_STACK macro crashing in windowoverflow8 exception 2022-03-04 15:25:52 +08:00
README.md esp_hw_support/esp_system: Re-evaluate header inclusions and include directories 2022-03-07 11:18:08 +05:30

Core Components

Overview

This document contains details about what the core components are, what they contain, and how they are organized.

Organization

The core components are organized into two groups.

The first group (referred to as G0 from now on) contains hal, xtensa and riscv (referred to as arch components from now on), esp_rom, esp_common, and soc. This group contain information about and low-level access to underlying hardware; or in the case of esp_common, hardware-agnostic code and utilities. These components can depend on each other, but as much as possible have no dependencies outside the group. The reason for this is that, due to the nature of what these components contain, the likelihood is high that a lot of other components will require these. Ideally, then, the dependency relationship only goes one way. This makes it easier for these components, as a group, to be usable in another project. One can conceivably implement a competing SDK to ESP-IDF on top of these components.

The second group (referred to as G1 from now on) sits at a higher level than the first group. This group contains the components esp_hw_support, esp_system, newlib, spi_flash, freertos, log, and heap. Like the first group, circular dependencies within the group are allowed; and being at a higher level, dependency on the first group is allowed. These components represent software mechanisms essential to building other components.

Descriptions

The following is a short description of the components mentioned above.

G0 Components

hal

Contains the hardware abstraction layer and low-level operation implementations for the various peripherals. The low-level functions assign meaningful names to register-level manipulations; the hardware abstraction provide operations one level above this, grouping these low-level functions into routines that achieve a meaningful action or state of the peripheral.

Example:

  • spi_flash_ll_set_address is a low-level function part of the hardware abstraction spi_flash_hal_read_block

arch

Contains low-level architecture operations and definitions, including those for customizations (can be thought of on the same level as the low-level functions of hal). This can also contain files provided by the architecture vendor.

Example:

  • xt_set_exception_handler
  • riscv_global_interrupts_enable
  • ERI_PERFMON_MAX

esp_common

Contains hardware-agnostic definitions, constants, macros, utilities, 'pure' and/or algorithmic functions that is useable by all other components (that is, barring there being a more appropriate component to put them in).

Example:

  • BIT(nr) and other bit manipulation utilities in the future
  • IDF_DEPRECATED(REASON)
  • ESP_IDF_VERSION_MAJOR

soc

Contains description of the underlying hardware: register structure, addresses, pins, capabilities, etc.

Example:

  • DR_REG_DPORT_BASE
  • SOC_MCPWM_SUPPORTED
  • uart_dev_s

esp_rom

Contains headers, linker scripts, abstraction layer, patches, and other related files to ROM functions.

Example:

  • esp32.rom.eco3.ld
  • rom/aes.h

G1 Components

spi_flash

SPI flash device access implementation.

freertos

FreeRTOS port to targets supported by ESP-IDF.

log

Logging library.

heap

Heap implementation.

newlib

Some functions n the standard library are implemented here, especially those needing other G1 components.

Example:

  • malloc is implemented in terms of the component heap's functions
  • gettimeofday is implemented in terms of system time in esp_system

esp_system

Contains implementation of system services and controls system behavior. The implementations here may take hardware resources and/or decide on a hardware state needed for support of a system service/feature/mechanism. Currently, this encompasses the following, but not limited to:

  • Startup and initialization
  • Panic and debug
  • Reset and reset reason
  • Task and interrupt watchdogs

esp_hw_support

Contains implementations that provide hardware operations, arbitration, or resource sharing, especially those that is used in the system. Unlike esp_system, implementations here do not decide on a hardware state or takes hardware resource, acting merely as facilitator to hardware access. Currently, this encompasses the following, but not limited to:

  • Interrupt allocation
  • Sleep functions
  • Memory functions (external SPIRAM, async memory, etc.)
  • Clock and clock control
  • Random generation
  • CPU utilities
  • MAC settings

esp_hw_support vs esp_system

This section details list some implementations and the reason for placing it in either esp_hw_support or esp_system.

task_wdt.c (esp_system) vs intr_alloc.c (esp_hw_support)

The task watchdog fits the definition of taking and configuring hardware resources (wdt, interrupt) for implementation of a system service/mechanism.

This is in contrast with interrupt allocation that merely facilitates access to the underlying hardware for other implementations - drivers, user code, and even the task watchdog mentioned previously!

crosscore_int.c (esp_system)

The current implementation of crosscore interrupts is tightly coupled with a number of interrupt reasons associated with system services/mechanisms: REASON_YIELD (scheduler), REASON_FREQ_SWITCH (power management) REASON_PRINT_BACKTRACE (panic and debug).

However, if an implementation exists that makes it possible to register an arbitrary interrupt reason - a lower level inter-processor call if you will, then this implementation is a good candidate for esp_hw_support. The current implementation in esp_system can then just register the interrupt reasons mentioned above.

esp_mac.h, esp_chip_info.h, esp_random.h (esp_hw_support)

The functions in these headers used to be in esp_system.h, but have been split-off.

The remaining functions in esp_system.h are those that deal with system behavior, such as esp_register_shutdown_handler, or are proxy for other system components's APIs such as esp_get_free_heap_size.

The functions split-off from esp_system.h are much more hardware manipulation oriented such as: esp_read_mac, esp_random and esp_chip_info.