Commit Graph

85 Commits

Author SHA1 Message Date
Fu Hanxi
7641776ae2
ci: support filter pytest with sdkconfig name 2024-03-12 11:16:39 +01:00
Fu Hanxi
9783207f0b Merge branch 'ci/qemu_respect_all_test_triggerer' into 'master'
ci: fix idf_relpath issue while searching the apps

See merge request espressif/esp-idf!28645
2024-01-30 16:01:24 +08:00
Fu Hanxi
432c5a783d
ci: gitlab auth failing hint 2024-01-29 13:52:40 +01:00
Fu Hanxi
142a3c8a7a ci: fix idf_relpath issue while searching the apps
Now `PytestCase`, collect_app_info file, are all using relpath to idf
instead
2024-01-29 20:45:00 +08:00
Fu Hanxi
2ddb0fb3f6
ci: fix app.requires_elf_or_map. Use absolute paths 2024-01-22 11:14:03 +01:00
Fu Hanxi
23c339e231
ci: raise RuntimeError instead of SystemExit to avoid kill the process
otherwise the pytest process will be killed immediately
2024-01-16 20:21:40 +01:00
Fu Hanxi
61aafd1e89
ci: fix download with multi-dut test cases with markers only 2024-01-15 22:36:09 +01:00
Fu Hanxi
c8dffc9378
ci: fix collect multi-dut test case with markers issue
While collecting, we stop registering the new plugin.
Otherwise the new created plugin will override the one we passed

also run the tests inside idf. the behavior is different.
2024-01-15 22:36:09 +01:00
Fu Hanxi
edf735a458
ci: fix get binaries from pipeline via the build report
should extract to IDF_PATH, not the current workdir
2024-01-12 08:43:20 +01:00
Fu Hanxi
fba96d58c2
ci: dynamic pipeline
build:
- upgrade idf-build-apps to 2.x
- unify get_pytest_apps and get_cmake_apps to get_all_apps
	- returns (test_apps, non_test_apps) tuple
- add tests for the new get_all_apps

assign:
- generate build report
- generate target test pipeline based on the build report

target test:
- download artifacts from minio server
- users can use `pytest --pipeline-id xxxxx` to download and flash
the binaries from the artifacts

.post:
- generate target test reports
2024-01-10 15:37:34 +01:00
Fu Hanxi
06af021c9f
ci(pytest): stop ambiguous markers for multi-dut test case
also add `tools/ci/idf_pytest/tests` for testing
2024-01-10 15:29:42 +01:00
igor.udot
e0a40feb5c refactor: changed logic of unity_tester, replaced threads by generators 2023-12-06 15:58:05 +08:00
Aleksei Apaseev
a3362727cc ci: assign the test_case_name attribute to the case item while setting up a pytest session 2023-10-23 20:45:05 +08:00
Fu Hanxi
24b2e0a56d ci: different test case name with different params 2023-10-04 16:05:29 +00:00
Fu Hanxi
5e4427ab13
ci(pytest): add plugin pytest-ignore-test-results
pass with warning if test job got ignored.
2023-08-18 10:50:18 +08:00
Fu Hanxi
39f3a5f3ac
ci(pytest): skip test case if no app found while collecting, not setup 2023-08-18 08:36:06 +08:00
Fu Hanxi
1d69302eae
ci(pytest): move pytest utils into tools/ci/idf_pytest
For future usage
2023-08-18 08:36:06 +08:00
Xu Si Yu
36511a3005 Merge branch 'feature/add_sleep_test_for_ot_ci' into 'master'
OpenThread CI: add a test case of sleepy device

See merge request espressif/esp-idf!24715
2023-08-01 20:38:29 +08:00
Abhik Roy
ef50beb4d0 ci: Added napt pytest with vlan example
CI: add vlan example to ethernet patterns
Included a Pytest for the vlan_support example, which focuses on testing
the NAPT module in lwip by forwarding packets between different VLAN interfaces.
2023-07-31 13:42:26 +00:00
Xu Si Yu
5f51dcc686 ci(openthread): Add a test case for openthread sleepy device 2023-07-31 15:38:11 +08:00
Fu Hanxi
7c3143dba8
ci: name the test case id with _qemu postfix for qemu test cases 2023-07-26 17:09:38 +08:00
Aleksei Apaseev
9f5f8fa939 ci(pytest): Add functionality to merge JUnit files of the multidut testcases into one file with the unique testcases 2023-07-25 10:11:55 +08:00
Harshit Malpani
7645723127
fix(ci): update HTTP client example tests runner assignment
HTTP client example tests now connect with locally hosted httpbin service
for more stable results across multiple runs
2023-07-21 10:55:25 +05:30
Ondrej Kosta
3e97f81727 Merge branch 'bugdix/lwip_bridge_ci_err' into 'master'
Fix lwip bridge CI error

See merge request espressif/esp-idf!24718
2023-07-14 16:51:19 +08:00
Shu Chen
5ffeff55b4 Merge branch 'zigbee/Add_pytest_in_CI' into 'master'
ci(zigbee): Add pytest for esp32h2 in CI

See merge request espressif/esp-idf!23779
2023-07-13 23:24:55 +08:00
Abudl Rehman
a4ddf7d5f7 ci(zigbee): Add pytest for esp32h2 in CI 2023-07-13 15:15:33 +08:00
Planck (Lu Zeyu)
c190beb4d9 bugfix(esp_lcd): propagate the errors in the IO link layer
Closes https://github.com/espressif/esp-idf/issues/11741
Check the result of each esp_lcd_panel_io_tx_param/esp_lcd_panel_io_tx_color call
Add runner and modify test rules
Update .build-test-rules.yml
2023-07-13 10:23:05 +08:00
Ondrej Kosta
c7d56d213c ci(examples/bridge): Fixed issue when broadcast message was not recevived time to time 2023-07-12 12:30:23 +02:00
Fu Hanxi
22e2738f78 ci: build and test only modified components related test cases 2023-05-26 22:59:57 +08:00
Laukik Hase
72f703ccd4
nvs_flash: Extended test-app and host tests for the HMAC-based NVS encr-keys protection scheme 2023-05-23 13:55:59 +05:30
laokaiyao
1f84f6c6ed esp32h4: remove esp32h4 target from ci 2023-04-20 15:19:47 +08:00
Armando
ad46b43c2c sdmmc: add an example communicating with eMMC chip on S3 2023-04-14 18:18:54 +08:00
Ondrej Kosta
eb17a9d6e0 network_examples: added LwIP bridge test 2023-04-12 09:14:12 +02:00
Fu Hanxi
1be18d4bc5 ci: migrate peripherals ttfw test scripts 2023-04-10 08:46:42 +08:00
Sachin Parekh
109afcb311 ci: Add patterns and target-tests for ecdsa_efuse runner 2023-04-07 14:56:37 +05:30
Fu Hanxi
9295aef934 ci: remove linux build dir workaround 2023-03-31 15:07:07 +08:00
Fu Hanxi
a25176d963 ci: make unity test case known failure work!
Besides, it would also improve the test report summary
2023-02-27 14:37:07 +08:00
Erhan Kurubas
1ee5c8d877 example/system: add generic apptrace example with pytest support 2023-02-15 10:30:08 +01:00
KonstantinKondrashov
c191e95300 ci: Run test_examples_efuse_with_virt_secure_boot_v2 only on ESP32 ECO3 2023-02-14 18:16:51 +08:00
Xu Si Yu
f6c13515b3 Merge branch 'feature/add_openthread_ci_for_esp32c6' into 'master'
openthread: add ci for esp32c6

See merge request espressif/esp-idf!22026
2023-02-03 10:29:30 +08:00
Xu Si Yu
389d07b9c1 openthread: add ci for esp32c6 2023-02-02 16:29:19 +08:00
jiangguangming
b0fa18d290 ci: fix typos tag naming of all flash_multi 2023-02-01 08:46:48 +08:00
Ondrej Kosta
5da702bab3 Merge branch 'feature/iperf_pytest_migration' into 'master'
iperf pytest migration

Closes IDFCI-1143

See merge request espressif/esp-idf!21726
2023-01-31 18:04:59 +08:00
Cao Sen Miao
94120b82c2 esp32h2: add build test 2023-01-17 10:29:04 +08:00
Ondrej Kosta
7aa4462d0b Ethernet & WiFi iperf test migration to pytest 2023-01-16 15:45:56 +01:00
Fu Hanxi
51adb9ab27 test: temp workaround for linux test apps 2023-01-16 10:25:55 +08:00
Fu Hanxi
6ee874ccad ci: add log_performance and check_performance as fixtures in pytest 2022-12-21 10:25:33 +08:00
Fu Hanxi
dc3c630919 ci: move more openocd scripts into pytest-embedded 2022-12-08 14:25:02 +08:00
Fu Hanxi
08e68c192a ci(pytest): differentiate temp_skip and temp_skip_ci markers 2022-12-08 09:49:12 +08:00
Fu Hanxi
52e6fefb3d ci(pytest): stop adding xtal_40mhz when running test case for other targets 2022-12-08 09:49:12 +08:00