Fu Hanxi
23c339e231
ci: raise RuntimeError instead of SystemExit to avoid kill the process
...
otherwise the pytest process will be killed immediately
2024-01-16 20:21:40 +01:00
Fu Hanxi
61aafd1e89
ci: fix download with multi-dut test cases with markers only
2024-01-15 22:36:09 +01:00
Fu Hanxi
c8dffc9378
ci: fix collect multi-dut test case with markers issue
...
While collecting, we stop registering the new plugin.
Otherwise the new created plugin will override the one we passed
also run the tests inside idf. the behavior is different.
2024-01-15 22:36:09 +01:00
Fu Hanxi
edf735a458
ci: fix get binaries from pipeline via the build report
...
should extract to IDF_PATH, not the current workdir
2024-01-12 08:43:20 +01:00
Fu Hanxi
fba96d58c2
ci: dynamic pipeline
...
build:
- upgrade idf-build-apps to 2.x
- unify get_pytest_apps and get_cmake_apps to get_all_apps
- returns (test_apps, non_test_apps) tuple
- add tests for the new get_all_apps
assign:
- generate build report
- generate target test pipeline based on the build report
target test:
- download artifacts from minio server
- users can use `pytest --pipeline-id xxxxx` to download and flash
the binaries from the artifacts
.post:
- generate target test reports
2024-01-10 15:37:34 +01:00
Fu Hanxi
06af021c9f
ci(pytest): stop ambiguous markers for multi-dut test case
...
also add `tools/ci/idf_pytest/tests` for testing
2024-01-10 15:29:42 +01:00
igor.udot
e0a40feb5c
refactor: changed logic of unity_tester, replaced threads by generators
2023-12-06 15:58:05 +08:00
Aleksei Apaseev
a3362727cc
ci: assign the test_case_name attribute to the case item while setting up a pytest session
2023-10-23 20:45:05 +08:00
Fu Hanxi
24b2e0a56d
ci: different test case name with different params
2023-10-04 16:05:29 +00:00
Fu Hanxi
5e4427ab13
ci(pytest): add plugin pytest-ignore-test-results
...
pass with warning if test job got ignored.
2023-08-18 10:50:18 +08:00
Fu Hanxi
39f3a5f3ac
ci(pytest): skip test case if no app found while collecting, not setup
2023-08-18 08:36:06 +08:00
Fu Hanxi
1d69302eae
ci(pytest): move pytest utils into tools/ci/idf_pytest
...
For future usage
2023-08-18 08:36:06 +08:00
Xu Si Yu
36511a3005
Merge branch 'feature/add_sleep_test_for_ot_ci' into 'master'
...
OpenThread CI: add a test case of sleepy device
See merge request espressif/esp-idf!24715
2023-08-01 20:38:29 +08:00
Abhik Roy
ef50beb4d0
ci: Added napt pytest with vlan example
...
CI: add vlan example to ethernet patterns
Included a Pytest for the vlan_support example, which focuses on testing
the NAPT module in lwip by forwarding packets between different VLAN interfaces.
2023-07-31 13:42:26 +00:00
Xu Si Yu
5f51dcc686
ci(openthread): Add a test case for openthread sleepy device
2023-07-31 15:38:11 +08:00
Fu Hanxi
7c3143dba8
ci: name the test case id with _qemu postfix for qemu test cases
2023-07-26 17:09:38 +08:00
Aleksei Apaseev
9f5f8fa939
ci(pytest): Add functionality to merge JUnit files of the multidut testcases into one file with the unique testcases
2023-07-25 10:11:55 +08:00
Harshit Malpani
7645723127
fix(ci): update HTTP client example tests runner assignment
...
HTTP client example tests now connect with locally hosted httpbin service
for more stable results across multiple runs
2023-07-21 10:55:25 +05:30
Ondrej Kosta
3e97f81727
Merge branch 'bugdix/lwip_bridge_ci_err' into 'master'
...
Fix lwip bridge CI error
See merge request espressif/esp-idf!24718
2023-07-14 16:51:19 +08:00
Shu Chen
5ffeff55b4
Merge branch 'zigbee/Add_pytest_in_CI' into 'master'
...
ci(zigbee): Add pytest for esp32h2 in CI
See merge request espressif/esp-idf!23779
2023-07-13 23:24:55 +08:00
Abudl Rehman
a4ddf7d5f7
ci(zigbee): Add pytest for esp32h2 in CI
2023-07-13 15:15:33 +08:00
Planck (Lu Zeyu)
c190beb4d9
bugfix(esp_lcd): propagate the errors in the IO link layer
...
Closes https://github.com/espressif/esp-idf/issues/11741
Check the result of each esp_lcd_panel_io_tx_param/esp_lcd_panel_io_tx_color call
Add runner and modify test rules
Update .build-test-rules.yml
2023-07-13 10:23:05 +08:00
Ondrej Kosta
c7d56d213c
ci(examples/bridge): Fixed issue when broadcast message was not recevived time to time
2023-07-12 12:30:23 +02:00
Fu Hanxi
22e2738f78
ci: build and test only modified components related test cases
2023-05-26 22:59:57 +08:00
Laukik Hase
72f703ccd4
nvs_flash: Extended test-app and host tests for the HMAC-based NVS encr-keys protection scheme
2023-05-23 13:55:59 +05:30
laokaiyao
1f84f6c6ed
esp32h4: remove esp32h4 target from ci
2023-04-20 15:19:47 +08:00
Armando
ad46b43c2c
sdmmc: add an example communicating with eMMC chip on S3
2023-04-14 18:18:54 +08:00
Ondrej Kosta
eb17a9d6e0
network_examples: added LwIP bridge test
2023-04-12 09:14:12 +02:00
Fu Hanxi
1be18d4bc5
ci: migrate peripherals ttfw test scripts
2023-04-10 08:46:42 +08:00
Sachin Parekh
109afcb311
ci: Add patterns and target-tests for ecdsa_efuse runner
2023-04-07 14:56:37 +05:30
Fu Hanxi
9295aef934
ci: remove linux build dir workaround
2023-03-31 15:07:07 +08:00
Fu Hanxi
a25176d963
ci: make unity test case known failure work!
...
Besides, it would also improve the test report summary
2023-02-27 14:37:07 +08:00
Erhan Kurubas
1ee5c8d877
example/system: add generic apptrace example with pytest support
2023-02-15 10:30:08 +01:00
KonstantinKondrashov
c191e95300
ci: Run test_examples_efuse_with_virt_secure_boot_v2 only on ESP32 ECO3
2023-02-14 18:16:51 +08:00
Xu Si Yu
f6c13515b3
Merge branch 'feature/add_openthread_ci_for_esp32c6' into 'master'
...
openthread: add ci for esp32c6
See merge request espressif/esp-idf!22026
2023-02-03 10:29:30 +08:00
Xu Si Yu
389d07b9c1
openthread: add ci for esp32c6
2023-02-02 16:29:19 +08:00
jiangguangming
b0fa18d290
ci: fix typos tag naming of all flash_multi
2023-02-01 08:46:48 +08:00
Ondrej Kosta
5da702bab3
Merge branch 'feature/iperf_pytest_migration' into 'master'
...
iperf pytest migration
Closes IDFCI-1143
See merge request espressif/esp-idf!21726
2023-01-31 18:04:59 +08:00
Cao Sen Miao
94120b82c2
esp32h2: add build test
2023-01-17 10:29:04 +08:00
Ondrej Kosta
7aa4462d0b
Ethernet & WiFi iperf test migration to pytest
2023-01-16 15:45:56 +01:00
Fu Hanxi
51adb9ab27
test: temp workaround for linux test apps
2023-01-16 10:25:55 +08:00
Fu Hanxi
6ee874ccad
ci: add log_performance and check_performance as fixtures in pytest
2022-12-21 10:25:33 +08:00
Fu Hanxi
dc3c630919
ci: move more openocd scripts into pytest-embedded
2022-12-08 14:25:02 +08:00
Fu Hanxi
08e68c192a
ci(pytest): differentiate temp_skip and temp_skip_ci markers
2022-12-08 09:49:12 +08:00
Fu Hanxi
52e6fefb3d
ci(pytest): stop adding xtal_40mhz when running test case for other targets
2022-12-08 09:49:12 +08:00
Fu Hanxi
d9bcb99f58
ci(pytest): declare markers in conftest.py instead of pytest.ini
2022-12-08 09:49:12 +08:00
Song Ruo Jing
f201226439
ci: Move esp32c6 from preview_targets to supported_targets for ci
2022-11-28 11:58:30 +08:00
Fu Hanxi
056601127b
ci: add temp_skip_ci marker to simplify markers
...
example: `@pytest.mark.temp_skip_ci(targets=['esp32'])`
2022-11-22 17:54:55 +08:00
Chen Yudong
a78d492091
pytest: use case_tester for multi-device tests
2022-11-10 22:29:05 +08:00
laokaiyao
8677216576
esp32h2: renaming esp32h2 to esp32h4
2022-11-08 17:05:33 +08:00
