Commit Graph

49 Commits

Author SHA1 Message Date
Fu Hanxi
a25176d963 ci: make unity test case known failure work!
Besides, it would also improve the test report summary
2023-02-27 14:37:07 +08:00
Erhan Kurubas
1ee5c8d877 example/system: add generic apptrace example with pytest support 2023-02-15 10:30:08 +01:00
KonstantinKondrashov
c191e95300 ci: Run test_examples_efuse_with_virt_secure_boot_v2 only on ESP32 ECO3 2023-02-14 18:16:51 +08:00
Xu Si Yu
f6c13515b3 Merge branch 'feature/add_openthread_ci_for_esp32c6' into 'master'
openthread: add ci for esp32c6

See merge request espressif/esp-idf!22026
2023-02-03 10:29:30 +08:00
Xu Si Yu
389d07b9c1 openthread: add ci for esp32c6 2023-02-02 16:29:19 +08:00
jiangguangming
b0fa18d290 ci: fix typos tag naming of all flash_multi 2023-02-01 08:46:48 +08:00
Ondrej Kosta
5da702bab3 Merge branch 'feature/iperf_pytest_migration' into 'master'
iperf pytest migration

Closes IDFCI-1143

See merge request espressif/esp-idf!21726
2023-01-31 18:04:59 +08:00
Cao Sen Miao
94120b82c2 esp32h2: add build test 2023-01-17 10:29:04 +08:00
Ondrej Kosta
7aa4462d0b Ethernet & WiFi iperf test migration to pytest 2023-01-16 15:45:56 +01:00
Fu Hanxi
51adb9ab27 test: temp workaround for linux test apps 2023-01-16 10:25:55 +08:00
Fu Hanxi
6ee874ccad ci: add log_performance and check_performance as fixtures in pytest 2022-12-21 10:25:33 +08:00
Fu Hanxi
dc3c630919 ci: move more openocd scripts into pytest-embedded 2022-12-08 14:25:02 +08:00
Fu Hanxi
08e68c192a ci(pytest): differentiate temp_skip and temp_skip_ci markers 2022-12-08 09:49:12 +08:00
Fu Hanxi
52e6fefb3d ci(pytest): stop adding xtal_40mhz when running test case for other targets 2022-12-08 09:49:12 +08:00
Fu Hanxi
d9bcb99f58 ci(pytest): declare markers in conftest.py instead of pytest.ini 2022-12-08 09:49:12 +08:00
Song Ruo Jing
f201226439 ci: Move esp32c6 from preview_targets to supported_targets for ci 2022-11-28 11:58:30 +08:00
Fu Hanxi
056601127b ci: add temp_skip_ci marker to simplify markers
example: `@pytest.mark.temp_skip_ci(targets=['esp32'])`
2022-11-22 17:54:55 +08:00
Chen Yudong
a78d492091 pytest: use case_tester for multi-device tests 2022-11-10 22:29:05 +08:00
laokaiyao
8677216576 esp32h2: renaming esp32h2 to esp32h4 2022-11-08 17:05:33 +08:00
Song Ruo Jing
2557e24a28 ci: Enable esp32c6 example, test_apps, and unit tests CI build stage 2022-11-01 11:23:21 +08:00
Fu Hanxi
a8f68044a2 ci: fix setup error ignore issue 2022-10-21 11:46:24 +08:00
laokaiyao
cf528deeb1 test: add a script for supporting multi-dev and multi-stage case 2022-10-20 18:35:51 +08:00
Chen Yudong
aa822339aa pytest: set default timeout for each case 2022-10-08 04:47:35 +00:00
laokaiyao
ba235c5615 ci: add xtal_40mhz tag for c2 tests 2022-07-28 02:02:18 +00:00
Fu Hanxi
377cd97f4d fix: junit report not merged in component ut
related github pr: https://github.com/espressif/pytest-embedded/pull/111

released in pytest-embedded 0.7.6
2022-07-25 11:34:58 +08:00
Fu Hanxi
4317448f71 ci: allow pytest pass when no tests collected 2022-07-18 09:11:37 +08:00
Chen Yudong
f7981d8760 ci: add python_package for running pytest locally 2022-07-15 14:21:39 +08:00
Chen Yudong
69e15827c9 CI: add specific job rules 2022-07-11 12:32:30 +08:00
Aleksei Apaseev
97725036db ci: add support nightly jobs for pytest cases 2022-07-05 12:25:23 +08:00
Fu Hanxi
7e0bb1dabd ci: use tags as markers 2022-06-10 09:13:23 +08:00
Fu Hanxi
4746a71028 ci: add qemu example 2022-05-21 00:11:59 +08:00
Fu Hanxi
5c997bd5dd ci(pytest): upgrade to 0.7.0 2022-05-13 11:54:42 +08:00
Fu Hanxi
c626297f81 ci: fix xfail test cases end up failed when existing known failure cases 2022-05-12 05:18:57 +00:00
morris
47e4fe83ba ci: enable build pytest ut and examples on esp32c2 2022-05-12 05:18:57 +00:00
Fu Hanxi
877e98ae4b Revert "ci: rename all the generic s3 tag to generic_s3_fixme"
This reverts commit 9bb9b58b3b.
2022-04-27 04:00:17 +00:00
Fu Hanxi
5e05a1f174 ci: use IDF_PATH as pytest log dir 2022-04-06 18:46:49 +08:00
Fu Hanxi
9bb9b58b3b ci: rename all the generic s3 tag to generic_s3_fixme 2022-03-25 12:56:58 +08:00
Fu Hanxi
51aff7264e ci(pytest): fix multi-dut build_dir 2022-03-21 18:34:25 +01:00
Fu Hanxi
66296f56e9 ci(pytest): add known failure cases 2022-03-14 20:29:38 +08:00
Fu Hanxi
f64d25191e ci(pytest): move to class plugin 2022-03-14 20:29:38 +08:00
Fu Hanxi
d261840dbd ci: pytest idf ci could accept "--target" as uppercase 2022-03-10 11:52:34 +08:00
Fu Hanxi
31fafaea93 ci(pytest): reorder test sequence to run tests faster 2022-02-23 09:12:46 +08:00
Fu Hanxi
1b095db5c9 ci(pytest): refactor panic test to pytest 2022-02-23 09:12:46 +08:00
Fu Hanxi
4f0393b0d1 ci(pytest): add --sdkconfig to trigger only the sdkconfig tests 2022-02-23 09:03:36 +08:00
Fu Hanxi
a801555299 ci: replace all component ut with pytest-embedded 2022-01-24 16:37:23 +08:00
Fu Hanxi
ea4673a3a2 ci(pytest): support special markers "supported_targets", "preview_targets", "all_targets" 2022-01-24 15:55:00 +08:00
Fu Hanxi
61942a9f9f fix(pytest): use "--target" to filter the test cases
"-m" can't be specified for multiple times. pytest is using "and", "or",
"not" and parentheses to filter by markers
2021-12-02 10:55:24 +08:00
Fu Hanxi
c2a239bd6b ci: set pytest case id to target.config.case_name 2021-12-02 10:18:28 +08:00
Fu Hanxi
ef685456ab example: use pytest-embedded to replace examples/system/console test scripts 2021-11-30 09:42:12 +08:00