Commit Graph

119 Commits

Author SHA1 Message Date
Shivani Tipnis
2d22374460 ble-wifi-example-tests: Add fixes and cleanups to ble and wifi tests 2021-05-28 19:50:28 +05:30
He Yin Ling
201018da43 Merge branch 'ci/shorter_performance_test_log' into 'master'
ci: optimize performance test log

See merge request espressif/esp-idf!13607
2021-05-21 06:48:16 +00:00
He Yin Ling
79cd45fdee Merge branch 'test/support_multiple_targets_for_iperf_example_test' into 'master'
test: support multiple targets for iperf example test

Closes TCI-656

See merge request espressif/esp-idf!13527
2021-05-21 06:43:21 +00:00
He Yin Ling
016a37c8ad ci: save built binaries could be tested locally:
we have some test cases not executed in CI. we need to save those
binaries as artifacts so we can test locally.
2021-05-20 16:58:39 +08:00
He Yin Ling
8434c0c731 ttfw: fix DUT exception not added to junit report 2021-05-20 16:28:20 +08:00
Fu Hanxi
bccaab7e6c fix(ci): fix missing [Performance] prefix in junit report 2021-05-20 14:13:54 +08:00
Fu Hanxi
4304866780 ci: shorter performance test log 2021-05-20 14:13:54 +08:00
KonstantinKondrashov
2e4b625f59 simple_ota_example: Adds sha256 check for app images 2021-05-05 22:18:40 +08:00
Cao Sen Miao
2059990c94 ci: Add more information for flash performance test 2021-04-25 17:59:10 +08:00
Fu Hanxi
9b8d1e7826 fix(ci): return as failed when no test case result generated 2021-04-20 11:18:12 +08:00
Fu Hanxi
15b6389ca7 fix(ci): ci_fetch_submodule return full match name first 2021-04-19 19:34:11 +08:00
Fu Hanxi
7651e031cb fix: running ttfw tests locally hang forever while detecting ports 2021-04-14 11:43:13 +08:00
Fu Hanxi
92a9ad0b31 ci: allow wildcard in known failure cases 2021-04-01 19:29:04 +08:00
Fu Hanxi
4ffd458ddd ci: bugfix: known failure cases cannot read files 2021-02-09 15:33:49 +08:00
Ivan Grokhotkov
9a20283485 Merge branch 'bugfix/scan_test_missing_build_apps_without_tests' into 'master'
ci: bugfix: scan_test missing build apps without tests

See merge request espressif/esp-idf!12138
2021-01-28 17:48:24 +08:00
Fu Hanxi
85d4bca81a feat(tiny_test_fw): unify all junit report test case name
new format: <target>.<config>.<case_name>, the default value of
"config" is "default"
2021-01-28 12:25:14 +08:00
Fu Hanxi
d63069068f feat(tiny_test_fw): ignore known failure cases result
py
2021-01-28 12:25:14 +08:00
Fu Hanxi
be3d74efb2 fix(ci): scan_test missing build apps without tests 2021-01-27 12:35:49 +08:00
Fu Hanxi
0146f258d7 style: format python files with isort and double-quote-string-fixer 2021-01-26 10:49:01 +08:00
Aditya Patwardhan
b77c85c1e1 ttfw/IDFDUT: i) Added option to erase_flash in the IDFDUT class
ii) Renamed the method dump_flush to dump_flash
2021-01-20 11:12:14 +00:00
He Yin Ling
5befaac4be ttfw: fix get dut failed when dut port is set as env variable 2021-01-14 17:22:11 +08:00
Angus Gratton
6d3e06a9a3 ttfw: Move TestCaseFailed exception and handle differently to other exceptions
But also ensure the string form of this exception is never empty, if it ends up
somewhere else.
2021-01-12 11:42:03 +11:00
Angus Gratton
441d1306be ci ttfw: Consistently handle unexpected exceptions in test cases 2021-01-12 11:42:03 +11:00
He Yin Ling
97220af848 test: use pyecharts to replace matplotlib in iperf test 2021-01-07 17:10:41 +08:00
He Yin Ling
4e82540730 ttfw: save console log to file 2021-01-07 17:10:40 +08:00
He Yin Ling
16a488c405 test: fix iperf example errors:
1. fix TypeError when running with python3
2. fix throughput chart x/y axis label error
3. make test case compatibile with iperf bin on earlier release branches
2021-01-07 17:10:40 +08:00
Angus Gratton
ec75f923ef Merge branch 'ci/raise_esptool_errors' into 'master'
ci: Don't swallow exception details from flashing process

See merge request espressif/esp-idf!11803
2020-12-30 11:22:57 +08:00
Marius Vikhammer
7fe16bae25 tools: merge C3 changes into master 2020-12-30 07:04:12 +08:00
Angus Gratton
88d0d1fa02 ci: Don't swallow exception details from flashing process
If flashing fails, throw an exception that includes some information about the failure.
2020-12-29 15:41:22 +11:00
Omar Chebib
fcbc706a66 ci: fix flasher_args.json parser (iterate over dictionary)
Closes IDFCI-347
2020-12-29 12:27:51 +08:00
Ivan Grokhotkov
0b31f6a5fc Merge branch 'feature/ci_flasher_args_json_encrypted_flag' into 'master'
ci: use "encrypted" information in flasher_args.json

Closes IDF-2231

See merge request espressif/esp-idf!11551
2020-12-28 06:37:05 +08:00
Omar Chebib
05f97542b8 ci: use "encrypted" information in flasher_args.json
Take into account the new field "encrypted" that is part of the
partition entries in flasher_args.json file
Closes IDF-2231
2020-12-23 18:16:17 +08:00
Fu Hanxi
eda42035d2 scan test: bugfix: now can build multi target for one app 2020-12-15 17:56:53 +08:00
Fu Hanxi
3a88626ec3 search case: print target as well 2020-12-15 17:56:53 +08:00
Fu Hanxi
a5bcaea9cc use "additional_duts" to overwrite dut class for different targets 2020-12-15 17:55:54 +08:00
Fu Hanxi
7281a5a0cc Split component_ut tests based on targets
- add more label in CIScanTest.py
- fix the bug that will cause labels not iterate correctly
2020-11-30 14:08:54 +08:00
Angus Gratton
190aed41ee Merge branch 'bugfix/ttfw_example_test_fails_port_remains_open' into 'master'
ci: Fix CI issue if one example test fails, and if serial port returns some noise

Closes IDFCI-236

See merge request espressif/esp-idf!11273
2020-11-26 08:04:00 +08:00
Angus Gratton
26fb74bc97 ci: ttfw: Encode serial port data to whatever the console encoding is
This is a bit of a hack, but gives us a way to always log it
2020-11-24 18:32:47 +11:00
Angus Gratton
37838803db ci: Log failure to close any DUT 2020-11-24 18:32:47 +11:00
He Yin Ling
e568daf213 ttfw: fix idf performance check doesn't work 2020-11-12 09:49:44 +00:00
Mahavir Jain
0fb65d0bae Merge branch 'bugfix/ttfw_idf_find_artifacts_inaccurate_with_same_prefix_path' into 'master'
CI: fix the bug returns wrong artifact path when app_name is a subset of a longer one

Closes IDFCI-217

See merge request espressif/esp-idf!11187
2020-11-12 12:12:51 +08:00
Angus Gratton
66fb5a29bb Whitespace: Automated whitespace fixes (large commit)
Apply the pre-commit hook whitespace fixes to all files in the repo.

(Line endings, blank lines at end of file, trailing whitespace)
2020-11-11 07:36:35 +00:00
Fu Hanxi
5fa935e5ea CI: fix the bug returns wrong artifact path when app_name is a subset of a longer one 2020-11-11 12:31:39 +08:00
Fu Hanxi
75ab9223f9 scan test when weekend test. 2020-10-26 10:25:21 +08:00
Ivan Grokhotkov
2218ac91c2 tools/ci: fix import error when running ttfw tests locally 2020-10-13 18:09:22 +02:00
morris
9fa06719fa global: enable build uinit test for esp32-s3 2020-09-22 15:15:03 +08:00
Ivan Grokhotkov
d17a3c76d0 ci: fetch submodules from mirror, if enabled 2020-09-16 21:22:26 +02:00
Ivan Grokhotkov
f16d231197 Merge branch 'feature/improve_load_env_log' into 'master'
CI: Improve load env config log output

See merge request espressif/esp-idf!9587
2020-09-16 01:59:05 +08:00
Fu Hanxi
edc7cc9c00 add component_ut in assign-test and target-test stage.
Add one template_test python file to get test case
2020-09-07 12:12:11 +08:00
Fu Hanxi
e35328afd9 build component unit test apps
use idf_py_actions supported targets
2020-09-07 12:11:55 +08:00