Re: [EXT] [testing-wg] Zephyr: Testing WG weekly call - Mon, 02/15/2021 2:00pm-3:00pm, Please RSVP
#cal-reminder
Hake Huang
Hi All,
This weekly meeting agenda:
1. Zephyr v2.5.0 tagged. 1. Call for review the release document at: https://github.com/zephyrproject-rtos/test_results/pull/154
2. nomenclature of test suites and test cases discussion. (Maciej 15 minutes) any detailed examples in on discussion? https://github.com/zephyrproject-rtos/zephyr/discussions/31090
3. round table discussion. (All)
Regards, Hake
From: testing-wg@... <testing-wg@...>
On Behalf Of testing-wg@... Calendar via lists.zephyrproject.org
Caution: EXT Email Reminder: Zephyr: Testing WG weekly call When: Monday, 15 February 2021, 2:00pm to 3:00pm, (GMT+00:00) UTC Where:Microsoft Teams Meeting An RSVP is requested. Click here to RSVP Organizer: testing-wg@... Description: Meeting Agenda: https://docs.google.com/document/d/1Qti_6mFPkctk9v2vnbz-IMe0ZZO2FJEpX72FaNnEfpE/edit?usp=sharing ________________________________________________________________________________ +1 321-558-6518 United States, Orlando (Toll) Conference ID: 831 716 531# Local numbers | Reset PIN | Learn more about Teams | Meeting options
________________________________________________________________________________
|
|
Zephyr: Testing WG weekly call - Mon, 02/08/2021 2:00pm-3:00pm, Please RSVP
#cal-reminder
testing-wg@lists.zephyrproject.org Calendar <testing-wg@...>
Reminder: Zephyr: Testing WG weekly call When: Monday, 8 February 2021, 2:00pm to 3:00pm, (GMT+00:00) UTC Where:Microsoft Teams Meeting An RSVP is requested. Click here to RSVP Organizer: testing-wg@... Description: Meeting Agenda: https://docs.google.com/document/d/1Qti_6mFPkctk9v2vnbz-IMe0ZZO2FJEpX72FaNnEfpE/edit?usp=sharing
________________________________________________________________________________
+1 321-558-6518 United States, Orlando (Toll)
Conference ID: 831 716 531#
Local numbers | Reset PIN | Learn more about Teams | Meeting options
________________________________________________________________________________
|
|
Re: [EXT] [testing-wg] Zephyr: Testing WG weekly call - Mon, 02/08/2021 2:00pm-3:00pm, Please RSVP
#cal-reminder
Hake Huang
Hi All,
This weekly meeting agenda:
1. V2.5.0 test release document review. (Hake/ All 15 minutes) https://github.com/zephyrproject-rtos/test_results/pull/154 Add link to the code base of footprint test(SHA) -> done Add footprint steps in to appendix-> done Please upload v2.5.0-rc3 board testing report.
2. nomenclature of test suites and test cases discussion, a short sync. (Maciej 15 minutes) https://github.com/zephyrproject-rtos/zephyr/discussions/31090 Maceij will take AI and create PR for this -> follow up
3. call for proposal on test result visualization solution. https://github.com/zephyrproject-rtos/test_results/discussions/190
4. Round table discussion. (30 minutes) https://github.com/zephyrproject-rtos/zephyr/pull/29427 please help to review https://github.com/zephyrproject-rtos/zephyr/pull/29427/files we need more reviewer/maintainer for twister scripts, let continue thinking about how to make it more maintainable.
Regards, Hake
From: testing-wg@... <testing-wg@...>
On Behalf Of testing-wg@... Calendar via lists.zephyrproject.org
Caution: EXT Email Reminder: Zephyr: Testing WG weekly call When: Monday, 1 February 2021, 2:00pm to 3:00pm, (GMT+00:00) UTC Where:Microsoft Teams Meeting An RSVP is requested. Click here to RSVP Organizer: testing-wg@... Description: Meeting Agenda: https://docs.google.com/document/d/1Qti_6mFPkctk9v2vnbz-IMe0ZZO2FJEpX72FaNnEfpE/edit?usp=sharing ________________________________________________________________________________ +1 321-558-6518 United States, Orlando (Toll) Conference ID: 831 716 531# Local numbers | Reset PIN | Learn more about Teams | Meeting options
________________________________________________________________________________
|
|
Zephyr: Testing WG weekly call - Mon, 02/01/2021 2:00pm-3:00pm, Please RSVP
#cal-reminder
testing-wg@lists.zephyrproject.org Calendar <testing-wg@...>
Reminder: Zephyr: Testing WG weekly call When: Monday, 1 February 2021, 2:00pm to 3:00pm, (GMT+00:00) UTC Where:Microsoft Teams Meeting An RSVP is requested. Click here to RSVP Organizer: testing-wg@... Description: Meeting Agenda: https://docs.google.com/document/d/1Qti_6mFPkctk9v2vnbz-IMe0ZZO2FJEpX72FaNnEfpE/edit?usp=sharing
________________________________________________________________________________
+1 321-558-6518 United States, Orlando (Toll)
Conference ID: 831 716 531#
Local numbers | Reset PIN | Learn more about Teams | Meeting options
________________________________________________________________________________
|
|
Re: [EXT] [testing-wg] Zephyr: Testing WG weekly call - Mon, 2/1/2021 2:00pm-3:00pm, Please RSVP
#cal-reminder
Hake Huang
Hi All,
This weekly meeting agenda:
1. V2.5.0 test release document review. (Hake/ All 15 mintues) https://github.com/zephyrproject-rtos/test_results/pull/154 pending items: added platfrom testing status?
2. nomenclature of test suites and test cases discussion, a short sync. (Maciej 15 mintues) https://github.com/zephyrproject-rtos/zephyr/discussions/31090
3. call for proposal on test result visualiztion solution https://github.com/zephyrproject-rtos/test_results/discussions/190
4. Round table discussion. (30 mintues)
Regards, Hake
From: testing-wg@... <testing-wg@...>
On Behalf Of testing-wg@... Calendar via lists.zephyrproject.org
Caution: EXT Email Reminder: Zephyr: Testing WG weekly call When: Monday, 1 Feberuary 2021, 2:00pm to 3:00pm, (GMT+00:00) UTC Where:Microsoft Teams Meeting An RSVP is requested. Click here to RSVP Organizer: testing-wg@... Description: Meeting Agenda: https://docs.google.com/document/d/1Qti_6mFPkctk9v2vnbz-IMe0ZZO2FJEpX72FaNnEfpE/edit?usp=sharing ________________________________________________________________________________ +1 321-558-6518 United States, Orlando (Toll) Conference ID: 831 716 531# Local numbers | Reset PIN | Learn more about Teams | Meeting options
________________________________________________________________________________
|
|
Re: [EXT] [testing-wg] Zephyr: Testing WG weekly call - Mon, 01/25/2021 2:00pm-3:00pm, Please RSVP
#cal-reminder
Hake Huang
Hi All,
I create a discussion here for test result visualization https://github.com/zephyrproject-rtos/test_results/discussions/190
Please provide you ideas and proposal here, Thanks.
Regards, Hake
From: testing-wg@... <testing-wg@...>
On Behalf Of testing-wg@... Calendar via lists.zephyrproject.org
Caution: EXT Email Reminder: Zephyr: Testing WG weekly call When: Monday, 25 January 2021, 2:00pm to 3:00pm, (GMT+00:00) UTC Where:Microsoft Teams Meeting An RSVP is requested. Click here to RSVP Organizer: testing-wg@... Description: Meeting Agenda: https://docs.google.com/document/d/1Qti_6mFPkctk9v2vnbz-IMe0ZZO2FJEpX72FaNnEfpE/edit?usp=sharing ________________________________________________________________________________ +1 321-558-6518 United States, Orlando (Toll) Conference ID: 831 716 531# Local numbers | Reset PIN | Learn more about Teams | Meeting options
________________________________________________________________________________
|
|
Zephyr: Testing WG weekly call - Mon, 01/25/2021 2:00pm-3:00pm, Please RSVP
#cal-reminder
testing-wg@lists.zephyrproject.org Calendar <testing-wg@...>
Reminder: Zephyr: Testing WG weekly call When: Monday, 25 January 2021, 2:00pm to 3:00pm, (GMT+00:00) UTC Where:Microsoft Teams Meeting An RSVP is requested. Click here to RSVP Organizer: testing-wg@... Description: Meeting Agenda: https://docs.google.com/document/d/1Qti_6mFPkctk9v2vnbz-IMe0ZZO2FJEpX72FaNnEfpE/edit?usp=sharing
________________________________________________________________________________
+1 321-558-6518 United States, Orlando (Toll)
Conference ID: 831 716 531#
Local numbers | Reset PIN | Learn more about Teams | Meeting options
________________________________________________________________________________
|
|
Re: [EXT] [testing-wg] Zephyr: Testing WG weekly call - Mon, 01/25/2021 2:00pm-3:00pm, Please RSVP
#cal-reminder
Hake Huang
Hi All,
This weekly meeting agenda:
1. V2.5-RC1 tagged, let’s switch to this weekly testing.
https://github.com/zephyrproject-rtos/zephyr/discussions/31090 Note: need consider none-ztest based test cases naming. Al: we need to vote whether to change the naming as Maciej proposed. 3. Bug analysis on https://testing.zephyrproject.org/daily_tests/zephyr-v2.4.0-3224-gc77ae15c9967/report/index.html (10 minutes) NXP: l can driver testing has one issue. (in analysis) l counter issue fixed. l Some board upstable issues found in kernel / libraries-libc testing retesting is ongoing(FRDM_KW41z, mimxrt1060_evk).
4. Test result data visualization discussion. (20 minutes/ All)
5. Release document comments https://github.com/zephyrproject-rtos/test_results/pull/154 (reminds)
6. Round table discussion. (15 minutes / All) NXP: any testing data on I2S?
Regards, Hake
From: testing-wg@... <testing-wg@...>
On Behalf Of testing-wg@... Calendar via lists.zephyrproject.org
Caution: EXT Email Reminder: Zephyr: Testing WG weekly call When: Monday, 25 January 2021, 2:00pm to 3:00pm, (GMT+00:00) UTC Where:Microsoft Teams Meeting An RSVP is requested. Click here to RSVP Organizer: testing-wg@... Description: Meeting Agenda: https://docs.google.com/document/d/1Qti_6mFPkctk9v2vnbz-IMe0ZZO2FJEpX72FaNnEfpE/edit?usp=sharing ________________________________________________________________________________ +1 321-558-6518 United States, Orlando (Toll) Conference ID: 831 716 531# Local numbers | Reset PIN | Learn more about Teams | Meeting options
________________________________________________________________________________
|
|
Zephyr: Testing WG weekly call - Mon, 01/18/2021 2:00pm-3:00pm, Please RSVP
#cal-reminder
testing-wg@lists.zephyrproject.org Calendar <testing-wg@...>
Reminder: Zephyr: Testing WG weekly call When: Monday, 18 January 2021, 2:00pm to 3:00pm, (GMT+00:00) UTC Where:Microsoft Teams Meeting An RSVP is requested. Click here to RSVP Organizer: testing-wg@... Description: Meeting Agenda: https://docs.google.com/document/d/1Qti_6mFPkctk9v2vnbz-IMe0ZZO2FJEpX72FaNnEfpE/edit?usp=sharing
________________________________________________________________________________
+1 321-558-6518 United States, Orlando (Toll)
Conference ID: 831 716 531#
Local numbers | Reset PIN | Learn more about Teams | Meeting options
________________________________________________________________________________
|
|
Re: [EXT] [testing-wg] Zephyr: Testing WG weekly call - Mon, 01/18/2021 2:00pm-3:00pm, Please RSVP
#cal-reminder
Hake Huang
Hi All,
This is this weekly meeting agenda:
1. Release document is RST format reviewing follow up. Any comments? https://github.com/zephyrproject-rtos/test_results/pull/154
2. V2.5.0 is closing, we need prepare the testing plans. (40 minutes) a) Testing scope. (boards, plans, doeuments, etc) b) Related links: https://github.com/zephyrproject-rtos/zephyr/projects/9 https://github.com/zephyrproject-rtos/zephyr/issues?q=is%3Aopen+is%3Aissue+milestone%3Av2.5.0
3. Round table discussion. (20 mintues) a) Pytest has allure plugin, would this possible to merge it to twister? b) H5py format trail. Some questions: I do some work on your proposed h5py format file, here is my trial: https://github.com/hakehuang/test_results/commit/84834483181f2e66e47d8707e2e985fc8f108fd2 my observations are: 1. h5py is initially to store large numpy data sets, so it is friendly to numbers, but to xml result format I only use a variable string to store all the xml, as I did not see an ready schema to convert all the result xml content to h5 attribute, tough. But in this way the h5py table function is not supported, as the variable is only comments. Looks like we need at least define a dataset which represents the trend. 2. We can merge all the report in to several result h5 files named by the version number or further merge them to one file, is this what your proposed? c) twister.xml and twister_report.xml full path differences. https://zephyrproject.slack.com/archives/CG9H1L6LE/p1610723284017000
Regards, Hake
From: testing-wg@... <testing-wg@...>
On Behalf Of testing-wg@... Calendar via lists.zephyrproject.org
Caution: EXT Email Reminder: Zephyr: Testing WG weekly call When: Monday, 18 January 2021, 2:00pm to 3:00pm, (GMT+00:00) UTC Where:Microsoft Teams Meeting An RSVP is requested. Click here to RSVP Organizer: testing-wg@... Description: Meeting Agenda: https://docs.google.com/document/d/1Qti_6mFPkctk9v2vnbz-IMe0ZZO2FJEpX72FaNnEfpE/edit?usp=sharing ________________________________________________________________________________ +1 321-558-6518 United States, Orlando (Toll) Conference ID: 831 716 531# Local numbers | Reset PIN | Learn more about Teams | Meeting options
________________________________________________________________________________
|
|
Re: [EXT] [testing-wg] Zephyr: Testing WG weekly call - Mon, 01/11/2021 2:00pm-3:00pm, Please RSVP
#cal-reminder
Hake Huang
Hi Maciej,
I do some work on your proposed h5py format file, here is my trial: https://github.com/hakehuang/test_results/commit/84834483181f2e66e47d8707e2e985fc8f108fd2
my observations are:
1. h5py is initially to store large numpy data sets, so it is friendly to numbers, but to xml result format I only use a variable string to store all the xml, as I did not see an ready schema to convert all the result xml content to h5 attribute, tough. But in this way the h5py table function is not supported, as the variable is only comments. Looks like we need at least define a dataset which represents the trend. 2. We can merge all the report in to several result h5 files named by the version number or further merge them to one file, is this what your proposed?
Regards, Hake
From: testing-wg@... <testing-wg@...>
On Behalf Of testing-wg@... Calendar via lists.zephyrproject.org
Caution: EXT Email Reminder: Zephyr: Testing WG weekly call When: Monday, 11 January 2021, 2:00pm to 3:00pm, (GMT+00:00) UTC Where:Microsoft Teams Meeting An RSVP is requested. Click here to RSVP Organizer: testing-wg@... Description: Meeting Agenda: https://docs.google.com/document/d/1Qti_6mFPkctk9v2vnbz-IMe0ZZO2FJEpX72FaNnEfpE/edit?usp=sharing ________________________________________________________________________________ +1 321-558-6518 United States, Orlando (Toll) Conference ID: 831 716 531# Local numbers | Reset PIN | Learn more about Teams | Meeting options
________________________________________________________________________________
|
|
Zephyr: Testing WG weekly call - Mon, 01/11/2021 2:00pm-3:00pm, Please RSVP
#cal-reminder
testing-wg@lists.zephyrproject.org Calendar <testing-wg@...>
Reminder: Zephyr: Testing WG weekly call When: Monday, 11 January 2021, 2:00pm to 3:00pm, (GMT+00:00) UTC Where:Microsoft Teams Meeting An RSVP is requested. Click here to RSVP Organizer: testing-wg@... Description: Meeting Agenda: https://docs.google.com/document/d/1Qti_6mFPkctk9v2vnbz-IMe0ZZO2FJEpX72FaNnEfpE/edit?usp=sharing
________________________________________________________________________________
+1 321-558-6518 United States, Orlando (Toll)
Conference ID: 831 716 531#
Local numbers | Reset PIN | Learn more about Teams | Meeting options
________________________________________________________________________________
|
|
Re: [EXT] [testing-wg] Zephyr: Testing WG weekly call - Mon, 1/11/2021 2:00pm-3:00pm, Please RSVP
#cal-reminder
Hake Huang
Hi All,
This is this weekly agenda:
1. Update the version SHA to 12 digitals merged(https://github.com/zephyrproject-rtos/zephyr/pull/31140) Note: Last weekly result can not merged, due to this check.
2. Release document is RST format reviewing.(All, 15 minutes) https://github.com/zephyrproject-rtos/test_results/pull/154
3. Round table discussion. (40 mintues) a) Pytest has allure plugin, would this possible to merge it to twister? b) …
Regards, Hake
From: testing-wg@... <testing-wg@...>
On Behalf Of testing-wg@... Calendar via lists.zephyrproject.org
Caution: EXT Email Reminder: Zephyr: Testing WG weekly call When: Monday, 1 January 2021, 2:00pm to 3:00pm, (GMT+00:00) UTC Where:Microsoft Teams Meeting An RSVP is requested. Click here to RSVP Organizer: testing-wg@... Description: Meeting Agenda: https://docs.google.com/document/d/1Qti_6mFPkctk9v2vnbz-IMe0ZZO2FJEpX72FaNnEfpE/edit?usp=sharing ________________________________________________________________________________ +1 321-558-6518 United States, Orlando (Toll) Conference ID: 831 716 531# Local numbers | Reset PIN | Learn more about Teams | Meeting options
________________________________________________________________________________
|
|
Re: [EXT] [testing-wg] about git version issue in testresult xml file
Hake Huang
update PR created. https://github.com/zephyrproject-rtos/zephyr/pull/31140 . @Anas Nashif please review. Thanks in advance.
Regards, Hake
From: Hake Huang
I find this is because
b9c953c12636a8d8f3d22b10e23218a50a695030
twister: add 12 hexadecimal digits to version
With the earlier version of Git, git describe command will use the default 7 hexadecimal digits as the abbreviated object name. But currently the Linux kernel project needs 11 to 12 hexdigits to stay unique.So it's necessary to add --abbrev=12 to ensure twister always generate the same tags.
In https://testing.zephyrproject.org/daily_tests/versions.json, all tags have 10 hexadecimal digits.
Signed-off-by: Jingru Wang <jingru@...>
Regards, hake
From:
testing-wg@... <testing-wg@...>
On Behalf Of Hake Huang via lists.zephyrproject.org
Caution: EXT Email Hi All,
Does anyone meet this issue like https://github.com/zephyrproject-rtos/test_results/pull/179?
I find the problem is the version in xml file is zephyr-v2.4.0-2748-gfbb0327d3e29, but the json file is zephyr-v2.4.0-2748-gfbb0327d3e.
Regards, Hake
|
|
Re: [EXT] [testing-wg] about git version issue in testresult xml file
Hake Huang
I find this is because
b9c953c12636a8d8f3d22b10e23218a50a695030
twister: add 12 hexadecimal digits to version
With the earlier version of Git, git describe command will use the default 7 hexadecimal digits as the abbreviated object name. But currently the Linux kernel project needs 11 to 12 hexdigits to stay unique.So it's necessary to add --abbrev=12 to ensure twister always generate the same tags.
In https://testing.zephyrproject.org/daily_tests/versions.json, all tags have 10 hexadecimal digits.
Signed-off-by: Jingru Wang <jingru@...>
Regards, hake
From: testing-wg@...
<testing-wg@...> On Behalf Of Hake Huang via lists.zephyrproject.org
Caution: EXT Email Hi All,
Does anyone meet this issue like https://github.com/zephyrproject-rtos/test_results/pull/179?
I find the problem is the version in xml file is zephyr-v2.4.0-2748-gfbb0327d3e29, but the json file is zephyr-v2.4.0-2748-gfbb0327d3e.
Regards, Hake
|
|
about git version issue in testresult xml file
Hake Huang
Hi All,
Does anyone meet this issue like https://github.com/zephyrproject-rtos/test_results/pull/179?
I find the problem is the version in xml file is zephyr-v2.4.0-2748-gfbb0327d3e29, but the json file is zephyr-v2.4.0-2748-gfbb0327d3e.
Regards, Hake
|
|
Zephyr: Testing WG weekly call - Mon, 12/14/2020 2:00pm-3:00pm, Please RSVP
#cal-reminder
testing-wg@lists.zephyrproject.org Calendar <testing-wg@...>
Reminder: Zephyr: Testing WG weekly call When: Monday, 14 December 2020, 2:00pm to 3:00pm, (GMT+00:00) UTC Where:Microsoft Teams Meeting An RSVP is requested. Click here to RSVP Organizer: testing-wg@... Description: Meeting Agenda: https://docs.google.com/document/d/1Qti_6mFPkctk9v2vnbz-IMe0ZZO2FJEpX72FaNnEfpE/edit?usp=sharing
________________________________________________________________________________
+1 321-558-6518 United States, Orlando (Toll)
Conference ID: 831 716 531#
Local numbers | Reset PIN | Learn more about Teams | Meeting options
________________________________________________________________________________
|
|
Re: [EXT] [testing-wg] Zephyr: Testing WG weekly call - Mon, 12/14/2020 2:00pm-3:00pm, Please RSVP
#cal-reminder
Hake Huang
Hi All,
1. Bug scrum meeting for last weekly testing. (hake/all 20 minutes). a) Call for board test result on last weekly. i. https://testing.zephyrproject.org/daily_tests/zephyr-v2.4.0-2126-g7516d5846d/report/index.html 2. Last weekly action items updates (All, 30 minutes) a) Add GHAction for checking test result. i. https://github.com/PerMac/test_results/pull/2 b) Release document pr i. https://github.com/zephyrproject-rtos/test_results/pull/154 ii. 3. Round table discussion. (all 10 minutes)
This is the last weekly meeting of 2020. Thanks all for your participant in TWG.
Best wishes to all TWG members for 2021, Happy New Year and Merry Christmas.
Regards, Hake
From: testing-wg@... <testing-wg@...>
On Behalf Of testing-wg@... Calendar via lists.zephyrproject.org
Caution: EXT Email Reminder: Zephyr: Testing WG weekly call When: Monday, 14 December 2020, 2:00pm to 3:00pm, (GMT+00:00) UTC Where:Microsoft Teams Meeting An RSVP is requested. Click here to RSVP Organizer: testing-wg@... Description: Meeting Agenda: https://docs.google.com/document/d/1Qti_6mFPkctk9v2vnbz-IMe0ZZO2FJEpX72FaNnEfpE/edit?usp=sharing ________________________________________________________________________________ +1 321-558-6518 United States, Orlando (Toll) Conference ID: 831 716 531# Local numbers | Reset PIN | Learn more about Teams | Meeting options
________________________________________________________________________________
|
|
Re: [EXT] RE: Zephyr meetings over winter holidays
On Thu, Dec 10, 2020 10:35 AM, Hake Huang hake.huang@... wrote:
Brett Preston The Linux Foundation +1 (971) 303-9030 bpreston@... Google Talk: bpreston@... Skype: bprestoncf
|
|
Cancelled Event: Zephyr: Testing WG weekly call - Monday, 4 January 2021
#cal-cancelled
testing-wg@lists.zephyrproject.org Calendar <noreply@...>
Cancelled: Zephyr: Testing WG weekly call This event has been cancelled. When: Where: Organizer: testing-wg@... Description: Meeting Agenda: https://docs.google.com/document/d/1Qti_6mFPkctk9v2vnbz-IMe0ZZO2FJEpX72FaNnEfpE/edit?usp=sharing
________________________________________________________________________________
+1 321-558-6518 United States, Orlando (Toll)
Conference ID: 831 716 531#
Local numbers | Reset PIN | Learn more about Teams | Meeting options
________________________________________________________________________________
|
|