Re: [EXT] [testing-wg] Updated Event: Zephyr: Testing WG weekly call #cal-invite


Erwan Gouriou
 

Hi Hake,

I have few questions indeed:
1. Does it mean that https://testing.zephyrproject.org/daily_tests/versions.json would not be used anymore ?
    I suggest we keep it as weekly frequency will not be sufficient in release periods.
2. Is there a gating protocol in order to avoid publishing a "bad" commit with build issues that would prevent
    having meaningful results? If there's only one test result upload per week, we need to ensure a minimum quality
    is guaranteed
3. The duration of an automated test campaign on 14 boards is less than 3 hours (when there are no major issues).
    This of course depends on the machine used, but even with twice this duration, this can be done in a night.
    I'm curious about the obstacles to perform such campaigns on a daily basis.

Cheers
Erwan




On Tue, 27 Oct 2020 at 07:04, Hake Huang <hake.huang@...> wrote:

Hi All,

 

In this weekly meeting, Anas proposes that we shall create a regular candency to upload our test result. If we can not afford daily result upload, then we shall do a weekly upload in a given version, this PR is to create a new https://testing.zephyrproject.org/daily_tests/weeklys.json which contains the week of year and version tag in dict, so that we can use this json file to sync our efforts. In such way, we can get a full report with as many boards as possible in a given tag. Please kindly give you comments.

 

https://github.com/zephyrproject-rtos/test_results/pull/141

 

Regards,

Hake

 

From: testing-wg@... <testing-wg@...> On Behalf Of testing-wg@... Calendar via lists.zephyrproject.org
Sent: 2020
1026 22:20
To: testing-wg@...
Subject: [EXT] [testing-wg] Updated Event: Zephyr: Testing WG weekly call #cal-invite

 

Caution: EXT Email

Zephyr: Testing WG weekly call

When:
Monday, 2 November 2020
2:00pm to 3:00pm
(UTC+00:00) UTC
Repeats: Weekly on Monday

Where:
Microsoft Teams Meeting

Organizer: testing-wg@...

An RSVP is requested. Click here to RSVP

Description:

________________________________________________________________________________

+1 321-558-6518 United States, Orlando (Toll)

Conference ID: 831 716 531#

Local numbers | Reset PIN | Learn more about Teams | Meeting options

 

 

________________________________________________________________________________

Join {testing-wg@lists.zephyrproject.org to automatically receive all group messages.